FEL3330 Networked and Multi-Agent Control Systems. Lecture 11: Distributed Estimation

Size: px
Start display at page:

Download "FEL3330 Networked and Multi-Agent Control Systems. Lecture 11: Distributed Estimation"

Transcription

1 FEL3330, Lecture 11 1 June 8, 2011 FEL3330 Networked and Multi-Agent Control Systems Lecture 11: Distributed Estimation Distributed Estimation Distributed Localization

2 where R X is the covariance of X. The proof is from the fact that P 1ˆx = H R 1 V y. FEL3330, Lecture 11 2 June 8, 2011 Distributed Estimation with a Central Node A random variable X being observed by n sensors: y i = H i x + v i where the noises v i are all uncorrelated with each other and with the variable X. Denote the estimate of x based on all the n measurements by ˆx and the estimate of x based only on the measurement y i by ˆx i. Then ˆx can be calculated using P 1ˆx = P 1 i ˆx i where P is the estimate error covariance corresponding to ˆx and P i is the error covariance corresponding to x i. Further P 1 = P 1 i (n 1)R 1 X

3 FEL3330, Lecture 11 3 June 8, 2011 Distributed Estimation Each node calculates the following: x i (k + 1) = x i (k) + hw 1 i j:jisconnectedtoi (x j (k) x i (k)) In our case, we let x i (0) to be the local estimate values and W i to be inverse of the local estimation error covariance, and obtain the required weighted sum. However, what if the measurements are not linear, and example is that they are distances.

4 FEL3330, Lecture 11 4 June 8, 2011 Localization Problem Known: Information between neighbour nodes, e.g. distances Goal: Nodes Positions

5 FEL3330, Lecture 11 4 June 8, 2011 Localization Problem Known: Information between neighbour nodes, e.g. distances Goal: Nodes Positions Other things needed:

6 FEL3330, Lecture 11 4 June 8, 2011 Localization Problem Known: Information between neighbour nodes, e.g. distances Goal: Nodes Positions Other things needed: In 2D, Positions of 3 Agents (non-collinear)

7 FEL3330, Lecture 11 4 June 8, 2011 Localization Problem Known: Information between neighbour nodes, e.g. distances Goal: Nodes Positions Other things needed: In 2D, Positions of 3 Agents (non-collinear) Agents with Known Positions: Anchors

8 FEL3330, Lecture 11 4 June 8, 2011 Localization Problem Known: Information between neighbour nodes, e.g. distances Goal: Nodes Positions Other things needed: In 2D, Positions of 3 Agents (non-collinear) Agents with Known Positions: Anchors A Formation Characteristic: Global Rigidity

9 FEL3330, Lecture 11 4 June 8, 2011 Localization Problem Known: Information between neighbour nodes, e.g. distances Goal: Nodes Positions Other things needed: In 2D, Positions of 3 Agents (non-collinear) Agents with Known Positions: Anchors A Formation Characteristic: Global Rigidity Problem to be addressed: Estimate the position of the nodes in a distributed way using only local measurements and information exchange.

10 P i R 2 P 0 FEL3330, Lecture 11 5 June 8, 2011 Barycentric Coordinate P 0 = π i P i π i 0 πi = 1

11 FEL3330, Lecture 11 6 June 8, 2011 Distributed Localization Algorithm A well-known barycentric coordinates for the points inside a convex polygon is called Wachspress coordinates, where A(P i 1, P i, P i+1 ) A(P l, P j, P j+1 ) π i = n A(P k 1, P k, P k+1 ) k=1 j i,i 1 j k,k 1 A(P l, P j, P j+1 ) (1) where A(P i, P j, P k ) is the signed area of the triangle P i P j P k.

12 FEL3330, Lecture 11 7 June 8, 2011 A(P i, P j, P k ) is the signed area of the triangle P i P j P k, i.e., A(P i, P j, P k ) = x i x j x k y i y j y k (2) An alternative method can be used to calculate A(P i, P j, P k ) using only the distances between the points: 0 dij 2 dik 2 1 A 2 (P i, P j, P k ) = 1 16 det dji 2 0 djk 2 1 dki 2 dkj (3)

13 FEL3330, Lecture 11 8 June 8, 2011 Distributed Localization Algorithm Assumption The neighborhood graph of sensor l, is complete and l lies in the convex hull of the neighbor nodes, V l. Proposition A network satisfying the abovementioned assumption with underlying graph G is globally rigid.

14 FEL3330, Lecture 11 9 June 8, 2011 Distributed Localization Algorithm The iterations are given by P l (k) l V P l (k + 1) = A π li Pi (k) l V (4) S i V l Let P(k)= [ P A (k) P S (k)] be the matrix obtained from stacking all the row vectors Then we have the following system P(t + 1) = ΥP(t) [ I 0 = B A ] P(t)

15 Distributed Localization Algorithm [ ] I 0 is stochastic and corresponds to an absorbing B A Markov chain. The estimate values P i converges to their real values if P S = (I A) 1 BP A. (P A denotes the position of the anchors, P S denotes the position of the sensors). Lemma The underlying Markov chain with the transition probability matrix given by the iteration matrix Υ is absorbing and [ lim P(k) = k I 0 (I A) 1 B 0 ] P(0). (5) Theorem The position estimate of each sensor l, P l (t), converges to the actual value Pl as t. FEL3330, Lecture June 8, 2011

16 FEL3330, Lecture June 8, 2011 Distributed Localization Algorithm P(t+1) = P 1 (t + 1) P 2 (t + 1) P 3 (t + 1) P 4 (t + 1) P 5(t + 1) P 6 (t + 1) P 7(t + 1) = a a 45 0 a a 54 0 a 56 a 57 0 a a 65 0 a a 73 a 74 0 a 76 0 P 1 (t) P 2 (t) P 3 (t) P 4 (t) P 5(t) P 6 (t) P 7(t)

17 FEL3330, Lecture June 8, 2011 Distributed Localization Algorithm We propose a continuous algorithm where the steady-state solution of it is equal to the steady-state solution of the aforementioned discrete time algorithm, i.e. the actual positions of the the sensors. The continuous-time algorithm is Υ c = Υ I Ṗ = Υ c P Theorem The position estimate of each sensor l, P l (t), converges to the actual value Pl as t.

18 FEL3330, Lecture June 8, 2011 Distributed Localization Algorithm We modify the system so that the estimate of positions of the sensors converge to their actual values in finite-time. for positive α and β. Ṗ = αυ c P + βsgn (Υ c P) Theorem The position estimate of each sensor l, P l (t), converges to the actual value Pl in finite time. In particular, P(t) = P for any t T where { Pi (0) P } i T = max (6) i β

19 Simulation Results FEL3330, Lecture June 8, 2011

20 FEL3330, Lecture June 8, 2011 Sensor Deployment Lemma A sufficient condition to triangulate sensor l is to have at least one node in each of the four disjoint equal area sectors Q i, which partition the circle of radius r l centered at l.

21 FEL3330, Lecture June 8, 2011 Convex Hull Membership Problems P i R 2 Consider the graph G(V, E).

22 FEL3330, Lecture June 8, 2011 Convex Hull Membership Problems Problem Consider a vertex l V. How can one determine if P l is inside the convex hull defined by the set of points {P i, i V \ {l}} using only distances P i P j, for all i, j V? Problem How can one find the p points from the set {P i } i V\{l} that are the vertices of the largest convex polygon encircling the whole set?

23 FEL3330, Lecture June 8, 2011 Distance Only Algorithm of Square Order Choose an arbitrary i V; Form ( ( V 1) 2) triangles, j, with i as a vertex; ) do for j = 1 to ( ( V 1 2) if l C( j ) then return True; end if end for return False;

24 Distance Only Algorithm of Square Order FEL3330, Lecture June 8, 2011

25 Distance Only Algorithm of Square Order FEL3330, Lecture June 8, 2011

26 Distance Only Algorithm of Square Order FEL3330, Lecture June 8, 2011

27 FEL3330, Lecture June 8, 2011 Distance Only Algorithm of Cubic Order C V \ {l} for i V \ {l} do Form ( ( V 2) 2) triangles, j, with i as a vertex; for k = 1 to ( ( V 2) 2) do if l C( j ) then C \ {i} break; end if end for return C; end for

28 Distance Only Algorithm of Square Order FEL3330, Lecture June 8, 2011

29 Distance Only Algorithm of Square Order FEL3330, Lecture June 8, 2011

30 FEL3330, Lecture June 8, 2011 Algorithm of Linear-logarithmic Order with Rough Localization Localize(realize) G for some 3 fixed points; % O( V ) Find a triangulation graph for {P i }; % O( V log V ) Label f faces of the graph j (f 2 V 4); for j = 1 to f do if l C( j ) then return True; end if end for return False;

31 Algorithm of Linear-logarithmic Order with Rough Localization FEL3330, Lecture June 8, 2011

32 Algorithm of Linear-logarithmic Order with Rough Localization FEL3330, Lecture June 8, 2011

33 Algorithm of Linear-logarithmic Order with Rough Localization FEL3330, Lecture June 8, 2011

34 Algorithm of Linear-logarithmic Order with Rough Localization FEL3330, Lecture June 8, 2011

35 FEL3330, Lecture June 8, 2011 Algorithm of Square Order with Rough Localization We use Gift-wrapping algorithm to find the convex hull.

36 FEL3330, Lecture June 8, 2011 Conclusions The dynamical version of the estimation algorithm proposed here can be constructed, usually more complicated. A distributed algorithm to achieve localization is proposed. The algorithm converges to the real values for positions of the sensors in finite-time. Some tests (in polynomial time) are proposed to check if a point is inside the convex hull of a set of points where the distances between every pair of the points are available.

Multi-Robotic Systems

Multi-Robotic Systems CHAPTER 9 Multi-Robotic Systems The topic of multi-robotic systems is quite popular now. It is believed that such systems can have the following benefits: Improved performance ( winning by numbers ) Distributed

More information

Note that in the example in Lecture 1, the state Home is recurrent (and even absorbing), but all other states are transient. f ii (n) f ii = n=1 < +

Note that in the example in Lecture 1, the state Home is recurrent (and even absorbing), but all other states are transient. f ii (n) f ii = n=1 < + Random Walks: WEEK 2 Recurrence and transience Consider the event {X n = i for some n > 0} by which we mean {X = i}or{x 2 = i,x i}or{x 3 = i,x 2 i,x i},. Definition.. A state i S is recurrent if P(X n

More information

T 1. The value function v(x) is the expected net gain when using the optimal stopping time starting at state x:

T 1. The value function v(x) is the expected net gain when using the optimal stopping time starting at state x: 108 OPTIMAL STOPPING TIME 4.4. Cost functions. The cost function g(x) gives the price you must pay to continue from state x. If T is your stopping time then X T is your stopping state and f(x T ) is your

More information

Markov decision processes and interval Markov chains: exploiting the connection

Markov decision processes and interval Markov chains: exploiting the connection Markov decision processes and interval Markov chains: exploiting the connection Mingmei Teo Supervisors: Prof. Nigel Bean, Dr Joshua Ross University of Adelaide July 10, 2013 Intervals and interval arithmetic

More information

Markov Chains and Stochastic Sampling

Markov Chains and Stochastic Sampling Part I Markov Chains and Stochastic Sampling 1 Markov Chains and Random Walks on Graphs 1.1 Structure of Finite Markov Chains We shall only consider Markov chains with a finite, but usually very large,

More information

Perron Frobenius Theory

Perron Frobenius Theory Perron Frobenius Theory Oskar Perron Georg Frobenius (1880 1975) (1849 1917) Stefan Güttel Perron Frobenius Theory 1 / 10 Positive and Nonnegative Matrices Let A, B R m n. A B if a ij b ij i, j, A > B

More information

High dimensional consensus in large-scale networks: Theory and applications

High dimensional consensus in large-scale networks: Theory and applications High dimensional consensus in large-scale networks: Theory and applications Usman Ahmed Khan August 28, 2009 Dissertation submitted in partial fulfillment of the requirements for the degree of Doctor of

More information

A Stochastic Online Sensor Scheduler for Remote State Estimation with Time-out Condition

A Stochastic Online Sensor Scheduler for Remote State Estimation with Time-out Condition A Stochastic Online Sensor Scheduler for Remote State Estimation with Time-out Condition Junfeng Wu, Karl Henrik Johansson and Ling Shi E-mail: jfwu@ust.hk Stockholm, 9th, January 2014 1 / 19 Outline Outline

More information

Data Mining and Analysis: Fundamental Concepts and Algorithms

Data Mining and Analysis: Fundamental Concepts and Algorithms : Fundamental Concepts and Algorithms dataminingbook.info Mohammed J. Zaki 1 Wagner Meira Jr. 2 1 Department of Computer Science Rensselaer Polytechnic Institute, Troy, NY, USA 2 Department of Computer

More information

Classical Complexity and Fixed-Parameter Tractability of Simultaneous Consecutive Ones Submatrix & Editing Problems

Classical Complexity and Fixed-Parameter Tractability of Simultaneous Consecutive Ones Submatrix & Editing Problems Classical Complexity and Fixed-Parameter Tractability of Simultaneous Consecutive Ones Submatrix & Editing Problems Rani M. R, Mohith Jagalmohanan, R. Subashini Binary matrices having simultaneous consecutive

More information

Interpolation via Barycentric Coordinates

Interpolation via Barycentric Coordinates Interpolation via Barycentric Coordinates Pierre Alliez Inria Some material from D. Anisimov Outline Barycenter Convexity Barycentric coordinates For Simplices For point sets Inverse distance (Shepard)

More information

Game Theory and Algorithms Lecture 7: PPAD and Fixed-Point Theorems

Game Theory and Algorithms Lecture 7: PPAD and Fixed-Point Theorems Game Theory and Algorithms Lecture 7: PPAD and Fixed-Point Theorems March 17, 2011 Summary: The ultimate goal of this lecture is to finally prove Nash s theorem. First, we introduce and prove Sperner s

More information

The Multi-Agent Rendezvous Problem - The Asynchronous Case

The Multi-Agent Rendezvous Problem - The Asynchronous Case 43rd IEEE Conference on Decision and Control December 14-17, 2004 Atlantis, Paradise Island, Bahamas WeB03.3 The Multi-Agent Rendezvous Problem - The Asynchronous Case J. Lin and A.S. Morse Yale University

More information

Markov Independence (Continued)

Markov Independence (Continued) Markov Independence (Continued) As an Undirected Graph Basic idea: Each variable V is represented as a vertex in an undirected graph G = (V(G), E(G)), with set of vertices V(G) and set of edges E(G) the

More information

6 Markov Chain Monte Carlo (MCMC)

6 Markov Chain Monte Carlo (MCMC) 6 Markov Chain Monte Carlo (MCMC) The underlying idea in MCMC is to replace the iid samples of basic MC methods, with dependent samples from an ergodic Markov chain, whose limiting (stationary) distribution

More information

Lecture 1 and 2: Introduction and Graph theory basics. Spring EE 194, Networked estimation and control (Prof. Khan) January 23, 2012

Lecture 1 and 2: Introduction and Graph theory basics. Spring EE 194, Networked estimation and control (Prof. Khan) January 23, 2012 Lecture 1 and 2: Introduction and Graph theory basics Spring 2012 - EE 194, Networked estimation and control (Prof. Khan) January 23, 2012 Spring 2012: EE-194-02 Networked estimation and control Schedule

More information

MA 323 Geometric Modelling Course Notes: Day 11 Barycentric Coordinates and de Casteljau s algorithm

MA 323 Geometric Modelling Course Notes: Day 11 Barycentric Coordinates and de Casteljau s algorithm MA 323 Geometric Modelling Course Notes: Day 11 Barycentric Coordinates and de Casteljau s algorithm David L. Finn December 16th, 2004 Today, we introduce barycentric coordinates as an alternate to using

More information

1 Random Walks and Electrical Networks

1 Random Walks and Electrical Networks CME 305: Discrete Mathematics and Algorithms Random Walks and Electrical Networks Random walks are widely used tools in algorithm design and probabilistic analysis and they have numerous applications.

More information

Markov Decision Processes

Markov Decision Processes Markov Decision Processes Lecture notes for the course Games on Graphs B. Srivathsan Chennai Mathematical Institute, India 1 Markov Chains We will define Markov chains in a manner that will be useful to

More information

MATH 56A: STOCHASTIC PROCESSES CHAPTER 1

MATH 56A: STOCHASTIC PROCESSES CHAPTER 1 MATH 56A: STOCHASTIC PROCESSES CHAPTER. Finite Markov chains For the sake of completeness of these notes I decided to write a summary of the basic concepts of finite Markov chains. The topics in this chapter

More information

Chapter 3 Conforming Finite Element Methods 3.1 Foundations Ritz-Galerkin Method

Chapter 3 Conforming Finite Element Methods 3.1 Foundations Ritz-Galerkin Method Chapter 3 Conforming Finite Element Methods 3.1 Foundations 3.1.1 Ritz-Galerkin Method Let V be a Hilbert space, a(, ) : V V lr a bounded, V-elliptic bilinear form and l : V lr a bounded linear functional.

More information

Consensus Problems on Small World Graphs: A Structural Study

Consensus Problems on Small World Graphs: A Structural Study Consensus Problems on Small World Graphs: A Structural Study Pedram Hovareshti and John S. Baras 1 Department of Electrical and Computer Engineering and the Institute for Systems Research, University of

More information

MATH6142 Complex Networks Exam 2016

MATH6142 Complex Networks Exam 2016 MATH642 Complex Networks Exam 26 Solution Problem a) The network is directed because the adjacency matrix is not symmetric. b) The network is shown in Figure. (4 marks)[unseen] 4 3 Figure : The directed

More information

Social network analysis: social learning

Social network analysis: social learning Social network analysis: social learning Donglei Du (ddu@unb.edu) Faculty of Business Administration, University of New Brunswick, NB Canada Fredericton E3B 9Y2 October 20, 2016 Donglei Du (UNB) AlgoTrading

More information

Reaching a Consensus in a Dynamically Changing Environment A Graphical Approach

Reaching a Consensus in a Dynamically Changing Environment A Graphical Approach Reaching a Consensus in a Dynamically Changing Environment A Graphical Approach M. Cao Yale Univesity A. S. Morse Yale University B. D. O. Anderson Australia National University and National ICT Australia

More information

Markov Chains. Andreas Klappenecker by Andreas Klappenecker. All rights reserved. Texas A&M University

Markov Chains. Andreas Klappenecker by Andreas Klappenecker. All rights reserved. Texas A&M University Markov Chains Andreas Klappenecker Texas A&M University 208 by Andreas Klappenecker. All rights reserved. / 58 Stochastic Processes A stochastic process X tx ptq: t P T u is a collection of random variables.

More information

Distributed localization and tracking with coordinated and uncoordinated motion models

Distributed localization and tracking with coordinated and uncoordinated motion models Distributed localization and tracking with coordinated and uncoordinated motion models Usman A. Khan, Soummya Kar, and José M. F. Moura Abstract This paper introduces the MDL algorithm for distributed

More information

Time Reversibility and Burke s Theorem

Time Reversibility and Burke s Theorem Queuing Analysis: Time Reversibility and Burke s Theorem Hongwei Zhang http://www.cs.wayne.edu/~hzhang Acknowledgement: this lecture is partially based on the slides of Dr. Yannis A. Korilis. Outline Time-Reversal

More information

Lecture: Local Spectral Methods (2 of 4) 19 Computing spectral ranking with the push procedure

Lecture: Local Spectral Methods (2 of 4) 19 Computing spectral ranking with the push procedure Stat260/CS294: Spectral Graph Methods Lecture 19-04/02/2015 Lecture: Local Spectral Methods (2 of 4) Lecturer: Michael Mahoney Scribe: Michael Mahoney Warning: these notes are still very rough. They provide

More information

Information Theory. Lecture 5 Entropy rate and Markov sources STEFAN HÖST

Information Theory. Lecture 5 Entropy rate and Markov sources STEFAN HÖST Information Theory Lecture 5 Entropy rate and Markov sources STEFAN HÖST Universal Source Coding Huffman coding is optimal, what is the problem? In the previous coding schemes (Huffman and Shannon-Fano)it

More information

The Multi-Agent Rendezvous Problem - Part 1 The Synchronous Case

The Multi-Agent Rendezvous Problem - Part 1 The Synchronous Case The Multi-Agent Rendezvous Problem - Part 1 The Synchronous Case J. Lin 800 Phillips Road MS:0128-30E Webster, NY 14580-90701 jie.lin@xeroxlabs.com 585-422-4305 A. S. Morse PO Box 208267 Yale University

More information

Recap. Probability, stochastic processes, Markov chains. ELEC-C7210 Modeling and analysis of communication networks

Recap. Probability, stochastic processes, Markov chains. ELEC-C7210 Modeling and analysis of communication networks Recap Probability, stochastic processes, Markov chains ELEC-C7210 Modeling and analysis of communication networks 1 Recap: Probability theory important distributions Discrete distributions Geometric distribution

More information

Lecture 20 : Markov Chains

Lecture 20 : Markov Chains CSCI 3560 Probability and Computing Instructor: Bogdan Chlebus Lecture 0 : Markov Chains We consider stochastic processes. A process represents a system that evolves through incremental changes called

More information

TCOM 501: Networking Theory & Fundamentals. Lecture 6 February 19, 2003 Prof. Yannis A. Korilis

TCOM 501: Networking Theory & Fundamentals. Lecture 6 February 19, 2003 Prof. Yannis A. Korilis TCOM 50: Networking Theory & Fundamentals Lecture 6 February 9, 003 Prof. Yannis A. Korilis 6- Topics Time-Reversal of Markov Chains Reversibility Truncating a Reversible Markov Chain Burke s Theorem Queues

More information

Outlines. Discrete Time Markov Chain (DTMC) Continuous Time Markov Chain (CTMC)

Outlines. Discrete Time Markov Chain (DTMC) Continuous Time Markov Chain (CTMC) Markov Chains (2) Outlines Discrete Time Markov Chain (DTMC) Continuous Time Markov Chain (CTMC) 2 pj ( n) denotes the pmf of the random variable p ( n) P( X j) j We will only be concerned with homogenous

More information

Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science Algorithms For Inference Fall 2014

Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science Algorithms For Inference Fall 2014 Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science 6.438 Algorithms For Inference Fall 2014 Problem Set 3 Issued: Thursday, September 25, 2014 Due: Thursday,

More information

4 Packing T-joins and T-cuts

4 Packing T-joins and T-cuts 4 Packing T-joins and T-cuts Introduction Graft: A graft consists of a connected graph G = (V, E) with a distinguished subset T V where T is even. T-cut: A T -cut of G is an edge-cut C which separates

More information

Lecture Notes Introduction to Cluster Algebra

Lecture Notes Introduction to Cluster Algebra Lecture Notes Introduction to Cluster Algebra Ivan C.H. Ip Update: July 11, 2017 11 Cluster Algebra from Surfaces In this lecture, we will define and give a quick overview of some properties of cluster

More information

Statistical Mechanics and Combinatorics : Lecture I

Statistical Mechanics and Combinatorics : Lecture I Statistical Mechanics and Combinatorics : Lecture I 1 Overview We are considering interactions between three fields of mathematics: combinatorics, statistics and probability In short, combinatorics is

More information

Consensus-Based Distributed Optimization with Malicious Nodes

Consensus-Based Distributed Optimization with Malicious Nodes Consensus-Based Distributed Optimization with Malicious Nodes Shreyas Sundaram Bahman Gharesifard Abstract We investigate the vulnerabilities of consensusbased distributed optimization protocols to nodes

More information

Cographs; chordal graphs and tree decompositions

Cographs; chordal graphs and tree decompositions Cographs; chordal graphs and tree decompositions Zdeněk Dvořák September 14, 2015 Let us now proceed with some more interesting graph classes closed on induced subgraphs. 1 Cographs The class of cographs

More information

Example: multivariate Gaussian Distribution

Example: multivariate Gaussian Distribution School of omputer Science Probabilistic Graphical Models Representation of undirected GM (continued) Eric Xing Lecture 3, September 16, 2009 Reading: KF-chap4 Eric Xing @ MU, 2005-2009 1 Example: multivariate

More information

a 2 = ab a 2 b 2 = ab b 2 (a + b)(a b) = b(a b) a + b = b

a 2 = ab a 2 b 2 = ab b 2 (a + b)(a b) = b(a b) a + b = b Discrete Structures CS2800 Fall 204 Final Solutions. Briefly and clearly identify the errors in each of the following proofs: (a) Proof that is the largest natural number: Let n be the largest natural

More information

Lecture 9: Counting Matchings

Lecture 9: Counting Matchings Counting and Sampling Fall 207 Lecture 9: Counting Matchings Lecturer: Shayan Oveis Gharan October 20 Disclaimer: These notes have not been subjected to the usual scrutiny reserved for formal publications.

More information

INTRODUCTION TO MCMC AND PAGERANK. Eric Vigoda Georgia Tech. Lecture for CS 6505

INTRODUCTION TO MCMC AND PAGERANK. Eric Vigoda Georgia Tech. Lecture for CS 6505 INTRODUCTION TO MCMC AND PAGERANK Eric Vigoda Georgia Tech Lecture for CS 6505 1 MARKOV CHAIN BASICS 2 ERGODICITY 3 WHAT IS THE STATIONARY DISTRIBUTION? 4 PAGERANK 5 MIXING TIME 6 PREVIEW OF FURTHER TOPICS

More information

Key words and phrases. Hausdorff measure, self-similar set, Sierpinski triangle The research of Móra was supported by OTKA Foundation #TS49835

Key words and phrases. Hausdorff measure, self-similar set, Sierpinski triangle The research of Móra was supported by OTKA Foundation #TS49835 Key words and phrases. Hausdorff measure, self-similar set, Sierpinski triangle The research of Móra was supported by OTKA Foundation #TS49835 Department of Stochastics, Institute of Mathematics, Budapest

More information

The Turán number of sparse spanning graphs

The Turán number of sparse spanning graphs The Turán number of sparse spanning graphs Noga Alon Raphael Yuster Abstract For a graph H, the extremal number ex(n, H) is the maximum number of edges in a graph of order n not containing a subgraph isomorphic

More information

Bernstein polynomials of degree N are defined by

Bernstein polynomials of degree N are defined by SEC. 5.5 BÉZIER CURVES 309 5.5 Bézier Curves Pierre Bézier at Renault and Paul de Casteljau at Citroën independently developed the Bézier curve for CAD/CAM operations, in the 1970s. These parametrically

More information

2.1 Laplacian Variants

2.1 Laplacian Variants -3 MS&E 337: Spectral Graph heory and Algorithmic Applications Spring 2015 Lecturer: Prof. Amin Saberi Lecture 2-3: 4/7/2015 Scribe: Simon Anastasiadis and Nolan Skochdopole Disclaimer: hese notes have

More information

Stable periodic billiard paths in obtuse isosceles triangles

Stable periodic billiard paths in obtuse isosceles triangles Stable periodic billiard paths in obtuse isosceles triangles W. Patrick Hooper March 27, 2006 Can you place a small billiard ball on a frictionless triangular pool table and hit it so that it comes back

More information

ITCT Lecture IV.3: Markov Processes and Sources with Memory

ITCT Lecture IV.3: Markov Processes and Sources with Memory ITCT Lecture IV.3: Markov Processes and Sources with Memory 4. Markov Processes Thus far, we have been occupied with memoryless sources and channels. We must now turn our attention to sources with memory.

More information

Lecture 3: A dynamic IS-LM model

Lecture 3: A dynamic IS-LM model Lecture 3: A dynamic IS-LM model José L. Torres Universidad de Málaga Advanced Macroeconomics José L. Torres (Universidad de Málaga) Lecture 3: A dynamic IS-LM model Advanced Macroeconomics 1 / 26 Model

More information

R ij = 2. Using all of these facts together, you can solve problem number 9.

R ij = 2. Using all of these facts together, you can solve problem number 9. Help for Homework Problem #9 Let G(V,E) be any undirected graph We want to calculate the travel time across the graph. Think of each edge as one resistor of 1 Ohm. Say we have two nodes: i and j Let the

More information

Markov Random Fields

Markov Random Fields Markov Random Fields Umamahesh Srinivas ipal Group Meeting February 25, 2011 Outline 1 Basic graph-theoretic concepts 2 Markov chain 3 Markov random field (MRF) 4 Gauss-Markov random field (GMRF), and

More information

Lecture 4: NP and computational intractability

Lecture 4: NP and computational intractability Chapter 4 Lecture 4: NP and computational intractability Listen to: Find the longest path, Daniel Barret What do we do today: polynomial time reduction NP, co-np and NP complete problems some examples

More information

Scientific Computing WS 2017/2018. Lecture 18. Jürgen Fuhrmann Lecture 18 Slide 1

Scientific Computing WS 2017/2018. Lecture 18. Jürgen Fuhrmann Lecture 18 Slide 1 Scientific Computing WS 2017/2018 Lecture 18 Jürgen Fuhrmann juergen.fuhrmann@wias-berlin.de Lecture 18 Slide 1 Lecture 18 Slide 2 Weak formulation of homogeneous Dirichlet problem Search u H0 1 (Ω) (here,

More information

Math II. Number and Quantity The Real Number System

Math II. Number and Quantity The Real Number System MATHEMATICS Math II The high school mathematics curriculum is designed to develop deep understanding of foundational math ideas. In order to allow time for such understanding, each level focuses on concepts

More information

Introduction to Search Engine Technology Introduction to Link Structure Analysis. Ronny Lempel Yahoo Labs, Haifa

Introduction to Search Engine Technology Introduction to Link Structure Analysis. Ronny Lempel Yahoo Labs, Haifa Introduction to Search Engine Technology Introduction to Link Structure Analysis Ronny Lempel Yahoo Labs, Haifa Outline Anchor-text indexing Mathematical Background Motivation for link structure analysis

More information

Bichain graphs: geometric model and universal graphs

Bichain graphs: geometric model and universal graphs Bichain graphs: geometric model and universal graphs Robert Brignall a,1, Vadim V. Lozin b,, Juraj Stacho b, a Department of Mathematics and Statistics, The Open University, Milton Keynes MK7 6AA, United

More information

The destiny of constant structure discrete time closed semantic systems

The destiny of constant structure discrete time closed semantic systems arxiv:1711.07071v1 [cs.ai] 19 Nov 2017 The destiny of constant structure discrete time closed semantic systems E.E. Ivanko a) Institute of Mathematics and Mechanics, Ural branch, RAS b) Ural Federal University

More information

Lecture notes for Analysis of Algorithms : Markov decision processes

Lecture notes for Analysis of Algorithms : Markov decision processes Lecture notes for Analysis of Algorithms : Markov decision processes Lecturer: Thomas Dueholm Hansen June 6, 013 Abstract We give an introduction to infinite-horizon Markov decision processes (MDPs) with

More information

Probabilistic Graphical Models

Probabilistic Graphical Models Probabilistic Graphical Models Brown University CSCI 2950-P, Spring 2013 Prof. Erik Sudderth Lecture 12: Gaussian Belief Propagation, State Space Models and Kalman Filters Guest Kalman Filter Lecture by

More information

37th United States of America Mathematical Olympiad

37th United States of America Mathematical Olympiad 37th United States of America Mathematical Olympiad 1. Prove that for each positive integer n, there are pairwise relatively prime integers k 0, k 1,..., k n, all strictly greater than 1, such that k 0

More information

Constructing Linkages for Drawing Plane Curves

Constructing Linkages for Drawing Plane Curves Constructing Linkages for Drawing Plane Curves Christoph Koutschan (joint work with Matteo Gallet, Zijia Li, Georg Regensburger, Josef Schicho, Nelly Villamizar) Johann Radon Institute for Computational

More information

Higher Order Singularities in Piecewise Linear Vector Fields

Higher Order Singularities in Piecewise Linear Vector Fields Higher Order Singularities in Piecewise Linear Vector Fields Xavier Tricoche, Gerik Scheuermann, Hans Hagen Computer Science Department, University of Kaiserslautern, Germany Summary. Piecewise linear

More information

Spectral Graph Theory and You: Matrix Tree Theorem and Centrality Metrics

Spectral Graph Theory and You: Matrix Tree Theorem and Centrality Metrics Spectral Graph Theory and You: and Centrality Metrics Jonathan Gootenberg March 11, 2013 1 / 19 Outline of Topics 1 Motivation Basics of Spectral Graph Theory Understanding the characteristic polynomial

More information

Lecture: Local Spectral Methods (1 of 4)

Lecture: Local Spectral Methods (1 of 4) Stat260/CS294: Spectral Graph Methods Lecture 18-03/31/2015 Lecture: Local Spectral Methods (1 of 4) Lecturer: Michael Mahoney Scribe: Michael Mahoney Warning: these notes are still very rough. They provide

More information

Lecture 10: Lovász Local Lemma. Lovász Local Lemma

Lecture 10: Lovász Local Lemma. Lovász Local Lemma Lecture 10: Introduction Let A 1,..., A n be indicator variables for bad events in an experiment Suppose P [A i ] p We want to avoid all the bad events If P [ A 1 A n ] > 0, then there exists a way to

More information

A New Approximation Algorithm for the Asymmetric TSP with Triangle Inequality By Markus Bläser

A New Approximation Algorithm for the Asymmetric TSP with Triangle Inequality By Markus Bläser A New Approximation Algorithm for the Asymmetric TSP with Triangle Inequality By Markus Bläser Presented By: Chris Standish chriss@cs.tamu.edu 23 November 2005 1 Outline Problem Definition Frieze s Generic

More information

Sydney University Mathematical Society Problems Competition Solutions.

Sydney University Mathematical Society Problems Competition Solutions. Sydney University Mathematical Society Problems Competition 005 Solutions 1 Suppose that we look at the set X n of strings of 0 s and 1 s of length n Given a string ɛ = (ɛ 1,, ɛ n ) X n, we are allowed

More information

On Spectral Properties of the Grounded Laplacian Matrix

On Spectral Properties of the Grounded Laplacian Matrix On Spectral Properties of the Grounded Laplacian Matrix by Mohammad Pirani A thesis presented to the University of Waterloo in fulfillment of the thesis requirement for the degree of Master of Science

More information

Invertibility and stability. Irreducibly diagonally dominant. Invertibility and stability, stronger result. Reducible matrices

Invertibility and stability. Irreducibly diagonally dominant. Invertibility and stability, stronger result. Reducible matrices Geršgorin circles Lecture 8: Outline Chapter 6 + Appendix D: Location and perturbation of eigenvalues Some other results on perturbed eigenvalue problems Chapter 8: Nonnegative matrices Geršgorin s Thm:

More information

Link Analysis. Leonid E. Zhukov

Link Analysis. Leonid E. Zhukov Link Analysis Leonid E. Zhukov School of Data Analysis and Artificial Intelligence Department of Computer Science National Research University Higher School of Economics Structural Analysis and Visualization

More information

Manifold Coarse Graining for Online Semi-supervised Learning

Manifold Coarse Graining for Online Semi-supervised Learning for Online Semi-supervised Learning Mehrdad Farajtabar, Amirreza Shaban, Hamid R. Rabiee, Mohammad H. Rohban Digital Media Lab, Department of Computer Engineering, Sharif University of Technology, Tehran,

More information

Quantum walk algorithms

Quantum walk algorithms Quantum walk algorithms Andrew Childs Institute for Quantum Computing University of Waterloo 28 September 2011 Randomized algorithms Randomness is an important tool in computer science Black-box problems

More information

LECTURE 3. Last time:

LECTURE 3. Last time: LECTURE 3 Last time: Mutual Information. Convexity and concavity Jensen s inequality Information Inequality Data processing theorem Fano s Inequality Lecture outline Stochastic processes, Entropy rate

More information

Discrete Geometry. Problem 1. Austin Mohr. April 26, 2012

Discrete Geometry. Problem 1. Austin Mohr. April 26, 2012 Discrete Geometry Austin Mohr April 26, 2012 Problem 1 Theorem 1 (Linear Programming Duality). Suppose x, y, b, c R n and A R n n, Ax b, x 0, A T y c, and y 0. If x maximizes c T x and y minimizes b T

More information

Ma/CS 6b Class 23: Eigenvalues in Regular Graphs

Ma/CS 6b Class 23: Eigenvalues in Regular Graphs Ma/CS 6b Class 3: Eigenvalues in Regular Graphs By Adam Sheffer Recall: The Spectrum of a Graph Consider a graph G = V, E and let A be the adjacency matrix of G. The eigenvalues of G are the eigenvalues

More information

A posteriori error estimation for elliptic problems

A posteriori error estimation for elliptic problems A posteriori error estimation for elliptic problems Praveen. C praveen@math.tifrbng.res.in Tata Institute of Fundamental Research Center for Applicable Mathematics Bangalore 560065 http://math.tifrbng.res.in

More information

Construction of `Wachspress type' rational basis functions over rectangles

Construction of `Wachspress type' rational basis functions over rectangles Proc. Indian Acad. Sci. (Math. Sci.), Vol. 110, No. 1, February 2000, pp. 69±77. # Printed in India Construction of `Wachspress type' rational basis functions over rectangles P L POWAR and S S RANA Department

More information

Classes of Problems. CS 461, Lecture 23. NP-Hard. Today s Outline. We can characterize many problems into three classes:

Classes of Problems. CS 461, Lecture 23. NP-Hard. Today s Outline. We can characterize many problems into three classes: Classes of Problems We can characterize many problems into three classes: CS 461, Lecture 23 Jared Saia University of New Mexico P is the set of yes/no problems that can be solved in polynomial time. Intuitively

More information

Lecture 15: MCMC Sanjeev Arora Elad Hazan. COS 402 Machine Learning and Artificial Intelligence Fall 2016

Lecture 15: MCMC Sanjeev Arora Elad Hazan. COS 402 Machine Learning and Artificial Intelligence Fall 2016 Lecture 15: MCMC Sanjeev Arora Elad Hazan COS 402 Machine Learning and Artificial Intelligence Fall 2016 Course progress Learning from examples Definition + fundamental theorem of statistical learning,

More information

CS 781 Lecture 9 March 10, 2011 Topics: Local Search and Optimization Metropolis Algorithm Greedy Optimization Hopfield Networks Max Cut Problem Nash

CS 781 Lecture 9 March 10, 2011 Topics: Local Search and Optimization Metropolis Algorithm Greedy Optimization Hopfield Networks Max Cut Problem Nash CS 781 Lecture 9 March 10, 2011 Topics: Local Search and Optimization Metropolis Algorithm Greedy Optimization Hopfield Networks Max Cut Problem Nash Equilibrium Price of Stability Coping With NP-Hardness

More information

Markov chains. Randomness and Computation. Markov chains. Markov processes

Markov chains. Randomness and Computation. Markov chains. Markov processes Markov chains Randomness and Computation or, Randomized Algorithms Mary Cryan School of Informatics University of Edinburgh Definition (Definition 7) A discrete-time stochastic process on the state space

More information

A Correlation of. Pearson Integrated CME Project. to the. Common Core State Standards for Mathematics - High School PARRC Model Content Frameworks

A Correlation of. Pearson Integrated CME Project. to the. Common Core State Standards for Mathematics - High School PARRC Model Content Frameworks A Correlation of Pearson 2013 to the Common Core State Standards for A Correlation of Pearson Introduction This document demonstrates how Pearson 2013 meets the standards of the Mathematics, PAARC Model

More information

The Vapnik-Chervonenkis Dimension

The Vapnik-Chervonenkis Dimension The Vapnik-Chervonenkis Dimension Prof. Dan A. Simovici UMB 1 / 91 Outline 1 Growth Functions 2 Basic Definitions for Vapnik-Chervonenkis Dimension 3 The Sauer-Shelah Theorem 4 The Link between VCD and

More information

Statistical Mechanics and Combinatorics : Lecture IV

Statistical Mechanics and Combinatorics : Lecture IV Statistical Mechanics and Combinatorics : Lecture IV Dimer Model Local Statistics We ve already discussed the partition function Z for dimer coverings in a graph G which can be computed by Kasteleyn matrix

More information

Partial characterizations of clique-perfect graphs II: diamond-free and Helly circular-arc graphs

Partial characterizations of clique-perfect graphs II: diamond-free and Helly circular-arc graphs Partial characterizations of clique-perfect graphs II: diamond-free and Helly circular-arc graphs Flavia Bonomo a,1, Maria Chudnovsky b,2 and Guillermo Durán c,3 a Departamento de Matemática, Facultad

More information

CMPSCI 611: Advanced Algorithms

CMPSCI 611: Advanced Algorithms CMPSCI 611: Advanced Algorithms Lecture 12: Network Flow Part II Andrew McGregor Last Compiled: December 14, 2017 1/26 Definitions Input: Directed Graph G = (V, E) Capacities C(u, v) > 0 for (u, v) E and

More information

Markov chains (week 6) Solutions

Markov chains (week 6) Solutions Markov chains (week 6) Solutions 1 Ranking of nodes in graphs. A Markov chain model. The stochastic process of agent visits A N is a Markov chain (MC). Explain. The stochastic process of agent visits A

More information

Lecture 13: 04/23/2014

Lecture 13: 04/23/2014 COMS 6998-3: Sub-Linear Algorithms in Learning and Testing Lecturer: Rocco Servedio Lecture 13: 04/23/2014 Spring 2014 Scribe: Psallidas Fotios Administrative: Submit HW problem solutions by Wednesday,

More information

The L 3 (4) near octagon

The L 3 (4) near octagon The L 3 (4) near octagon A. Bishnoi and B. De Bruyn October 8, 206 Abstract In recent work we constructed two new near octagons, one related to the finite simple group G 2 (4) and another one as a sub-near-octagon

More information

CSC 412 (Lecture 4): Undirected Graphical Models

CSC 412 (Lecture 4): Undirected Graphical Models CSC 412 (Lecture 4): Undirected Graphical Models Raquel Urtasun University of Toronto Feb 2, 2016 R Urtasun (UofT) CSC 412 Feb 2, 2016 1 / 37 Today Undirected Graphical Models: Semantics of the graph:

More information

0.1 Naive formulation of PageRank

0.1 Naive formulation of PageRank PageRank is a ranking system designed to find the best pages on the web. A webpage is considered good if it is endorsed (i.e. linked to) by other good webpages. The more webpages link to it, and the more

More information

Australian National University WORKSHOP ON SYSTEMS AND CONTROL

Australian National University WORKSHOP ON SYSTEMS AND CONTROL Australian National University WORKSHOP ON SYSTEMS AND CONTROL Canberra, AU December 7, 2017 Australian National University WORKSHOP ON SYSTEMS AND CONTROL A Distributed Algorithm for Finding a Common

More information

Summary: A Random Walks View of Spectral Segmentation, by Marina Meila (University of Washington) and Jianbo Shi (Carnegie Mellon University)

Summary: A Random Walks View of Spectral Segmentation, by Marina Meila (University of Washington) and Jianbo Shi (Carnegie Mellon University) Summary: A Random Walks View of Spectral Segmentation, by Marina Meila (University of Washington) and Jianbo Shi (Carnegie Mellon University) The authors explain how the NCut algorithm for graph bisection

More information

CSE373: Data Structures and Algorithms Lecture 2: Math Review; Algorithm Analysis. Hunter Zahn Summer 2016

CSE373: Data Structures and Algorithms Lecture 2: Math Review; Algorithm Analysis. Hunter Zahn Summer 2016 CSE373: Data Structures and Algorithms Lecture 2: Math Review; Algorithm Analysis Hunter Zahn Summer 2016 Today Finish discussing stacks and queues Review math essential to algorithm analysis Proof by

More information

1.3 Convergence of Regular Markov Chains

1.3 Convergence of Regular Markov Chains Markov Chains and Random Walks on Graphs 3 Applying the same argument to A T, which has the same λ 0 as A, yields the row sum bounds Corollary 0 Let P 0 be the transition matrix of a regular Markov chain

More information

Lab 8: Measuring Graph Centrality - PageRank. Monday, November 5 CompSci 531, Fall 2018

Lab 8: Measuring Graph Centrality - PageRank. Monday, November 5 CompSci 531, Fall 2018 Lab 8: Measuring Graph Centrality - PageRank Monday, November 5 CompSci 531, Fall 2018 Outline Measuring Graph Centrality: Motivation Random Walks, Markov Chains, and Stationarity Distributions Google

More information

The Radical Axis. MA 341 Topics in Geometry Lecture 24

The Radical Axis. MA 341 Topics in Geometry Lecture 24 The Radical Axis MA 341 Topics in Geometry Lecture 24 What is the Radical Axis? Is it x? y? Is it one of the Axis powers gone rogue? No, it is the following: The radical axis of two circles is the locus

More information