# In particular, if A is a square matrix and λ is one of its eigenvalues, then we can find a non-zero column vector X with

Save this PDF as:

Size: px
Start display at page:

Download "In particular, if A is a square matrix and λ is one of its eigenvalues, then we can find a non-zero column vector X with"

## Transcription

1 Appendix: Matrix Estimates and the Perron-Frobenius Theorem. This Appendix will first present some well known estimates. For any m n matrix A = [a ij ] over the real or complex numbers, it will be convenient to use the notation A = i,j For any product matrix AB, note that AB = a ij b jk i,k j i,j,j,k a ij. a ij b j k = A B. (A : 1) In particular, if A is a square matrix and λ is one of its eigenvalues, then we can find a non-zero column vector X with λx = AX, hence λ k X = A k X and λ k X A k X. Dividing by X, it follows that λ k A k. (Here λ and X may be complex, even if A is real.) Define the spectral radius λ max of an n n matrix A to be the largest of the absolute values λ 1,... λ n of its n eigenvalues. Then it follows that λ k max A k. (A : 2) Lemma A.1. The sequence of powers A k converges uniformly to zero if and only if the spectral radius satisfies λ max < 1. (However, examples such as A = show that the convergence may be very slow.) [ ] Proof of A.1. If λ max 1, then A k 1 for all k by (A : 2). The proof for the case λ max < 1 will be by induction on n. Evidently the statement is clear when n = 1. For n > 1, we can always find a non-singular complex matrix S so that SAS 1 has zeros below the diagonal. We can then write SAS 1 = [ ] P Q, 0 R where P and R are square matrices. Since each eigenvalue of P or R is also an eigenvalue of A, we may assume inductively that P k 0 and R k 0 as k. Now set where SA k S 1 = [ P Q 0 R ] k = [ P k ] Q(k) 0 R k Q(k + l) = P k Q(l) + Q(k)R l. Let q m be the maximum of Q(k) over the range 2 m k < 2 m+1. Choosing m large enough so that P k < 1/4 and R k < 1/4 for k 2 m, it follows easily that A-1,

2 APPENDIX q m+1 q m /2, and more generally, q m+r q m /2 r, tending to zero. It follows that Q(k) tends to zero as k, and hence that A k does also. Corollary A.2 Let f(z) = a 0 + a 1 z + a 2 z 2 + be a complex power series with radius of convergence 0 < r. If A is a real or complex n n matrix with spectral radius satisfying λ max < r, then the corresponding series converges absolutely. f(a) = a 0 I + a 1 A + a 2 A 2 +, Proof. Choose η with λ max < η < r. Then the powers of A/η converge to zero by A.1, and hence are bounded, A k /η k c for some uniform constant c. On the other hand, the series a k η k converges, and hence the series a k A k also converges. a k A k c a k η k, Example. If the spectral radius of A satisfies λ max < 1, then it follows that the series A k converges absolutely, and the identity (I A) 1 = I + A + A 2 + A 3 + (A : 3) can be verified by multiplying both sides of this equation by I A. We next prove two formulas for the spectral radius of a matrix A = [a ij ] in terms of the powers A k. We will also make use of the trace trace A = a 11 + a a nn of the matrix A, as well as the traces of its powers A k. Theorem A.3. The spectral radius of any real or complex n n matrix A is given by λ max = lim k Ak 1/k = lim sup trace (A k ) 1/k. k Here it is essential to work with the lim sup, since the limit may not exist. For example, if { A = then trace(a k 3 if k 0 (mod 3) ) = 0 otherwise, so that lim sup trace A k 1/k = +1 but lim inf trace A k 1/k = 0. (The eigenvalues of this matrix are the three cube roots of unity.) Proof of A.3. Since A k λ k max by (A : 2), it certainly follows that A k 1/k λ max. On the other hand, if c = λ max + ɛ, then it follows from A.1 that the powers of A/c converge to zero. Hence we can choose some constant c so that A k c k c for all k. It follows that A k 1/k c k c which converges to c = λ max + ɛ as k. A-2

3 PERRON-FROBENIUS THEOREM Since ɛ can be arbitrarily small, this proves that A k 1/k λ max as k. The inequality lim sup trace(a k ) 1/k λ max k follows immediately, since trace(a k ) A k. To obtain a lower bound for this lim sup, let λ 1,..., λ n be the eigenvalues of A, and note that trace(a k ) = λ k λ k n. For each non-zero λ j, let µ j = λ j / λ j. We will need the following. Lemma A.4. Let µ 1,..., µ q ɛ > 0 there exist infinitely many values of k such that µ j k Re (µ k j ) > 1 ɛ for every µ j. be complex numbers with µ j = 1. For any 1 < ɛ and hence Proof. If p > 2π/ɛ, then we can cover the unit circle by p intervals J 1,..., J p of length less than ɛ. Hence we can cover the torus T q = S 1 S 1 q by p q boxes J i(1) J i(q). Consider the sequence of points µ h = (µ 1 h,..., µ q h ) on the torus T q. Given any p q + 1 of these points, there must be at least two, say µ h and µ l, belonging to the same box. Setting k = h l, it follows that µ j k 1 = µ h j µ j l < ɛ for all j, as required. Since ɛ can be arbitrarily small, we can construct infinitely many such integers k by this procedure. The proof of A.3 continues as follows. Taking ɛ = 1/2, we can choose k as above, and conclude that the real part satisfies Re ((λ j / λ j ) k ) > 1/2 whenever λ j 0. Multiplying by λ j k, it follows that Re (λj k ) 1 2 λ j k for every eigenvalue λ j. Thus trace(a k ) Re (trace(a k )) = j for infinitely many values of k. The required inequality follows immediately. lim sup trace(a k ) 1/k k Re (λj k ) 1 2 λ j k 1 2 λ max k j λ max The Perron-Frobenius Theorem. We say that an m n matrix is non-negative if all of its entries are real and non-negative, and strictly positive if all of the entries are strictly greater than zero. The following helps to show the special properties of such matrices. Lemma A.5. If the non-negative n n matrix A has an eigenvector X which is strictly positive, then the corresponding eigenvalue λ ( where AX = λx ) is equal to the spectral radius λ max. Furthermore λ > 0 unless A is the zero matrix. Proof. If A is not the zero matrix, then since X is strictly positive, it follows that the vector AX has at least one strictly positive component. The equation AX = λx then implies that λ > 0. A-3

4 APPENDIX Now since A k X = λ k X, it follows that A k X = λ k X. If X has components x j c > 0, then A k X c A k, hence λ k X c A k. Taking the k-th root and passing to the limit as k, using A.3, we get as required. λ lim A k 1/k = λ max, and hence λ = λ max, Definition. We will say that a non-negative n n matrix A is transitive if for every i and j there exists an integer k > 0 so that the ij -th entry a (k) ij of the k-th power matrix A k is non-zero. (Some authors use the term irreducible for such matrices.) We can interpret this condition graphically as follows. Let G(A) be the graph with one vertex v i for eacch integer between 1 and n, and with a directed edge from v i to v j if and only if a ij > 0. Then A is transitive if and only if we can get from any vertex to any other vertex by following these directed edges. Since such a path can always be chosen so as to pass through each vertex at most once, we may assume that its length is strictly less than n. Hence a completely equivalent condition would be that the matrix sum is strictly positive. A + A 2 + A A n 1 Theorem A.6. (O. Perron and G. Frobenius). Every non-negative n n matrix A has a non-negative eigenvector, AY = λy, with the property that the associated eigenvalue λ is equal to the spectral radius λ max. If the matrix A is transitive, then there is only one non-negative eigenvector Y up to multiplication by a positive constant, and this eigenvector is strictly positive: y i > 0 for all i. Proof in the transitive case. We will make use of the Brouwer Fixed Point Theorem, which asserts that any continuous mapping f : from a closed simplex to itself must have at least one fixed point, X = f(x). In fact let be the standard (n 1)-dimensional simplex consisting of all non-negative column vectors Y with Y = y y n = 1. If A is transitive and Y, note that AY 0. For if AY were the zero vector, then A k Y would be zero for all k > 0. But choosing some component y j > 0, for any i we can choose some power of A k so that the (i, j)-th component of A k is non-zero, and hence so that the i-th component of A k Y is non-zero. A similar argument shows that any eigenvalue AY = λy must be strictly positive. We can now define the required map f : by the formula Thus there exists at least one fixed point f(y ) = AY/ AY. Y = f(y ) = AY/ AY. Taking λ = AY > 0, it follows that AY = λy where, as noted above, Y must be strictly positive, with λ > 0. It then follows from A.5 that λ = λ max. A-4

5 PERRON-FROBENIUS THEOREM Now suppose that there were two distinct eigenvectors Y and Y in, both necessarily with eigenvalue equal to λ max. Then every point on the straight line joining Y and Y would also be an eigenvector. But such a line would contain boundary points of, contradicting the assertion that any such eigenvector must be strictly positive. This proves A.6 in the transitive case. Proof in the non-transitive case. We will give a constructive procedure for reducing the non-transitive case to the transitive one. The statement of A.6 is trivially true when n = 1, so we may assume that A is a non-transitive n n matrix with n 2. Then there exist indices i j so that the (i, j)-th entry a (k) ij of A k is zero for all k. Let us say that the index j is accessible from i if a (k) > 0 for some k > 0. Evidently this is a transitive relation between indices. After conjugating A by a permutation matrix, we may assume that i = 1, and that all of the indices which are accessible from i are listed first, with all of the remaining indices at the end. It follows that A can be written as a block matrix of the form [ P ] 0 Q R where P and R are square matrices. Here we may assume by induction on n that Theorem A.5 is true for P and R. Since the eigenvalues of such a block matrix are just the eigenvalues of P together with the eigenvalues of R, it certainly follows that the spectral radius λ max is itself an eigenvalue. To complete the proof, we must solve the equation [ ] [ ] [ ] P 0 Y Y Q R Y = λ Y, with λ = λ max, and with Y and Y non-negative. If λ is an eigenvalue of R, we can simply take Y to be the appropriate eigenvector for R, with Y = 0. Otherwise, we can assume that the spectral radius of R is strictly less than λ = λ max. Let P Y = λy be a non-negative eigenvalue for P. Then we must find a non-negative vector Y which satisfies the equation QY + RY = λy, or in other words (λi R)Y = QY or Y = (I R/λ) 1 QY/λ where I is the identity matrix of appropriate size. Since QY is certainly non-negative, it only remains to show that (I R/λ) 1 is non-negative. But according to (A : 3) this inverse matrix can be expressed as the sum of a convergentpower series (I R/λ) 1 = I + (R/λ) + (R/λ) 2 +, where all summands on the right are non-negative. This completes the proof of A.6. We conclude with two problems. Problem A-a. Iteration of Y AY. For any real or complex n n matrix A, show that there is a lower dimensional subspace V in the vector space of n 1 column vectors so that, for any fixed Y V. we have λ max = lim k Ak Y 1/k. (To prove this in the complex case, it is convenient to conjugate A to an appropriate normal form. It is then necessary to check that the real case follows.) A-5 ij,

6 APPENDIX Problem A-b. Simplicity of the largest eigenvector, and computation. Suppose that A is an n n matrix with a left eigenvector ˆXA = λ ˆX and a right eigenvector AŶ = µŷ such that ˆXŶ = 1. Show that λ = µ. If λ 0, then setting B = A/λ we have ˆXB = ˆX and BŶ = Ŷ with ˆXŶ = 1. If ˆX is the hyperplane consisting of all column vectors Y with ˆXY = 0, show that the space of all column vectors splits as a dirct sum n = ˆX Ŷ. Show that the linear map Y BY carries the hyperplane ˆX into itself and fixes each point of the eigenspace Ŷ. Show that every orbit under this map Y BY converges towards some vector in Ŷ if and only if all but one of the n eigenvalues of B belong to the open unit disk, λ j < 1. Now suppose that A is strictly positive. Let be the simplex consisting of all nonnegative Y with ˆXY = 1 Show that the associated transformation Y BY = AY/ λ max carries into its interior. Conclude that all orbits in converge to Ŷ. For example we can prove this by constructing a kind of norm function N on which is linear on each line segment joining Ŷ to the boundary of, taking the value 0 at Ŷ and the value +1 on. It is then easy to check that N(BY ) cn(y ) for some constant c < 1. Conclude that all but one of the n eigenvalues of A must satisfy λ j < λ max. Next suppose only that T is a non-negative transitive matrix. Applying the discussion above to the strictly positive matrix A = T + T T n 1, we see that all but one of the eigenvalues of A satisfies λ j < λ max. Conclude that the spectral radius of T must be a simple eigenvalue. That is, all but one of the eigenvalues of T must be different from the spectral radius of T. Show that the positive eigenvector for a transitive matrix T can always be located by iterating the associated map Y AY/ AY, or even the map Y (I + T )Y/ (I + T )Y. A-6

### T.8. Perron-Frobenius theory of positive matrices From: H.R. Thieme, Mathematics in Population Biology, Princeton University Press, Princeton 2003

T.8. Perron-Frobenius theory of positive matrices From: H.R. Thieme, Mathematics in Population Biology, Princeton University Press, Princeton 2003 A vector x R n is called positive, symbolically x > 0,

### NOTES ON THE PERRON-FROBENIUS THEORY OF NONNEGATIVE MATRICES

NOTES ON THE PERRON-FROBENIUS THEORY OF NONNEGATIVE MATRICES MIKE BOYLE. Introduction By a nonnegative matrix we mean a matrix whose entries are nonnegative real numbers. By positive matrix we mean a matrix

### NORMS ON SPACE OF MATRICES

NORMS ON SPACE OF MATRICES. Operator Norms on Space of linear maps Let A be an n n real matrix and x 0 be a vector in R n. We would like to use the Picard iteration method to solve for the following system

### Math Introduction to Numerical Analysis - Class Notes. Fernando Guevara Vasquez. Version Date: January 17, 2012.

Math 5620 - Introduction to Numerical Analysis - Class Notes Fernando Guevara Vasquez Version 1990. Date: January 17, 2012. 3 Contents 1. Disclaimer 4 Chapter 1. Iterative methods for solving linear systems

### Notes on Linear Algebra and Matrix Theory

Massimo Franceschet featuring Enrico Bozzo Scalar product The scalar product (a.k.a. dot product or inner product) of two real vectors x = (x 1,..., x n ) and y = (y 1,..., y n ) is not a vector but a

### Detailed Proof of The PerronFrobenius Theorem

Detailed Proof of The PerronFrobenius Theorem Arseny M Shur Ural Federal University October 30, 2016 1 Introduction This famous theorem has numerous applications, but to apply it you should understand

### Spectral radius, symmetric and positive matrices

Spectral radius, symmetric and positive matrices Zdeněk Dvořák April 28, 2016 1 Spectral radius Definition 1. The spectral radius of a square matrix A is ρ(a) = max{ λ : λ is an eigenvalue of A}. For an

### Jim Lambers MAT 610 Summer Session Lecture 2 Notes

Jim Lambers MAT 610 Summer Session 2009-10 Lecture 2 Notes These notes correspond to Sections 2.2-2.4 in the text. Vector Norms Given vectors x and y of length one, which are simply scalars x and y, the

### 08a. Operators on Hilbert spaces. 1. Boundedness, continuity, operator norms

(February 24, 2017) 08a. Operators on Hilbert spaces Paul Garrett garrett@math.umn.edu http://www.math.umn.edu/ garrett/ [This document is http://www.math.umn.edu/ garrett/m/real/notes 2016-17/08a-ops

### 5 Compact linear operators

5 Compact linear operators One of the most important results of Linear Algebra is that for every selfadjoint linear map A on a finite-dimensional space, there exists a basis consisting of eigenvectors.

### Markov Chains and Stochastic Sampling

Part I Markov Chains and Stochastic Sampling 1 Markov Chains and Random Walks on Graphs 1.1 Structure of Finite Markov Chains We shall only consider Markov chains with a finite, but usually very large,

### 642:550, Summer 2004, Supplement 6 The Perron-Frobenius Theorem. Summer 2004

642:550, Summer 2004, Supplement 6 The Perron-Frobenius Theorem. Summer 2004 Introduction Square matrices whose entries are all nonnegative have special properties. This was mentioned briefly in Section

### Math 104: Homework 7 solutions

Math 04: Homework 7 solutions. (a) The derivative of f () = is f () = 2 which is unbounded as 0. Since f () is continuous on [0, ], it is uniformly continous on this interval by Theorem 9.2. Hence for

### Analysis-3 lecture schemes

Analysis-3 lecture schemes (with Homeworks) 1 Csörgő István November, 2015 1 A jegyzet az ELTE Informatikai Kar 2015. évi Jegyzetpályázatának támogatásával készült Contents 1. Lesson 1 4 1.1. The Space

### International Competition in Mathematics for Universtiy Students in Plovdiv, Bulgaria 1994

International Competition in Mathematics for Universtiy Students in Plovdiv, Bulgaria 1994 1 PROBLEMS AND SOLUTIONS First day July 29, 1994 Problem 1. 13 points a Let A be a n n, n 2, symmetric, invertible

### Kernels of Directed Graph Laplacians. J. S. Caughman and J.J.P. Veerman

Kernels of Directed Graph Laplacians J. S. Caughman and J.J.P. Veerman Department of Mathematics and Statistics Portland State University PO Box 751, Portland, OR 97207. caughman@pdx.edu, veerman@pdx.edu

### Math 108b: Notes on the Spectral Theorem

Math 108b: Notes on the Spectral Theorem From section 6.3, we know that every linear operator T on a finite dimensional inner product space V has an adjoint. (T is defined as the unique linear operator

### Lecture 8 : Eigenvalues and Eigenvectors

CPS290: Algorithmic Foundations of Data Science February 24, 2017 Lecture 8 : Eigenvalues and Eigenvectors Lecturer: Kamesh Munagala Scribe: Kamesh Munagala Hermitian Matrices It is simpler to begin with

### FIXED POINT ITERATIONS

FIXED POINT ITERATIONS MARKUS GRASMAIR 1. Fixed Point Iteration for Non-linear Equations Our goal is the solution of an equation (1) F (x) = 0, where F : R n R n is a continuous vector valued mapping in

### AN ELEMENTARY PROOF OF THE SPECTRAL RADIUS FORMULA FOR MATRICES

AN ELEMENTARY PROOF OF THE SPECTRAL RADIUS FORMULA FOR MATRICES JOEL A. TROPP Abstract. We present an elementary proof that the spectral radius of a matrix A may be obtained using the formula ρ(a) lim

### Z-Pencils. November 20, Abstract

Z-Pencils J. J. McDonald D. D. Olesky H. Schneider M. J. Tsatsomeros P. van den Driessche November 20, 2006 Abstract The matrix pencil (A, B) = {tb A t C} is considered under the assumptions that A is

### Nonlinear Programming Algorithms Handout

Nonlinear Programming Algorithms Handout Michael C. Ferris Computer Sciences Department University of Wisconsin Madison, Wisconsin 5376 September 9 1 Eigenvalues The eigenvalues of a matrix A C n n are

### Foundations of Matrix Analysis

1 Foundations of Matrix Analysis In this chapter we recall the basic elements of linear algebra which will be employed in the remainder of the text For most of the proofs as well as for the details, the

### Convex Functions and Optimization

Chapter 5 Convex Functions and Optimization 5.1 Convex Functions Our next topic is that of convex functions. Again, we will concentrate on the context of a map f : R n R although the situation can be generalized

### Mathematical foundations - linear algebra

Mathematical foundations - linear algebra Andrea Passerini passerini@disi.unitn.it Machine Learning Vector space Definition (over reals) A set X is called a vector space over IR if addition and scalar

### Optimization Theory. A Concise Introduction. Jiongmin Yong

October 11, 017 16:5 ws-book9x6 Book Title Optimization Theory 017-08-Lecture Notes page 1 1 Optimization Theory A Concise Introduction Jiongmin Yong Optimization Theory 017-08-Lecture Notes page Optimization

### The Perron-Frobenius Theorem and its Application to Population Dynamics

The Perron-Frobenius Theorem and its Application to Population Dynamics by Jerika Baldin A project submitted in partial fulfillment of the requirements for the degree of Mathematics (April 2017) Department

### SPECTRAL THEOREM FOR COMPACT SELF-ADJOINT OPERATORS

SPECTRAL THEOREM FOR COMPACT SELF-ADJOINT OPERATORS G. RAMESH Contents Introduction 1 1. Bounded Operators 1 1.3. Examples 3 2. Compact Operators 5 2.1. Properties 6 3. The Spectral Theorem 9 3.3. Self-adjoint

### NONCOMMUTATIVE POLYNOMIAL EQUATIONS. Edward S. Letzter. Introduction

NONCOMMUTATIVE POLYNOMIAL EQUATIONS Edward S Letzter Introduction My aim in these notes is twofold: First, to briefly review some linear algebra Second, to provide you with some new tools and techniques

### Computational math: Assignment 1

Computational math: Assignment 1 Thanks Ting Gao for her Latex file 11 Let B be a 4 4 matrix to which we apply the following operations: 1double column 1, halve row 3, 3add row 3 to row 1, 4interchange

### THE PERTURBATION BOUND FOR THE SPECTRAL RADIUS OF A NON-NEGATIVE TENSOR

THE PERTURBATION BOUND FOR THE SPECTRAL RADIUS OF A NON-NEGATIVE TENSOR WEN LI AND MICHAEL K. NG Abstract. In this paper, we study the perturbation bound for the spectral radius of an m th - order n-dimensional

### INTRODUCTION TO LIE ALGEBRAS. LECTURE 2.

INTRODUCTION TO LIE ALGEBRAS. LECTURE 2. 2. More examples. Ideals. Direct products. 2.1. More examples. 2.1.1. Let k = R, L = R 3. Define [x, y] = x y the cross-product. Recall that the latter is defined

### Ma/CS 6b Class 20: Spectral Graph Theory

Ma/CS 6b Class 20: Spectral Graph Theory By Adam Sheffer Recall: Parity of a Permutation S n the set of permutations of 1,2,, n. A permutation σ S n is even if it can be written as a composition of an

### Ma/CS 6b Class 20: Spectral Graph Theory

Ma/CS 6b Class 20: Spectral Graph Theory By Adam Sheffer Eigenvalues and Eigenvectors A an n n matrix of real numbers. The eigenvalues of A are the numbers λ such that Ax = λx for some nonzero vector x

### Convex Optimization Notes

Convex Optimization Notes Jonathan Siegel January 2017 1 Convex Analysis This section is devoted to the study of convex functions f : B R {+ } and convex sets U B, for B a Banach space. The case of B =

### Math 489AB Exercises for Chapter 1 Fall Section 1.0

Math 489AB Exercises for Chapter 1 Fall 2008 Section 1.0 1.0.2 We want to maximize x T Ax subject to the condition x T x = 1. We use the method of Lagrange multipliers. Let f(x) = x T Ax and g(x) = x T

### Math 489AB Exercises for Chapter 2 Fall Section 2.3

Math 489AB Exercises for Chapter 2 Fall 2008 Section 2.3 2.3.3. Let A M n (R). Then the eigenvalues of A are the roots of the characteristic polynomial p A (t). Since A is real, p A (t) is a polynomial

### Perron Frobenius Theory

Perron Frobenius Theory Oskar Perron Georg Frobenius (1880 1975) (1849 1917) Stefan Güttel Perron Frobenius Theory 1 / 10 Positive and Nonnegative Matrices Let A, B R m n. A B if a ij b ij i, j, A > B

### Perron-Frobenius theorem for nonnegative multilinear forms and extensions

Perron-Frobenius theorem for nonnegative multilinear forms and extensions Shmuel Friedland Univ. Illinois at Chicago ensors 18 December, 2010, Hong-Kong Overview 1 Perron-Frobenius theorem for irreducible

### Perron-Frobenius theorem

Perron-Frobenius theorem V.S. Sunder Institute of Mathematical Sciences sunder@imsc.res.in Unity in Mathematics Lecture Chennai Math Institute December 18, 2009 Overview The aim of the talk is to describe

### MATH36001 Perron Frobenius Theory 2015

MATH361 Perron Frobenius Theory 215 In addition to saying something useful, the Perron Frobenius theory is elegant. It is a testament to the fact that beautiful mathematics eventually tends to be useful,

### Course 212: Academic Year Section 1: Metric Spaces

Course 212: Academic Year 1991-2 Section 1: Metric Spaces D. R. Wilkins Contents 1 Metric Spaces 3 1.1 Distance Functions and Metric Spaces............. 3 1.2 Convergence and Continuity in Metric Spaces.........

### Lecture Notes 6: Dynamic Equations Part C: Linear Difference Equation Systems

University of Warwick, EC9A0 Maths for Economists Peter J. Hammond 1 of 45 Lecture Notes 6: Dynamic Equations Part C: Linear Difference Equation Systems Peter J. Hammond latest revision 2017 September

### In English, this means that if we travel on a straight line between any two points in C, then we never leave C.

Convex sets In this section, we will be introduced to some of the mathematical fundamentals of convex sets. In order to motivate some of the definitions, we will look at the closest point problem from

### MATH 581D FINAL EXAM Autumn December 12, 2016

MATH 58D FINAL EXAM Autumn 206 December 2, 206 NAME: SIGNATURE: Instructions: there are 6 problems on the final. Aim for solving 4 problems, but do as much as you can. Partial credit will be given on all

### Real Analysis Math 131AH Rudin, Chapter #1. Dominique Abdi

Real Analysis Math 3AH Rudin, Chapter # Dominique Abdi.. If r is rational (r 0) and x is irrational, prove that r + x and rx are irrational. Solution. Assume the contrary, that r+x and rx are rational.

### A Perron-type theorem on the principal eigenvalue of nonsymmetric elliptic operators

A Perron-type theorem on the principal eigenvalue of nonsymmetric elliptic operators Lei Ni And I cherish more than anything else the Analogies, my most trustworthy masters. They know all the secrets of

### THE INVERSE FUNCTION THEOREM

THE INVERSE FUNCTION THEOREM W. PATRICK HOOPER The implicit function theorem is the following result: Theorem 1. Let f be a C 1 function from a neighborhood of a point a R n into R n. Suppose A = Df(a)

### Lecture 2 INF-MAT : A boundary value problem and an eigenvalue problem; Block Multiplication; Tridiagonal Systems

Lecture 2 INF-MAT 4350 2008: A boundary value problem and an eigenvalue problem; Block Multiplication; Tridiagonal Systems Tom Lyche Centre of Mathematics for Applications, Department of Informatics, University

### The Eigenvalue Problem: Perturbation Theory

Jim Lambers MAT 610 Summer Session 2009-10 Lecture 13 Notes These notes correspond to Sections 7.2 and 8.1 in the text. The Eigenvalue Problem: Perturbation Theory The Unsymmetric Eigenvalue Problem Just

### j=1 u 1jv 1j. 1/ 2 Lemma 1. An orthogonal set of vectors must be linearly independent.

Lecture Notes: Orthogonal and Symmetric Matrices Yufei Tao Department of Computer Science and Engineering Chinese University of Hong Kong taoyf@cse.cuhk.edu.hk Orthogonal Matrix Definition. Let u = [u

### 1 Directional Derivatives and Differentiability

Wednesday, January 18, 2012 1 Directional Derivatives and Differentiability Let E R N, let f : E R and let x 0 E. Given a direction v R N, let L be the line through x 0 in the direction v, that is, L :=

### Chapter 2 Convex Analysis

Chapter 2 Convex Analysis The theory of nonsmooth analysis is based on convex analysis. Thus, we start this chapter by giving basic concepts and results of convexity (for further readings see also [202,

### SPECTRAL THEOREM FOR SYMMETRIC OPERATORS WITH COMPACT RESOLVENT

SPECTRAL THEOREM FOR SYMMETRIC OPERATORS WITH COMPACT RESOLVENT Abstract. These are the letcure notes prepared for the workshop on Functional Analysis and Operator Algebras to be held at NIT-Karnataka,

### Set, functions and Euclidean space. Seungjin Han

Set, functions and Euclidean space Seungjin Han September, 2018 1 Some Basics LOGIC A is necessary for B : If B holds, then A holds. B A A B is the contraposition of B A. A is sufficient for B: If A holds,

### g 2 (x) (1/3)M 1 = (1/3)(2/3)M.

COMPACTNESS If C R n is closed and bounded, then by B-W it is sequentially compact: any sequence of points in C has a subsequence converging to a point in C Conversely, any sequentially compact C R n is

### Homework If the inverse T 1 of a closed linear operator exists, show that T 1 is a closed linear operator.

Homework 3 1 If the inverse T 1 of a closed linear operator exists, show that T 1 is a closed linear operator Solution: Assuming that the inverse of T were defined, then we will have to have that D(T 1

### 18.S34 linear algebra problems (2007)

18.S34 linear algebra problems (2007) Useful ideas for evaluating determinants 1. Row reduction, expanding by minors, or combinations thereof; sometimes these are useful in combination with an induction

### 1. Linear systems of equations. Chapters 7-8: Linear Algebra. Solution(s) of a linear system of equations (continued)

1 A linear system of equations of the form Sections 75, 78 & 81 a 11 x 1 + a 12 x 2 + + a 1n x n = b 1 a 21 x 1 + a 22 x 2 + + a 2n x n = b 2 a m1 x 1 + a m2 x 2 + + a mn x n = b m can be written in matrix

### Scientific Computing WS 2018/2019. Lecture 9. Jürgen Fuhrmann Lecture 9 Slide 1

Scientific Computing WS 2018/2019 Lecture 9 Jürgen Fuhrmann juergen.fuhrmann@wias-berlin.de Lecture 9 Slide 1 Lecture 9 Slide 2 Simple iteration with preconditioning Idea: Aû = b iterative scheme û = û

### VISCOSITY SOLUTIONS. We follow Han and Lin, Elliptic Partial Differential Equations, 5.

VISCOSITY SOLUTIONS PETER HINTZ We follow Han and Lin, Elliptic Partial Differential Equations, 5. 1. Motivation Throughout, we will assume that Ω R n is a bounded and connected domain and that a ij C(Ω)

### Invertibility and stability. Irreducibly diagonally dominant. Invertibility and stability, stronger result. Reducible matrices

Geršgorin circles Lecture 8: Outline Chapter 6 + Appendix D: Location and perturbation of eigenvalues Some other results on perturbed eigenvalue problems Chapter 8: Nonnegative matrices Geršgorin s Thm:

### An Alternative Proof of Primitivity of Indecomposable Nonnegative Matrices with a Positive Trace

An Alternative Proof of Primitivity of Indecomposable Nonnegative Matrices with a Positive Trace Takao Fujimoto Abstract. This research memorandum is aimed at presenting an alternative proof to a well

### On the sum of two largest eigenvalues of a symmetric matrix

On the sum of two largest eigenvalues of a symmetric matrix Javad Ebrahimi B. Department of Mathematics Simon Fraser University Burnaby, B.C. V5A 1S6 Vladimir Nikiforov Department of Mathematical Sci.

### Scientific Computing

Scientific Computing Direct solution methods Martin van Gijzen Delft University of Technology October 3, 2018 1 Program October 3 Matrix norms LU decomposition Basic algorithm Cost Stability Pivoting Pivoting

### ON ALLEE EFFECTS IN STRUCTURED POPULATIONS

PROCEEDINGS OF THE AMERICAN MATHEMATICAL SOCIETY Volume 00, Number 0, Pages 000 000 S 0002-9939(XX)0000-0 ON ALLEE EFFECTS IN STRUCTURED POPULATIONS SEBASTIAN J. SCHREIBER Abstract. Maps f(x) = A(x)x of

### Jordan Normal Form. Chapter Minimal Polynomials

Chapter 8 Jordan Normal Form 81 Minimal Polynomials Recall p A (x) =det(xi A) is called the characteristic polynomial of the matrix A Theorem 811 Let A M n Then there exists a unique monic polynomial q

### NATIONAL BOARD FOR HIGHER MATHEMATICS. M. A. and M.Sc. Scholarship Test. September 24, Time Allowed: 150 Minutes Maximum Marks: 30

NATIONAL BOARD FOR HIGHER MATHEMATICS M. A. and M.Sc. Scholarship Test September 24, 2011 Time Allowed: 150 Minutes Maximum Marks: 30 Please read, carefully, the instructions on the following page 1 INSTRUCTIONS

### MATH 5720: Unconstrained Optimization Hung Phan, UMass Lowell September 13, 2018

MATH 57: Unconstrained Optimization Hung Phan, UMass Lowell September 13, 18 1 Global and Local Optima Let a function f : S R be defined on a set S R n Definition 1 (minimizers and maximizers) (i) x S

### Problem Set 6: Solutions Math 201A: Fall a n x n,

Problem Set 6: Solutions Math 201A: Fall 2016 Problem 1. Is (x n ) n=0 a Schauder basis of C([0, 1])? No. If f(x) = a n x n, n=0 where the series converges uniformly on [0, 1], then f has a power series

### Lecture 15 Perron-Frobenius Theory

EE363 Winter 2005-06 Lecture 15 Perron-Frobenius Theory Positive and nonnegative matrices and vectors Perron-Frobenius theorems Markov chains Economic growth Population dynamics Max-min and min-max characterization

### Here is an example of a block diagonal matrix with Jordan Blocks on the diagonal: J

Class Notes 4: THE SPECTRAL RADIUS, NORM CONVERGENCE AND SOR. Math 639d Due Date: Feb. 7 (updated: February 5, 2018) In the first part of this week s reading, we will prove Theorem 2 of the previous class.

### Primitive Digraphs with Smallest Large Exponent

Primitive Digraphs with Smallest Large Exponent by Shahla Nasserasr B.Sc., University of Tabriz, Iran 1999 A Thesis Submitted in Partial Fulfillment of the Requirements for the Degree of MASTER OF SCIENCE

### Convexity in R n. The following lemma will be needed in a while. Lemma 1 Let x E, u R n. If τ I(x, u), τ 0, define. f(x + τu) f(x). τ.

Convexity in R n Let E be a convex subset of R n. A function f : E (, ] is convex iff f(tx + (1 t)y) (1 t)f(x) + tf(y) x, y E, t [0, 1]. A similar definition holds in any vector space. A topology is needed

### Nonnegative and spectral matrix theory Lecture notes

Nonnegative and spectral matrix theory Lecture notes Dario Fasino, University of Udine (Italy) Lecture notes for the first part of the course Nonnegative and spectral matrix theory with applications to

### Eigenvalues of the Redheffer Matrix and Their Relation to the Mertens Function

Eigenvalues of the Redheffer Matrix and Their Relation to the Mertens Function Will Dana June 7, 205 Contents Introduction. Notations................................ 2 2 Number-Theoretic Background 2 2.

### A LOCALIZATION PROPERTY AT THE BOUNDARY FOR MONGE-AMPERE EQUATION

A LOCALIZATION PROPERTY AT THE BOUNDARY FOR MONGE-AMPERE EQUATION O. SAVIN. Introduction In this paper we study the geometry of the sections for solutions to the Monge- Ampere equation det D 2 u = f, u

### Analysis Preliminary Exam Workshop: Hilbert Spaces

Analysis Preliminary Exam Workshop: Hilbert Spaces 1. Hilbert spaces A Hilbert space H is a complete real or complex inner product space. Consider complex Hilbert spaces for definiteness. If (, ) : H H

### POLARS AND DUAL CONES

POLARS AND DUAL CONES VERA ROSHCHINA Abstract. The goal of this note is to remind the basic definitions of convex sets and their polars. For more details see the classic references [1, 2] and [3] for polytopes.

### 1 Overview. 2 A Characterization of Convex Functions. 2.1 First-order Taylor approximation. AM 221: Advanced Optimization Spring 2016

AM 221: Advanced Optimization Spring 2016 Prof. Yaron Singer Lecture 8 February 22nd 1 Overview In the previous lecture we saw characterizations of optimality in linear optimization, and we reviewed the

### Differential Topology Final Exam With Solutions

Differential Topology Final Exam With Solutions Instructor: W. D. Gillam Date: Friday, May 20, 2016, 13:00 (1) Let X be a subset of R n, Y a subset of R m. Give the definitions of... (a) smooth function

### REAL VARIABLES: PROBLEM SET 1. = x limsup E k

REAL VARIABLES: PROBLEM SET 1 BEN ELDER 1. Problem 1.1a First let s prove that limsup E k consists of those points which belong to infinitely many E k. From equation 1.1: limsup E k = E k For limsup E

### 4. Ergodicity and mixing

4. Ergodicity and mixing 4. Introduction In the previous lecture we defined what is meant by an invariant measure. In this lecture, we define what is meant by an ergodic measure. The primary motivation

### DS-GA 1002 Lecture notes 0 Fall Linear Algebra. These notes provide a review of basic concepts in linear algebra.

DS-GA 1002 Lecture notes 0 Fall 2016 Linear Algebra These notes provide a review of basic concepts in linear algebra. 1 Vector spaces You are no doubt familiar with vectors in R 2 or R 3, i.e. [ ] 1.1

### w T 1 w T 2. w T n 0 if i j 1 if i = j

Lyapunov Operator Let A F n n be given, and define a linear operator L A : C n n C n n as L A (X) := A X + XA Suppose A is diagonalizable (what follows can be generalized even if this is not possible -

### LIE ALGEBRAS: LECTURE 3 6 April 2010

LIE ALGEBRAS: LECTURE 3 6 April 2010 CRYSTAL HOYT 1. Simple 3-dimensional Lie algebras Suppose L is a simple 3-dimensional Lie algebra over k, where k is algebraically closed. Then [L, L] = L, since otherwise

### Mapping Class Groups MSRI, Fall 2007 Day 2, September 6

Mapping Class Groups MSRI, Fall 7 Day, September 6 Lectures by Lee Mosher Notes by Yael Algom Kfir December 4, 7 Last time: Theorem (Conjugacy classification in MCG(T. Each conjugacy class of elements

### Mathematics 530. Practice Problems. n + 1 }

Department of Mathematical Sciences University of Delaware Prof. T. Angell October 19, 2015 Mathematics 530 Practice Problems 1. Recall that an indifference relation on a partially ordered set is defined

### Introduction to Real Analysis Alternative Chapter 1

Christopher Heil Introduction to Real Analysis Alternative Chapter 1 A Primer on Norms and Banach Spaces Last Updated: March 10, 2018 c 2018 by Christopher Heil Chapter 1 A Primer on Norms and Banach Spaces

### 1 Review: symmetric matrices, their eigenvalues and eigenvectors

Cornell University, Fall 2012 Lecture notes on spectral methods in algorithm design CS 6820: Algorithms Studying the eigenvalues and eigenvectors of matrices has powerful consequences for at least three

### ELEMENTARY LINEAR ALGEBRA

ELEMENTARY LINEAR ALGEBRA K. R. MATTHEWS DEPARTMENT OF MATHEMATICS UNIVERSITY OF QUEENSLAND Second Online Version, December 1998 Comments to the author at krm@maths.uq.edu.au Contents 1 LINEAR EQUATIONS

### Math 341: Convex Geometry. Xi Chen

Math 341: Convex Geometry Xi Chen 479 Central Academic Building, University of Alberta, Edmonton, Alberta T6G 2G1, CANADA E-mail address: xichen@math.ualberta.ca CHAPTER 1 Basics 1. Euclidean Geometry

### CS 246 Review of Linear Algebra 01/17/19

1 Linear algebra In this section we will discuss vectors and matrices. We denote the (i, j)th entry of a matrix A as A ij, and the ith entry of a vector as v i. 1.1 Vectors and vector operations A vector

### Properties of Matrices and Operations on Matrices

Properties of Matrices and Operations on Matrices A common data structure for statistical analysis is a rectangular array or matris. Rows represent individual observational units, or just observations,

### Linear Algebra using Dirac Notation: Pt. 2

Linear Algebra using Dirac Notation: Pt. 2 PHYS 476Q - Southern Illinois University February 6, 2018 PHYS 476Q - Southern Illinois University Linear Algebra using Dirac Notation: Pt. 2 February 6, 2018

### Section 3.9. Matrix Norm

3.9. Matrix Norm 1 Section 3.9. Matrix Norm Note. We define several matrix norms, some similar to vector norms and some reflecting how multiplication by a matrix affects the norm of a vector. We use matrix

### On John type ellipsoids

On John type ellipsoids B. Klartag Tel Aviv University Abstract Given an arbitrary convex symmetric body K R n, we construct a natural and non-trivial continuous map u K which associates ellipsoids to

### Section 1.7: Properties of the Leslie Matrix

Section 1.7: Properties of the Leslie Matrix Definition: A matrix A whose entries are nonnegative (positive) is called a nonnegative (positive) matrix, denoted as A 0 (A > 0). Definition: A square m m