Math 510 Assignment 6 Due date: Nov. 26, 2012

Similar documents
Symmetric Matrices and Quadratic Forms

c 2006 Society for Industrial and Applied Mathematics

LECTURE 8: ORTHOGONALITY (CHAPTER 5 IN THE BOOK)

Maths /2014. CCP Maths 2. Reduction, projector,endomorphism of rank 1... Hadamard s inequality and some applications. Solution.

Lecture 8: October 20, Applications of SVD: least squares approximation

5.1 Review of Singular Value Decomposition (SVD)

Math Solutions to homework 6

MATH10212 Linear Algebra B Proof Problems

(VII.A) Review of Orthogonality

A Hadamard-type lower bound for symmetric diagonally dominant positive matrices

Eigenvalues and Eigenvectors

Homework Set #3 - Solutions

Assignment 2 Solutions SOLUTION. ϕ 1 Â = 3 ϕ 1 4i ϕ 2. The other case can be dealt with in a similar way. { ϕ 2 Â} χ = { 4i ϕ 1 3 ϕ 2 } χ.

Math 778S Spectral Graph Theory Handout #3: Eigenvalues of Adjacency Matrix

Geometry of LS. LECTURE 3 GEOMETRY OF LS, PROPERTIES OF σ 2, PARTITIONED REGRESSION, GOODNESS OF FIT

Basic Iterative Methods. Basic Iterative Methods

A 2nTH ORDER LINEAR DIFFERENCE EQUATION

MATH 312 Midterm I(Spring 2015)

Matrix Algebra from a Statistician s Perspective BIOS 524/ Scalar multiple: ka

Math 140A Elementary Analysis Homework Questions 3-1

Matrix Theory, Math6304 Lecture Notes from October 25, 2012 taken by Manisha Bhardwaj

d) If the sequence of partial sums converges to a limit L, we say that the series converges and its

Assignment Number 3 Solutions

PROBLEM SET 5 SOLUTIONS 126 = , 37 = , 15 = , 7 = 7 1.

TMA4205 Numerical Linear Algebra. The Poisson problem in R 2 : diagonalization methods

Technical Proofs for Homogeneity Pursuit

1 lim. f(x) sin(nx)dx = 0. n sin(nx)dx

Chapter 3 Inner Product Spaces. Hilbert Spaces

Algebra of Least Squares

ON WELLPOSEDNESS QUADRATIC FUNCTION MINIMIZATION PROBLEM ON INTERSECTION OF TWO ELLIPSOIDS * M. JA]IMOVI], I. KRNI] 1.

Sequences and Limits

On Nonsingularity of Saddle Point Matrices. with Vectors of Ones

36-755, Fall 2017 Homework 5 Solution Due Wed Nov 15 by 5:00pm in Jisu s mailbox

Iterative Techniques for Solving Ax b -(3.8). Assume that the system has a unique solution. Let x be the solution. Then x A 1 b.

EIGENVALUES OF SEVERAL TRIDIAGONAL MATRICES

Eigenvalue localization for complex matrices

The Jordan Normal Form: A General Approach to Solving Homogeneous Linear Systems. Mike Raugh. March 20, 2005

Solutions for Math 411 Assignment #8 1

Where do eigenvalues/eigenvectors/eigenfunctions come from, and why are they important anyway?

M A T H F A L L CORRECTION. Algebra I 1 4 / 1 0 / U N I V E R S I T Y O F T O R O N T O

Notes for Lecture 11

15.083J/6.859J Integer Optimization. Lecture 3: Methods to enhance formulations

Linear regression. Daniel Hsu (COMS 4771) (y i x T i β)2 2πσ. 2 2σ 2. 1 n. (x T i β y i ) 2. 1 ˆβ arg min. β R n d

Singular value decomposition. Mathématiques appliquées (MATH0504-1) B. Dewals, Ch. Geuzaine

Supplemental Material: Proofs

Chapter Vectors

Lecture 10: Bounded Linear Operators and Orthogonality in Hilbert Spaces

Stochastic Matrices in a Finite Field

M17 MAT25-21 HOMEWORK 5 SOLUTIONS

Brief Review of Functions of Several Variables

Matsubara-Green s Functions

Topics. Homework Problems. MATH 301 Introduction to Analysis Chapter Four Sequences. 1. Definition of convergence of sequences.

1+x 1 + α+x. x = 2(α x2 ) 1+x

Solutions to home assignments (sketches)

PAPER : IIT-JAM 2010

Introduction to Computational Biology Homework 2 Solution

Machine Learning for Data Science (CS 4786)

5.74 TIME-DEPENDENT QUANTUM MECHANICS

Math 203A, Solution Set 8.

1 Last time: similar and diagonalizable matrices

Math F215: Induction April 7, 2013

too many conditions to check!!

Different kinds of Mathematical Induction

Topics in Eigen-analysis

Session 5. (1) Principal component analysis and Karhunen-Loève transformation

MA131 - Analysis 1. Workbook 9 Series III

Random Matrices with Blocks of Intermediate Scale Strongly Correlated Band Matrices

1. By using truth tables prove that, for all statements P and Q, the statement

Section Let A =. Then A has characteristic equation λ. 2 4λ + 3 = 0 or (λ 3)(λ 1) = 0. Hence the eigenvalues of A are λ 1 = 3 and λ 2 = 1.

Functional Analysis: Assignment Set # 10 Spring Professor: Fengbo Hang April 22, 2009

Ma 530 Introduction to Power Series

Efficient GMM LECTURE 12 GMM II

Solutions to Math 347 Practice Problems for the final

Matrix Algebra 2.2 THE INVERSE OF A MATRIX Pearson Education, Inc.

Review Problems 1. ICME and MS&E Refresher Course September 19, 2011 B = C = AB = A = A 2 = A 3... C 2 = C 3 = =

MATH : Matrices & Linear Algebra Spring Final Review

Matrix Theory, Math6304 Lecture Notes from October 23, 2012 taken by Satish Pandey

1 1 2 = show that: over variables x and y. [2 marks] Write down necessary conditions involving first and second-order partial derivatives for ( x0, y

Curve Sketching Handout #5 Topic Interpretation Rational Functions

CHAPTER 10. Majorization and Matrix Inequalities. 10.1/1 Find two vectors x, y R 3 such that neither x y nor x y holds.

MATH301 Real Analysis (2008 Fall) Tutorial Note #7. k=1 f k (x) converges pointwise to S(x) on E if and

Matrix Algebra 2.3 CHARACTERIZATIONS OF INVERTIBLE MATRICES Pearson Education, Inc.

Apply change-of-basis formula to rewrite x as a linear combination of eigenvectors v j.

Application of Jordan Canonical Form

Some Results on Certain Symmetric Circulant Matrices

Mathematics 116 HWK 21 Solutions 8.2 p580

LOWER BOUNDS FOR THE BLOW-UP TIME OF NONLINEAR PARABOLIC PROBLEMS WITH ROBIN BOUNDARY CONDITIONS

MA1200 Exercise for Chapter 7 Techniques of Differentiation Solutions. First Principle 1. a) To simplify the calculation, note. Then. lim h.

On the distribution of coefficients of powers of positive polynomials

ECE-S352 Introduction to Digital Signal Processing Lecture 3A Direct Solution of Difference Equations

Bertrand s Postulate. Theorem (Bertrand s Postulate): For every positive integer n, there is a prime p satisfying n < p 2n.

Math 61CM - Solutions to homework 3

Solutions to quizzes Math Spring 2007

n n 2 + 4i = lim 2 n lim 1 + 4x 2 dx = 1 2 tan ( 2i 2 x x dx = 1 2 tan 1 2 = 2 n, x i = a + i x = 2i

USA Mathematical Talent Search Round 3 Solutions Year 27 Academic Year

Machine Learning for Data Science (CS 4786)

Machine Learning for Data Science (CS4786) Lecture 9

Problem 4: Evaluate ( k ) by negating (actually un-negating) its upper index. Binomial coefficient

SPECTRUM OF THE DIRECT SUM OF OPERATORS

Journal of Inequalities in Pure and Applied Mathematics

Transcription:

1 If A M is Hermitia, show that Math 510 Assigmet 6 Due date: Nov 6, 01 tr A rak (Atr (A with equality if ad oly if A = ap for some a R ad orthogoal projectio P M (ie P = P = P Solutio: Let A = A If A = O, the tr A = 0 = rak (Atr (A ad A = 0P for every orthogoal projectio P M Suppose A 0, the tr A = tr A A > 0 Let r = rak A ad λ 1,, λ r the o-zero eigevalues of A The there exists a orthoormal set {u 1,, u } of eigevectors of A such that A λ 1 0 0 0 0 0 λr 0 0 = u 1 u 0 0 u 1 u 0 0 0 0 = r λ iu i u i λ 1 0 = u 1 u r 0 0 0 λr By the Cauchy-Schwartz iequality, we have u 1 u r (tr A = ( r λ i = ( r 1 λ i ( r 1 ( r λ i = r ( r λ i = rak (Atr A rak (A (tr A tr A with equality holds if ad oly if (λ 1,, λ r = a(1,, 1 for some a R A = au 1 u r I r u 1 u r = au 1 u r u 1 u r Note that for U = u 1 u r M, r with orthoormal colums, P = UU is Hermitia ad satisfies P = UU UU = UI r U = UU = P So P is a orthogoal projectio Suppose A, B H have eigevalues a 1 a ad b 1 b (a Give uitary matrices U, V, let C = U AU + V BV have eigevalues c 1 c Prove that a 1 + b 1 c 1 a 1 + b, a + b 1 a 1 + b, a + b 1 c a + b (1 a 1 + a + b 1 + b = c 1 + c 1

Solutio: Note that λ i (A = λ i (U AU ad λ i (B = λ i (V BV for 1 j Applyig Theorem 437 (i our order with (j, k = (1, 1, (1,, (, 1, (,, we have the iequalities i (1 The equality follows from c 1 + c = tr (C = tr (U AU + V BV = tr (A + tr (B = a 1 + a + b 1 + b (b Suppose C H has eigevalues c 1 c satisfyig (1 Show that there exist uitary matrices U, V such that C = U AU + V BV a1 0 (Hit: First cosider the case whe A = ad B = Show that 0 a 0 b there exists t such that cos t si t cos t si t A + B si t cos t si t cos t has eigevalues c 1, c Deduce the geeral case from this a1 0 Solutio: First cosider the case whe A = ad B = Let ( 0 a 0 b cos t si t U(t = ad C(t = U(t si t cos t AU(t + B The U(t is uitary for all t ad we have ( a1 + b C(0 = 1 0 ad 0 a + b Sice ( π C = ( a + b 1 0 0 a 1 + b ( π λ 1 (C(0 = a 1 + b 1 c 1 max{a 1 + b, a + b 1 } = λ 1 (C, there exists t 0, π such that λ1 (C(t = c 1 The λ (C(t = tr (C(t λ 1 (C(t = tr A + tr B c 1 = a 1 + a + b 1 + b c 1 = c Hece, there exists a uitary U 1 such that U1 c1 0 C(tU 1 = 0 c C = U c1 0 U 0 c for some uitary U The Suppose C = U U 1 C(tU 1 U = U U 1 (U(t AU(t + BU 1 U = U AU + V BV, where U = U(tU 1 U ad V = U 1 U For the geeral case, we ca get uitaries V 1, V such that V1 a1 0 AV 1 = 0 a The we have 0 b, V BV = C = U U 1 C(tU 1 U = U U 1 (U(t (V 1 AV 1 U(t + V BV U 1 U = U AU + V BV, where U = V 1 U(tU 1 U ad V = V U 1 U

3 A matrix S = (s i j is said to be doubly stochastic (ds if s i j 0, s i j = s i j = 1 for all 1 i, j Prove that if S M is ds, the for Sx x for all x R (You ca use the hit i Problem 9 o page 199, Hor ad Johso but be careful with the differece i orderig You eed to write dow more details tha those give i the hit Solutio: We prove a slightly more geeral result Suppose s i j 0, s i j 1 for all 1 i, j The Sx w x For 1 k, let w (k j Let Sx = y 1 y s ij The 0 w (k j 1 ad w(k j s i j k Sice y i = s ijx j, we have k x i k y i x i k s ijx j k x i k s ijx j x k (k w(k j x j w(k j (1 w(k j x j x j x k ( k j=k+1 w(k j (1 w(k j j=k+1 w(k j x j x k ( k (1 w(k j (x j x k + j=k+1 w(k j (x k x j 0 because x j x k for j k ad x k x j for j k + 1 Hece, Sx w x If, i additio, k=1 s k j = 1 for all 1 j The Hece, Sx x y i = s ij x j = s ij x j = (1 w(k j j=k+1 w(k j x j 4 Suppose A = a ij is a ormal matrix with eigevalues λ i, i = 1,,, such that λ 1 λ λ Let (d 1, d,, d = diag (A Prove that ( d 1, d,, d w ( λ 1, λ,, λ Solutio: We may assume that d 1 d d ad A = U d 1 d = u ij λ 1 λ Let u ij λ 1 λ = (b 1, b,, b ( λ 1, λ,, λ 3 b 1 b λ 1 O O λ The we have U The

Therefore, for 1 k, d i = u ij λ j u ij λ j = b i λ i 5 Suppose A = a ij H has eigevalues λ 1 (A λ (A λ (A Let 1 r 1 Prove that (a if r a ii = r λ A1 0 i(a the A = where A 0 A 1 H r has eigevalues λ 1 (A λ (A λ r (A Solutio: Firstly, we follow the hit ad prove the followig: a11 a Claim: Suppose A = 1 a 1 a such that (U AU 11 > a 11 H ad a 1 0 The there exists a uitary U M If a 1 0, let a 1 = a 1 e it for some t R The a 1 = a 1 = a 1 e it Choose 0 < θ < π such that cot θ > (a 11 a a 1 si θ > (a 11 a si θ Let U = e it si θ e it si θ a 1 The (U AU 11 = e it a11 a si θ 1 a 1 a e it si θ = a 11 cos θ + a si θ + a 1 si θ > a 11 cos θ + a si θ + (a 11 a si θ = a 11 A11 A Suppose 1 r < ad A = 1 with A A 1 A 11 H r such that r a ii = r λ i(a To show that A 1 = 0 Suppose the cotrary that there exist 1 i r ad r + 1 j such ( that a ij 0 By the above claim, there exists a uitary matrix U 1 such that U1 aii a ij U 1 > a ii Let U = (u st be give by a ji a jj 11 u st = (U 1 11 if (s, t = (i, i (U 1 1 if (s, t = (i, j (U 1 1 if (s, t = (j, i (U 1 if (s, t = (j, j δ st otherwise The U is uitary ad (U AU ii > a ii ad (U AU kk = a kk for all 1 k r ad k i So we have r k=1 (U AU kk > r k=1 a kk = r k=1 λ i(a, a cotradictio to Theorem 43 4

(b if r a ii = r λ +1 i(a, the A = λ +1 r (A λ + r (A λ (A A1 0 0 A where A 1 H r has eigevalues Solutio: r a ii = r λ +1 i(a r ( a ii = r λ +1 i(a = r λ i( A The apply the result i part (a to A 5