CSCE 790S Background Results
|
|
- Stephen Sutton
- 5 years ago
- Views:
Transcription
1 CSCE 790S Background Results Stephen A. Fenner September 8, 011 Abstract These results are background to the course CSCE 790S/CSCE 790B, Quantum Computaton and Informaton (Sprng 007 and Fall 011). Each result, or group of related results, s roughly one page long. Contents 1 The Cauchy-Schwarz Inequalty The Schur Trangular Form and the Spectral Theorem 3 3 The Polar and Sngular Value Decompostons 4 4 Sterlng s Approxmaton 6 5 Inequaltes of Markov and Chebyshev 7 6 Relatve Entropy 8 7 A Standard Tal Inequalty 9 1
2 1 The Cauchy-Schwarz Inequalty Ths s one of the most versatle nequaltes n all of mathematcs. Theorem 1.1 (Cauchy-Schwarz) For any real numbers a 1,..., a n and b 1,..., b n, a 1 b a n b n (a a n)(b b n), (1) wth equalty holdng ff the two vectors (a 1,..., a n ) and (b 1,..., b n ) are lnearly dependent. Proof. There are many, many ways of provng ths. Here s a drect calculaton. We have, 0 1 <j n(a b j a j b ) = [a b j (a b j a j b ) a j b (a b j a j b )] <j = [a b j (a b j a j b ) + a j b (a j b a b j )] = <j <j a b j (a b j a j b ) + <j a j b (a j b a b j ) = a b j (a b j a j b ) + a b j (a b j a j b ) = a b j (a b j a j b ) = <j j< j,j = a b j ( n ) ( n ) a b a j b j = a b j a b.,j,j =1 j=1 =1 a b j (a b j a j b ) Addng ( a b ) to both sdes then takng the square root of both sdes (notng that the square root functon s strctly monotone ncreasng) yelds the nequalty (1). Clearly, equalty holds above ff a b j a j b = 0 for all < j, or equvalently, a b j = a j b for all < j. It s not hard to check that ths condton s equvalent to (a 1,..., a n ) and (b 1,..., b n ) beng lnearly dependent. Note that (1) stll holds f we remove the absolute value delmters from the left-hand sde. In that case, equalty holds ff there exsts a λ 0 such that ether (a 1,..., a n ) = λ(b 1,..., b n ) or (b 1,..., b n ) = λ(a 1,..., a n ). Corollary 1. (Trangle Inequalty for Complex Numbers) For any z, w C, z + w z + w. Proof. Wrtng z = a 1 + a and w = b 1 + b for real a 1, a, b 1, b, we have z + w = (a 1 + b 1 ) + (a + b ) = a 1 + a + b 1 + b + (a 1 b 1 + a b ) a 1 + a + b 1 + b + (a ( a 1 + a )(b1 + b ) = 1 + a + b 1 ) + b = ( z + w ). Takng the square root of both sdes yelds the corollary. Corollary 1.3 For any complex numbers z 1,..., z n and w 1,..., w n, z1w znw n ( z z n )( w w n ). () Proof. We have z1w znw n z1w znw n (by Corollary 1.) = z 1 w z n w n ( z z n )( w w n ). (by Theorem 1.1) Corollary 1.4 For any column vectors u, v C n, u v u v.
3 The Schur Trangular Form and the Spectral Theorem Theorem.1 (Schur Trangular Form) For every n n matrx M, there exsts a untary U and an upper trangular T (both n n matrces) such that M = UT U. Proof. We prove ths by nducton on n. The n = 1 case s trval. Now supposng the theorem holds for n 1, we prove t holds for n + 1. Let M be any (n + 1) (n + 1) matrx. We let A be the lnear operator on C n+1 whose matrx s M wth respect to some orthonormal bass. A has some egenvalue λ wth correspondng unt egenvector v. Usng the Gram-Schmdt procedure, we can fnd an orthonormal bass {y 1,..., y n+1 } for C n+1 such that y 1 = v. Wth respect to ths bass, the matrx for A looks lke N = λ w 0 N, where w s some vector n C n and N s an n n matrx. Snce M and N represent the same operator wth respect to dfferent orthonormal bases, they must be untarly conjugate,.e., there s a untary V such that M = V NV. N s an n n matrx, so we apply the nductve hypothess to get a untary W and an upper trangular T (both n n matrces) such that N = W T W. Now we can factor N: N = λ w 0 W T W = W λ w W 0 T W = W T W, where W = W and T = λ w W 0 T. T s clearly upper trangular, and t s easly checked that W W = I, usng the fact that W s untary. Thus W s untary, and we get M = V NV = V W T W V = UT U, where U = V W s untary. A Schur bass for an operator A s an orthonormal bass that gves an upper trangular matrx for A. Theorem. If an n n matrx A s both upper trangular and normal, then A s dagonal. Proof. Suppose that A s upper trangular and normal, but not dagonal. Then there s some < j such that [A] j 0. Let j be least such that there exsts < j such that [A] j 0. For ths and j, we get [AA ] = [A] k [A ] k = [A] k [A] k = [A] k = [A] k [A] + [A] j > [A]. (3) The last nequalty follows from the fact that [A] j 0. Smlarly, [A A] = [A] k[a] k = k= [A] k = [A] k = [A]. (4) The next to last equaton holds because A s upper trangular, and the last equaton holds because of our mnmum choce of j and the fact that < j. From (3) and (4), we have [AA ] > [A A]. But A s normal, so these two quanttes must be equal. From ths contradcton we get that A must be dagonal. Corollary.3 (Spectral Theorem for Normal Operators) Every normal matrx s untarly conjugate to a dagonal matrx. Equvalently, every normal operator has an orthonormal egenbass. 3
4 3 The Polar and Sngular Value Decompostons Theorem 3.1 (Polar Decomposton) For every n n matrx A there are s an n n untary matrx U and a unque n n matrx H such that H 0 and A = UH. In fact, H = A. Proof. Frst unqueness. If A = UH wth U untary and H 0, then A = A A = H U UH = H H = H = H. Now exstence. Let {e 1,..., e n } be the standard orthonormal bass for C n. We frst prove the specal case where A s the dagonal matrx dag(s 1, s,..., s n ) for some real values s 1 s s n 0. Let 0 k n be largest such that s k > 0 (k = 0 f A = 0). Thus we have A = [ D where D s the k k nonsngular matrx dag(s 1,..., s k ). If j > k, then A e j = 0, and thus 0 = A e j = A e j = A Ae j, whence Ae j = Ae j Ae j = e j A Ae j = e j 0 = 0, and so Ae j = 0. Ths means that A = [ B 0 ], where B s some n k matrx, and the last n k columns of A are 0. We have [ B B ], ] [ ] B [ ] = B 0 = A A = A = 0 [ D and so B B = D. Let W be an n (n k) matrx whose columns are unt vectors orthogonal to all the columns of B and to each other. (There are many possbltes for W f k < n; the columns of W can be any orthonormal set n the orthogonal complement of the space spanned by the columns of B.) By our choce of W, we have B W = 0, W B = 0, and W W = I. Fnally, defne U := [ BD 1 W ]. We clam that U s untary and that A = U A. Notng that D 1 s Hermtean, we have [ ] D U U = 1 B [ BD W 1 W ] [ ] [ ] D = 1 B BD 1 D 1 B W I 0 W BD 1 W = = I, W 0 I and therefore U s untary. We also have U A = [ BD 1 W ] [ D ] = [ B 0 ] = A. Now for the general case. Snce A 0 (and hence normal), there s a untary V such that V A V = dag(s 1,..., s n ) for some real values s 1 s n 0. Snce V A V = V A AV = V A AV = (V AV ) (V AV ) = V AV, we see that V AV satsfes the specal case, above, and so there s a untary U such that V AV = U V AV. It follows that A = V V AV V = V U V AV V = V UV A V V = V UV A, whch proves the theorem because V UV s untary. ], Theorem 3. (Sngular Value Decomposton) For any n n matrx A there exst n n untary matrces V, W and unque real values s 1 s s n 0 such that A = V DW, where D = dag(s 1,..., s n ). Furthermore, s 1,..., s n are the egenvalues of A. 4
5 The s 1,..., s n are known as the sngular values of A. Proof. For unqueness, f A = V DW as above, then A = A A = W DV V DW = W D W = W D W = W DW, and so the dagonal entres of D must be the egenvalues of A. For exstence, the Polar Decomposton gves a untary U such that A = U A. Snce A 0 (and hence s normal), there exsts a untary Y such that A = Y DY, where D = dag(s 1,..., s n ) for some s 1 s n 0. Then A = U A = UY DY. Settng V := UY and W := Y proves the theorem. 5
6 4 Sterlng s Approxmaton Theorem 4.1 (Sterlng s Approxmaton) n! πn(n/e) n. Here, f(n) g(n) means that lm n f(n)/g(n) = 1. We ll prove a slghtly weaker verson of Theorem 4.1 that nevertheless suffces for all our purposes, namely, Theorem 4. (Weak Sterlng) For all postve ntegers n, e ( n ) n ( n ) n n n! e n. e e Proof. We start wth an ntegral approxmaton. The theorem clearly holds for n = 1, so assume n. Snce the log functon s concave downward, we clam that for all such that n, log + log( 1) 1 log x dx log 1. (5) The left-hand sde s the area of the trapezod T 1 formed by the ponts ( 1, 0), (, 0), (, log ), ( 1, log( 1)), and the rght-hand sde s the area of the trapezod T formed by the ponts ( 1, 0), (, 0), (, log ), ( 1, log 1/). Note that T s upper edge s the tangent lne to the curve y = log x at the pont (, log ). By concavty of log, the regon under the curve y = log x n the nterval [ 1, ] contans T 1 and s contaned n T, hence the nequaltes (5). Now note that log(n!) = n =1 log = n = log. Summng (5) from = to n and smplfyng, we get log(n!) log n n 1 log x dx = n log n n + 1 log(n!) 1 = 1, (6) usng the closed form log x dx = x log x x + C. The sum on the rght-hand sde of (6) s the Harmonc seres, whch satsfes another ntegral approxmaton: Equatons (6) and (7) yeld log n! log n = 1 n dx = log n log. (7) x n log n n + 1 log(n!) log n + log, and so n log n n log n log log n! n log n n log n. (8) Takng e to the power of all three quanttes n (8) and smplfyng, we have e ( n ) n ( n ) n n n! e n e e as desred. 6
7 5 Inequaltes of Markov and Chebyshev We only consder random varables that are real-valued and over dscrete sample spaces. If X s such a random varable, then we let E[X] and var[x] respectvely denote the expected value (mean) of X and the varance of X. Theorem 5.1 (Markov s Inequalty) Let X be a random varable wth fnte mean, and suppose X 0. For every real c > 0, Pr[X c] E[X]. c Proof. Let Ω be the sample space for X. We have E[X] = X(a) Pr[a] = X(a) Pr[a] + X(a) Pr[a] a Ω a:x(a) c a:x(a)<c X(a) Pr[a] c Pr[a] = c Pr[X c]. a:x(a) c a:x(a) c Dvdng both sdes by c proves the theorem. Theorem 5. (Chebyshev s Inequalty) Let X be a random varable wth fnte mean and varance, and let a > 0 be real. Pr[ X E[X] a ] var[x] a. Proof. We nvoke Markov s Inequalty wth the random varable Y = (X E[X]), lettng c = a. Note that Y 0, E[Y ] = var[x], and Pr[ X E[X] a ] = Pr[Y a ]. 7
8 6 Relatve Entropy Let p = (p 1, p,...) and q = (q 1, q,...) be two probablty dstrbutons over some (fnte or nfnte) dscrete sample space {1,,...}. The relatve entropy of q wth respect to p s defned as H(q; p) = p lg q p, (9) Where the sum s taken over all such that p > 0. If q = 0 and p > 0 for some, then H(q; p) =. Otherwse, the sum n (9) may or may not converge, but we always have the followng regardless: Theorem 6.1 H(q; p) 0, wth equalty holdng f and only f p = q. Proof. We use that fact that log x x 1 for all x > 0, wth equalty holdng ff x = 1. We have H(q; p) = p lg q p = 1 p log q log p 1 ( ) q p 1 log p 1 = (p q ) log ( 1 = 1 ) q log 0. It s easy to see that equalty holds above f and only f p = q. An mportant specal case s when q = (q 1,..., q n ) = (1/n,..., 1/n) s the unform dstrbuton on a sample space of sze n (and p = (p 1,..., p n ) s arbtrary). In ths case, we have H(q; p) = lg n H(p 1,..., p n ). (10) If (p, 1 p) and (q, 1 q) are bnary dstrbutons, then we abbrevate H((q, 1 q); (p, 1 p)) by h(q; p). Note that by (10), h(1/, p) = 1 h(p). 8
9 7 A Standard Tal Inequalty It mght be necessary to read Secton 6 before ths one. Let 0 < p < 1 and let n > 0 be an nteger. In ths secton, we gve an upper bound for the sum t ( n ) =0 p (1 p) n, where t pn. [For example, ths sum s the probablty of gettng at most t heads among n flps of a p-based con (.e., n dentcal Bernoull trals wth bas p). The expected number of heads among n flps s pn, and we want to show that the probablty of gettng sgnfcantly fewer than pn heads dmnshes exponentally wth n.] Theorem 7.1 Let n be a postve nteger. Let 0 < p < 1 be arbtrary, and set q = 1 p. If t s an nteger such that 0 t pn, then t ( ) n p q n nh(p;t/n), (11) where h( ; ) s the bnary relatve entropy defned n Secton 6. =0 Proof. If t = 0, then h(p; t/n) = h(p; 0) = lg q, and so both sdes of (11) equal q n and so the nequalty s satsfed. Now suppose 0 < t pn. Set λ = t/n, and let µ = 1 λ. Note that 0 < λ p < 1 and 0 < q µ < 1. Defne C = pt q n t λ t µ n t. For any 0 t, we have p q n = C Therefore, startng wth the left-hand sde of (11), we get t =0 ( ) n p q n C For the rght-hand sde of (11), we get ( ) t q ( µ ) t λ t µ n t C λ t µ n t = Cλ µ n. p λ t =0 ( ) n λ µ n C =0 ( ) n λ µ n = C(λ + µ) n = C. ( p ) ( ) nλ nµ q ( p ) ( ) t n t q nh(p;t/n) = nh(p;λ) = n[λ lg(p/λ)+µ lg(q/µ)] = = = C, λ µ λ µ whch proves the theorem. 9
APPENDIX A Some Linear Algebra
APPENDIX A Some Lnear Algebra The collecton of m, n matrces A.1 Matrces a 1,1,..., a 1,n A = a m,1,..., a m,n wth real elements a,j s denoted by R m,n. If n = 1 then A s called a column vector. Smlarly,
More information3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X
Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number
More informationChapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems
Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons
More informationThe Order Relation and Trace Inequalities for. Hermitian Operators
Internatonal Mathematcal Forum, Vol 3, 08, no, 507-57 HIKARI Ltd, wwwm-hkarcom https://doorg/0988/mf088055 The Order Relaton and Trace Inequaltes for Hermtan Operators Y Huang School of Informaton Scence
More informationMore metrics on cartesian products
More metrcs on cartesan products If (X, d ) are metrc spaces for 1 n, then n Secton II4 of the lecture notes we defned three metrcs on X whose underlyng topologes are the product topology The purpose of
More informationMATH 5707 HOMEWORK 4 SOLUTIONS 2. 2 i 2p i E(X i ) + E(Xi 2 ) ä i=1. i=1
MATH 5707 HOMEWORK 4 SOLUTIONS CİHAN BAHRAN 1. Let v 1,..., v n R m, all lengths v are not larger than 1. Let p 1,..., p n [0, 1] be arbtrary and set w = p 1 v 1 + + p n v n. Then there exst ε 1,..., ε
More informationLectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix
Lectures - Week 4 Matrx norms, Condtonng, Vector Spaces, Lnear Independence, Spannng sets and Bass, Null space and Range of a Matrx Matrx Norms Now we turn to assocatng a number to each matrx. We could
More informationMATH Homework #2
MATH609-601 Homework #2 September 27, 2012 1. Problems Ths contans a set of possble solutons to all problems of HW-2. Be vglant snce typos are possble (and nevtable). (1) Problem 1 (20 pts) For a matrx
More informationHomework Notes Week 7
Homework Notes Week 7 Math 4 Sprng 4 #4 (a Complete the proof n example 5 that s an nner product (the Frobenus nner product on M n n (F In the example propertes (a and (d have already been verfed so we
More informationMatrix Approximation via Sampling, Subspace Embedding. 1 Solving Linear Systems Using SVD
Matrx Approxmaton va Samplng, Subspace Embeddng Lecturer: Anup Rao Scrbe: Rashth Sharma, Peng Zhang 0/01/016 1 Solvng Lnear Systems Usng SVD Two applcatons of SVD have been covered so far. Today we loo
More informationSingular Value Decomposition: Theory and Applications
Sngular Value Decomposton: Theory and Applcatons Danel Khashab Sprng 2015 Last Update: March 2, 2015 1 Introducton A = UDV where columns of U and V are orthonormal and matrx D s dagonal wth postve real
More informationGoogle PageRank with Stochastic Matrix
Google PageRank wth Stochastc Matrx Md. Sharq, Puranjt Sanyal, Samk Mtra (M.Sc. Applcatons of Mathematcs) Dscrete Tme Markov Chan Let S be a countable set (usually S s a subset of Z or Z d or R or R d
More informationNorms, Condition Numbers, Eigenvalues and Eigenvectors
Norms, Condton Numbers, Egenvalues and Egenvectors 1 Norms A norm s a measure of the sze of a matrx or a vector For vectors the common norms are: N a 2 = ( x 2 1/2 the Eucldean Norm (1a b 1 = =1 N x (1b
More information10-801: Advanced Optimization and Randomized Methods Lecture 2: Convex functions (Jan 15, 2014)
0-80: Advanced Optmzaton and Randomzed Methods Lecture : Convex functons (Jan 5, 04) Lecturer: Suvrt Sra Addr: Carnege Mellon Unversty, Sprng 04 Scrbes: Avnava Dubey, Ahmed Hefny Dsclamer: These notes
More information1 Matrix representations of canonical matrices
1 Matrx representatons of canoncal matrces 2-d rotaton around the orgn: ( ) cos θ sn θ R 0 = sn θ cos θ 3-d rotaton around the x-axs: R x = 1 0 0 0 cos θ sn θ 0 sn θ cos θ 3-d rotaton around the y-axs:
More informationREAL ANALYSIS I HOMEWORK 1
REAL ANALYSIS I HOMEWORK CİHAN BAHRAN The questons are from Tao s text. Exercse 0.0.. If (x α ) α A s a collecton of numbers x α [0, + ] such that x α
More informationLecture 3: Probability Distributions
Lecture 3: Probablty Dstrbutons Random Varables Let us begn by defnng a sample space as a set of outcomes from an experment. We denote ths by S. A random varable s a functon whch maps outcomes nto the
More informationSolutions HW #2. minimize. Ax = b. Give the dual problem, and make the implicit equality constraints explicit. Solution.
Solutons HW #2 Dual of general LP. Fnd the dual functon of the LP mnmze subject to c T x Gx h Ax = b. Gve the dual problem, and make the mplct equalty constrants explct. Soluton. 1. The Lagrangan s L(x,
More informationAn Inequality for the trace of matrix products, using absolute values
arxv:1106.6189v2 [math-ph] 1 Sep 2011 An Inequalty for the trace of matrx products, usng absolute values Bernhard Baumgartner 1 Fakultät für Physk, Unverstät Wen Boltzmanngasse 5, A-1090 Venna, Austra
More informationprinceton univ. F 13 cos 521: Advanced Algorithm Design Lecture 3: Large deviations bounds and applications Lecturer: Sanjeev Arora
prnceton unv. F 13 cos 521: Advanced Algorthm Desgn Lecture 3: Large devatons bounds and applcatons Lecturer: Sanjeev Arora Scrbe: Today s topc s devaton bounds: what s the probablty that a random varable
More informationMATH 241B FUNCTIONAL ANALYSIS - NOTES EXAMPLES OF C ALGEBRAS
MATH 241B FUNCTIONAL ANALYSIS - NOTES EXAMPLES OF C ALGEBRAS These are nformal notes whch cover some of the materal whch s not n the course book. The man purpose s to gve a number of nontrval examples
More informationLecture 12: Discrete Laplacian
Lecture 12: Dscrete Laplacan Scrbe: Tanye Lu Our goal s to come up wth a dscrete verson of Laplacan operator for trangulated surfaces, so that we can use t n practce to solve related problems We are mostly
More informationU.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017
U.C. Berkeley CS94: Beyond Worst-Case Analyss Handout 4s Luca Trevsan September 5, 07 Summary of Lecture 4 In whch we ntroduce semdefnte programmng and apply t to Max Cut. Semdefnte Programmng Recall that
More informationLecture 3. Ax x i a i. i i
18.409 The Behavor of Algorthms n Practce 2/14/2 Lecturer: Dan Spelman Lecture 3 Scrbe: Arvnd Sankar 1 Largest sngular value In order to bound the condton number, we need an upper bound on the largest
More informationOn Finite Rank Perturbation of Diagonalizable Operators
Functonal Analyss, Approxmaton and Computaton 6 (1) (2014), 49 53 Publshed by Faculty of Scences and Mathematcs, Unversty of Nš, Serba Avalable at: http://wwwpmfnacrs/faac On Fnte Rank Perturbaton of Dagonalzable
More informationn α j x j = 0 j=1 has a nontrivial solution. Here A is the n k matrix whose jth column is the vector for all t j=0
MODULE 2 Topcs: Lnear ndependence, bass and dmenson We have seen that f n a set of vectors one vector s a lnear combnaton of the remanng vectors n the set then the span of the set s unchanged f that vector
More information= = = (a) Use the MATLAB command rref to solve the system. (b) Let A be the coefficient matrix and B be the right-hand side of the system.
Chapter Matlab Exercses Chapter Matlab Exercses. Consder the lnear system of Example n Secton.. x x x y z y y z (a) Use the MATLAB command rref to solve the system. (b) Let A be the coeffcent matrx and
More informationTHE CHINESE REMAINDER THEOREM. We should thank the Chinese for their wonderful remainder theorem. Glenn Stevens
THE CHINESE REMAINDER THEOREM KEITH CONRAD We should thank the Chnese for ther wonderful remander theorem. Glenn Stevens 1. Introducton The Chnese remander theorem says we can unquely solve any par of
More informationSTAT 309: MATHEMATICAL COMPUTATIONS I FALL 2018 LECTURE 16
STAT 39: MATHEMATICAL COMPUTATIONS I FALL 218 LECTURE 16 1 why teratve methods f we have a lnear system Ax = b where A s very, very large but s ether sparse or structured (eg, banded, Toepltz, banded plus
More informationMath 217 Fall 2013 Homework 2 Solutions
Math 17 Fall 013 Homework Solutons Due Thursday Sept. 6, 013 5pm Ths homework conssts of 6 problems of 5 ponts each. The total s 30. You need to fully justfy your answer prove that your functon ndeed has
More informationSupplement: Proofs and Technical Details for The Solution Path of the Generalized Lasso
Supplement: Proofs and Techncal Detals for The Soluton Path of the Generalzed Lasso Ryan J. Tbshran Jonathan Taylor In ths document we gve supplementary detals to the paper The Soluton Path of the Generalzed
More informationU.C. Berkeley CS294: Spectral Methods and Expanders Handout 8 Luca Trevisan February 17, 2016
U.C. Berkeley CS94: Spectral Methods and Expanders Handout 8 Luca Trevsan February 7, 06 Lecture 8: Spectral Algorthms Wrap-up In whch we talk about even more generalzatons of Cheeger s nequaltes, and
More informationSome basic inequalities. Definition. Let V be a vector space over the complex numbers. An inner product is given by a function, V V C
Some basc nequaltes Defnton. Let V be a vector space over the complex numbers. An nner product s gven by a functon, V V C (x, y) x, y satsfyng the followng propertes (for all x V, y V and c C) (1) x +
More informationExercise Solutions to Real Analysis
xercse Solutons to Real Analyss Note: References refer to H. L. Royden, Real Analyss xersze 1. Gven any set A any ɛ > 0, there s an open set O such that A O m O m A + ɛ. Soluton 1. If m A =, then there
More informationSELECTED PROOFS. DeMorgan s formulas: The first one is clear from Venn diagram, or the following truth table:
SELECTED PROOFS DeMorgan s formulas: The frst one s clear from Venn dagram, or the followng truth table: A B A B A B Ā B Ā B T T T F F F F T F T F F T F F T T F T F F F F F T T T T The second one can be
More information763622S ADVANCED QUANTUM MECHANICS Solution Set 1 Spring c n a n. c n 2 = 1.
7636S ADVANCED QUANTUM MECHANICS Soluton Set 1 Sprng 013 1 Warm-up Show that the egenvalues of a Hermtan operator  are real and that the egenkets correspondng to dfferent egenvalues are orthogonal (b)
More informationThe lower and upper bounds on Perron root of nonnegative irreducible matrices
Journal of Computatonal Appled Mathematcs 217 (2008) 259 267 wwwelsevercom/locate/cam The lower upper bounds on Perron root of nonnegatve rreducble matrces Guang-Xn Huang a,, Feng Yn b,keguo a a College
More informationPerron Vectors of an Irreducible Nonnegative Interval Matrix
Perron Vectors of an Irreducble Nonnegatve Interval Matrx Jr Rohn August 4 2005 Abstract As s well known an rreducble nonnegatve matrx possesses a unquely determned Perron vector. As the man result of
More informationw ). Then use the Cauchy-Schwartz inequality ( v w v w ).] = in R 4. Can you find a vector u 4 in R 4 such that the
Math S-b Summer 8 Homework #5 Problems due Wed, July 8: Secton 5: Gve an algebrac proof for the trangle nequalty v+ w v + w Draw a sketch [Hnt: Expand v+ w ( v+ w) ( v+ w ) hen use the Cauchy-Schwartz
More informationLinear Approximation with Regularization and Moving Least Squares
Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...
More informationFirst day August 1, Problems and Solutions
FOURTH INTERNATIONAL COMPETITION FOR UNIVERSITY STUDENTS IN MATHEMATICS July 30 August 4, 997, Plovdv, BULGARIA Frst day August, 997 Problems and Solutons Problem. Let {ε n } n= be a sequence of postve
More informationC/CS/Phy191 Problem Set 3 Solutions Out: Oct 1, 2008., where ( 00. ), so the overall state of the system is ) ( ( ( ( 00 ± 11 ), Φ ± = 1
C/CS/Phy9 Problem Set 3 Solutons Out: Oct, 8 Suppose you have two qubts n some arbtrary entangled state ψ You apply the teleportaton protocol to each of the qubts separately What s the resultng state obtaned
More informationMaximizing the number of nonnegative subsets
Maxmzng the number of nonnegatve subsets Noga Alon Hao Huang December 1, 213 Abstract Gven a set of n real numbers, f the sum of elements of every subset of sze larger than k s negatve, what s the maxmum
More informationEigenvalues of Random Graphs
Spectral Graph Theory Lecture 2 Egenvalues of Random Graphs Danel A. Spelman November 4, 202 2. Introducton In ths lecture, we consder a random graph on n vertces n whch each edge s chosen to be n the
More informationProblem Set 9 Solutions
Desgn and Analyss of Algorthms May 4, 2015 Massachusetts Insttute of Technology 6.046J/18.410J Profs. Erk Demane, Srn Devadas, and Nancy Lynch Problem Set 9 Solutons Problem Set 9 Solutons Ths problem
More informationPHYS 215C: Quantum Mechanics (Spring 2017) Problem Set 3 Solutions
PHYS 5C: Quantum Mechancs Sprng 07 Problem Set 3 Solutons Prof. Matthew Fsher Solutons prepared by: Chatanya Murthy and James Sully June 4, 07 Please let me know f you encounter any typos n the solutons.
More informationHADAMARD PRODUCT VERSIONS OF THE CHEBYSHEV AND KANTOROVICH INEQUALITIES
HADAMARD PRODUCT VERSIONS OF THE CHEBYSHEV AND KANTOROVICH INEQUALITIES JAGJIT SINGH MATHARU AND JASPAL SINGH AUJLA Department of Mathematcs Natonal Insttute of Technology Jalandhar 144011, Punab, INDIA
More informationBOUNDEDNESS OF THE RIESZ TRANSFORM WITH MATRIX A 2 WEIGHTS
BOUNDEDNESS OF THE IESZ TANSFOM WITH MATIX A WEIGHTS Introducton Let L = L ( n, be the functon space wth norm (ˆ f L = f(x C dx d < For a d d matrx valued functon W : wth W (x postve sem-defnte for all
More informationNOTES ON SIMPLIFICATION OF MATRICES
NOTES ON SIMPLIFICATION OF MATRICES JONATHAN LUK These notes dscuss how to smplfy an (n n) matrx In partcular, we expand on some of the materal from the textbook (wth some repetton) Part of the exposton
More informationSalmon: Lectures on partial differential equations. Consider the general linear, second-order PDE in the form. ,x 2
Salmon: Lectures on partal dfferental equatons 5. Classfcaton of second-order equatons There are general methods for classfyng hgher-order partal dfferental equatons. One s very general (applyng even to
More informationStanford University CS359G: Graph Partitioning and Expanders Handout 4 Luca Trevisan January 13, 2011
Stanford Unversty CS359G: Graph Parttonng and Expanders Handout 4 Luca Trevsan January 3, 0 Lecture 4 In whch we prove the dffcult drecton of Cheeger s nequalty. As n the past lectures, consder an undrected
More informationAnother converse of Jensen s inequality
Another converse of Jensen s nequalty Slavko Smc Abstract. We gve the best possble global bounds for a form of dscrete Jensen s nequalty. By some examples ts frutfulness s shown. 1. Introducton Throughout
More information6. Stochastic processes (2)
Contents Markov processes Brth-death processes Lect6.ppt S-38.45 - Introducton to Teletraffc Theory Sprng 5 Markov process Consder a contnuous-tme and dscrete-state stochastc process X(t) wth state space
More information6. Stochastic processes (2)
6. Stochastc processes () Lect6.ppt S-38.45 - Introducton to Teletraffc Theory Sprng 5 6. Stochastc processes () Contents Markov processes Brth-death processes 6. Stochastc processes () Markov process
More informationComplete subgraphs in multipartite graphs
Complete subgraphs n multpartte graphs FLORIAN PFENDER Unverstät Rostock, Insttut für Mathematk D-18057 Rostock, Germany Floran.Pfender@un-rostock.de Abstract Turán s Theorem states that every graph G
More informationLearning Theory: Lecture Notes
Learnng Theory: Lecture Notes Lecturer: Kamalka Chaudhur Scrbe: Qush Wang October 27, 2012 1 The Agnostc PAC Model Recall that one of the constrants of the PAC model s that the data dstrbuton has to be
More informationHomework 1 Lie Algebras
Homework 1 Le Algebras Joshua Ruter February 9, 018 Proposton 0.1 Problem 1.7a). Let A be a K-algebra, wth char K. Then A s alternatve f and only f the folowng two lnear) denttes hold for all a, b, y A.
More informationExpected Value and Variance
MATH 38 Expected Value and Varance Dr. Neal, WKU We now shall dscuss how to fnd the average and standard devaton of a random varable X. Expected Value Defnton. The expected value (or average value, or
More informationMath 702 Midterm Exam Solutions
Math 702 Mdterm xam Solutons The terms measurable, measure, ntegrable, and almost everywhere (a.e.) n a ucldean space always refer to Lebesgue measure m. Problem. [6 pts] In each case, prove the statement
More informationAppendix B. Criterion of Riemann-Stieltjes Integrability
Appendx B. Crteron of Remann-Steltes Integrablty Ths note s complementary to [R, Ch. 6] and [T, Sec. 3.5]. The man result of ths note s Theorem B.3, whch provdes the necessary and suffcent condtons for
More informationCOMPUTING THE NORM OF A MATRIX
COMPUTING THE NORM OF A MATRIX KEITH CONRAD 1. Introducton In R n there s a standard noton of length: the sze of a vector v = (a 1,..., a n ) s v = a 2 1 + + a2 n. We wll dscuss n Secton 2 the general
More informationLecture 14 (03/27/18). Channels. Decoding. Preview of the Capacity Theorem.
Lecture 14 (03/27/18). Channels. Decodng. Prevew of the Capacty Theorem. A. Barg The concept of a communcaton channel n nformaton theory s an abstracton for transmttng dgtal (and analog) nformaton from
More informationInner Product. Euclidean Space. Orthonormal Basis. Orthogonal
Inner Product Defnton 1 () A Eucldean space s a fnte-dmensonal vector space over the reals R, wth an nner product,. Defnton 2 (Inner Product) An nner product, on a real vector space X s a symmetrc, blnear,
More informationLecture 20: Lift and Project, SDP Duality. Today we will study the Lift and Project method. Then we will prove the SDP duality theorem.
prnceton u. sp 02 cos 598B: algorthms and complexty Lecture 20: Lft and Project, SDP Dualty Lecturer: Sanjeev Arora Scrbe:Yury Makarychev Today we wll study the Lft and Project method. Then we wll prove
More informationYong Joon Ryang. 1. Introduction Consider the multicommodity transportation problem with convex quadratic cost function. 1 2 (x x0 ) T Q(x x 0 )
Kangweon-Kyungk Math. Jour. 4 1996), No. 1, pp. 7 16 AN ITERATIVE ROW-ACTION METHOD FOR MULTICOMMODITY TRANSPORTATION PROBLEMS Yong Joon Ryang Abstract. The optmzaton problems wth quadratc constrants often
More informationGELFAND-TSETLIN BASIS FOR THE REPRESENTATIONS OF gl n
GELFAND-TSETLIN BASIS FOR THE REPRESENTATIONS OF gl n KANG LU FINITE DIMENSIONAL REPRESENTATIONS OF gl n Let e j,, j =,, n denote the standard bass of the general lnear Le algebra gl n over the feld of
More informationLecture 10: May 6, 2013
TTIC/CMSC 31150 Mathematcal Toolkt Sprng 013 Madhur Tulsan Lecture 10: May 6, 013 Scrbe: Wenje Luo In today s lecture, we manly talked about random walk on graphs and ntroduce the concept of graph expander,
More informationThe internal structure of natural numbers and one method for the definition of large prime numbers
The nternal structure of natural numbers and one method for the defnton of large prme numbers Emmanul Manousos APM Insttute for the Advancement of Physcs and Mathematcs 3 Poulou str. 53 Athens Greece Abstract
More informationVapnik-Chervonenkis theory
Vapnk-Chervonenks theory Rs Kondor June 13, 2008 For the purposes of ths lecture, we restrct ourselves to the bnary supervsed batch learnng settng. We assume that we have an nput space X, and an unknown
More informationBézier curves. Michael S. Floater. September 10, These notes provide an introduction to Bézier curves. i=0
Bézer curves Mchael S. Floater September 1, 215 These notes provde an ntroducton to Bézer curves. 1 Bernsten polynomals Recall that a real polynomal of a real varable x R, wth degree n, s a functon of
More information1 GSW Iterative Techniques for y = Ax
1 for y = A I m gong to cheat here. here are a lot of teratve technques that can be used to solve the general case of a set of smultaneous equatons (wrtten n the matr form as y = A), but ths chapter sn
More informatione - c o m p a n i o n
OPERATIONS RESEARCH http://dxdoorg/0287/opre007ec e - c o m p a n o n ONLY AVAILABLE IN ELECTRONIC FORM 202 INFORMS Electronc Companon Generalzed Quantty Competton for Multple Products and Loss of Effcency
More informationa b a In case b 0, a being divisible by b is the same as to say that
Secton 6.2 Dvsblty among the ntegers An nteger a ε s dvsble by b ε f there s an nteger c ε such that a = bc. Note that s dvsble by any nteger b, snce = b. On the other hand, a s dvsble by only f a = :
More informationDimensionality Reduction Notes 1
Dmensonalty Reducton Notes 1 Jelan Nelson mnlek@seas.harvard.edu August 10, 2015 1 Prelmnares Here we collect some notaton and basc lemmas used throughout ths note. Throughout, for a random varable X,
More informationRepresentation theory and quantum mechanics tutorial Representation theory and quantum conservation laws
Representaton theory and quantum mechancs tutoral Representaton theory and quantum conservaton laws Justn Campbell August 1, 2017 1 Generaltes on representaton theory 1.1 Let G GL m (R) be a real algebrac
More informationDIFFERENTIAL FORMS BRIAN OSSERMAN
DIFFERENTIAL FORMS BRIAN OSSERMAN Dfferentals are an mportant topc n algebrac geometry, allowng the use of some classcal geometrc arguments n the context of varetes over any feld. We wll use them to defne
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 12 10/21/2013. Martingale Concentration Inequalities and Applications
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.65/15.070J Fall 013 Lecture 1 10/1/013 Martngale Concentraton Inequaltes and Applcatons Content. 1. Exponental concentraton for martngales wth bounded ncrements.
More informationFINITELY-GENERATED MODULES OVER A PRINCIPAL IDEAL DOMAIN
FINITELY-GENERTED MODULES OVER PRINCIPL IDEL DOMIN EMMNUEL KOWLSKI Throughout ths note, s a prncpal deal doman. We recall the classfcaton theorem: Theorem 1. Let M be a fntely-generated -module. (1) There
More informationj) = 1 (note sigma notation) ii. Continuous random variable (e.g. Normal distribution) 1. density function: f ( x) 0 and f ( x) dx = 1
Random varables Measure of central tendences and varablty (means and varances) Jont densty functons and ndependence Measures of assocaton (covarance and correlaton) Interestng result Condtonal dstrbutons
More informationRandom Walks on Digraphs
Random Walks on Dgraphs J. J. P. Veerman October 23, 27 Introducton Let V = {, n} be a vertex set and S a non-negatve row-stochastc matrx (.e. rows sum to ). V and S defne a dgraph G = G(V, S) and a drected
More informationDifference Equations
Dfference Equatons c Jan Vrbk 1 Bascs Suppose a sequence of numbers, say a 0,a 1,a,a 3,... s defned by a certan general relatonshp between, say, three consecutve values of the sequence, e.g. a + +3a +1
More informationMMA and GCMMA two methods for nonlinear optimization
MMA and GCMMA two methods for nonlnear optmzaton Krster Svanberg Optmzaton and Systems Theory, KTH, Stockholm, Sweden. krlle@math.kth.se Ths note descrbes the algorthms used n the author s 2007 mplementatons
More informationStrong Markov property: Same assertion holds for stopping times τ.
Brownan moton Let X ={X t : t R + } be a real-valued stochastc process: a famlty of real random varables all defned on the same probablty space. Defne F t = nformaton avalable by observng the process up
More informationHANSON-WRIGHT INEQUALITY AND SUB-GAUSSIAN CONCENTRATION
HANSON-WRIGHT INEQUALITY AND SUB-GAUSSIAN CONCENTRATION MARK RUDELSON AND ROMAN VERSHYNIN Abstract. In ths expostory note, we gve a modern proof of Hanson-Wrght nequalty for quadratc forms n sub-gaussan
More information2.3 Nilpotent endomorphisms
s a block dagonal matrx, wth A Mat dm U (C) In fact, we can assume that B = B 1 B k, wth B an ordered bass of U, and that A = [f U ] B, where f U : U U s the restrcton of f to U 40 23 Nlpotent endomorphsms
More informationSL n (F ) Equals its Own Derived Group
Internatonal Journal of Algebra, Vol. 2, 2008, no. 12, 585-594 SL n (F ) Equals ts Own Derved Group Jorge Macel BMCC-The Cty Unversty of New York, CUNY 199 Chambers street, New York, NY 10007, USA macel@cms.nyu.edu
More informationPES 1120 Spring 2014, Spendier Lecture 6/Page 1
PES 110 Sprng 014, Spender Lecture 6/Page 1 Lecture today: Chapter 1) Electrc feld due to charge dstrbutons -> charged rod -> charged rng We ntroduced the electrc feld, E. I defned t as an nvsble aura
More informationCOMBINATORIAL IDENTITIES DERIVING FROM THE n-th POWER OF A 2 2 MATRIX
COMBINATORIAL IDENTITIES DERIVING FROM THE n-th POWER OF A MATRIX J Mc Laughln 1 Mathematcs Department Trnty College 300 Summt Street, Hartford, CT 06106-3100 amesmclaughln@trncolledu Receved:, Accepted:,
More informationAnti-van der Waerden numbers of 3-term arithmetic progressions.
Ant-van der Waerden numbers of 3-term arthmetc progressons. Zhanar Berkkyzy, Alex Schulte, and Mchael Young Aprl 24, 2016 Abstract The ant-van der Waerden number, denoted by aw([n], k), s the smallest
More information5 The Rational Canonical Form
5 The Ratonal Canoncal Form Here p s a monc rreducble factor of the mnmum polynomal m T and s not necessarly of degree one Let F p denote the feld constructed earler n the course, consstng of all matrces
More informationSolutions to exam in SF1811 Optimization, Jan 14, 2015
Solutons to exam n SF8 Optmzaton, Jan 4, 25 3 3 O------O -4 \ / \ / The network: \/ where all lnks go from left to rght. /\ / \ / \ 6 O------O -5 2 4.(a) Let x = ( x 3, x 4, x 23, x 24 ) T, where the varable
More information2 More examples with details
Physcs 129b Lecture 3 Caltech, 01/15/19 2 More examples wth detals 2.3 The permutaton group n = 4 S 4 contans 4! = 24 elements. One s the dentty e. Sx of them are exchange of two objects (, j) ( to j and
More informationLinear, affine, and convex sets and hulls In the sequel, unless otherwise specified, X will denote a real vector space.
Lnear, affne, and convex sets and hulls In the sequel, unless otherwse specfed, X wll denote a real vector space. Lnes and segments. Gven two ponts x, y X, we defne xy = {x + t(y x) : t R} = {(1 t)x +
More informationEdge Isoperimetric Inequalities
November 7, 2005 Ross M. Rchardson Edge Isopermetrc Inequaltes 1 Four Questons Recall that n the last lecture we looked at the problem of sopermetrc nequaltes n the hypercube, Q n. Our noton of boundary
More informationBezier curves. Michael S. Floater. August 25, These notes provide an introduction to Bezier curves. i=0
Bezer curves Mchael S. Floater August 25, 211 These notes provde an ntroducton to Bezer curves. 1 Bernsten polynomals Recall that a real polynomal of a real varable x R, wth degree n, s a functon of the
More informationSupplementary material: Margin based PU Learning. Matrix Concentration Inequalities
Supplementary materal: Margn based PU Learnng We gve the complete proofs of Theorem and n Secton We frst ntroduce the well-known concentraton nequalty, so the covarance estmator can be bounded Then we
More informationAdvanced Quantum Mechanics
Advanced Quantum Mechancs Rajdeep Sensarma! sensarma@theory.tfr.res.n ecture #9 QM of Relatvstc Partcles Recap of ast Class Scalar Felds and orentz nvarant actons Complex Scalar Feld and Charge conjugaton
More informationBACKGROUND: WEAK CONVERGENCE, LINEAR ALGEBRA 1. WEAK CONVERGENCE
BACKGROUND: WEAK CONVERGENCE, LINEAR ALGEBRA 1. WEAK CONVERGENCE Defnton 1. Let (X,d) be a complete, separable metrc space (also known as a Polsh space). The Borel σ algebra on X s the mnmal σ algebra
More informationRandomness and Computation
Randomness and Computaton or, Randomzed Algorthms Mary Cryan School of Informatcs Unversty of Ednburgh RC 208/9) Lecture 0 slde Balls n Bns m balls, n bns, and balls thrown unformly at random nto bns usually
More informationErrors for Linear Systems
Errors for Lnear Systems When we solve a lnear system Ax b we often do not know A and b exactly, but have only approxmatons  and ˆb avalable. Then the best thng we can do s to solve ˆx ˆb exactly whch
More information