arxiv: v3 [math-ph] 21 Jun 2012

Transcription

1 LOCAL MARCHKO-PASTUR LAW AT TH HARD DG OF SAMPL COVARIAC MATRICS CLAUDIO CACCIAPUOTI, AA MALTSV, AD BJAMI SCHLI arxiv: v3 [math-ph] 2 Jun 202 Abstract. Let X be a matrix whose entries are i.i.d. complex random variables with mean zero and variance. We study the asymptotic spectral distribution of the eigenvalues of the covariance matrix XX for. We prove that the empirical density of eigenvalues in an interval [,+η] converges to the Marchenko-Pastur law locally on the optimal scale, / log b, and in any log b interval up to the hard edge, 4 κ, for any κ > 0. As a consequence, we show the complete delocalization of the eigenvectors.. Introduction Let X be a M matrix with entries x ij = Rex ij +iimx ij. We assume that Rex ij and Imx ij are independent identically distributed real random variables with mean zero and variance /2 so that x ij = 0 and x ij 2 = i =,...,, j =,...,M, In what follows we shall denote by X the scaled matrix. X = X/. We denote by ν the probability distribution of Rex ij and Imx ij. Let s α, α =,...,, be the eigenvalues of X X. Since X X is positive definite we can assume that 0 s s 2 s. The results of this paper extend easily to X having real entries; to simplify the notation, we will consider in the following only the case of complex entries. Assume d = lim/m > 0 and let λ ± = ±d 2. Marchenko and Pastur showed in [9] the convergence of the density of the eigenvalues s,...,s towards the Marchenko-Pastur law.2 ρ MP = λ+ λ 2π 2, whenever [λ,λ + ] and 0 otherwise. In this paper, we will be interested in the case d =. In this case the Marchenko-Pastur law is supported on the interval [0,4] and is given by ρ MP = 2π 4 It has therefore a /2 singularity close to the origin = 0. This reflects the fact that the typical distance between eigenvalues is of order / rather than /, as it is in the bulk; for this reason, = 0 is known as the hard edge of the sample covariance matrix X X soft edges are instead characterized by the fact that the typical distance between neighbouring eigenvalues is larger than in the bulk. While the result of [9] determines the convergence to.2 on intervals of order one, containing typically order eigenvalues, in the present paper we establish the convergence of the density of states locally, on intervals containing typically a bounded number of eigenvalues, independent of. In particular, we consider intervals close to the hard edge = 0. As a direct consequence of the local validity of the Marchenko-Pastur law, we obtain the complete delocalization of the eigenvectors 200 Mathematics Subject Classification. 60B20, 60B2, 47B80. Key words and phrases. Random matrices, covariance matrices, Marchenko-Pastur law, density of states, delocalization.

2 2 associated to eigenvalues up to the edge. A further possible application of our results consists in establishing the universality of the local eigenvalue correlations close to the hard edge; this can be obtained following the receipt of [7], making use of the result of [2], in the case of complex entries, or similarly to [2, 3], using the method of the local relaxation flow, for both X having real or complex entries. We observe, however, that the universality of the local eigenvalue correlations close to the hard edge where they can be described in terms of the so called Bessel kernel has already been established, using a different approach, in [22]. In the last years, a lot of progress was achieved in the spectral analysis of random matrices. Local convergence of the density of states of Wigner matrices to the semicircle law and delocalization of the eigenvectors has been established in [9, 0,, 5]. Universality of the local eigenvalue correlations was proven for Wigner ensembles with arbitrary symmetry real symmetric, hermitian, or quaternion hermitian ensembles in [2, 5]. This result was obtained by the introduction of the local relaxation flow, a flow for the eigenvalues of the Wigner matrix with the property of fast relaxation to equilibrium and such that, locally, it remains close to the Dyson Brownian motion described by the eigenvalue when the entries are evolved by independent Brownian motions. For ensembles of hermitian Wigner matrices, universality was proven earlier in [7, 23, 8]. In all these proofs of universality, the local convergence of the density of states was a crucial ingredient. Universality at the edge of Wigner matrices was proven in [2] and more recently in [24,, 5, 7]. For sample covariance matrices with 0 < d <, local convergence to the Marchenko-Pastur law and universality of the local eigenvalue correlations were determined in thebulk [3, 25] and at the soft edge [26,, 20]. More recently, local convergence of the density of states and delocalization results have also been obtained for more structured ensembles, such as the adjacency matrices of rdős-rényi graphs [4, 5] and band matrices [6]. In this paper, we focus on the hard edge of sample covariance matrices, proving the local convergence of the density of states to the Marchenko-Pastur law on the optimal scale up to logarithmic corrections. As a consequence, we obtain complete delocalization of the eigenvectors associated with eigenvalues close to the hard edge. After the completion of our work, we learned that, independently from us, Bourgade, Yau and Yin study in [3] the convergence of the density of the eigenvalues of a random matrix X with no symmetry constraints towards the circular law, on optimal scales. The basic ingredient of their proof is the study of the spectrum of the hermitization X z X z. In particular, for z = 0, they obtain results similar to ours for the eigenvalues of sample covariance matrices. An important object used in the proof of the local validity of the Marchenko-Pastur law is the Stieltjes transform defined for any θ C with Im θ > 0 by.3 θ = TrX X θ = s α θ. In a similar way, one defines θ to be the Stieltjes transform of the Marchenko Pastur distribution. In the case d = that will be considered in this paper.4 θ = x θ ρxdx = θ. R Local convergence towards the Marchenko-Pastur law follows from the convergence of towards. To simplify our analysis, we will assume that ν has subgaussian decay, i.e., that there exists δ 0 > 0 such that.5 e δ 0x 2 dνx <. R This condition is needed to apply a version of a theorem of Hanson and Wright as formulated in [, Prop. 4.5], see also Proposition 2.2 below. At the price of getting weaker convergence rates, this assumption can be substantially relaxed existence of sufficiently high moments is sufficient. Furthermore, we assume that probability density function of the real and imaginary parts of the α=

3 entries is bounded; this will simplify the study of the eigenvalues located very close to the origin. Also in this case, improvements are certainly possible. 3 Our first result is a proof of a bound on the number of eigenvalues s α in a window I = [, + η], valid up to the hard edge and for small η s.t. / log b, b > 2. The proof of the following theorem can be found in Section 3. Theorem. Let X be a matrix as described in., whose entries satisfy.5. Let I = [, +η] with / log b, for some b > 2. Denote by I the number of eigenvalues of X X in I. Then there exist constants c,c,k 0 > 0 such that, for any K K 0 and large enough,.6 P I K e c K η. Using the a priori bound in Theorem we prove the convergence of the Stieltjes transform +iη of the sample covariance matrices towards the Stieltjes trasnform + iη of the Marchenko-Pastur law, up to the hard edge, and close to the real axis. Theorem 2. Let X be a matrix as described in., whose entries satisfy.5. Assume moreover that the probability density function of the real and imaginary part of the entries is bounded. Moreover set θ = + iη, with 4 κ, 0 < η < κ, / log b, for some b > 4 and 0 < κ < these bounds also imply that log 2b /κ 2. Then there exist ε 0 > 0, c > 0 such that for 0 < ε < ε 0 and large enough, P θ θ ε e cε +e clogb/4. The proof of this theorem is in Section 5. The convergence of the Stieltjes transform immediately implies the convergence of the density of states. Theorem 3. Let X be a matrix as described in., whose entries satisfy.5. Assume moreover that the probability density function of the real and imaginary part of the entries is bounded. Suppose 4 κ, 0 < η < κ, / log b, for some b > 4 and 0 < κ <, and let I = [, +η]. Then there exist ε 0 > 0, C,c > 0 such that for 0 < ε < ε 0 and large enough, I.7 P η +η dsρs ε Ce cε2 +Ce clogb/4. The proof of Theorem 3 can be obtained from Theorem 2, similarly as in [9, Cor. 4.2]. Finally, Theorem 3 implies complete [ delocalization ] of the normalized eigenvectors of X X associated with eigenvalues in the window log b,4 κ, for any κ > 0. κ 2 Theorem 4 Delocalization. Let X be a matrix as described in., whose entries satisfy.5. Assume moreover that the probability density function of the real and imaginary part of the entries is bounded. Fix 0 < κ <, b > 4. Then there exist constants c, C > 0 such that and for large enough,.8 [ log P u s.t. XX 2b ] u = su, u =, s κ 2,4 κ and u C logb 2 e clogb Basic definitions and results In this section we collect several definitions and results which will be used to prove the main theorems.

4 4 2.. A formula for. The proofs of Theorems and 2 rely on the following formula for the diagonal components of the resolvent X X θ see [3] X X θ kk = 2. w k 2 θ wk W k W k W k θ W k w k =. θ +wk Wk Wk θ wk where w k = x k / is the k-th column of the matrix X and W k denotes the matrix obtained by removing the k-th column from the matrix X notice that W k W k is the minor of X X, obtained by removing the k-th row and the k-th column. We used here the wellknown identity W k W k W k θ W k = W k W kw k W k θ valid for Im θ 0, which can be proved using the eumann expansion of the resolvent. q. 2. gives the following formula for the Stieltjes transform θ: θ = k=. θ +wk Wk Wk θ wk 2.2. Properties of. We collect here some properties of the Stieltjes transform θ of the Marchenko- Pastur distribution ρ MP, defined by 2.2 θ = dx x θ ρ MPx = θ R where we use the branch of the square root with Re 4/θ 0. We use the fixed point equation 2.3 θ θ+ = θ. Lemma 2.. Let θ = +iη, with η > 0. Then 2.4 θ 2 and + θ 2 max Moreover 2.5 Im θ C 4 /2 +η /2 2 +η 2 /4 { } 2 +η 2, 4 if 2 +η 2 4 this condition defines a circle of radius 2 around,η = 2,0. Proof. From 2.3, taking the imaginary part, we get 2.6 Im 2 = ηre+ 2. q. 2.2 implies that Re + > 0. Since Im + iη > 0 for η > 0, together with 2.6, this implies the first bound in 2.4. To get the second bound in 2.4 we first notice that by 2.2, Re+ > /2. This implies immediately that + 2 > /4. The bound + 2 > / 2 +η 2 follows instead from 2.3, combined with 2 /. To show 2.5, we observe that, from 2.2, Im = 2 Im 4 θ 4 4 θ C 4 /2 +η /2 2 +η 2 /4 under the assumption that 2 +η 2 < 4. Here we used the fact that Im z z /2 / 2, if Re z 0 and Im z 0.

5 2.3. Large deviations of quadratic forms. We will make use of the following inequality for the fluctuations of quadratic forms, due to Hanson and Wright. For the proof of the next proposition we refer to [, Prop. 4.5], see also [4, App. B] and [6]. Proposition 2.2. For j =,..., let x j = Re x j +iim x j, where {Re x j,im x j } j= is a sequence of 2 real iid random variables, whose common distribution satisfies.5. Let A = a ij be a complex matrix. Then there exist constants c,c > 0 such that, for any δ > 0 P a ij x i x j x i x j δ Ce cmin{δ/ TrA A,δ 2 /TrA A}, i,j= The following proposition is a consequence of the Hanson-Wright inequality. Its proof can be found, for example, in []. Proposition 2.3. Let {v α } m α= be a set of m orthonormal vectors in C and x = x,...,x C, where {Re x j,im x j } j= are 2 real iid random variables satisfying.5 such that x j = 0, and x j 2 =. Then there exist two constants c,c > 0 such that m P x v α 2 m Ce cm. 2 α= 3. Upper bound for the number of eigenvalues: Proof of Theorem Recall that I = [, +η], and that I denotes the number of eigenvalues of the matrix X X in I. We have η 2 I = s α [, +η] C s α 2 +η 2 = CηIm s α iη α= α= = CηIm TrX X iη = CηIm = CηIm k= α= XX iη k=. θ +wk Wk Wk θ wk where we put θ = +iη and we used 2.. Using the spectral decomposition of W k Wk, we find I CηIm C k= C 2 η 2 k= + α= θ α=0 w k v α k 2 + s k α w k v α k 2 α= s k α θ k= s k α w k v k α 2 s k α 2 +η 2 α:s k α [,+η] w k v k where, in the second inequality, we used the fact that Im /z / Im z. Setting K = 2C /2, it follows that I K unless there exists k {,...,}, with α:s k α [,+η] α 2 w k v k α 2 I 4 kk 5

6 6 In other words, P I K = P I K and k {,...,} with α:s k α [,+η] w k v α k 2 I 4 Since Wk W k is a minor of X X, it follows that its eigenvalues are interlaced between the eigenvalues of X X. This implies that {α : s k α [, +η]} I I 2 on the event we consider. Proposition 2.3 applied with =,η = 0 implies therefore that P I K Ce c K c K Ce after adjusting the constants. This concludes the proof of Theorem. 4. An estimate for the number of eigenvalues close to zero In this section, we show that, with high probability, there cannot be too many eigenvalues at distances smaller than / from 0. To this end, we need the boundedness of the probability density function of the entries. We use here the notation [a,b] to indicate the number of eigenvalues in [a,b]. Proposition 4.. Let X = x ij / be a matrix as described in equation.. Assume that the probability density function hx of Re x ij and Im x ij is bounded. Then there exists a constant C,c > 0 such that 4. P [0, K ] 2 L Ce L for all L > ck. Proof. We start with the observation that ext, we notice that P[0,K/ ] L = P[0,K/ ]/L p [0,K/ ]/L p [0,K/ ] CK k= where we set θ = K 2 +ik 2. This implies that [0,K/ p ] CK p L L by Hölder inequality. Hence k= P[0,K/ ] L ImX X θ kk p ImX X θ kk CK p L ImX X θ k= CK p ImX L X θ p CK p L CK L θ +θ w v α 2 α=0 s α θ p α=0 c α x v α p 2 p kk p

7 where we neglected the real part of the denominator and we defined x = w it is a vector in C, whose components have iid real and imaginary parts with zero mean and variance /2, and 4.2 c α = s α /K 2 + We recall that the eigenvalues s α and s α are ordered in increasing order. On the event [0,K/ ] L, the interlacing property implies that at least L eigenvalues of the minor are in the interval [0,K/ ]; i.e. s α [0,K/ ] for α = 0,...,L. This implies that c α /2 for all α =,...,L. Therefore 2CK p P[0,K/ ] L L L α=0 x v α p 2 ext, we take p = L 2/2. Since the matrix entries are assumed to have a bounded probability density function, Lemma A. of [8] implies that x L k= x v α 2 L 2/2 C for C > 0 indpendent of L. This concludes the proof of the proposition. 5. Convergence of the Stieltjes transform: Proof of Theorem 2 We start from the formula 2., rewritten as 5. = which immediately implies that θ + = θ + + Ω k k= k= Ω k / θ+ +Ω k / + Here we defined the error terms Ω k = w k W kw k θ w k TrW kw k θ + TrW kwk θ TrX X θ Observe that, with probability one, 5.3 TrX X θ TrW kwk θ C. This follows from TrW kwk θ = θ + TrW k W k θ and from the interlacing of the eigenvalues of Wk W k between the eigenvalues of X X. To estimate the first difference in the error Ω k, we notice that wk w k W kw k θ w k = TrW kw k θ Therefore, defining the matrix A = a ij, with a ij = α v α iv α j s k α θ 7

8 8 and the vector x = w k = x,...,x this is a vector in C, whose components are order one random variables, we find wk W kwk θ w k TrW kwk θ = a ij x i x j x x i x j ij and therefore taking into account also 5.3 P Ω k ε P a ij x i x j x x i x j ε Observe that ij TrA A = α s k α θ 2 In Lemma 5., we show that, up to an event with probability at most e clogb/4, TrA A C Therefore, Proposition 2.2 implies that and thus 5.4 P max Ω k ε k=,..., P Ω k ε Ce clogb/4 +Ce cε Ce clogb/4 +Ce cε after adjusting the constants. We restrict now our attention to the event Ω k ε for all k =,...,. To complete the proof of Theorem 2, we use a continuity argument. We fix κ > 0, and consider θ = +iη C with 0 < < 4 κ, 0 < η < κ, / log b. We connect θ with the point θ 0 = 2+2iκ. Let L denote the line segment connecting θ and θ 0. ote that, on L, 2 2 +η 2 4 always holds. Hence, Lemma 2. implies that, on L, Im > C 0 / for a constant C 0 depending only on κ C 0 can be chosen as const κ /2 /+κ 2 /4. We claim now that, if C 0 /2 somewhere on L, then Cε/ where C depends only on κ. In fact, Im > C 0 / and C 0 /2 imply that Im > C 0 /2. This implies for ε < C 0 /4 that Im +Ω k / C 0 /4. Hence 5.2 gives + θ + 8ε C0 2 Subtracting the fixed point equation +/θ + = 0, we find + 8ε + C0 2 Therefore 8ε + C ε C 2 0 ] + [ + > < ε + C0 2 C 0 where we used that, on L, Im > C 0 / and / see Lemma 2.. Theorem 2 follows because, from [9], +2iκ 2+2iκ C 0 /2 2 for large enough. This completes the proof of Theorem 2.

9 Lemma 5.. Let X = x ij / be an M matrix as defined in.. Denote by s α the eigenvalues of X X. Assume the real and imaginary part of the entries x ij are iid random variables with a common bounded probability density function. Let θ = + iη, with η and / log b. Then there exist constants C,C 2,c > 0 with 5.5 P Proof. We clearly have P α= s α θ 2 C α= s α θ 2 C P +P +P C 2 e clogb/4. s α θ 2 C 3 α:s α log b / α:s α [log b /,/2] α:s α>/2 s α θ 2 C 3 s α θ 2 C = I+II+III 3 We start by controlling the term I. To this end, note that s α θ 2 η 2 [0,logb / ] α:s α log b / where, as usual, [a,b] denotes the number of eigenvalues of X X in the interval [a,b]. Hence, by Prop. 4., I P [0,log b / ] C c Ce Ce clog b 3 for appropriate constants C,c > 0. ext, we consider the term II. We have α:s α [log b /,/2] s α θ 2 k 0 k=2 [2 k,2 k+ ] 2 where k 0 > 0 is chosen as the smallest integer with 2 k 0 log b /. From Theorem, it follows that, for a sufficiently large K > 0, [2 k,2 k+ ] C2 k/2 up to an event of probability at most exp c2 k/2 /2. This implies that, apart from an event of total probability bounded by we have k 0 k=2 e c 2 k/2 k 0 e c 2 k 0 /2 k 0 e clogb/4 e c/2logb/4 α:s α [log b /,/2] s α θ 2 C k 0 k=2 2 k/2 2 C C where we used the assumption η. Finally, we have to control the term III. To this end, we observe that s α θ 2 s α 2 +η 2 Ik 2 2k η 2 α:s α>/2 α:s α>/2 k 0 9

10 0 where we set I k = J k [/2,, with J k = [ 2 k η, 2 k η] [+2 k η,+2 k η] for k and J 0 = [ η, +η]. Observe that, by Theorem, Ik C 2k up to an event with probability at most 2 k e c e clog b/4 Therefore, e c α:s α>/2 s α θ 2 2 k 2 2k η 2 C apart from an event with probability at most e clogb/4. This completes the proof of the lemma. k 0 6. Delocalization: Proof of Theorem 4 Denote by {s α } α= the eigenvalues of the matrix X X with s... s and by {u α } α= the corresponding set of orthonormal eigenvalues. From the equation X X u α = s α u α and the condition u α 2 = it follows that see also [25, Cor. 25] and [0, 9] u α k 2 = + β= s k β uk β x k 2 s α s k β 2 where x k = w k and w k denotes the k-th column of the matrix X, while s k β and u k β are the eigenvalues and the corresponding eigenvectors of the matrix Wk W k, where the matrix W k is obtained by removing the k-th column from the matrix X. For arbitrary η > 0, we have u α k 2 2 s α β:s k β [sα,sα+η] uk β x k 2 Taking η = s logb, Theorem 3 implies that {s k β [s α,s α +η]} Clog b up to an event with probability smaller than e clogb. Prop. 2.3 implies then that k β x k 2 logb 2 β:s k β [sα,sα+η] u apart from an event with probability smaller than e clogb. This implies that P u α k 2 logb Ce clogb Taking the maximum over k, Theorem 4 follows. References [] A. Auffinger, G. Ben Arous, S. Péché: Poisson convergence for the largest eigenvalues of heavy-taled matrices. Ann. Inst. Henri Poincaré: Probab. Stat , o. 3, [2] G. Ben Arous and S. Péché: Universality of local eigenvalue statistics for some sample covariance matrices. Comm. Pure Appl. Math , o. 0, [3] P. Bourgade, H.-T. Yau and J. Yin: Local circular law for random matrices. [4] L. rdős, A. Knowles, H.-T. Yau and J. Yin: Spectral Statistics of rdős-rényi Graphs I: Local Semicircle Law. Preprint arxiv: [5] L. rdős, A. Knowles, H.-T. Yau and J. Yin: Spectral Statistics of rdős-rényi Graphs II: igenvalue Spacing and the xtreme igenvalues. Preprint arxiv:

11 [6] L. rdős, A. Knowles, H.-T. Yau and J. Yin: Delocalization and Diffusion Profile for Random Band Matrices. Preprint arxiv: [7] L. rdős, S. Péché, J. Ramírez, B. Schlein and H.-T. Yau: Bulk Universality for Wigner Matrices. Comm. Pure Appl. Math , o. 7, [8] L. rdős, J. Ramírez, B. Schlein, T. Tao, V. Vu and H.-T. Yau: Bulk Universality for Wigner Hermitian matrices with subexponential decay. Math. Res. Lett , o. 4, [9] L. rdős, B. Schlein and H.-T. Yau: Semicircle law on short scales and delocalization of eigenvectors for Wigner random matrices. Ann. Probab , o. 3, [0] L. rdős, B. Schlein and H.-T. Yau: Local semicircle law and complete delocalization for Wigner random matrices. Comm. Math. Phys , o. 2, [] L. rdős, B. Schlein and H.-T. Yau: Wegner estimate and level repulsion for Wigner random matrices. IMR , o. 3, [2] L. rdős, B. Schlein and H.-T. Yau: Universality of random matrices and local relaxation flow. Invent. Math , no., [3] L. rdős, B. Schlein, H.-T. Yau and J. Yin: The local relaxation flow approach to universality of the local statistics for random matrices. Ann. Inst. H. Poincaré B: Probab. Statist , 46. [4] L. rdős, H.-T. Yau and J. Yin: Bulk universality for generalized Wigner matrices. Preprint arxiv: [5] L. rdős, H.-T. Yau and J. Yin: Rigidity of igenvalues of Generalized Wigner Matrices. Preprint arxiv: [6] D.L. Hanson and F.T. Wright: A bound on tail probabilities for quadratic forms in independent random variables. Ann. Math. Statist , [7] J. O. Lee, J. Yin: A ecessary and Sufficient Condition for dge Universality of Wigner matrices. Preprint arxiv: [8] A. Maltsev, B. Schlein: Average density of states of Hermitian Wigner matrices. Adv. Math , o. 5, [9] V.A. Marčenko, L. A. Pastur: Distribution of eigenvalues in certain sets of random matrices. Mat. Sb..S , [20]. Pillai and J. Yin: Universality of covariance matrices. Preprint arxiv: [2] A. Soshnikov: Universality at the edge of the spectrum in Wigner random matrices. Comm. Math. Phys , o. 3, [22] T. Tao and V. Vu: Random Matrices: the Distribution of the Smallest Singular Values. GAFA , o., [23] T. Tao and V. Vu: Random matrices: Universality of local eigenvalue statistics. Acta Math , o., [24] T. Tao and V. Vu: Random matrices: universality of local eigenvalue statistics up to the edge. Comm. Math. Phys , o. 2, [25] T. Tao and V. Vu: Random covariance matrices: Universality of local statistics of eigenvalues. Preprint arxiv: [26] K. Wang: Random covariance matrices: Universality of local statistics of eigenvalues up to the edge. Preprint arxiv: Hausdorff Center for Mathematics, Institute for Applied Mathematics, University of Bonn, ndenicher Allee 60, 535 Bonn, Germany -mail address: CACCIAPUOTI@HCM.UI-BO.D -mail address: AAVMALTSV@GMAIL.COM -mail address: BJAMI.SCHLI@HCM.UI-BO.D