arxiv: v1 [math.pr] 30 Nov 2017

Transcription

1 REGULARIZATIO OF O-ORMAL MATRICES BY GAUSSIA OISE - THE BADED TOEPLITZ AD TWISTED TOEPLITZ CASES AIRBA BASAK, ELLIOT PAQUETTE, AD OFER ZEITOUI arxiv:7242v [mathpr] 3 ov 27 Abstract We consider the spectrum of additive, poynomiay vanishing random perturbations of deterministic matrices, as foows Let M be a deterministic matrix, and et G be a compex Ginibre matrix We consider the matrix M = M + γ G, where γ > /2 With L the empirica measure of eigenvaues of M, we provide a genera deterministic equivaence theorem that ties L to the singuar vaues of z M, with z C We then compute the imit of L when M is an upper trianguar Toepitz matrix of finite symbo: if M = d i= a ij i where d is fixed, a i C are deterministic scaars and J is the nipotent matrix Ji, j) = j=i+, then L converges, as, to the aw of d i= a iu i where U is a uniform random variabe on the unit circe in the compex pane We aso consider the case of sowy varying diagonas twisted Toepitz matrices), and, when d =, aso of iid entries on the diagonas in M Introduction Write G for an random matrix whose entries are iid standard compex Gaussian variabes a Ginibre matrix), and et {M } = be a sequence of deterministic matrices Consider a noisy counterpart given by ) M := M + γ G, where γ /2, ) is fixed, noting that by standard estimates, see [3, Coroary 2], 2) γ G as, where denotes the operator norm Let λ i, i =,, denote the eigenvaues of M, and et 3) L := denote the associated empirica measure In this paper, we study the convergence of L for a cass of matrices M Main resuts For a probabiity measure µ on C which integrates the og function at infinity, and z C, denote the Logarithmic potentia associated with µ by 4) L µ z) := og z y µdy) i= δ λi The importance of the ogarithmic potentias ies in the fact that the pointwise convergence of L µn z) to a imit L µ z) impies the weak convergence µ n µ Our first main resut is a deterministic equivaence theorem for L L z) We formuate here a simpified version under more stringent conditions than necessary, and refer to Theorem 2 for the genera statement, which aso has an expicit description of the functions g appearing in the statement of Theorem Let Id = Id stand for the identity matrix of dimension Let J = J denote the nipotent matrix with J ij = j=i+ for i < j Partiay supported by grant 47/5 from the Israe Science Foundation

2 2 A BASAK, E PAQUETTE, AD O ZEITOUI 2 γ = 75 γ = 75 γ = 4 γ = 75 γ = 75 γ = γ = 75 γ = 75 γ = Figure The eigenvaues of M, with = 4 and various γ On the top eft, M = J + J 2 On the top right, M = D + J with D i, i) = + 2/ On the bottom, M = D + J with D iid uniform on [ 2, 2] Theorem Fix γ > /2 Let s z) denote the number of singuar vaues of M z Id smaer than γ+/2+δ, where < δ Suppose s z) og / Then, there exist expicit, deterministic functions g z) so that LL z) g z) The importance of Theorem and its more eaborate version, Theorem 2) ies in the fact that it reduces the question of weak convergence of the random empirica measure L to computations invoving the deterministic matrices M Sti, these computations are, in genera, non-trivia The other resuts in this paper are instances in which these computations can be carried through and the imit of L can be described expicity Our second main resut deas with upper trianguar Toepitz matrices of finite symbo, that is banded upper trianguar Toepitz matrices Pd Theorem 2 Let ai, i =,,, d be compex deterministic) numbers Let M := i= ai J i, and et Pd M and L be as in ) and 3) Then L converges weaky in probabiity to the aw of i= ai U i, where U is uniformy distributed on the unit circe A generaization of Theorem 2 to the twisted Toepitz setup appears in Section 4, see Theorem 4 there As the next theorem shows, in the case of two diagonas in M more can be said For x, x2 R we denote x x2 := max{x, x2 }

3 REGULARIZATIO OF O-ORMAL MATRICES 3 Theorem 3 Let D be a diagona matrix with entries d i, set M = D + J and et M be as in ) a) Let d i be iid random variabes of aw ν supported on a subset of a simpy connected compact set with Lebesgue area Then L converges weaky in probabiity to a measure µ characterized by L µ z) = E ν og z d ) b) Let f : [, ] C be Höder-continuous and set d i = fi/n) Then L converges weaky in probabiity to a probabiity measure µ satisfying µ = unif fz), dz, where unif a,b denotes the uniform aw on a circe in the compex pane of radius b and center a See Section 3 for detais and further exampes, and note that Theorem 3 a) is Coroary 36, whie Theorem 3 b) is Coroary 39 An iustration of Theorems 2 and 3 is provided in Figure Remark 4 We chose to consider throughout the paper ony the case of perturbation matrices G which are compex Ginibre matrices We beieve that the resuts shoud carry over in a rather straightforward way to the case of rea Ginibre matrices, and with a significant effort to the iid setup, in the same spirit as [2] To avoid additiona technicaities, we did not pursue these extensions here 2 A Thouess type formua Both Theorems 2 and 3a) can aso be formuated in terms of Lyapunov exponents Consider the vector space V := {x R : M z Id)x) j =, j d} This space is d dimensiona Further, to find x V, having chosen x, x 2,, x d, one can sove for the remaining entries of x using the equations M z Id)x) j = for j d to propagate the soution Concisey, we can find d d transfer matrices T j z)) d so that for a j d x ) j+d =j+ = T jz) x ) j+d =j For detais, see Definition 5; for the exposition here, the expicit form of this matrix wi not be necessary In the setup of Theorem 2, these matrices wi a be identica In the setup of Theorem 3 part a), the matrices wi be iid scaars In either case, the sequence T j z)) d is stationary, and we can consider the Lyapunov spectra as the set of vaues { {µ z), µ 2 z),, µ d z)} := im n } n og T nz)t n z) T z)v : v C d In the setup of Theorem 3 part a), there is a singe Lyapunov eigenvaue, given by µ z) = E og d z This aows us to write that L L z) µ z) In the setup of Theorem 2, if we set P x) = d i= a ix i we have that L L z) 2π og P e iθ ) z dθ 2π d On the other hand, factorizing P x) z = a d i= x λ iz)), we can write 2π og P e iθ ) z dθ d 2π = og λ i z) ) ) Furthermore, in the Toepitz case, the eigenvaues of T j z) = T z) are just the roots of the symbo P x), and the Lyapunov spectra are nothing but og λ i z) for i d Hence, we have that in both Theorem 3 part a) and Theorem 2, d L L z) µ i z) ) i= i=

4 4 A BASAK, E PAQUETTE, AD O ZEITOUI Figure 2 umerica evauation of eigenvaues of U M U with U Haar-distributed unitary and = On the top eft, M = J + J 2 On the top right, M = D + J with D i, i) = + 2/ On the bottom, M = D + J with D iid uniform on [ 2, 2], = 4 The computation was performed in Scipy with a 64-bit foating point precision ote the simiarity with Figure A simiar resut had appeared previousy in the study of the Thouess formua for the strip [4, Theorem 24] For the twisted Toepitz cases such as in Theorem 3 part b)), the formua must be repaced by an average over oca Lyapunov exponents 3 Background, previous resut, and strategy The fact that the spectrum of non-norma matrices and operators is not stabe with respect to perturbations is we known, see eg [5] for a recent study To iustrate the issue, we attach in Figure 2 an actua simuation of U M U where M is as in Figure and U is a random Haar-distributed unitary matrix Whie the spectrum of M is rea, the numerica simuations produce errors that make the spectrum ook simiar to the one for the noisy perturbed mode M, compare with Figure The notion of pseudospectrum, which deas with worse case perturbations, is one way of quantifying the instabiity of the spectrum, see [2] for an extensive background and appications in numerica anaysis and beyond Our work is an attempt to address the same issue from a typica perturbation point of view, and in this sense continues the ine of research initiated in [9, 2] and [6], which we now describe

5 REGULARIZATIO OF O-ORMAL MATRICES 5 In [9], the authors consider the case where M converges in -moments, that is, there exists an operator a in a non-commutative probabiity space A, tr) so that for any non commutative poynomia P, tr P M, M ) tr P a, a ) Under a reguarity assumption on a and the existence of poynomiay vanishing perturbations of M with empirica measure converging to the spectra measure µ a associated with a, they show that L converges to µ a in probabiity They further show that their assumptions are satisfied when M = J The paper [2] shows that this resut is stabe in the sense that repacing G by a matrix with iid entries satisfying mid assumptions does not change the resut The proofs in [9] and [2] contros the og potentia of M by methods inspired by free probabiity, and in particuar breaks down if the -moment imit does not coincide with the imit of L Further, in [9] one can find an exampe of a matrix M with ony one non-zero diagona) where the atter is indeed the case - namey, M i, j) = Ji, j) j mod og In [6], the authors consider the atter situation and prove a imit theorem, where the imit does depend on γ The method of proof is very different from [9, 2] - it invoves a combinatoria anaysis of det M z) where M z) := M z Id oting that L L z) = og det M z), concentration of measure arguments then identify the terms contributing to the determinant Our approach in this paper is reated to [6] in that we aso compute detm z)) However, our starting point is to reate the atter to a truncation of M z) = M z Id, where the owest ying singuar vaues of M z) are eiminated we refer to this as a deterministic equivaent mode, using terminoogy borrowed from []) The eve of truncation depends on γ, which parametrizes the strength of the perturbation Once this step has been estabished, we can study the sma singuar vaues of M z) using transfer-matrix techniques, in case M is Toepitz with a finite symbo or a sowy-varying version of such a matrix This anaysis was not present in [9, 6, 2] and seems to be new in the context of the stabiity that we study We note that other approaches to the study of perturbations of non-norma operators exist In particuar, Sjöstrand and Voge [5], [6] identify the imit of the empirica vaue of a random perturbation of a banded Toepitz matrix with two non-zero diagonas, one above and one beow the main diagona Their methods, which are quite different from ours, are imited to γ > 5/2, and yied more quantitative estimates on the empirica measure and its outiers The structure of the paper is as foows In the next section, we introduce and prove the deterministic equivaence Various standard agebraic facts needed for the proofs are coected in Appendix A Section 3 presents the anaysis of the deterministic equivaent mode in the case where ony two diagonas are present; the atter restriction simpifies the anaysis because transfer matrices reduce to a scaar in that case Section 4 treats the case of d >, and reduces the twisted Toepitz case to piecewise-constant twisted Toepitz matrices, described in Theorem 44 The proof of the atter appears in Section 5 4 otation We use throughout the foowing standard notation For two rea-vaued sequences {a n } and {b n } we write a n = ob n ) if im sup n b n /a n =, a n = Ob n ) if im sup n b n / a n <, and a n b n if im sup n a n / b n = For any x R, we denote x := min{x, } and x + := max{x, } For any x >, we denote og + x) := ogx)) + For x, x 2 R we denote x x 2 := max{x, x 2 } and x x 2 = min{x, x 2 } We use e j to denote the standard unit vector, a of whose entries are except for at the j-th entry For two random variabes X i, i =, 2, we write X L = X2 to denote that X and X 2 have the same aw For any matrix M, denote by M 2 := [TrMM )] /2 its Hibert-Scmidt norm, and for any vector v denote by v 2 its Eucidean norm Acknowedgement We thank ick Trefethen for usefu discussions and exampes that motivated this study, and in particuar for urging us to consider the twisted Toepitz case 2 The deterministic equivaent Let Σ M z)) be the diagona matrix of singuar vaues of M z) := M z Id Suppose the entries of Σ M z)) are arranged to be non-decreasing going down the diagona That is, Σ ii z) = σ i+ M z)) for i [] := {, 2,, }, where Σ ii z) is the i-th diagona entry of Σ M z)), and σ i M z)) is the

6 6 A BASAK, E PAQUETTE, AD O ZEITOUI i-th argest singuar vaue of M z) By invariance of the Gaussian matrix, detz Id M ) L = detσ M z)) + γ G ) Suppose that Σ M z)) is decomposed into two bocks of sizes + 2 =, so that ) ) S M 2) Σ M z)) := z)), and γ X X G B M z)) := 2 X 3 X 4 For ease of writing, when the matrix M is cear from the context, we simpy write Σ z), S z), and B z) instead of Σ M z)), S M z)), and B M z)) ow by the Schur compement formua, 22) detσ z) + γ G ) L = detb z) + X 4 ) det S z)), where 23) S z) := S z) + X X 2 B z) + X 4 ) X 3 This decomposition proves usefu when we choose the decomposition so that the entries of B z) are somewhat arge with respect to the noise For such a decomposition as we wi see ater see Theorem 2) the og determinant of B z) correcty characterizes the og-potentia of the imiting spectra distribution of M So we need to define B z) appropriatey Fix a sequence of {ε } going down to zero We define := z, γ, ε ) as the argest integer i so that 24) Σ ii z) < ε γ i+) /2 If no such i exists then we et = ow set = This defines B z) With this choice of B z) we have the foowing resut Theorem 2 Suppose that og / α < Then for any {ε } that tends to sowy enough that ogε )/ og, 25) og detσ z) + γ G ) og detb z) αγ 2 ), in probabiity, as If α =, we may take ε = η for any η > The proof of Theorem 2 requires a two-fod argument First we show that the truncation eve chosen above assures that X 4 is negigibe with respect to B z) In particuar, we obtain the foowing resut Lemma 22 For any given sequence of {ε }, such that ε, ) for a, we have 26) E detb z) + X 4 ) = detb z)) and 27) Var detb z) + X 4 ) ε2 ε 2 detb z))) 2 Proof Since the entries of X 4 are independent with zero mean, 26) foows from Lemma A To compute the second moment, we again use Lemma A and the fact that entries of X 4 are independent with zero mean and variance 2γ to obtain E detb z) + X 4 ) 2 = = k= k= S []\[ ] S = k k!) 2γk ) E det X 4 [Š] 2 Σ ii z) 2 S []\[ ] i S S = k i S Σ ii z) 2,

7 REGULARIZATIO OF O-ORMAL MATRICES 7 where Š := [] \ [ ]) \ S As the diagona entries of Σ z) are arranged in non-decreasing order, recaing the definition of B z) and we find that Σ ii z) 2 i S for any S [] \ [ ] with S = k Therefore, det B z) 2 ε γ), 2k ) k E detb z) + X 4 ) 2 k= The ast dispay together with 26) yieds 27) )k!) 2γk detb z)) 2 ε 2 detb z)) 2 k ε γ ) 2k ) k Remark 23 Bounding higher centered) moments of detb z) + X 4 ) and appying the Bore-Cantei emma one can strengthen the concusion of Theorem 2 and show that 25) hods amost surey This in turn shows that the concusions of the main theorems of the paper, such as Theorems 2, 3, and 44 hod amost surey We do not pursue this direction here Lemma 22 shows that if ε then the og determinant of B z)+x 4 is asymptoticay the same as that of B z) To estabish Theorem 2 we aso need to show that the og-determinant of the Schur compement, og det S z)), is asymptoticay negigibe, see 22) To this end, we obtain the foowing ower bound Proposition 24 Set Ñ := If /2, then there exist absoute constants c 2, c > so that 28) P[ det S z)) γ!)e cñ ] e c2ñ Before bringing the proof of Proposition 24, we reca the foowing emma, which is proved in [6, Lemma 44] in the rea case, but the proof carries over to the compex case) An aternative proof can be given based on [7, Theorem 4] Lemma 25 Suppose that E is a Q Q standard Gaussian matrix independent of E and a t, P[ dete + M) t] P[ det E t] Then for any Q Q matrix M We wi aso need the foowing emma, whose proof is an adaptation of the proof of [6, Lemma 25] Lemma 26 Let E be an matrix of independent compex standard Gaussians There are absoute constants c > and c 2 > so that for a, P[ det E!e c ] c e c 2 2 Proof We begin by recaing from [7] that if E is a compex Ginibre matrix of dimension matrix, then det E 2 L = χ 2 r, where χ 2 r are independent chi-square random variabes with r degrees of freedom, ie they have the distribution of the square of the ength of an r-dimensiona standard Gaussian vector ow fix a arge integer K and denote K F K := χ r r= r=

8 8 A BASAK, E PAQUETTE, AD O ZEITOUI Then, F K 2 with exponentiay in ) sma probabiity Then, proceeding as in the proof of [6, Lemma 25], we find that for a sufficienty arge K, where The rest foows from Markov s inequaity EL 2 K K!2! K!2! L K := Proof of Proposition 24 By Lemma 25, for a t r=k+ χ r P[ det S z)) t] P[ detx ) t], where X is an matrix of iid compex Gaussians of variance 2γ Hence, the desired concusion foows from Lemma 26 We turn to finding an upper bound on the determinant of S z) To this end, we first derive an upper bound on the norm of the inverse of B z) + X 4 Lemma 27 Fix {ε } such that ε < /8 for a, and assume that /2 Then, P B z) + X 4 ) 2ε γ ) /2) exp c), for some absoute constant c Proof Gordon s theorem for Gaussian matrices see [3, Coroary 2]) and the triange inequaity give E X γ Since A A is a -Lipschitz function, the standard concentration inequaity for Gaussian random variabes appies and yieds P X 4 4 γ ) exp 2c )) exp c), for some absoute constant c On the other hand, by our definition, see 24), σ min B z)) ε γ, where σ min B) denotes the minimum singuar vaue of B Since ε < /8, Wey s inequaity see [, Theorem 336c)]) gives that σ min B z) + X 4 ) 2ε ) γ, with probabiity at east exp c) This competes the proof Buiding on Lemma 27 and using a standard concentration inequaity we have the foowing resut Lemma 28 Fix {ε } such that ε < /8 for a, and assume that /2 Then there exist absoute constants c and C such that the 2 -norm of each of the rows of X 2 B z) + X 4 ) X 3 is at most with probabiity at east exp c ) Proof By the rotation invariance of X 2 and X 3, C ε γ+/2, X 2 B z) + X 4 ) X 3 L = X2 DX 3, where D is a diagona matrix with entries equa to the singuar vaues of B z) + X 4 ) Hence, a row of B z) + X 4 ) is equa in distribution to γ Dx) t X 3,

9 REGULARIZATIO OF O-ORMAL MATRICES 9 where x is an ) dimensiona standard compex Gaussian vector independent of X 3 and for any vector y the notation y t denotes its transpose From the rotation invariance of X 3, it foows that Dx) t X 3 L = Dx 2 e t X 3 The aw of Dx 2 2 is stochasticay dominated by the aw of D 2 x 2 2, and so we concude that the aw of the 2 -norm of a row of X 2 B z)+x 4 ) X 3 is stochasticay dominated by 2γ χ χ B z)+x 4 ), where {χ r } are random variabes distributed as the ength of an r-dimensiona standard compex Gaussian vector Appying Lemma 27 and standard tai bounds for χ variabes, the resut foows Using Lemma 28 we now find an upper bound on the determinant of the Schur compement Lemma 29 Fix {ε } such that ε and ε < /8 for a, and assume that /2 Then there are absoute constants c and C such that with probabiity at east exp c) det S z)) < C γ ε ) /2 Proof ote that the rows of X have 2 norm at most 2 /2 γ with probabiity at east exp c ) where c is some absoute constant By construction of the diagona matrix S z), its entries and hence the 2 norm of its rows) are bounded by ε γ+/2 It foows from these facts and Lemma 28 that the 2 norm of the rows of S z) are bounded by a constant mutipe of ε /2 γ, with probabiity at east exp c) Hadamard s bound on the determinant yieds the desired concusion Equipped with a the ingredients we are now ready to prove Theorem 2 Proof of Theorem 2 From Lemma 22, upon using Markov s inequaity we find detb z) + X 4 ) P detb z)) ) 4ε2 2 ε 2 Therefore we see that there is a set Ω, such that on Ω, we have 29) og detb z) + X 4 ) og det B z) 2 detb z) + X 4 ) detb z)), and 2) PΩ c,) 4ε2 ε 2 Since γ > /2, from Proposition 24 and Lemma 29 we aso obtain that og det S z)) og γ + 2 ) [ ) og C + og + 2 ε og ] + c + )Ñ og og C ) + og ε + 2 og/ ) 2) + γ + c + )Ñ og on an event Ω,2 such that 22) PΩ c,2) exp c) + exp c 2 Ñ) Hence when og / α <, then taking ogε ) = oog ), the desired concusion hods With ε = η and = o/ og ) we deduce from 2) that 23) og det S z)) = o), on the event Ω,2 ow combining 29)-2) and 22)-23) we see that the convergence in 25) hods in probabiity

10 A BASAK, E PAQUETTE, AD O ZEITOUI 3 Bidiagona matrices: rigidity theorems for sma singuar vectors of D + J In this section, we deveop estimates for the sma singuar vaues of the bidiagona matrix M = D + J where D = diagd, d 2,, d ) is a diagona matrix These are then used to prove Theorem 3 For a i j, et D i,j be defined by D i,j := d i <j ote that D i,i = by this definition For a i j define a vector by, for each k, k < i, 3) v i,j k := D i,k i k j, j < k The point of these vectors is that they sove M v i,j ) k = for k between the boundaries Precisey: k = i 32) M v i,j ) k = D i,j+ k = j otherwise Hence if D i,j+ is much smaer than some D i,k for i < k j, then this wi be neary a sma singuar vector, ie a singuar vector corresponding to a sma singuar vaue ote that for i k j, we have the identity 33) v i,j k+ = d kv i,j k Using the vectors v i,j we now construct approximate sma singuar vectors Fix an integer L := L, the choice of which wi be determined ater Consider integers = i < i 2 < i 3 < < i L < i L+ = The vectors { w j = v ij+,ij+ v ij+,ij+ 2, j =, 2,, L} have disjoint supports and are therefore orthogona We use these vectors as approximations for the sma singuar vectors and quantify the approximation To this end, define 34) D ij,ij+ + := max i j<s r i j+ p=s D ij,ij+ := max i j<s r i j+ p=s r { D p,r + D s,p }, and r { D p,r + D s,p We then et [ { }] 35) D := max min D ij,ij+ +, D ij,ij+ j L When D is sma, the approximation wi be good Let π j denote the coordinate projection from C to the coordinates that support w j Our main resut in this section on singuar vaues of M is the foowing Theorem 3 The L + )-st smaest singuar vaue satisfies σ L M ) D There is an absoute constant C > so that the product of the L smaest singuar vaues of M satisfies 36) C M D L L L L) L π k M w k 2 σ k M ) π k M w k 2 k= The proof of Theorem 3 is deferred to Section 32 k= } k=

11 REGULARIZATIO OF O-ORMAL MATRICES 3 Appications Theorem 3 regarding the behavior of the eigenvaues of M in the bidiagona case foows from direct appications of Theorems 3 and 2 We show now how these appications foow We begin with a particuary simpe case to consider that is not directy reated to Theorem 3 Coroary 32 Consider a Jordan bock z J z) = z z z Setting F = min{ z,, z }/2, there is a constant Cz) >, depending ony on z, so that for a, we have σ J z)) F, σ J z)) F z ) /Cz), and σ J z)) Cz) z ) Proof We appy Theorem 3 with a singe bock, ie L =, i =, and i 2 = We bound D F upon observing that D p,r = z r p for r p By the Gershgorin circe theorem we aso have that J z) = J J /2 = O z ) Therefore, the proof now finishes upon using 3)-32) Remark 33 Observe that the same concusions as in Coroary 32 hod if the diagona of J were repaced by arbitrary compex numbers having the same moduus Remark 34 By combining Coroary 32 with Theorem 2, we get a new proof of [6, Theorem 4] When D is a diagona matrix of iid random variabes the outcome is simiar Coroary 35 Suppose the entries of D are iid compex random variabes with 37) E d ±β < for some β > and E og d Then, for every ε >, there is a δ > and an L 5 δ so that with probabiity approaching as, σ L M ) ε and L k= σ k M ) = e E og d ) +o) Proof The key to the proof is to construct a partition of [] so that D is sma and the upper and the ower bounds of 36) are evauated easiy To this end, we first note that 38) im β E d ±β) /β = e ±E og d, which foows from Tayor s theorem and dominated convergence using 37) ow we focus on the case E og d > By 38) there exists a β > so that p β := E d β < We fix this β for the remainder of the proof ext we reca that if {Z k } is a non-negative martingae with Z = then Doob s maxima inequaity impies that [ ] 39) P sup Z k t k t Let G δ be the set of j [] so that there exists a k [] for which Then i=j j k i=j k d i β p β ) 2δ j+k Pj G δ ) Psup d i β p β ) 2δ ) + P sup k j 2 k j i=k d i β p β ) 2δ ) =: P + P 2

12 2 A BASAK, E PAQUETTE, AD O ZEITOUI Setting Z k := j+k i=j d i β p β ), one sees that {Z k} is a non-negative martingae with Z := Appying 39) one gets that P 2δ Simiary, setting Z k = j i=j k+ d i β p β ), one gets P 2 2δ Thus, E G δ 2 2δ, and hence by Markov s inequaity, with probabiity at east δ, G δ 2 δ Let S Z be defined by 3) S := δ k= δ k { x Gδ x + {, })}, where for two sets S and S 2 we denote S + S 2 := {s + s 2 : s S, s 2 S 2 } Enumerate the eements of S as {i 2 < i 3 < i 4 < < i S + } Extend the coection i s by etting i =, L = S +, and i L+ = Then L 5 δ with probabiity at east δ, and the separation i k+ i k δ for a k From the definition of the set S, it foows that when i j G δ, we have for any i j r < i j+ and any k r, k d i 2δ/β p k/β β 2δ/β, i=r where the ast inequaity foows from the fact that p β < Hence, D ij,ij+ 2 δ+2/β) Recaing the definition of S once more we see that when i j G δ, we have i j+ = i j + Thus, in that case D ij,jj+ 2 Therefore, we concude that if E og d > then D 2 δ+2/β), with probabiity at east δ Using 38), a simiar argument yieds that 3) D ij,ij+ + 2 δ+2/β) for a j =, 2,, L, with probabiity at east δ, when E og d < Therefore, the same bound as above hods for D in this case ow taking δ = δε) sma enough and invoking the first part of Theorem 3, one concudes that with the same probabiity, σ L M ) ε, as caimed To show the second part of the coroary, we caim that for any η > there is a δ := δ η) >, with im η δ η) =, such that for a t > { [ k ] [ k ]} 32) max P og d i t + ke og d η), P og d i t + ke og d + η) e δ t i= To see the above, appying Markov s inequaity, we note that for any β, β ], [ k ] [ k E i= d i β ] P og d i t + ke og d + η) exp β ke og d ) e β i= ow using 38) and choosing β sufficienty sma depending on η) we deduce [ k ] P og d i t + ke og d + η) e δ t i= i= t β kη Using a simiar argument for the second probabiity in the eft hand side of 32), we concude that 32) hods We continue with the proof of the second part of the coroary From 32) we concude that for any η >, there is a constant Cη) >, with im η Cη) =, so that, with probabiity, for a j L, 33) e 2ij+ ij)e og d η) Cη) og i j+ i=i j+ d i 2 = π j M v ij+,ij+ 2 2 e 2ij+ ij)e og d +η)+ Cη) og

13 REGULARIZATIO OF O-ORMAL MATRICES 3 In the case that E og d >, using the fact that i j+ i j δ we see that i j+ i=i j+ d i 2 v ij+,ij+ 2 2 δ max r i j<r i j+ i>i j+ Proceeding simiary to the proof of 33) and appying an union bound we concude that with probabiity at east 99, for a j L 34) e 2ij+ ij)e og d η) Cη) og v ij+,ij+ 2 2 e 2ij+ ij)e og d +η)+ Cη)+δ) og Reca that π k M w k 2 = π k M n v i k+,i k+ 2 / v i k+,i k+ 2 Hence combining 33)-34), using the fact i j+ i j δ again, and taking η sufficienty sowy with, so that Cη) og = o δ ), we concude that if E og d > then L 35) e o) π k M w k 2 e o), k= with probabiity approaching one as Turning to the case E og d < we begin with the estimate d i 2 v ij+,ij+ 2 2 δ D ij,ij δ+/β), for a j =, 2,, L, with probabiity at east δ, where the ast step foows from 3) Therefore 36) e L i= og di o) π k M w k i= 2 = d i L e i= og di, j= vij+,ij+ 2 k= with probabiity approaching one, as To compete the proof using Markov s inequaity and the union bound we note that Pmax i d i 2/β ) = O/) Therefore, using the Gershgorin circe theorem we derive that M 2 = M M = O 4/β ) with probabiity tending to one ow appying Theorem 3, the derived bound on D, using 35) when E og d >, and 36) and Chebycheff s inequaity when E og d <, the coroary foows The next coroary and Remark 37 foowing it, combine Coroary 35 with Theorem 2 to obtain Theorem 3 b) Coroary 36 Suppose that D is a diagona matrix of iid compex random variabes of aw ν, and et M = D +J Suppose that E d ±β < for some β > and that E og d z, for Lebesgue-ae z C Then L converges weaky in probabiity to the probabiity measure with og potentia E og d z ) + Remark 37 Let S := Supp d ) The condition that L ν z) = E og d z, for Lebesgue-ae z is satisfied, for exampe, when S is contained in a compact simpy connected set of two-dimensiona Lebesgue measure Indeed, note that L ν is harmonic on S c L ν cannot vanish identicay in S c because S c is connected and im sup z L ν z) = By [4, Theorem 38], it foows that the zero set of L ν in S c has zero Lebesgue measure Proof of Coroary 36 We note first that by Wey s inequaities for singuar vaues, if d i, i =,, denote the monotone decreasing reordering of the variabes d,, d then σ i M ) d i 2 for a i, with probabiity approaching as In the ast statement, we used that J and that by 2), γ G ) By Wey s majorant theorem [3, Theorem II36] it foows that, with probabiity tending to as, og + λ i M ) og + σ i M ) og + d i + 2) i= i= Since E d β < it foows that E og + d +2) <, which in turn impies that the sequence {L } a is tight Therefore, by [8, Theorem 283], the coroary foows once one proves that L M z) E og d z + in probabiity for Lebesgue amost every z C i=

14 4 A BASAK, E PAQUETTE, AD O ZEITOUI To prove the convergence of L M, we check that D z Id +J satisfies the hypotheses of Coroary 35 for Lebesgue-ae every z By assumption E d β < and hence E d z β < for a z C Observe that for any M > z y dz 2 νdy) = 2πM C z y <M with dz 2 the 2-dimensiona Lebesgue voume eement Jensen s inequaity, we have that E z d β E z d ) β < In particuary, as this is ocay integrabe, by is finite for Lebesgue-ae z, where without oss of generaity we have assumed β Hence M z Id satisfies the hypotheses of Coroary 35 for Lebesgue-ae z C Let z C be a point at which these hypotheses are satisfied Choosing ε, η > sufficienty sma so that ε < γ 2 η, we get from Coroary 35 that there is a δ > and an L 5 δ so that σ L M z Id) ε and 37) L k= σ k M z Id) = e E og d z ) +o), with probabiity approaching to one, as Appying Theorem 2, with ε = η, we get that 38) og detm z Id) og detm z Id) k= σ k M z Id) in probabiity, where we reca that was defined in 24) as the argest i so that So L, and therefore 39) η γ ) /2 ) L σ i < η γ i) /2 < ε L k= σ km z Id) k= σ k M z Id) M z Id L As we have aready seen during the proof of Coroary 35 that M = O 2/β ) with probabiity approaching one, by the triange inequaity the same bound continues to hod for M z Id Therefore, using the fact that L = O δ ) we deduce that both the upper and ower bounds in 39) are sub-exponentia in On the other hand, since M is an upper trianguar matrix, by Chebycheff s inequaity it aso foows that detm z Id) = e E og d z +o), with probabiity tending to one Hence, combining 37)-38) we deduce og detm z Id) og e E og d z +o) e E og d z ) +o) in probabiity As this hods for Lebesgue amost every z C, the caimed statement foows The next coroary deas with M = D + J where the entries in D vary sowy Coroary 38 Suppose that f : [, ] C is α-höder continuous, and that d i = fi/) for i For every ε >, there is a δ > and an L = O δ ) so that σ L M ) ε and L k= σ k M ) = e i= og fi/) ) +o) Proof The key to the proof is again to construct a suitabe partition of [] Fix any δ, ) Inductivey define a j by setting a := and etting { inf{a j < k : og fk/) > δ }, if og fa j /) <, a j+ := inf{a j < k : og fk/) < δ }, if og fa j /) >

15 REGULARIZATIO OF O-ORMAL MATRICES 5 From the definition of {a j } and the Höder continuity of f we see that there is a constant C so that and note that {a j } = O δ/α ) Let δ fa j /) fa j+ /) C aj+ a j S := δ k= δ k {a j : j } Enumerate the eements of S as {i 2 < i 3 < i 4 < < i S + } Extend this by etting i =, L = S +, and i L+ = Then, upon reducing δ if necessary, we obtain L = O δ ), and the separation i k+ i k < δ for a k ext, recaing the definition of D s,r, by the construction of {a j }, and the triange inequaity we aso have that either D s,r 2e r s) δ for a i k < s r i k+ or D s,r 2 e r s) δ for a i k < s r i k+ Hence D 4e δ, which upon an appication of Theorem 3 yieds that given any ε >, there exists δ >, sufficienty sma such that σ L M ) ε As M = M M /2 = Osup x [,] fx) ), by the Gershgorin circe theorem, appying Theorem 3 once again, it remains to show that 32) L k= π k M w k 2 = e i= og fi/) ) +o) where we reca that w k = v i k+,i k+ v i k+,i k+ 2 for k L To this end, we note that for each k L we have that either og fs/) δ for a i k < s < i k+ or og fs/) δ for a i k < s < i k+ Using the Höder continuity of f we further have that fi k+ /) 2e δ in the first case and fi k+ /) in the second case Therefore, in the first case, we have that δ 2e and D i k+,i k+ + = i k+ j=i k + v i k+,i k e 2 δ, fj/) = exp i k+ j=i k + = exp O) Hence, 32) π k M w k 2 = exp Oog ) Arguing simiary, in the second case, we have that and therefore ) 322) π k M w k 2 = exp Oog ) og fj/) ) + i k+ j=i k + i k+ j=i k + ) α i k+ j=i k + og fj/) ) ) og fj/) ) ) D i k+,i k+ 2 v i k+,i k e 2 δ D i k+,i k+ 2, = exp Oog ) Combining 32)-322) we arrive at 32) This competes the proof Buiding on Coroary 38, the next coroary is Theorem 3 b) i k+ j=i k + og fj/) ) og fj/) ) )

16 6 A BASAK, E PAQUETTE, AD O ZEITOUI Coroary 39 Suppose f : [, ] C is Höder continuous, and that d i = fi/) for i Set M = D + J Then L converges weaky in probabiity to a probabiity measure with og potentia ) og ft) z + dt The proof foows a very simiar track as the derivation of Coroary 36 from Coroary 35 Moreover, as we wi see ater in Section 5, the proof of Theorem 44 aso foows a very simiar ine of arguments Hence, the proof of Coroary 39 is omitted 32 Proof of Theorem 3: estimates for the sma singuar vaues of D + J The proof is divided into three separate caims: Coroary 33, which is a bound on the L + )-st smaest singuar vaue, Proposition 3, which is an upper bound on the product of sma singuar vaues, and Proposition 34, which is a ower bound on the product of sma singuar vaues Reca the notation in 33) and 35), and that that π j is the coordinate projection from C to the coordinates that support w j Let ρ j be the same coordinate projection that in addition kis the i j+ coordinate, ie the ast entry of the support of w j Lemma 3 For a j L, and any vector x C, inf a C π j x aw j ) 2 ρ j M x) 2 where D ij,ij+ + and D ij,ij+ were defined in 34) min { } D ij,ij+ +, D ij,ij+, Proof of Lemma 3 By definition of M, we have for any p < and any vector x C, x p+ = d p x p + M x) p By iterating this identity and using 32), we have for i j+ p > k i j + p x p awp j = x k aw j k )Dk,p + M x) r D r+,p Reversing the roes of k and p and rearranging the formua, this aso shows that for i j+ k > p i j + x p aw j p = x k aw j k ) D p,k r=k k r=p M x) r D p,r+ Picking a so that x ij+ aw j i ) = or x j+ i j+ aw j i j+ ) = we have that { p 323) x p awp j r=i M j+ x) r D r+,p, p > i j +, ij+ r=p M x) r D p,r+, p < i j+ Hence, using the first inequaity of 323), upon appying Jensen s inequaity, x p aw j p 2 { p r=i j+ } { p M x) r 2 D r+,p r=i j+ } D r+,p Summing this bound from p = i j + to p = i j+, rearranging the terms, and using the definition of D ij,ij+ +, π j x aw j ) 2 2 = i j+ p=i j+ x p aw j p 2 {i j+ r=i j+ } { } 2 { } 2 M x) r 2 D ij,ij+ + = ρ j M x) 2 2 D ij,ij+ + ext using the second inequaity of 323) and proceeding simiary as above we compete the proof

17 REGULARIZATIO OF O-ORMAL MATRICES 7 We now proceed to using these estimates in order to contro the product of the sma singuar vaues of M We begin with obtaining an upper bound on the product of sma singuar vaues To this end, we use Lemma A2, which is a mutivariate generaization of Courant-Fischer-Wey min-max principe for singuar vaues Proposition 3 324) L k= σ k M ) L π k M w k 2 k= Proof Denote W := [ w w 2 w L] Since the coumns of W are orthonorma, from Lemma A2 it foows that 325) L k= σ k M ) detw M M W ) To evauate the rhs of 325) we define the L L matrix M by M j,k := e ij+ ) t M w k Recaing 32) we note that W M M W = M M On the other hand, the matrix M being upper trianguar we aso have L L 326) π j M w j 2 2 = M j,j 2 = det M 2 = detw MM W ) j= The proof concudes by invoking 325) j= We next show that vectors v which have a sizeabe component orthogona to S := span { w j} wi necessariy have M v 2 arge To this end, et ψ be the orthogona projection map from C to S Let ρ be the projection 327) ρ := ρ j The projections ρ and ψ interact in that j= 328) ρm ψ =, which foows immediatey from the definition of w j We can then combine this observation with the earier Lemma 3 to obtain the next emma Lemma 32 For any vector v C, v 2 2 ψv 2 2 = ψ)v 2 2 ρm v 2 2D 2 Proof On the one hand, using the orthogonaity of π j, v 2 2 ψv 2 2 = inf v a j w j ) 2 2 = inf π j v a j w j ) 2 2 = {a j} C {a j} C j j j Hence using Lemma 3 and 35), we get v 2 2 ψv 2 2 j ρ j M v 2 2D 2 inf π jv a j w j ) 2 2 a j C The stated concusion of the emma foows by the orthogonaity of the ρ j The ast emma immediatey impies a ower bound for the L + )-st smaest singuar vaue

18 8 A BASAK, E PAQUETTE, AD O ZEITOUI Coroary 33 σ L M ) D Proof We reca the standard variationa characterization of this singuar vaue in the maximin form: σ L M ) = sup V L inf M x 2, x V L where V L is an L-dimensiona space and x is of unit 2 -norm Setting V L = S, the stated coroary immediatey foows from Lemma 32 ow it remains to find a ower bound on the product of the sma singuar vaues; this is sighty more invoved Proposition 34 With notation as above, L k= σ k M ) 8 M )D L) L L k= π k M w k 2 Proof Using Lemma A2 we see that it is enough to find a uniform ower bound on L k= M v k 2 over a coections of orthonorma vectors {v k } L k= We essentiay bound each M v k 2 beow in one of two ways If ψv k 2 2 2L then v k has a arge enough component in the W direction that we appy Lemma 32 to concude 329) M v k 2 ρm v k 2 2LD 8D L π k M w k 2, M where ρ is as in 327) Without oss of generaity, we may permute the ordering of the vectors so that the first v, v 2,, v p are those that satisfy ψv k 2 2 < 2L For these vectors, we have that 33) M v k 2 2 = ρm ψ)v k ρ)m v k 2 2, where we have used that ρm ψ = We now consider two cases First suppose Since we obtain Hence by 33) and Lemma 32 we deduce 33) On the other hand, if ρ)m ψv k 2 4 ρ)m ψ)v k 2 ρ)m ψ)v k 2 M ψ)v k 2, ρ)m ψv k 2 4 M ψ)v k 2 M v k 2 ρm ψ)v k 2 = ρm v k 2 D ψ)v k 2 4 M D ρ)m ψv k 2 then by 33) and the triange inequaity we see that M v k 2 ρ)m v k 2 ρ)m ψv k 2 > 4 ρ)m ψ)v k 2, 332) ρ)m ψv k 2 ρ)m ψ)v k ρ)m ψv k 2 Hence, combining 33)-332) and noting that D we concude that in either case, M v k 2 4 M )D M ψv k 2,

19 REGULARIZATIO OF O-ORMAL MATRICES 9 where we have again appied the fact that ρm ψ = Thus p ) p p 333) M v k 2 M ψv k 2 4 M )D k= The rest of the proof bois down to finding a ower bound on the rhs of 333) To this end, et Y be the matrix whose coumns are {ψv k } p m= Since the coumns of W := [ w w 2 w L] span the subspace S, there must exist an L p matrix A such that Y = W A We extend the matrix A to an L L matrix A so that the ast L p coumns of A are orthonorma and are aso orthogona to the first p coumns of A Such an extension is aways possibe by first extending arbitrariy to a basis and then running Gram-Schmidt on the fina L p coumns Set Y := W A and denote the coumns of Y by y m, for m [L] Turning to bound the rhs of 333), by Hadamard s inequaity we now find that 334) p k= k= M ψv k 2 2 dety M M Y ) L k=p+ M y k 2 2 We separatey bound the numerator and the denominator of 334) ote that y k = L m= a m,kw m where a m,k is the m, k)-th entry of A Since {w m } L m= are orthonorma, for k = p +, p + 2,, L, we have 335) M y k 2 M y k 2 = M L a m,k 2 w m 2 2 = M, where in the ast step we aso use the fact that the ast L p coumns of A have unit 2 -norm The inequaity 335) takes care of the denominator of 334) Thus it remains to find a ower bound of the numerator of 334) To obtain such a bound, we observe that L 336) dety MM Y ) = detw MM W ) detaa ) = π j M w j 2 2 detaa ) where the ast step foows from 326) It now remains to bound detaa ) Let a m,m be the m, m )-th entry of A A Using the orthonormaity of {w k } L k= we have that for any m, m p, [ L L ] [ L ] a m,m = ā r,m a r,m = a r,m w r a r,m w r = ψv m ) ψv m ) r= Since v m v m, for m m, we see that r= m= r= j= ψv m ) ψv m ) = Id ψ)v m ) Id ψ)v m ) By our construction we have that ψv m 2 2 > 2L, for m =, 2,, p Thus a m,m = ψv m ) ψv m ) ψ)v m 2 ψ)v m 2 2L, for a m m p By a simiar reasoning we aso obtain that a m,m 2L, for m =, 2,, p Since the ast L p coumns of A are orthonorma and orthogona to the first p coumns we further obtain and a m,m =, m = p +, p + 2,, L; a m,m =, p + m m L, a m,m =, m [p], m = p +, p + 2,, L

20 2 A BASAK, E PAQUETTE, AD O ZEITOUI So in the first p rows of the matrix A A we find that the diagona entries are at east 2L and the sum of off-diagona entries in a row is at most p )/2L) The ast L p rows of A A are simpy {e m } L m =p+ Hence by the Gershgorin circe theorem a eigenvaues of A A are at east 2 which impies 337) detaa ) = deta A) 2 L Therefore, from 333)-336), we derive p ) L M v k 2 D p 8 M ) k= L π k M w k 2 2 k= Combining this bound with 329) finishes the proof of the proposition 4 Limiting spectrum of noisy version of banded twisted Toepitz matrices We consider in this section upper trianguar twisted Toepitz matrices of finite symbos, namey upper trianguar matrices with a finite number of sowy varying diagonas; a particuar case is the case of upper trianguar Toepitz matrices of finite symbo Our main resut is the foowing theorem Theorem 4 Fix d, α > /2 and α, ] for [d] For each [d] {}, et f : [, ] C be an α -Höder continuous function, and et D ) be the diagona matrix with entries {f i/)} i [] Set M := d = D) J and set M as in ) Then L converges weaky in probabiity to µ d,f, the aw of d = f X)U, where X Unif, ), U is uniformy distributed on the unit circe in C, and X and U are independent of each other Remark 42 Theorem 2 foows from Theorem 4 by taking f ) = a Reca the notation L µ for the og-potentia of a measure µ, see 4) Simiar to Theorem 3, we prove Theorem 4 by showing that for Lebesgue ae z C, L L z) L µd,f z) in probabiity Toward this end we begin by identifying L µd,f ) For z C and x [, ], introduce the symbo 4) P z,x λ) := P z,x,d,f λ) := f d x)λ d + f d x)λ d + + f x)λ + f x) z Let ˆd := ˆdx) denote the degree of P z,x ) If ˆd > then P z,x ) has ˆd roots λ z, x), λ 2 z, x),, λˆd z, x) mutipicities aowed) Partition [, ] as foows: for {,, d} set 42) A := {x [, ] : f x) }, B := A \ d j=+a j ), and in particuar B d := A d Set B := [, ] \ d B ) Lemma 43 For any z C we have d L µd,f z) = og + λ j z, x) + og f x) B x) dx + j= Proof We have ) d L µd,f z) =E og z f X)U = og P z,x λ) dx dλ 2π = S d = og λ λ j z, x) 2π dλ + og f x) B x) dx + Since the caim foows S j= { og z og z λ dλ =, if z 2π S, otherwise, og f x) z B x) dx og f x) z B x) dx

21 REGULARIZATIO OF O-ORMAL MATRICES 2 4 Reduction to piecewise constant {f } d = To prove Theorem 4 we adopt a strategy simiar to the proof of Theorem 3 amey, we find approximate singuar vectors corresponding to sma singuar vaues of M z Id for amost a z C To this end, note that 43) M z Id)w) i = D ) z)w i + d D ) w +i, for i [ d] Therefore, given any arbitrary vaues of {w } j+d =j one can construct a -dimensiona vector w such that M z Id)w) i = for i [ d]\[j+d ] Such choices of w wi be candidates for approximate singuar vectors To study these vectors we note from 43) that w j+d,, w j+ ) T = T j w j+d,, w j ) T for some transfer matrix T j Iterating, we have that w,, w d+ ) T = k T k) w j+d,, w j ) T Unike Theorem 3, where the transfer matrices are actuay scaars, here the transfer matrices {T k } are in genera non-commuting if {f } d = are varying This compicates the study of the approximate singuar vaue vector w To overcome this difficuty we empoy the foowing two-fod argument We introduce a reguarized mode where the {f } d = are piecewise constant and hence {D) }d = have constant diagona bocks Then, the transfer matrices {T k } are constant, and hence commute, within each bock This wi be sufficient to derive the necessary properties of the sma approximate singuar vectors, which in turn aows us to deduce that if the sizes of the bocks are chosen carefuy then the empirica spectra distribution esd) of the reguarized mode admits the imit as described in Theorem 4 To compete the proof of Theorem 4 we then show that the imits of the esds of the reguarized mode and the origina mode must be the same We now introduce the reguarized mode Let {f } d = be as in Theorem 4 Fix some δ, δ 2, ) For ) [d] {}, et ˆD be a diagona matrix with ) ) ) ) i δ ˆD ) i δ i,i := f f δ2, i [], δ δ and define the reguarized version of M as d 44) ˆM := ˆD ) J, ˆM = ˆM + γ G = ote that in ˆM we have an additiona truncation f ) δ2 ), which wi be ater used in the proof to derive bounds on the operator norm of the transfer matrices ow we can state our main resut for ˆM Its proof, which is the main technica part of the proof of Theorem 4, is deferred to Section 5 Theorem 44 Fix d, α > /2, α, ] for [d] and δ, δ 2, /2) such that max{δ, δ 2 } γ /2)/2d 2 ) For each [d] {}, et f : [, ] C be an α -Höder continuous function Let ˆM be as in 44) Then L ˆM converges weaky in probabiity to µ d,f 42 Proof of Theorem 4 assuming Theorem 44 The proof is motivated by the proof of [9, Theorem 4, Theorem 5] and the repacement principe, which was introduced in [9, Theorem 2] We wi use a version of the repacement principe from [2, Lemma ]) We begin with some preparatory materia To appy the repacement principe we wi need the foowing reguarity property of the imit, cosey reated to [9, Definition ] Lemma 45 For Lebesgue amost every z C, im E [ ] µ d,f og X z ) { X z ε} = ε Proof Using integration by parts we have that for any probabiity measure µ on R and a < a 2 <, a2 a ogt) dµt) oga 2 ) µ, a 2 )) + a2 a µ, t)) dt t

22 22 A BASAK, E PAQUETTE, AD O ZEITOUI Therefore, recaing the definitions of µ d,f from the statement of Theorem 4 and P z,x ) from 4), we have [ ] Eµd,f og X z ) { X z ε} 45) We wi show that 2π og ε =: 2π og ε 2π 2π { Pz,xe iθ ) ε} dθ dx + 2π ε 2π { Pz,xe iθ ) ε} dθ dx + Term d ε) 46) im ε Term d ε) = { Pz,xe iθ ) t} t dθ dx dt This wi take care of the second term in the rhs of 45), and a simiar argument which we omit) appies to the first term, competing the proof of the emma Turning to prove 46), fix > α d > α d > > α > Recaing that {λ i z, x)} d i= are the roots of the equation P z,x λ) = on the set B d, see 42), we write there P z,x e iθ ) = f d x) d j= λ jz, x) e iθ Spitting the integra into the two parts f d x) t αd and f d x) t αd, we obtain Term d ε) ε d 2π j= { λjz,x) e iθ t α d d } dθ dx dt + Term d ε), 2π t where Term d ε) := 2π ε 2π { Pz,xe iθ ) t} { fdx) t α d } t dθ dx dt Since for any λ C, and s > sufficienty sma, 2π { λ e iθ s}dθ 4s, we concude that 47) im sup ε Term d ε) im sup Term d ε) ε Denote P z,x d) λ) := P z,x λ) f d x)λ d and, when f d x), et {λ d) i z, x)} d i= triange inequaity, for any t, ), we further have that denote its roots Using the { P z,x e iθ ) t} { f d x) t αd } { P z,x d) e iθ ) 2t αd } ) ) = { P z,x d) e iθ ) 2t αd } { f d x) t αd } { P z,x d) e iθ ) 2t αd } { f d x) t αd } Therefore arguing as in the ines eading to 47) we obtain im sup Term d ε) ε ε 2π im sup ε 2π im sup Term d 2 ε), ε d j= { λ d) j z,x) e iθ 2 d α d α d t d } t dθ dx dt + im sup Term d 2 ε) ε where Term d 2 ε) := ε 2π d) { P z,x e iθ ) 2t α d } { f d x) t α d } dθ dx dt 2π t Iterating the above argument and using induction we deduce that 48) im sup ε Term d ε) im sup ε ε { fx) z d+)t α } t dx dt Since f is an α -Höder-continuous function with α > /2, we have that f [, ]) := {f x) : x [, ]} has zero Lebesgue measure in C), by a voumetric argument Moreover the set f [, ]) being a cosed set, for every z / f [, ]) we have distz, f [, ]) := inf x [,] z f x) > Therefore, given a z / f [, ])

23 REGULARIZATIO OF O-ORMAL MATRICES 23 there exists ε > sufficienty sma such that {x [, ] : f x) z d + )ε α } = Thus, from 48) we deduce 46) This competes the proof of the emma To prove Theorem 4 we need another ingredient Lemma 46 Fix z C Let ν M z be the symmetrized version of empirica measure of the singuar vaues of M z Id Define ν zˆm simiary Then both ν M z and ν zˆm converge weaky in probabiity, as, to the symmetrized version ν z of the aw of d = f X)U z, where X and U are as in Theorem 4 Proof of Lemma 46 Let ν z M and ν zˆm denote the symmetrized versions of the empirica measures of M z Id and of ˆM z Id, respectivey ote first that γ G in probabiity and in fact, as) and that there exists a constant C = C{f }, z) so that M z Id C, ˆM z Id C Therefore, it foows from Wey s inequaities that for any metric on the space of probabiity measures on R compatibe with the weak topoogy, d ν z M, ν z M ), d ν zˆm, ν zˆm ), in probabiity On the other hand, by definition, M ˆM min{αδ,δ2}, where α := min d ={α } and therefore, by the Hoffman-Wieandt inequaity [, Lemma 29], d ν z M, ν zˆm ) Combining the ast two dispays, we deduce that it is enough to show that ν M z converges weaky to ν f z, the symmetrized version of the aw of d = f X)U z To this end, we wi empoy the method of moments We wi show that for every k, 49) im tr [M z Id)M z Id) ] k = E d 2k f X)U z This wi compete the proof Since we can absorb z in f ) it is enough to prove 49) ony for z = We begin by evauating the rhs of 49) for z = As U = U, we have d 2k kd 4) f X)U = F k) X)U, = = kd for some functions {F k) )} Since EU = EU = for any, we get 4) E d 2k f X)U = E[F k) X)] = F k) x)dx = Expanding the sum in the hs of 4) and coecting the coefficient of U it foows that 42) F k) x) = { i} 2k i= : k i= 2i 2i)= i= Turning to identifying the hs of 49) we see that 43) M M ) k = k d i= i= D ) J J ) 2 D 2) = k k f 2i x) f 2i x) i= D3) D 2k ) J 2k J ) 2k D 2k) Since {D ) } are diagona matrices we have that if k i= 2i 2i ), then ) ) i,i := D ) J J ) 2 D 2) D3) D 2k ) J 2k J ) 2k D 2k) i,i =,

24 24 A BASAK, E PAQUETTE, AD O ZEITOUI for any i [ 2kd] \ [2kd] Thus to estabish 49) we ony need to consider the sum over { i } 2k i= such that k i= 2i 2i ) = Fixing such a sequence of { i } 2k i= we observe that for any i [ 2kd] \ [2kd] 44) ) i,i = D ) ) i,i D 2) ) i+s,i+s D 3) ) i+s,i+s D 2k ) ) i+sk,i+s k D 2k) where s j := j i= 2i 2i ) Since D ) ) i,i = f i/), for any { i } 2k i=, such that s k =, we find that k k im i= ) i,i = i= f 2i x) i= f 2i x)dx Substituting in 43) and using 4)-42), we arrive at 49) with z = ) This competes the proof We next introduce further notation The Stietjes transform of a probabiity measure µ on R is defined as G µ ξ) := µdy), ξ C \ R ξ y We use the foowing standard bounds on the Stietjes transform, see [9, 6)-8)], in order to integrate the ogarithmic function: for any τ, ϱ >, and a, b R such that b a > ϱ we have 45) µ[a, b]) and 46) µ[a, b]) b+ϱ a ϱ b ϱ a+ϱ IG µ x + iτ) dx + τ ϱ, IG µ x + iτ) dx τ ϱ We need aso the symmetrized form of the Stietjes transform, as foows For a matrix C, define [ ] C C := C and the Stietjes transform G C ξ) := 2 tr ξ C ), ξ C \ R G C ) is the Stietjes transform of the symmetrized version of the empirica measure of the singuar vaues of C Using the resovent identity, we have that for two matrices C and D, 47) G C ξ) G D ξ) C D Iξ)) 2 We are finay ready to prove Theorem 4 Proof of Theorem 4 To show that L M and L ˆM admit the same imit we need to show that for every f Cc 2 C) supported on B C, R), for some R <, fz)dl M z) fz)dl ˆM z), as, in probabiity Upon using [2, Lemma ] we note that it is enough to show that i) The expression M ˆM 2 2 is bounded in probabiity ii) For Lebesgue amost a z B C, R), og detm z Id) og det ˆM z Id), as, in probabiity ) i,i,