Statistical Inference and Random Matrices
|
|
- Helen Pitts
- 5 years ago
- Views:
Transcription
1 Statistical Inference and Random Matrices N.S. Witte Institute of Fundamental Sciences Massey University New Zealand Joint work with Peter Forrester 6 th Wellington Workshop in Probability and Mathematical Statistics 4-6 December 2017 N.S. Witte Statistical Inference and Random Matrices 1-1
2 Applications Historical Origins: Integrals over Classical Groups U(N), O(N), Sp(2N) Hurwitz 1897, Haar 1933 Mathematical Statistics: Wishart 1928, James , Constantine 1964, Mathai 1997 Quantisation of Classically Chaotic Systems: Wigner 1955, 1958 N.S. Witte Statistical Inference and Random Matrices 1-2
3 Applications Historical Origins: Integrals over Classical Groups U(N), O(N), Sp(2N) Hurwitz 1897, Haar 1933 Mathematical Statistics: Wishart 1928, James , Constantine 1964, Mathai 1997 Quantisation of Classically Chaotic Systems: Wigner 1955, 1958 Contemporary Applications: Principal Component Analysis, sample covariance matrices, Wishart matrices, null and non-null SCM mathematical finance, cross correlations of financial data, sample correlation matrices, Polynuclear growth models, random permutations, last passage percolation, queuing models, Biogeographic pattern of species nested-ness, ordered binary presence-absence matrices, distribution of mutation fitness effects across species, Fisher s geometrical model, complex networks modeled by random graphs, e.g. adjacency matrices data analysis and statistical learning Stable signal recovery from incomplete and inaccurate measurements Compressed sensing, best k-term approximation, n-widths Wireless communication, antenna networks, quantum entanglement quantum chaos, semi-classical approximation quantum transport in mesoscopic systems N.S. Witte Statistical Inference and Random Matrices 1-3
4 What is a random matrix? E.g. Gaussian Orthogonal Ensembles of Random Matrices: GOE aka Gaussian Wigner matrix i.i.d random variables x j,j N[0, 1] x j,k N[0, 1 2 ] Construct n n real, symmetric matrix X = (x j,k ) n j,k=1 Joint p.d.f for the elements P(X ) = 1 n e 1 2 x2 j,j e x2 j,k = 1 e 1 2 x2 j,k = 1 e 2 1 Tr(X 2 ) C n C j=1 1 j<k n n C 1 j,k n n Invariance under orthogonal transformations X OXO, OO = I N.S. Witte Statistical Inference and Random Matrices 1-4
5 Spectral Decomposition of a Matrix n n Real Symmetric Matrices X = (x j,k ) 1 j,k n Eigenvalue Analysis λ 1,..., λ n X = OΛO Λ = diag(λ 1,..., λ n), Orthogonal Eigenvectors O = (O 1,..., O n), OO = I Volume form (dx ) = n j=1 dx j,j 1 j<k n dx j,k Change of 1 2 n(n + 1) variables {x j,k } {λ j, O j } Jacobian (dx ) = (O do) n m Real Matrices X Singular Value Decomposition σ 1,..., σ m 1 j<k n X = OΣP λ j λ k n j=1 dλ j Σ = diag(σ 1,..., σ m) R n m, Orthogonal O R n n, P R m m Gram-Schmidt orthogonalisation, QR, LU, Cholesky, Hessenberg Decompositions N.S. Witte Statistical Inference and Random Matrices 1-5
6 Putting it altogether: GOE or Gaussian Wigner Matrices Joint p.d.f for eigenvalues P(λ) = 1 n e 2 1 λ2 j λ j λ k 1, λ j R C n j=1 1 j<k n N.B. repulsion parameter, Dyson index, β = 1 in Stieltjes picture, Log-gas Hermite weight, one of the classical orthogonal polynomial weights normalisation is Selberg integral N.S. Witte Statistical Inference and Random Matrices 1-6
7 Principal Component Analysis X F n p (F = R, C) with with p p Covariance matrix X = {x (j) k } j=1,...,n, k=1,...,p p = # of variables, n = # of data points n A = X X = x (j) k x (j) 1 k 2 j=1 k 1 =1,...,p k 2 =1,...,p A is a Wishart matrix if x j,k are i.i.d random variables drawn from N[0, 1] Joint eigenvalue p.d.f. 1 p λ βa/2 k e βλ k /2 λ j λ k β, λ k [0, ) C k=1 1 j<k p i.e. Laguerre weight, a = n p + 1 2/β, n p { 1 Real, R β = 2 Complex, C N.S. Witte Statistical Inference and Random Matrices 1-7
8 Translation Single-Wishart Null hypothesis µ = 0, Σ = I p variate degrees of freedom = n Laguerre LβE e β 2 λ λ β 2 (n p+1 2/β) Double-Wishart Null hypothesis µ 1 = 0, Σ 1 = I, µ 2 = 0, Σ 2 = I p 1 st variate q 2 nd variate degrees of freedom = n Jacobi JβE (1 λ) β 2 (q p+1 2/β) (1+λ) β 2 (n q p+1 2/β) N.S. Witte Statistical Inference and Random Matrices 1-8
9 Global Properties of the spectra: Empirical Spectral Distribution n Wigner semi-circle Law for the global density of eigenvalues ρ(λ) = 1 π 2n λ 2 n, p Marchenko-Pastur Law for eigenvalues of X X where ρ(λ) = 1 (λ nx )(nx + λ) 2πλ ( ) x ± = c 1/2 2 p ± 1, c = n 1 N.S. Witte Statistical Inference and Random Matrices 1-9
10 GUE, GOE n = 24 2 nρ(2 nx) N.S. Witte Statistical Inference and Random Matrices 1-10
11 Global Properties of the spectra: Empirical Spectral Distribution Prop. 2.2 and Lemma 4.1 of Haagerup and Thorbjørnsen [2012] Theorem The eigenvalue density ρ(x) for the GUE satisfies the third order, homogeneous ordinary differential equation ρ + (4n x 2 )ρ + xρ = 0 subject to certain boundary conditions, for fixed n as x ±. W & Forrester [2013] Theorem The eigenvalue density ρ(x) for the GOE satisfies the fifth order, linear homogeneous ordinary differential equation 4ρ (V ) + 5(x 2 4n + 2)ρ 6xρ + [ x 4 + (8n 4)x 2 16n n + 2]ρ + x(x 2 4n + 2)ρ = 0 again subject to certain boundary conditions, for fixed n as x ±. N.S. Witte Statistical Inference and Random Matrices 1-11
12 The many ways to look at these problems Statistic on Spec(X ) = {λ 1,... λ n} density ρ(λ) Regime Global spectrum m-point correlation functions ρ m(λ 1,..., λ m) Linear Spectral Statistics, n i=1 f (λ i ) Hypothesis tests, Distribution theory Extreme Eigenvalues, λ max, λ min Large deviations, Spectrum edge Eigenvalue Spacings, λ i+1 λ i Bulk or Edge spectrum Spectral Gaps j, λ j / J Spec(X ) Condition Numbers, λmax λ min Determinants, Characteristic Polynomials n i=1 (ζ λ i ) N.S. Witte Statistical Inference and Random Matrices 1-12
13 Tools one can use Approach Primary Object Moment Methods Concentration Inequalities Large Deviation Theory Free Probability Loop Equations Hypergeometric Functions of Matrix Argument Orthogonal/Bi-orthogonal Polynomials Integrable Systems, Painlevé equations Potential problems and equilibrium measures Stieltjes transform Stieltjes transform, Resolvents Zonal and Jack Polynomials Riemann-Hilbert asymptotics Gap probabilities, Characteristic polynomial N.S. Witte Statistical Inference and Random Matrices 1-13
14 The Spectrum Edge: Soft Edge Tracy-Widom Distribution F 2 (s), β = 2 Gap probability i.e. probability of no eigenvalues of n n GUE in (t, ) denoted by Shift and scale t as E 2,n(0; (t, )) t = 2n + s 2n 1/6 Take limit n of Gap probability λmax 2n lim P[ s] = F n 2n 1/6 2(s) Tracy-Widom [1994] Fredholm determinant F 2(s) = det(1 K 2) L 2 (s, ) where the integral operator K 2 has the kernel, the Airy Kernel K 2(x, y) = Ai(x)Ai (y) Ai(y)Ai (x) x y N.S. Witte Statistical Inference and Random Matrices 1-14
15 Tracy-Widom Distribution F 2 (s) and the second Painlevé transcendent P II The P II transcendent q(t; α) then satisfies the standard form of the second Painlevé equation d 2 dt 2 q = 2q3 + tq + α, α C Gap probability, i.e. Tracy-Widom distribution F 2(s), is ( ) Soft Edge E2 (0; (s, )) = exp dt (t s)q(t) 2 s where q(t) is the α = 0 solution for P II with the boundary condition q(t) Ai(t) t Hastings and McLeod solution, see Hastings, S. P. and McLeod, J. B. A boundary value problem associated with the second Painlevé transcendent and the Korteweg-Vries equation. Arch. Rational Mech. Anal., 1980, 73(1), Forrester & W [2012], Tails Soft Edge log Eβ (n; (s, )) β s 3 2 (βn s s 3/2 + β2 ) 1 n s + [ β 2 n2 + ( ) β 2 1 n + 1 ( 1 2 ( 1 β ) 2 )] log s 3/4 6 β 2 N.S. Witte Statistical Inference and Random Matrices 1-15
16 Universality Hypothesis Extension of central limit theorems and the Gaussian distribution Conjecture As the rank of the random matrix ensembles n, with or without a similar scaling of other parameters, the ensembles have well-defined limits, these limits define new distributions which are insensitive to details of the finite model other than their symmetry class, β are characterised by the solutions of integrable dynamical systems, e.g. of the integrable hierarchies such as the Toda lattice, K-dV or K-P systems, or more precisely by Painlevé type equations. Proven Cases: Four Moments Theorems in Tao, T., Vu, V., Random covariance matrices: universality of local statistics of eigenvalues. Ann. Probab., 2012, 40, Riemann-Hilbert Approach in Deift, P., Gioev, D. Random Matrix Theory: Invariant Ensembles and Universality. Amer. Math. Soc., N.S. Witte Statistical Inference and Random Matrices 1-16
17 Beyond the Null case: Example 1, Appearance of phase transition phenomenon Baik, J., Ben Arous, G. and Péché, S. Phase transition of the largest eigenvalue for nonnull complex sample covariance matrices. Ann. Probab., 2005, 33(5), β = 2, λ 1 is the largest eigenvalue of the sample covariance matrix, γ 2 = n p, l1 l2 Population covariance matrix Σ = l1 l 2 I p 2 As p, n either ( ) P [λ 1 (1 + γ 1 ) 2 γ F 2(x), 0 < l 1, l 2 < 1 + γ 1 )] (1 + γ) 4/3 n2/3 x F 2 1 (x), 0 < l2 < 1 + γ 1 = l 1 F (x) l 1 = l 2 = 1 + γ 1 or ( P [λ 1 l 1(1 + γ 2 l 1 1 )] n 1/2 l 1 1 γ 2 /(l 1 1) x 2 ) { G 1(x), l 1 > 1 + γ 1, l 1 > l 2 G 2(x), l 1 = l 2 > 1 + γ 1 N.S. Witte Statistical Inference and Random Matrices 1-17
18 Beyond the Null case: The moral of the story As n and p n PCA works: Sample CM Population CM As n, p and p = O(n)??? Issue: How close are the eigenvalues of the sample PCA to the population PCA? Even though for n finite there is no phase transition (n ) as a function of n or some other parameter the eigenvector of the sample PCA (e.g associated with eigenvalue λ 1) may exhibit a sharp loss of tracking suddenly losing its relation to the eigenvector of the population PCA. Nadler, B. Finite sample approximation results for principal component analysis: a matrix perturbation approach. Ann. Statist. 36 (2008), no. 6, N.S. Witte Statistical Inference and Random Matrices 1-18
19 Beyond the Null case: Example 2, Spiked Population models Johnstone, I.M. On the distribution of the largest eigenvalue in principal components analysis Ann. Statist., 2001, 29(2), A model: where x i = µ + Au i + σz i, i = 1,..., n p number of variables M number of spikes x i observation p-vector µ p-vector of means A p M factor loading matrix u i M-vector of random factors z i p-vector of white noise Population Covariance Matrix where M Σ = l 2 j q j q T j j=1 + σ 2 I p Φ l j, q j, j = 1,..., M M M covariance matrix of u i eigenvalues/vectors of AΦA T Ma, Z. Sparse principal component analysis and iterative thresholding. Ann. Statist. 41 (2013), no. 2, N.S. Witte Statistical Inference and Random Matrices 1-19
20 Painlevé Transcendents P-I P-II d 2 y dx 2 d 2 y dx 2 = 6y 2 + x = 2y 3 +xy+ν P-III P-IV d 2 y dx 2 = 1 y ( ) dy 2 1 dy dx x dx + y 2 4x (γy+α) + β 2 4x + δ 4y, d 2 y dx 2 = 1 2y ( ) dy dx γ = 4, δ = 4 2 y 3 + 4xy 2 + 2(x 2 α)y + β y P-V d 2 { y 1 = dx 2 2y + 1 (y 1)2 + x 2 y 1 { αy + β y } ( ) dy 2 1 dy dx x dx } + γy δy(y + 1) + x y 1, δ = 1/2 P-VI d 2 y = 1 { 1 dx 2 2 y + 1 y } ( ) dy 2 { 1 y x dx x + 1 x } dy y x dx { y(y 1)(y x) + α+ βx } γ(x 1) δx(x 1) + + x 2 (x 1) 2 y 2 (y 1) 2 (y x) 2 N.S. Witte Statistical Inference and Random Matrices 1-20
21 Painlevé Equations: Digital Library of Mathematical Functions, Chapter 32, Classical Solution P Affine Weyl Group P I Airy: Ai(x), Bi(x) P II A 1 Bessel: I ν(x), K ν(x) P III B 2 Hermite-Weber: D ν(x) P IV A 2 Confluent Hypergeometric: 1F 1(a, c; x) P V A 3 Gauss Hypergeometric: 2F 1(a, b; c; x) P VI D 4 N.S. Witte Statistical Inference and Random Matrices 1-21
22 Reference Monographs/Reviews Muirhead, R. J., Aspects of Multivariate Statistical Theory, Wiley Series in Probability and Mathematical Statistics, John Wiley & Sons Inc., 1982, Bai, Z. and Silverstein, J. W., Spectral Analysis of Large Dimensional Random Matrices, 2nd Edition, Springer, New York, 2010, Mehta, M. L., Random Matrices, Pure and Applied Mathematics (Amsterdam), Vol. 142, 3rd Edition, Elsevier/Academic Press, Amsterdam, 2004, Anderson, G. W. and Guionnet, A. and Zeitouni, O., An Introduction to Random Matrices, Cambridge University Press, Cambridge, 2010, Forrester, P. J., Log Gases and Random Matrices, Princeton University Press, 2010 Akemann, G. and Baik, J. and Di Francesco, P., Handbook on Random Matrix Theory, Oxford University Press, 2011, Couillet, R. and Debbah, M., Random Matrix Methods for Wireless Communications, Cambridge University Press, 2011 Johnstone, I. M., High Dimensional Statistical Inference and Random Matrices, International Congress of Mathematicians. Vol. I, Eur. Math. Soc., Zürich, 2006, pp Paul, D. and Aue, A, Random matrix theory in statistics: A review J. Statist. Plann. Inference, 150, 1 29, 2014 N.S. Witte Statistical Inference and Random Matrices 1-22
Universality of distribution functions in random matrix theory Arno Kuijlaars Katholieke Universiteit Leuven, Belgium
Universality of distribution functions in random matrix theory Arno Kuijlaars Katholieke Universiteit Leuven, Belgium SEA 06@MIT, Workshop on Stochastic Eigen-Analysis and its Applications, MIT, Cambridge,
More informationExponential tail inequalities for eigenvalues of random matrices
Exponential tail inequalities for eigenvalues of random matrices M. Ledoux Institut de Mathématiques de Toulouse, France exponential tail inequalities classical theme in probability and statistics quantify
More informationMarkov operators, classical orthogonal polynomial ensembles, and random matrices
Markov operators, classical orthogonal polynomial ensembles, and random matrices M. Ledoux, Institut de Mathématiques de Toulouse, France 5ecm Amsterdam, July 2008 recent study of random matrix and random
More informationRandom Matrix: From Wigner to Quantum Chaos
Random Matrix: From Wigner to Quantum Chaos Horng-Tzer Yau Harvard University Joint work with P. Bourgade, L. Erdős, B. Schlein and J. Yin 1 Perhaps I am now too courageous when I try to guess the distribution
More informationDeterminantal point processes and random matrix theory in a nutshell
Determinantal point processes and random matrix theory in a nutshell part II Manuela Girotti based on M. Girotti s PhD thesis, A. Kuijlaars notes from Les Houches Winter School 202 and B. Eynard s notes
More informationLarge deviations of the top eigenvalue of random matrices and applications in statistical physics
Large deviations of the top eigenvalue of random matrices and applications in statistical physics Grégory Schehr LPTMS, CNRS-Université Paris-Sud XI Journées de Physique Statistique Paris, January 29-30,
More informationPainlevé Representations for Distribution Functions for Next-Largest, Next-Next-Largest, etc., Eigenvalues of GOE, GUE and GSE
Painlevé Representations for Distribution Functions for Next-Largest, Next-Next-Largest, etc., Eigenvalues of GOE, GUE and GSE Craig A. Tracy UC Davis RHPIA 2005 SISSA, Trieste 1 Figure 1: Paul Painlevé,
More informationConcentration Inequalities for Random Matrices
Concentration Inequalities for Random Matrices M. Ledoux Institut de Mathématiques de Toulouse, France exponential tail inequalities classical theme in probability and statistics quantify the asymptotic
More informationUniversality of local spectral statistics of random matrices
Universality of local spectral statistics of random matrices László Erdős Ludwig-Maximilians-Universität, Munich, Germany CRM, Montreal, Mar 19, 2012 Joint with P. Bourgade, B. Schlein, H.T. Yau, and J.
More informationNear extreme eigenvalues and the first gap of Hermitian random matrices
Near extreme eigenvalues and the first gap of Hermitian random matrices Grégory Schehr LPTMS, CNRS-Université Paris-Sud XI Sydney Random Matrix Theory Workshop 13-16 January 2014 Anthony Perret, G. S.,
More informationInsights into Large Complex Systems via Random Matrix Theory
Insights into Large Complex Systems via Random Matrix Theory Lu Wei SEAS, Harvard 06/23/2016 @ UTC Institute for Advanced Systems Engineering University of Connecticut Lu Wei Random Matrix Theory and Large
More informationFredholm determinant with the confluent hypergeometric kernel
Fredholm determinant with the confluent hypergeometric kernel J. Vasylevska joint work with I. Krasovsky Brunel University Dec 19, 2008 Problem Statement Let K s be the integral operator acting on L 2
More information1 Intro to RMT (Gene)
M705 Spring 2013 Summary for Week 2 1 Intro to RMT (Gene) (Also see the Anderson - Guionnet - Zeitouni book, pp.6-11(?) ) We start with two independent families of R.V.s, {Z i,j } 1 i
More informationc 2005 Society for Industrial and Applied Mathematics
SIAM J. MATRIX ANAL. APPL. Vol. XX, No. X, pp. XX XX c 005 Society for Industrial and Applied Mathematics DISTRIBUTIONS OF THE EXTREME EIGENVALUES OF THE COMPLEX JACOBI RANDOM MATRIX ENSEMBLE PLAMEN KOEV
More informationEigenvalues and Singular Values of Random Matrices: A Tutorial Introduction
Random Matrix Theory and its applications to Statistics and Wireless Communications Eigenvalues and Singular Values of Random Matrices: A Tutorial Introduction Sergio Verdú Princeton University National
More informationUpdate on the beta ensembles
Update on the beta ensembles Brian Rider Temple University with M. Krishnapur IISC, J. Ramírez Universidad Costa Rica, B. Virág University of Toronto The Tracy-Widom laws Consider a random Hermitian n
More informationA Remark on Hypercontractivity and Tail Inequalities for the Largest Eigenvalues of Random Matrices
A Remark on Hypercontractivity and Tail Inequalities for the Largest Eigenvalues of Random Matrices Michel Ledoux Institut de Mathématiques, Université Paul Sabatier, 31062 Toulouse, France E-mail: ledoux@math.ups-tlse.fr
More information1 Tridiagonal matrices
Lecture Notes: β-ensembles Bálint Virág Notes with Diane Holcomb 1 Tridiagonal matrices Definition 1. Suppose you have a symmetric matrix A, we can define its spectral measure (at the first coordinate
More informationBulk scaling limits, open questions
Bulk scaling limits, open questions Based on: Continuum limits of random matrices and the Brownian carousel B. Valkó, B. Virág. Inventiones (2009). Eigenvalue statistics for CMV matrices: from Poisson
More informationNon white sample covariance matrices.
Non white sample covariance matrices. S. Péché, Université Grenoble 1, joint work with O. Ledoit, Uni. Zurich 17-21/05/2010, Université Marne la Vallée Workshop Probability and Geometry in High Dimensions
More informationUniversality for random matrices and log-gases
Universality for random matrices and log-gases László Erdős IST, Austria Ludwig-Maximilians-Universität, Munich, Germany Encounters Between Discrete and Continuous Mathematics Eötvös Loránd University,
More informationRectangular Young tableaux and the Jacobi ensemble
Rectangular Young tableaux and the Jacobi ensemble Philippe Marchal October 20, 2015 Abstract It has been shown by Pittel and Romik that the random surface associated with a large rectangular Young tableau
More informationThe Tracy-Widom distribution is not infinitely divisible.
The Tracy-Widom distribution is not infinitely divisible. arxiv:1601.02898v1 [math.pr] 12 Jan 2016 J. Armando Domínguez-Molina Facultad de Ciencias Físico-Matemáticas Universidad Autónoma de Sinaloa, México
More informationRandom Matrices: Invertibility, Structure, and Applications
Random Matrices: Invertibility, Structure, and Applications Roman Vershynin University of Michigan Colloquium, October 11, 2011 Roman Vershynin (University of Michigan) Random Matrices Colloquium 1 / 37
More informationOn the concentration of eigenvalues of random symmetric matrices
On the concentration of eigenvalues of random symmetric matrices Noga Alon Michael Krivelevich Van H. Vu April 23, 2012 Abstract It is shown that for every 1 s n, the probability that the s-th largest
More informationExtreme eigenvalue fluctutations for GUE
Extreme eigenvalue fluctutations for GUE C. Donati-Martin 204 Program Women and Mathematics, IAS Introduction andom matrices were introduced in multivariate statistics, in the thirties by Wishart [Wis]
More informationRANDOM MATRIX THEORY AND TOEPLITZ DETERMINANTS
RANDOM MATRIX THEORY AND TOEPLITZ DETERMINANTS David García-García May 13, 2016 Faculdade de Ciências da Universidade de Lisboa OVERVIEW Random Matrix Theory Introduction Matrix ensembles A sample computation:
More informationThe circular law. Lewis Memorial Lecture / DIMACS minicourse March 19, Terence Tao (UCLA)
The circular law Lewis Memorial Lecture / DIMACS minicourse March 19, 2008 Terence Tao (UCLA) 1 Eigenvalue distributions Let M = (a ij ) 1 i n;1 j n be a square matrix. Then one has n (generalised) eigenvalues
More informationApplied Linear Algebra
Applied Linear Algebra Peter J. Olver School of Mathematics University of Minnesota Minneapolis, MN 55455 olver@math.umn.edu http://www.math.umn.edu/ olver Chehrzad Shakiban Department of Mathematics University
More informationEigenvalue PDFs. Peter Forrester, M&S, University of Melbourne
Outline Eigenvalue PDFs Peter Forrester, M&S, University of Melbourne Hermitian matrices with real, complex or real quaternion elements Circular ensembles and classical groups Products of random matrices
More informationLocal semicircle law, Wegner estimate and level repulsion for Wigner random matrices
Local semicircle law, Wegner estimate and level repulsion for Wigner random matrices László Erdős University of Munich Oberwolfach, 2008 Dec Joint work with H.T. Yau (Harvard), B. Schlein (Cambrigde) Goal:
More informationRandom Matrix Theory Lecture 1 Introduction, Ensembles and Basic Laws. Symeon Chatzinotas February 11, 2013 Luxembourg
Random Matrix Theory Lecture 1 Introduction, Ensembles and Basic Laws Symeon Chatzinotas February 11, 2013 Luxembourg Outline 1. Random Matrix Theory 1. Definition 2. Applications 3. Asymptotics 2. Ensembles
More informationTriangular matrices and biorthogonal ensembles
/26 Triangular matrices and biorthogonal ensembles Dimitris Cheliotis Department of Mathematics University of Athens UK Easter Probability Meeting April 8, 206 2/26 Special densities on R n Example. n
More informationNumerical analysis and random matrix theory. Tom Trogdon UC Irvine
Numerical analysis and random matrix theory Tom Trogdon ttrogdon@math.uci.edu UC Irvine Acknowledgements This is joint work with: Percy Deift Govind Menon Sheehan Olver Raj Rao Numerical analysis and random
More informationRandom Matrices and Multivariate Statistical Analysis
Random Matrices and Multivariate Statistical Analysis Iain Johnstone, Statistics, Stanford imj@stanford.edu SEA 06@MIT p.1 Agenda Classical multivariate techniques Principal Component Analysis Canonical
More informationFrom the mesoscopic to microscopic scale in random matrix theory
From the mesoscopic to microscopic scale in random matrix theory (fixed energy universality for random spectra) With L. Erdős, H.-T. Yau, J. Yin Introduction A spacially confined quantum mechanical system
More informationHomogenization of the Dyson Brownian Motion
Homogenization of the Dyson Brownian Motion P. Bourgade, joint work with L. Erdős, J. Yin, H.-T. Yau Cincinnati symposium on probability theory and applications, September 2014 Introduction...........
More informationLarge sample covariance matrices and the T 2 statistic
Large sample covariance matrices and the T 2 statistic EURANDOM, the Netherlands Joint work with W. Zhou Outline 1 2 Basic setting Let {X ij }, i, j =, be i.i.d. r.v. Write n s j = (X 1j,, X pj ) T and
More informationRandom Correlation Matrices, Top Eigenvalue with Heavy Tails and Financial Applications
Random Correlation Matrices, Top Eigenvalue with Heavy Tails and Financial Applications J.P Bouchaud with: M. Potters, G. Biroli, L. Laloux, M. A. Miceli http://www.cfm.fr Portfolio theory: Basics Portfolio
More informationThe Density Matrix for the Ground State of 1-d Impenetrable Bosons in a Harmonic Trap
The Density Matrix for the Ground State of 1-d Impenetrable Bosons in a Harmonic Trap Institute of Fundamental Sciences Massey University New Zealand 29 August 2017 A. A. Kapaev Memorial Workshop Michigan
More informationOptimality and Sub-optimality of Principal Component Analysis for Spiked Random Matrices
Optimality and Sub-optimality of Principal Component Analysis for Spiked Random Matrices Alex Wein MIT Joint work with: Amelia Perry (MIT), Afonso Bandeira (Courant NYU), Ankur Moitra (MIT) 1 / 22 Random
More informationJINHO BAIK Department of Mathematics University of Michigan Ann Arbor, MI USA
LIMITING DISTRIBUTION OF LAST PASSAGE PERCOLATION MODELS JINHO BAIK Department of Mathematics University of Michigan Ann Arbor, MI 48109 USA E-mail: baik@umich.edu We survey some results and applications
More informationRandom matrices: Distribution of the least singular value (via Property Testing)
Random matrices: Distribution of the least singular value (via Property Testing) Van H. Vu Department of Mathematics Rutgers vanvu@math.rutgers.edu (joint work with T. Tao, UCLA) 1 Let ξ be a real or complex-valued
More informationDEVIATION INEQUALITIES ON LARGEST EIGENVALUES
DEVIATION INEQUALITIES ON LARGEST EIGENVALUES M. Ledoux University of Toulouse, France In these notes, we survey developments on the asymptotic behavior of the largest eigenvalues of random matrix and
More informationSemicircle law on short scales and delocalization for Wigner random matrices
Semicircle law on short scales and delocalization for Wigner random matrices László Erdős University of Munich Weizmann Institute, December 2007 Joint work with H.T. Yau (Harvard), B. Schlein (Munich)
More informationFluctuations from the Semicircle Law Lecture 4
Fluctuations from the Semicircle Law Lecture 4 Ioana Dumitriu University of Washington Women and Math, IAS 2014 May 23, 2014 Ioana Dumitriu (UW) Fluctuations from the Semicircle Law Lecture 4 May 23, 2014
More informationAiry and Pearcey Processes
Airy and Pearcey Processes Craig A. Tracy UC Davis Probability, Geometry and Integrable Systems MSRI December 2005 1 Probability Space: (Ω, Pr, F): Random Matrix Models Gaussian Orthogonal Ensemble (GOE,
More informationIII. Quantum ergodicity on graphs, perspectives
III. Quantum ergodicity on graphs, perspectives Nalini Anantharaman Université de Strasbourg 24 août 2016 Yesterday we focussed on the case of large regular (discrete) graphs. Let G = (V, E) be a (q +
More informationEigenvalue variance bounds for Wigner and covariance random matrices
Eigenvalue variance bounds for Wigner and covariance random matrices S. Dallaporta University of Toulouse, France Abstract. This work is concerned with finite range bounds on the variance of individual
More informationDistribution of Bipartite Entanglement of a Random Pure State
Distribution of Bipartite Entanglement of a Random Pure State Satya N. Majumdar Laboratoire de Physique Théorique et Modèles Statistiques,CNRS, Université Paris-Sud, France Collaborators: C. Nadal (Oxford
More informationarxiv: v1 [cond-mat.stat-mech] 18 Aug 2008
Deformations of the Tracy-Widom distribution arxiv:0808.2434v1 [cond-mat.stat-mech] 18 Aug 2008 O. Bohigas 1, J. X. de Carvalho 2,3 and M. P. Pato 1,2 1 CNRS, Université Paris-Sud, UMR8626, LPTMS, Orsay
More informationarxiv: v3 [math-ph] 21 Jun 2012
LOCAL MARCHKO-PASTUR LAW AT TH HARD DG OF SAMPL COVARIAC MATRICS CLAUDIO CACCIAPUOTI, AA MALTSV, AD BJAMI SCHLI arxiv:206.730v3 [math-ph] 2 Jun 202 Abstract. Let X be a matrix whose entries are i.i.d.
More informationProgress in the method of Ghosts and Shadows for Beta Ensembles
Progress in the method of Ghosts and Shadows for Beta Ensembles Alan Edelman (MIT) Alex Dubbs (MIT) and Plamen Koev (SJS) Oct 8, 2012 1/47 Wishart Matrices (arbitrary covariance) G=mxn matrix of Gaussians
More informationMeasures and Jacobians of Singular Random Matrices. José A. Díaz-Garcia. Comunicación de CIMAT No. I-07-12/ (PE/CIMAT)
Measures and Jacobians of Singular Random Matrices José A. Díaz-Garcia Comunicación de CIMAT No. I-07-12/21.08.2007 (PE/CIMAT) Measures and Jacobians of singular random matrices José A. Díaz-García Universidad
More informationarxiv:hep-th/ v1 14 Oct 1992
ITD 92/93 11 Level-Spacing Distributions and the Airy Kernel Craig A. Tracy Department of Mathematics and Institute of Theoretical Dynamics, University of California, Davis, CA 95616, USA arxiv:hep-th/9210074v1
More informationTOP EIGENVALUE OF CAUCHY RANDOM MATRICES
TOP EIGENVALUE OF CAUCHY RANDOM MATRICES with Satya N. Majumdar, Gregory Schehr and Dario Villamaina Pierpaolo Vivo (LPTMS - CNRS - Paris XI) Gaussian Ensembles N = 5 Semicircle Law LARGEST EIGENVALUE
More informationReferences 167. dx n x2 =2
References 1. G. Akemann, J. Baik, P. Di Francesco (editors), The Oxford Handbook of Random Matrix Theory, Oxford University Press, Oxford, 2011. 2. G. Anderson, A. Guionnet, O. Zeitouni, An Introduction
More informationFluctuations of the free energy of spherical spin glass
Fluctuations of the free energy of spherical spin glass Jinho Baik University of Michigan 2015 May, IMS, Singapore Joint work with Ji Oon Lee (KAIST, Korea) Random matrix theory Real N N Wigner matrix
More informationCOMPLEX HERMITE POLYNOMIALS: FROM THE SEMI-CIRCULAR LAW TO THE CIRCULAR LAW
Serials Publications www.serialspublications.com OMPLEX HERMITE POLYOMIALS: FROM THE SEMI-IRULAR LAW TO THE IRULAR LAW MIHEL LEDOUX Abstract. We study asymptotics of orthogonal polynomial measures of the
More informationA Note on the Central Limit Theorem for the Eigenvalue Counting Function of Wigner and Covariance Matrices
A Note on the Central Limit Theorem for the Eigenvalue Counting Function of Wigner and Covariance Matrices S. Dallaporta University of Toulouse, France Abstract. This note presents some central limit theorems
More informationPreface to the Second Edition...vii Preface to the First Edition... ix
Contents Preface to the Second Edition...vii Preface to the First Edition........... ix 1 Introduction.............................................. 1 1.1 Large Dimensional Data Analysis.........................
More informationMaximal height of non-intersecting Brownian motions
Maximal height of non-intersecting Brownian motions G. Schehr Laboratoire de Physique Théorique et Modèles Statistiques CNRS-Université Paris Sud-XI, Orsay Collaborators: A. Comtet (LPTMS, Orsay) P. J.
More informationMultiple orthogonal polynomials. Bessel weights
for modified Bessel weights KU Leuven, Belgium Madison WI, December 7, 2013 Classical orthogonal polynomials The (very) classical orthogonal polynomials are those of Jacobi, Laguerre and Hermite. Classical
More informationOPSF, Random Matrices and Riemann-Hilbert problems
OPSF, Random Matrices and Riemann-Hilbert problems School on Orthogonal Polynomials in Approximation Theory and Mathematical Physics, ICMAT 23 27 October, 2017 Plan of the course lecture 1: Orthogonal
More informationA determinantal formula for the GOE Tracy-Widom distribution
A determinantal formula for the GOE Tracy-Widom distribution Patrik L. Ferrari and Herbert Spohn Technische Universität München Zentrum Mathematik and Physik Department e-mails: ferrari@ma.tum.de, spohn@ma.tum.de
More informationMULTIVARIATE ANALYSIS OF VARIANCE UNDER MULTIPLICITY José A. Díaz-García. Comunicación Técnica No I-07-13/ (PE/CIMAT)
MULTIVARIATE ANALYSIS OF VARIANCE UNDER MULTIPLICITY José A. Díaz-García Comunicación Técnica No I-07-13/11-09-2007 (PE/CIMAT) Multivariate analysis of variance under multiplicity José A. Díaz-García Universidad
More informationInvertibility of random matrices
University of Michigan February 2011, Princeton University Origins of Random Matrix Theory Statistics (Wishart matrices) PCA of a multivariate Gaussian distribution. [Gaël Varoquaux s blog gael-varoquaux.info]
More informationAdvances in Random Matrix Theory: Let there be tools
Advances in Random Matrix Theory: Let there be tools Alan Edelman Brian Sutton, Plamen Koev, Ioana Dumitriu, Raj Rao and others MIT: Dept of Mathematics, Computer Science AI Laboratories World Congress,
More informationSEA s workshop- MIT - July 10-14
Matrix-valued Stochastic Processes- Eigenvalues Processes and Free Probability SEA s workshop- MIT - July 10-14 July 13, 2006 Outline Matrix-valued stochastic processes. 1- definition and examples. 2-
More informationThe Matrix Dyson Equation in random matrix theory
The Matrix Dyson Equation in random matrix theory László Erdős IST, Austria Mathematical Physics seminar University of Bristol, Feb 3, 207 Joint work with O. Ajanki, T. Krüger Partially supported by ERC
More informationLarge Dimensional Random Matrices: Some Models and Applications
Large Dimensional Random Matrices: Some Models and Applications A tour through some pioneering breakthroughs Victor Pérez-Abreu Department of Probability and Statistics CIMAT, Guanajuato, Mexico 60th ISI
More informationFinite Rank Perturbations of Random Matrices and Their Continuum Limits. Alexander Bloemendal
Finite Rank Perturbations of Random Matrices and Their Continuum Limits by Alexander Bloemendal A thesis submitted in conformity with the requirements for the degree of Doctor of Philosophy Graduate Department
More informationarxiv: v1 [math-ph] 19 Oct 2018
COMMENT ON FINITE SIZE EFFECTS IN THE AVERAGED EIGENVALUE DENSITY OF WIGNER RANDOM-SIGN REAL SYMMETRIC MATRICES BY G.S. DHESI AND M. AUSLOOS PETER J. FORRESTER AND ALLAN K. TRINH arxiv:1810.08703v1 [math-ph]
More informationEIGENVECTOR OVERLAPS (AN RMT TALK) J.-Ph. Bouchaud (CFM/Imperial/ENS) (Joint work with Romain Allez, Joel Bun & Marc Potters)
EIGENVECTOR OVERLAPS (AN RMT TALK) J.-Ph. Bouchaud (CFM/Imperial/ENS) (Joint work with Romain Allez, Joel Bun & Marc Potters) Randomly Perturbed Matrices Questions in this talk: How similar are the eigenvectors
More informationENCYCLOPEDIA OF MATHEMATICS AND ITS APPLICATIONS. Special Functions GEORGE E. ANDREWS RICHARD ASKEY RANJAN ROY CAMBRIDGE UNIVERSITY PRESS
ENCYCLOPEDIA OF MATHEMATICS AND ITS APPLICATIONS Special Functions GEORGE E. ANDREWS RICHARD ASKEY RANJAN ROY CAMBRIDGE UNIVERSITY PRESS Preface page xiii 1 The Gamma and Beta Functions 1 1.1 The Gamma
More informationDynamical approach to random matrix theory
Dynamical approach to random matrix theory László Erdős, Horng-Tzer Yau May 9, 207 Partially supported by ERC Advanced Grant, RAMAT 338804 Partially supported by the SF grant DMS-307444 and a Simons Investigator
More informationLinear Algebra in Actuarial Science: Slides to the lecture
Linear Algebra in Actuarial Science: Slides to the lecture Fall Semester 2010/2011 Linear Algebra is a Tool-Box Linear Equation Systems Discretization of differential equations: solving linear equations
More informationHow long does it take to compute the eigenvalues of a random symmetric matrix?
How long does it take to compute the eigenvalues of a random symmetric matrix? Govind Menon (Brown University) Joint work with: Christian Pfrang (Ph.D, Brown 2011) Percy Deift, Tom Trogdon (Courant Institute)
More informationNUMERICAL SOLUTION OF DYSON BROWNIAN MOTION AND A SAMPLING SCHEME FOR INVARIANT MATRIX ENSEMBLES
NUMERICAL SOLUTION OF DYSON BROWNIAN MOTION AND A SAMPLING SCHEME FOR INVARIANT MATRIX ENSEMBLES XINGJIE HELEN LI AND GOVIND MENON Abstract. The Dyson Brownian Motion (DBM) describes the stochastic evolution
More informationSparse PCA in High Dimensions
Sparse PCA in High Dimensions Jing Lei, Department of Statistics, Carnegie Mellon Workshop on Big Data and Differential Privacy Simons Institute, Dec, 2013 (Based on joint work with V. Q. Vu, J. Cho, and
More informationApplications of random matrix theory to principal component analysis(pca)
Applications of random matrix theory to principal component analysis(pca) Jun Yin IAS, UW-Madison IAS, April-2014 Joint work with A. Knowles and H. T Yau. 1 Basic picture: Let H be a Wigner (symmetric)
More informationFluctuations of Random Matrices and Second Order Freeness
Fluctuations of Random Matrices and Second Order Freeness james mingo with b. collins p. śniady r. speicher SEA 06 Workshop Massachusetts Institute of Technology July 9-14, 2006 1 0.4 0.2 0-2 -1 0 1 2-2
More informationA Note on Universality of the Distribution of the Largest Eigenvalues in Certain Sample Covariance Matrices
Journal of Statistical Physics, Vol. 18, Nos. 5/6, September ( ) A Note on Universality of the Distribution of the Largest Eigenvalues in Certain Sample Covariance Matrices Alexander Soshnikov 1 Received
More informationNumerical Solutions to the General Marcenko Pastur Equation
Numerical Solutions to the General Marcenko Pastur Equation Miriam Huntley May 2, 23 Motivation: Data Analysis A frequent goal in real world data analysis is estimation of the covariance matrix of some
More informationLimits of spiked random matrices I
Limits of spiked random matrices I Alex Bloemendal Bálint Virág arxiv:1011.1877v2 [math.pr] 16 Sep 2011 September 16, 2011 Abstract Given a large, high-dimensional sample from a spiked population, the
More informationPreface to Second Edition... vii. Preface to First Edition...
Contents Preface to Second Edition..................................... vii Preface to First Edition....................................... ix Part I Linear Algebra 1 Basic Vector/Matrix Structure and
More informationEstimation of large dimensional sparse covariance matrices
Estimation of large dimensional sparse covariance matrices Department of Statistics UC, Berkeley May 5, 2009 Sample covariance matrix and its eigenvalues Data: n p matrix X n (independent identically distributed)
More informationABOUT PRINCIPAL COMPONENTS UNDER SINGULARITY
ABOUT PRINCIPAL COMPONENTS UNDER SINGULARITY José A. Díaz-García and Raúl Alberto Pérez-Agamez Comunicación Técnica No I-05-11/08-09-005 (PE/CIMAT) About principal components under singularity José A.
More informationHomework 1. Yuan Yao. September 18, 2011
Homework 1 Yuan Yao September 18, 2011 1. Singular Value Decomposition: The goal of this exercise is to refresh your memory about the singular value decomposition and matrix norms. A good reference to
More informationAsymptotic Distribution of the Largest Eigenvalue via Geometric Representations of High-Dimension, Low-Sample-Size Data
Sri Lankan Journal of Applied Statistics (Special Issue) Modern Statistical Methodologies in the Cutting Edge of Science Asymptotic Distribution of the Largest Eigenvalue via Geometric Representations
More informationBeyond the Gaussian universality class
Beyond the Gaussian universality class MSRI/Evans Talk Ivan Corwin (Courant Institute, NYU) September 13, 2010 Outline Part 1: Random growth models Random deposition, ballistic deposition, corner growth
More informationSelfadjoint Polynomials in Independent Random Matrices. Roland Speicher Universität des Saarlandes Saarbrücken
Selfadjoint Polynomials in Independent Random Matrices Roland Speicher Universität des Saarlandes Saarbrücken We are interested in the limiting eigenvalue distribution of an N N random matrix for N. Typical
More informationarxiv:cond-mat/ v1 [cond-mat.stat-mech] 13 Mar 2003
arxiv:cond-mat/0303262v1 [cond-mat.stat-mech] 13 Mar 2003 Quantum fluctuations and random matrix theory Maciej M. Duras Institute of Physics, Cracow University of Technology, ulica Podchor ażych 1, PL-30084
More informationNumerical Evaluation of Standard Distributions in Random Matrix Theory
Numerical Evaluation of Standard Distributions in Random Matrix Theory A Review of Folkmar Bornemann s MATLAB Package and Paper Matt Redmond Department of Mathematics Massachusetts Institute of Technology
More informationConcentration inequalities: basics and some new challenges
Concentration inequalities: basics and some new challenges M. Ledoux University of Toulouse, France & Institut Universitaire de France Measure concentration geometric functional analysis, probability theory,
More informationRandom matrices and determinantal processes
Random matrices and determinantal processes Patrik L. Ferrari Zentrum Mathematik Technische Universität München D-85747 Garching 1 Introduction The aim of this work is to explain some connections between
More informationOn the principal components of sample covariance matrices
On the principal components of sample covariance matrices Alex Bloemendal Antti Knowles Horng-Tzer Yau Jun Yin February 4, 205 We introduce a class of M M sample covariance matrices Q which subsumes and
More informationDeterminantal point processes and random matrix theory in a nutshell
Determinantal point processes and random matrix theory in a nutshell part I Manuela Girotti based on M. Girotti s PhD thesis and A. Kuijlaars notes from Les Houches Winter School 202 Contents Point Processes
More informationMIT Term Project: Numerical Experiments on Circular Ensembles and Jack Polynomials with Julia
MIT 18.338 Term Project: Numerical Experiments on Circular Ensembles and Jack Polynomials with Julia N. Kemal Ure May 15, 2013 Abstract This project studies the numerical experiments related to averages
More informationFluctuations of random tilings and discrete Beta-ensembles
Fluctuations of random tilings and discrete Beta-ensembles Alice Guionnet CRS (E S Lyon) Workshop in geometric functional analysis, MSRI, nov. 13 2017 Joint work with A. Borodin, G. Borot, V. Gorin, J.Huang
More information