arxiv: v4 [math.pr] 27 Jul 2016

Transcription

1 The Asymptotic Distribution of the Determinant of a Ranom Correlation Matrix arxiv:309768v4 mathpr] 7 Jul 06 AM Hanea a, & GF Nane b a Centre of xcellence for Biosecurity Risk Analysis, University of Melbourne, Australia b Delft Institute of Applie Mathematics, Technical University of Delft Abstract Ranom correlation matrices are stuie for both theoretical interestingness an importance for applications The author of 6] is intereste in their interpretation as covariance matrices of purely ranom signals, the authors of 6] employ them in the generation of ranom clusters for stuying clustering methos, whereas the authors of 8] use them for stuying subset selection in multiple regression, etc The eterminant of a matrix is one of the most basic an important matrix functions, an this makes stuying the istribution of the eterminant of a ranom correlation matrix of paramount importance Our main result gives the asymptotic istribution of the eterminant of a ranom correlation matrix sample from a uniform istribution over the space of correlation matrices Several spin-off results are proven along the way, an an interesting connection with the law of the eterminant of general ranom matrices, proven in ], is investigate Keywors: ranom correlation matrix, eterminant, beta istribution, ranom matrix, regular vines Introuction The authors of 7] an ] have stuie extensively the problem of generating ranom correlation matrices uniformly from the space of positive efinite correlation matrices In 7] it is shown that since a imensional positive efinite correlation matrix R ρ ij i,,, can be parametrise in terms of correlations ρ i,i+ an partial correlations ρ i,j;i+,,j for j i, an these parameters can inepenently take values in the interval,, one can generate a ranom correlation matrix by choosing inepenent istributions F ij, i < j for these parameters Appropriate choices for F ij lea to a joint ensity for ρ ij: i<j that is proportional to etr η, where η > 0 In ] it is shown that in this case the joint ensity is invariant to the orer of inexing of variables for the partial correlations, an each ρ ij marginally has a Beta η +, η + istribution on, The uniform ensity over the set of positive efinite correlation matrices is obtaine when η The proof of this result is formulate using the notion of the partial correlation regular vines Vines were introuce in 3] an ] A vine on variables is a neste set of trees The eges of the j th tree are the noes of the j + th tree A regular vine on variables is a vine in which two eges in tree j are joine by an ege in tree j + only if these eges share a common noe More formally: Definition V is calle a regular vine on elements if: V T,, T ; Corresponence to: AM Hanea, CBRA, University of Melbourne, Parkville, VIC 300, Australia, ancahanea@unimelbeuau

2 T is a tree with noes N {,, }, an eges an for i,,, T i is a tree with noes N i i ; 3 For i,,, a, b i, #a b, where enotes the symmetric ifference In other wors if a an b are noes of T i connecte by an ege in T i, where a {a, a }, b {b, b }, then exactly one of the a i equals one of the b i For each ege of the vine we istinguish a constraint, a conitioning, an a conitione set Variables reachable from an ege, via the membership relation, form its constraint set If two eges are joine by an ege in the next tree the intersection an symmetric ifference of their constraint sets give the conitioning an conitione sets, respectively ach regular vine ege may be associate with a partial correlation A complete partial correlation vine specification is a regular vine with a partial correlation specifie for each ege A partial correlation vine specification oes not uniquely specify a joint istribution, but there is a joint istribution satisfying the specifie information ] The property of vines that plays a crucial role in the starting point of this paper is given in the next theorem 9] Theorem Let D be the eterminant of a correlation matrix, R, of variables X,, X, with D > 0 For any partial correlation vine: D ρ e,e ;C e, e V where V is the set of eges of the vine V, C e enotes the conitioning set associate with ege e, an {e, e } is the conitione set of e Vines are actually a way of factorising the eterminant of the correlation matrix in terms of partial correlations As mentione earlier, the uniform ensity over the set of positive efinite correlation matrices is invariant to the orer of inexing of variables for the partial correlations, an each ρ ij marginally follows a Beta, istribution on,, k Remark It is worth mentioning that if the ρ ij s woul be inepenent, then they woul iniviually approach 0, as the imension approaches infinity As a consequence the eterminant of the correlation matrix woul then approach The main theorem from Section reveals a completely ifferent behaviour of the eterminant of a ranom correlation matrix It is shown that each partial correlation ρ i,j;k from factorisation has a Beta k istribution on,, where k is the carinality of the conitioning set K It follows that each ρ i,j;k has a Beta, k istribution on 0, an each ρ i,j;k is istribute accoring to a Beta k, istribution Rearranging the terms from factorisation, we rewrite D in terms of inepenent Beta k, variables on 0, as: where B i Beta + i, D j0 ij B i, Throughout the paper, we will enote by B i Beta istribute ranom variables on 0, Although etermine by ior j, the parameter of the Beta variables can iffer This abuse of notation will be compensate by an increase clarity of the exposition Moreover a given set of marginal istributions may not be consistent with a given set of partial correlations

3 Main Results Theorem For a uniform istribution over the space of correlation matrices, the marginal istribution of each correlation is Beta, on, Take R to be such a correlation matrix an let D be its eterminant Then D can be written as a prouct of inepenent Beta istribute ranom variables: where B j Beta j+, j, j,, D B j, 3 Proof Let D be represente as in equation The variables B i Beta + i, are inepenent Let a i + i an b i It follows that a i+ a i + b i The authors of 3] prove that for such variables: B i Beta a, b i i i Using the above property we reuce the secon prouct in to one variable with known istribution: B i Beta + j, Beta + j, j Then: ij ij where B j Beta j+, j D B j, Remark Observe that the sum of the Beta istribution parameters in Theorem is constant an equal to S + ; then the expression of the eterminant in equation 3 can be written as the prouct of B j Beta S j, j istribute variables, j,, Rearranging the terms an looking separately at o an even values of we obtain: B D B B k B j B j B j B j, k where B Beta,, Bk Beta k+, k+, Bj Beta j+, j, k +, an B j Beta j, j+ Corollary Consier the correlation matrices such that each ρ ij marginally has a Beta istribution on,, with both parameters equal to η +, for η > 0 Then the eterminant D of such correlation matrix can be written as a prouct of inepenent Beta istribute ranom variables B j, ie D B j, where B j Beta η + j, j 3

4 Theorem 3 Main Theorem For > 0, consier the uniform istribution over the space of correlation matrices Let R be a ranom correlation matrix an let D be its eterminant Then, as, D / p e Proof Consier the expression for D given in equation 3, where B j Beta j+, j The variables B j are inepenent, so the expectation of D / can be calculate as a prouct of expectations of Beta variables raise to the power Let α j+, β j, S α + β + Let Bα, β enote the Beta function, an Γ enote the Gamma function Then: D / B / j B / j Bα +, β Bα, β ] ΓS ΓS + Γ Γα + Γα + β Γα Γα + β + j+ + Γ j+ Using results originally formulate in 4] an refine in 0], we can write: for a, b 0 an z Γz + a Γz + b za b + O z ], 4 D / S + Furthermore, by using Stirling s approximation, j +! + O z ] +O z ] then! π + O ], e D / π e + O ] 6 4 π e + O ]

5 It follows immeiately that Similarly, By 7 an 8, lim var lim D / lim D / ] D / lim lim D / e 7 D / ] lim By 7 an 9, an by using Chebyshev s inequality, the proof is complete e 8 ] D / 0 9 Since convergence in probability implies convergence in istribution, the following result emerges Corollary For a uniform istribution over the space of correlation matrices, consier a ranom correlation matrix R an let D be its eterminant Consier the sequence of ranom variables D /, for,, Then, this sequence converges in istribution to a egenerate ranom variable D e, D / e The result of Theorem 3 also hols for the space of correlation matrices where each element marginally istribute accoring to a Beta η +, η + istribution on, This is state in the corollary below an the proof can be foun in the Appenix Corollary 3 Consier the correlation matrices such that each ρ ij marginally follows a Beta istribution on,, with both parameters equal to η +, for η > 0 Let R be such a matrix an D its eterminant Then D / e, as, in probability Remark 3 ach correlation in the correlation matrix marginally has a Beta, istribution on, When, each Beta, istribution will approach 0 In other wors, if the entries in the correlation matrix woul be inepenent, the eterminant woul approach as the imension increases The above theorem reveals an opposite behaviour, namely the convergence of the eterminant towars its other boun, namely 0 This behaviour is inuce by the epenence amongst the entries of the correlation matrix 3 Spin-off Results The asymptotic behaviour of the th root of the first two moments of D is formulate in the following proposition The proof of this proposition can be foun in the Appenix Proposition For a uniform istribution over the space of correlation matrices, the marginal istribution of each correlation follows a Beta/, / istribution on,, an the eterminant D of a correlation matrix follows the expression from equation 3 Then: lim D e lim D / lim var D e ] lim D

6 The first equality from the above proposition suggests a linear behaviour cause by the egenerate istribution of the scale eterminant The same behaviour will be later observe in a ifferent context Corollary 4 The first two moments of the istribution of the eterminant of a ranom correlation matrix can be written as follows, for very large : D D / ] + O vard D ] + O The first moment of D can be calculate exactly as a function of the imension, whereas it is easier to calculate only an approximation of the secon moment Their respective expressions are given in the following proposition see Appenix for proofs Proposition For a uniform istribution over the space of correlation matrices, the marginal istribution of each correlation is Beta, on, an the eterminant D of a correlation matrix follows the expression from equation 3 Then:! D + ] vard 6 +! +3! +! Form a completely ifferent perspective, it is interesting to notice that D can be expresse as an elementary norm ] Remark 4 Let D be approximate as in Corollary 4 see Appenix This approximation is the continuous version of the elementary r-norm, where r Using Theorem 87 from ], one can prove: D e lnd] + O More results about the logarithm of the eterminant of the correlation matrix are investigate in the following section 4 The Logarithm of the Determinant of a Ranom Correlation Matrix Since sums of inepenent ranom variables play a more important role than proucts, an they have been stuie more thoroughly, it woul be convenient to investigate the behavior of the logarithm of the eterminant of the correlation matrix, rather than of the eterminant itself Let us enote Y ln D an look at the first two moments of this new ranom variable Consier B j Beta j+, j, k, ψ the igamma function, an γ the uler - Mascheroni constant The calculations will follow the same lines for an o imension 6

7 Y ln B j ψ ψ + + ψk + ψ j + + k γ ln + Rewriting ψ k + as γ ln + k i k Y i ψ ] ψ i i k + ψ ] 4i k i ψ k + i i + an rearranging an cancelling terms we obtain: i ln + i ] + k i i 0 We will further provie lower an upper bouns for Y Firstly, note the the first sum is a partial sum of an alternating series that converges to ln: k i i i k i k k S k The partial sum S k approximates ln with an error that can be boune be the next term in the series, that is: For the secon sum in 0, we use that, for any N > : S k ln k + Then: lnn + < N i i + lnn Similarly, This gives that: By : which gives: k i k i k i k i > + i > + lnk + i0 i k i + < + + lnk + < k i i i + + lnk ] i + + lnk ] k + + S k ln + k + +, 7

8 Together with, we get: + + S k ln + ] ln + < Y ] + ln 3 To get an approximation for Y, we can use the result in Theorem 3 in ]: This gives: n i i lnn + γ + O Y + ln 4 n + + γ + o It woul seem that we coul use the approximation Y + o Nonetheless, the simulations in the following section will show that this approximation is not accurate Remark Using Remark 4 an the above result we obtain: D e Y + O 0, as To calculate the variance of Y we nee the first erivative of the igamma function, also known as the trigamma function, enote by ψ Then: ] j + + vary var ln B j ψ ψ k π 6 k ] + k π k i i i ψ i By rewriting ψ + as ψ 4 k i, substituting for the known values of ψ i, reucing an manipulating remaining terms, we obtain: vary ln k + γ + k k + π 4 + i By using, we obtain the lower an upper bouns for vary : ln π + γ ln + π < vary ln + γ ln 6 It can be easily shown that vary ln + o ven though the expression of the first two moments of Y o not look particularly promising, they will be employe in proving the central limit theorem CLT for inepenent, but not necessarily ientically istribute, ranom variables However, before iving into the proof, we present a simulation base confirmation of such a result, which provies an interesting link with results for the eterminant of ranom correlation matrices in general i 8

9 4 The law of the eterminant of ranom matrices The authors of ] prove that for a imensional ranom matrix A whose entries a ij are inepenent real ranom variables with mean zero an variance one, the logarithm of eta satisfies the central limit theorem More precisely: sup P x R log eta / log! x / log Φx log /3+o Since the entries of a ranom correlation matrix are efinitely not inepenent, we cannot use this result as it is So far, we only have an inication of the orer of the first two moments of Y The entries in our correlation matrix R ρ ij i,,, are Beta, istribute on, That is to say, they are ranom variables with mean 0 an variance + Then the variables + ρ ij have mean zero an variance one Ignoring for a moment that the ρ ijs are not inepenent, taking a ij + ρ ij, an applying the result above, we obtain that Y can be approximate by O + O ln N0,, where N0, is a stanar normal variable The above result is somewhat in line with the previous calculations for the mean an variance Y of Y Moreover, simulating +, for imensions 400, an 00, we obtain a istribution that is ln unistinguishable from a normal istribution when performing a two-sample Kolmogorov-Smirnov gooness-of-fit hypothesis test with mean 7, an stanar eviation 00 As shown above the mean of Y is not O, but O + ln + + γ The following section inclues the formal proof of the asymptotic normality of Y 4 The asymptotic normality of Y In this section we will prove the Lyapunov CLT of the logarithm of the eterminant of a ranom correlation matrix: Y ln D ln B j, 7 where B j Beta j+, j are inepenent ranom variables Note that Y involves a sequence of sequences, thus a CLT theorem for triangular arrays is provie below Theorem 4 Asymptotic normality For > 0, consier the uniform istribution over the space of correlation matrices Let R be a ranom correlation matrix an let D be its eterminant Moreover, let Y be the logarithm of D Then, as, Y + + ln + γ + ln N0, Proof Let an j + µ j ln B j ψ ψ +, j + + σj V arln B j ψ ψ 9

10 a Normal variable, 400 b c Normal variable, Y + q, ln 0 Y + q, ln Figure : Simulations of normally istribute ranom variables a,c an scale logarithm of the eterminant of a ranom correlation matrix b,, for 400 an 00 0

11 where ψ is the igamma function an ψ is the trigamma function The following inequality from ], for any x >, implies that x < ψ x < x, 8 σ j < j + < For j, ψ π 6 an σ < π 6 + < Thus σ j <, for all j,, Let s σj It is immeiate that the sequence Y Y s has mean 0 an variance To prove its asymptotic normality, we will show that the Lyapunov conition is satisfie, that is, there exists δ > 0 such that s +δ ln B j µ j +δ 0, 9 for We will prove 9 for δ, hence investigating the fourth central moment of the ranom variable ln B j, for j,,, ln B j µ j 4] k ln B j µ j ], where k 4 is the fourth cumulant of the istribution of ln B j, with B j Beta j+, j By letting ψ n enote the polygamma functions, then an we can write k n ψ n j + ln B j µ j 4] ψ 3 j + The authors of 4] have shown that, for any x > 0, + ψ n, + j + + ψ 3 + 3ψ 3ψ n! x + n + n! x n+ < ψ nx < n! n! x + + n x n+ By using this inequality, it follows that ln B j µ j 4 6 < j j ] + 6 j + + j A

12 To boun the variance term in 9, we employ another inequality provie in 4] x x < ψ x < x, for x > we have that ψ which gives that We have that where j + + ψ > j 3j, s 4 > j 3j B s 4 ln B j µ j 4 < A < A, B B ] A 3 j j j j + Proving that A b B 0 for completes then the proof of the theorem Note that, when letting, the enominator an numerator contain convergent p-series The ominant terms are the harmonic series, an by 4, they can be approximate by ln + γ The square sum in the enominator gets the limit to zero 43 Y s moment generating function The moment generating function of Y can be calculate as follows: M Y t e t ln B j B B t + j+ j+, j, j, 0 where Bα, β is a Beta function Using that Γz+a Γz+b za b, as z + an S +, an Proposition we obtain3 : M Y t + t Γ Γ j+ j+ ΓS ] Γt + S j + t t + t ]! t + D ] t In this case, the first erivative of M Y t evaluate at t 0 equals ln D, hence ln D ln D This suggests again a linear behaviour cause by the egenerate istribution of the scale eterminant 3 The prouct is ominate by the higher orer terms

13 Discussion This research is concerne with the asymptotic istribution of the eterminant D, of a ranom correlation matrix sample from a uniform istribution over the space of correlation matrices We prove that the th root of the eterminant has a egenerate limiting istribution Several spin-off results proven along the way inclue expressions for the first two moments of D an results about the asymptotic behaviour of the of the th root of the first two moments of D An interesting connection between D an elementary norms is establishe Another link with the law of the eterminant of general ranom matrices is also investigate When looking at the logarithm of the eterminant of the correlation matrix, we are actually investigating a sum of inepenent ranom variables Using this, the asymptotic normality of the logarithm of the eterminant of a ranom correlation matrix was establishe 6 Appenix The proof of Corollary 3 follows the same lines as the proof of Theorem 3 Corollary 3 Consier the correlation matrices such that each ρ ij marginally follows a Beta istribution on,, with both parameters equal to η +, for η > 0 Let R be such a matrix an D its eterminant Then D / e, as, in probability Proof Consier the expression for D given in Corollary Let B j enote the Beta variables from the prouct; B j s are inepenent, so the expectation of D / can be calculate as a prouct of expectations of Beta variables raise to the power Let α η + j, β j, S α + β η + Let Bα, β enote the Beta function, an Γ enote the Gamma function Then: By 4, D / B / j B / j ΓS ΓS + Bα +, β Bα, β ] Γα + Γα + β Γα Γα + β + Γη + j + Γη + j D / S η + j η + η +!] η!] Using an rearranging the terms gives 3

14 D / η!] e η+ π η + Then lim D / e In the same fashion we show that The above equalities prove η + η η + η + η + lim lim var Let us now prove Propositions D/ lim lim lim D / To summarize we have: e e ] D / D / D / e ] e 0 an the Corollary Proposition For a uniform istribution over the space of correlation matrices, the marginal istribution of each correlation follows Beta/, / istribution on, an the eterminant D of a correlation matrix follows the expression from equation 3 Then: lim D ] e lim D/ lim vard ] e lim D ] Proof The proof of the secon equality in both statements can be foun in the proof of Theorem 3 To prove the first equality in calculate D as follows: By, we obtain D j+ +! + Then lim D ] e D ]! + ] π e + π + O ] + + e 4 + O ]

15 Using again, we can calculate: D ] π e + π + + O ] + e + O ] ] which proves lim D e To prove Relation from Proposition we start from the expression of the eterminant D given in equation 3 an consier inepenent, Beta istribute ranom variables, B j Beta,, Then By, vard var B j j+ j j + j j j + j+, j! +! ! + ]! +! ! + ] +! + 3! +! ] π π π vard e + + e e + + ] π + + π π + + e + 6 e +3 e + + O π + 3/ + / +3 ] e + 6 e + + O π + 3/ 3e / 6e + 3/] + O ] By raising to the / power an taking the limit when we obtain The proof of Corollary 4 is provie below + O ] lim vard] e ] Corollary 4 The first two moments of the istribution of the eterminant of a ranom correlation matrix can be written as follows:, j

16 D D / ] + O vard D ] + O Proof By 6 By an, It will follow that D / π D π D + e + O + e + O D / + O ] ] For the secon relationship, notice that, by an, D ] j+ +!! + π e + + O ] Furthermore, vard var B j j + j j + j!! π e e ] D ] + O + O ] This proves the corollary The relations from Proposition fin their erivations in the proof of Proposition above Acknowlegements The author gratefully acknowleges fruitful iscussions with, an helpful comments from Frank Reig an Roger Cooke 6

17 References ] Apostol, TM Introuction to Analytic Number Theory New York: Springer Verlag, 976 ] Befor, TJ, Cooke, RM, Vines - A New Graphical Moel for Depenent Ranom Variables, Annals of Statistics, 304:03 068, 00 3] Cooke, RM, Markov an ntropy Properties of Tree an Vine-Depenent Variables, In Proceeings of the Section on Bayesian Statistical Science, American Statistical Association, 997 4] Guo, B-N, Qi, F, Zhao, J-L, Luo, Q-M, Sharp inequalities for polygamma functions Mathematica Slovaca, 6:03-0, 0 ] Hary, GH, Littlewoo, J, Polya,G Inequalities, Cambrige University Press, Cambrige Mathematical Library, 988 6] Holmes, RB On ranom corelation matrices, SIAM Matrix Anal Appl,, 99 7] Joe, H Generating ranom correlation matrices base on partial correlations, Journal of Multivariate Analysis, 97:77 89, 006 8] Johnson, DG, Welcht, WJ The generation of pseuo-ranom correlation matrices, J StatistComputSimul, : 69, 980 9] Kurowicka, D, Cooke, RM Completion problem with partial correlation vines, Linear Algebra an its Applications, 006 0] Natalini, P, Laforgia, A On the asymptotic expansion of a ratio of gamma functions Journal of mathematical analysis an applications, 389: , 0 ] Lewanowski, D, Kurowicka, D, Joe, H Generating ranom correlation matrices base on vines an exptene onion metho, Journal of Multivariate Analysis, 00:989 00, 009 ] Mitrinovic, DS Analytic inequalities, New York: Springer Verlag, 970 3] Naarajah, S, Gupta, AK Characterizations of the beta istribution, COMMUNICATIONS IN STATISTICS: Theory an Methos, 33:94 97, 004 4] rélyi, A, Tricomi, F G The asymptotic expansion of a ratio of gamma functions, Pacific Journal of Mathematics, :33 4, 9 ] Vu, HV Nguyen, HH Ranom matrices: law of the eterminant, arxivorg/math/arxiv:07, 0 6] Qiu, W Separation inex, variable selection an sequential algorithm for cluster analysis, PhD Thesis, Department of Statistics, University of British Columbia, 004 7