arxiv:math/ v2 [math.co] 1 Jul 2005

Transcription

1 A symbolic method for -statistics E. Di Nardo, D. Senato arxiv:math/ v2 [math.co] Jul 2005 Abstract Trough the classical umbral calculus, we provide new, compact and easy to handle expressions of -statistics, and more in general of U-statistics. In addition such a symbolic method can be naturally extended to multivariate case and to generalized -statistics. Keywords: umbral calculus, symmetric polynomials, U-statistics, -statistics, joint cumulants. Introduction In 929, Fisher [4] introduced the -statistics as new symmetric functions of the random sample. The aim of Fisher was to estimate the cumulants by free-distribution methods without using moment estimators. He used only combinatorial techniques. -statistics are related to the power sum symmetric polynomials whose variables are the random variables (r.v. s) of the sample. The Fisher point of view is described with a wealth of details by Kendall and Stuart in [8]. The method is straightforward enough, however his execution leads to some intricate computations and some cumbersome expressions, except in very simple cases. This is why many authors tried to simplify the matter later. One of the most relevant contributions has been given by Speed [7] in the Eighty. Speed resumed the Doubilet approach to symmetric functions [3], exploiting symmetric functions labelled by partition of a set rather than by partition of an integer. The entries in the transition matrices are computed via Mœbius function generalizing and simplifying the presentation of -statistics theory. Nevertheless, in order to extend such theory to generalized statistics, Speed must resort the tensor approach introduced by Kaplan in 952. We follow a different point of view by using the high computational potential of the classical umbral calculus. This symbolic method was introduced by Rota and Taylor in 994 [6] and further developed in [] and [2]. From a combinatorial perspective, we revisit the Fisher theory as exposed by Kendall and Stuart, taing into account the Doubilet approach to symmetric functions. The umbral calculus offers a nimble syntax method that allows both the computation without using the Mœbius function and a natural extension to the multivariate case without bringing the tensor device into. What is more, this language clarifies the role played by the power sum symmetric polynomials in the expressions of -statistics. After recalling in Section 2 the strictly necessary umbral bacground, in Section 3 we put in umbral setting the four classical bases of symmetric polynomial algebra. Then we proceed in defining a general procedure to write down U-statistics. Such a procedure is given in full details in Section 5, where analogous formulae for -statistics, h-statistics and multivariate -statistics are given. AMS 2000 Subject Classification: 05A40, 05E05, 62A0 Dipartimento di Matematica, Università degli Studi della Basilicata C.da Macchia Romana, I-8500 Potenza, {dinardo,senato}@unibas.it

2 2 The umbral calculus language 2 We start presenting the formal setting of the umbral calculus as introduced by Rota and Taylor in [6] and further developed in [] and [2]. We shall confine our exposition to what is necessary to the aims of this paper. The umbral calculus is a syntax consisting of the following data: an alphabet A = {α,β,...} whose elements are named umbrae; a commutative integral domain R whose quotient field is of characteristic zero; a linear functional E, called evaluation, defined on the polynomial ring R[A] and taing values in R and such that E[] =, E[α i β j γ ] = E[α i ]E[β j ] E[γ ] for any set of distinct umbrae in A and for i,j,..., non-negative integers (uncorrelation property); an element ǫ A, called augmentation, such that E[ǫ n ] = 0 for n ; an element u A, called unity umbra, such that E[u n ] =, for n. The support of an umbral polynomial p R[A] is the set of all umbrae occurring in p. Two umbral polynomials are said to be uncorrelated when their supports are disjoint. An umbra carries the structure of a r.v., while maing no reference to a probability space if the evaluation E is considered as the expectation operator. The moments of an umbra α are the elements a n R such that E[α n ] = a n for n. We said that the umbra α represents the sequence,a,a 2,... The singleton umbra χ is the umbra whose moments are all zero, but the first equal to. The factorial moments of an umbra α are the elements a (n) R corresponding to the umbral polynomials (α) n = α(α ) (α n+),n via the evaluation E, i.e. E[(α) n ] = a (n). The Bell umbra β is the umbra such that E[(β) n ] =,n. The umbra β and the umbra χ allow respectively a symbolic tool in order to handling composition and inversion of formal power series (for a detailed exposition of such two umbrae with their properties see [] and [2]). Two umbrae α and γ are said to be similar when E[α n ] = E[γ n ] for all n, and we will write α γ. Then two similar umbrae represent the same moment sequence. Given a sequence,a,a 2,... in R this is represented by infinitely many distinct and thus similar umbrae. Such a circumstance permits to deal with moment products by means of the uncorrelation property. Indeed, it is a i a j E[α i α j ] with a i = E[α i ] and a j = E[α j ], as well as a i a j = E[α i α j ] with α α and α uncorrelated with α. So, given n N, the sequence gives the moments of α+α. n ( n =0 ) a n a Let p and q be two umbral polynomials. We said that p is umbrally equivalent to q iff E[p] = E[q], in symbols p q. This last equivalence relation turns out to be very useful in defining and handling umbra generating functions. We point out that all operations among umbrae correspond to analogous operation in the algebra of generating functions. Nevertheless, in the following we mae no mention of generating functions (referring [9] to a formal exposition). Thans to the introduction of similarity notion, it is possible to extend the alphabet A with the socalled auxiliary umbrae derived from operations among similar umbrae. This leads to the construction of a saturated umbral calculus in which the auxiliary umbrae are treated as elements of the alphabet (cf. [6]). Let α,α,...,α be n uncorrelated umbrae similar to an umbra α. The symbol n.α denotes an auxiliary umbra similar to the sum α +α + +α. The symbol α.n denotes an auxiliary umbra similar to the product α α α. Properties of such auxiliary umbrae are extensively described in [] and they will

3 be recalled whenever it is necessary. We will assume disjoint both the support of n.α,m.α and α.n,α.m whenever n m. If p and q are correlated umbral polynomials, then n.p p + + p n is correlated to n.q q + +q n, and p i is correlated to q i but uncorrelated to q j with i j. In [], the following identity is stated: E[(n.α) i ] = i B i, (a,a 2,...,a i + ) i, () where B i, are the (incomplete) exponential Bell polynomials and a i is the i-th moment of α. Moreover, it is easy to verify that E[(α.n ) i ] = a n i for i 0. Two umbrae α and γ are said to be inverse to each other when α+γ ε. The inverse of the umbra α is denoted by.α. Note that, in dealing with a saturated umbral calculus, the inverse of an umbra is not unique, but any two inverse umbrae of the same umbra are similar. are Replacing the integer n in n.α with an umbra γ, we obtain the auxiliary umbra γ.α whose moments E[(γ.α) i ] = i g () B i, (a,a 2,...,a i + ) i, (2) where g () are the factorial moments of γ. In particular β.α is called α partition umbra and its moments are the (complete) exponential Bell polynomials (cf. []). Moreover χ.α is called α cumulant umbra and α.χ is called α factorial umbra, with moments equal to the factorial moments of α (cf. [2]). In particular it is β.χ u χ.β. (3) Again, replacing the umbra γ in γ.α with the umbra γ.β, we obtain the composition umbra of α and γ, i.e. γ.β.α. The compositional inverse of an umbra α is the umbra α < > such that α < >.β.α χ α.β.α < >. In particular it is u < >.β χ u < >.β, (4) where u < > denotes the compositional inverse of u. Via the umbral Lagrange inversion formula (cf. []), the moments of u < > are E[(u < > ) n ] = ( ) n (n )!. Finally it is χ.χ u < > χ.( χ) ( u) < >. (5) The disjoint sum of α and γ is the umbra whose moments are the sum of n-th moments a n and g n of α and γ respectively, in symbols (α +γ) n α n +γ n (cf. [2]). For instance it turns out χ.α +χ.γ χ.(α+γ) (6) that is the well nown additive property of cumulants. In the following, we denote by + n α the disjoint sum of n times the umbra α. 3 Umbral symmetric polynomials A partition of an integer m is a sequence λ = (λ,λ 2,...,λ t ), where λ i are wealy decreasing and t i= λ i = m. The integers λ i are said parts of λ. A different notation is λ = ( r,2 r2,...), where r i is the number of parts of λ equal to i. The monomial symmetric polynomials in the variables α,α 2,,α n are m λ = α λ αλt t, where the sum is over all distinct monomials having exponents λ,...,λ t. When λ 3

4 ranges in the set of partition of the integer m, m λ is a bases for the algebra of the symmetric polynomials. There are different other bases; we recall just those necessary in the following: the r-th power sum symmetric polynomials s r = n i= αr i ; the -th elementary symmetric polynomials e = α j α j2 α j, where the sum is over j < j 2 < < j n, and the r-th complete homogeneous symmetric polynomials h i = λ =i m λ. When the umbrae α,,α n are uncorrelated and similar to each other, these four classical bases of the symmetric polynomial algebra can be represented by means of the umbral polynomial n.(χα i ) and its moments. Propositions, 3 and 4 are stated under this hypothesis. For the power sum symmetric polynomials it is s r n.α r n.(χα r ). Note that s r are umbrally equivalent to the moments of + n α (cf. [2]). Proposition (Umbral elementary polynomials) 4 [n.(χα)] {!e, =,2,...,n, 0, = n+,n+2,... (7) Proof. For =,...,n the result follows applying the evaluation E to the multinomial expansion of [n.(χα)] (χ α + +χ n α n ) andobservingthattermshavingpowersofχgreaterthanvanish. Sojust!monomialsofthe formχ j α j χ j2 α j2 χ j α j hasanevaluationnotzero. Insteadfor = n+,n+2,... the result follows observing that at least one power of χ greater than occurs in each monomial of the multinomial expansion. Proposition 2 It is χ.n.(χα) u < >( + n α ) n.(χα) β. [ u < >( + n α )] (8) Proof. The first equivalence in (8) follows from (6) observing that χ.n.(χα) χ.(χ α + +χ n α n ) + n χ.(χα) + n u < > α. The second one follows from the first, maing the right dot-product with β and recalling (3). Equations (8) are the umbral version of the well-nown relations between power sum symmetric polynomials s r and elementary symmetric polynomials e. Indeed s r is umbrally equivalent to the moments of ( + n α) and e is umbrally equivalent to the moments of n.(χα). The umbral expression of m λ requires the introduction of augmented monomial symmetric polynomials m λ. Let λ = ( r,2 r2,...) be a partition of the integer m, such polynomials are defined by m λ = α j α jr α 2 j α2 r + j r +r 2. (9) j... j r j r +...j r +r 2... n The proof of the next proposition follows the same patterns of Proposition. Proposition 3 It is m λ [n.(χα)] r [n.(χα 2 )] r2. The next corollary follows recalling that m λ = m λ /[r!r 2! ].

5 5 Corollary 3. (Umbral monomial polynomials) m λ [n.(χα)]r r! Proposition 4 (Umbral complete polynomials) Proof. It is [n.(χα 2 )] r2. r 2! [ n.( χα)] m m!h m m =,2,... (0) [ n.( χα)] m [.( χ α )+ +.( χ n α n )] m m! [.( χ )].r ([.( χ )] 2 m ).r2 λ (!) r r!(2!) r2 r 2! λ =m and the result follows from Corollary 3., being ([.( χ)] i ).ri (i!) ri. Note that equivalences (7) and (0) are the umbral version of the well-nown identities: e t = n (+α i t) i= h t = n i= ( α it). Proposition 5 It is χ.n.( χα) ( u) < >( + n α ) n.( χα) β. [ ( u) < >( + n α )] () Proof. The results follow from (8) replacing the umbra χ with χ and recalling that u < > χ.χ must be replaced with ( u) < > χ.( χ). Equations () are the umbral version of the well-nown relations between power sum symmetric polynomials s r and complete symmetric polynomials h. Indeed s r is umbrally equivalent to the moments of ( + n α) and h is umbrally equivalent to the moments of n.( χα). 4 U-statistics Let X,X 2,...,X n be n independent r.v. s. A statistic of the form U = Φ(Xj,X j2,...,x j ) where the sum ranges in the set of all permutations (j,j 2,...,j ) of integers, j i n, is called U statistic [5]. If X,X 2,...,X n have the same cumulative distribution function F(x), U is an unbiased estimator of the population character θ(f) = Φ(x,,x )df(x ) df(x ). In this case, the function Φ may be assumed to be a symmetric function of its arguments. Often, in the applications, Φ is a polynomial in X i s so that the U statistic is a symmetric polynomial. By virtue of the fundamental theorem on symmetric polynomials, the U statistic can be considered a polynomial in the elementary symmetric polynomials. The following theorem is an umbral reformulation of the above statement. Theorem 4. (U statistic) If λ = ( r,2 r2,...,) is a partition of the integer m n then where j i {,2,...,n} and j r j =. (α j ).r (α 2 j 2 ).r2 [n.(χα)] r [n.(χα 2 )] r2 (2)

6 6 Proof. The result follows observing that [n.(χα i )] ri (n.χ) ri (α i ).ri and (n.χ). The formula (2) states how to estimate moment products by using only n information drawn out the population. Then the symmetric polynomial on the right side of (2) is the U statistic of the uncorrelated and similar umbrae α,α 2,...,α n associated to (α j ).r (α 2 j 2 ).r2. Example 4. Moment powers. Set r = 2 and = 2, from (2) the U statistic associated to α.2 a 2 is α.2 n(n ) [n.(χα)]2 n(n ) Example 4.2 h-statistics. As it has been shown in [2], it is (α a ) r r ( r =0 α i α j, n 2. i j ) r 2 ( ) α. (α ) r =0 ( ) r r α. (α ) r where α a is the central umbra of α about a = E[α] and α α is an umbra uncorrelated with α. Replacing the product α. (α ) r with the corresponding U statistic (2), it results (α a ) r =0 =0 r ( ) r ( ) [n.(χα)] n.(χα r ). (3) + When the products [n.(χα)] n.(χα r ) are expressed in terms of power sum symmetric polynomials, we have the so called h-statistics. On this matter, we will give more details in the next section. 5 -statistics The n-th -statistic n is the unique symmetric unbiased estimator of the n-th cumulant κ n of a given statistical distribution, i.e. E[ n ] = κ n. The -statistics can be expressed in terms of the sums of the r-th powers of the data points. In this section we give an umbral syntax that provides a general computational method to generate such expressions. To this aim, we digress to introduce the exponential Bell umbral polynomials. The most widespread expression of incomplete exponential Bell polynomials is referred to partition of an integer. Of course, it is also possible to express such polynomials referring them to partition of a set. Here we follow this last point of view. We denote by Π i, the set of all partitions of the set [i] = {,2,...,i} in blocs. Let π = {A,A 2,...,A } be an element of Π i,. Then it is B i, (a,a 2,...) = a n a n2 a n where A j = n j,j =,2,...,, as we will suppose from now on. Let us consider the following symmetric umbral polynomial: B i, (α,α 2,,α ) = α n αn2 2 α n, (4) whereα,α 2,,α areuncorrelatedumbraesimilartoαanda nj = E[α nj ],j =,2,...,.Obviouslyitis E[B i, ] = B i,, so that any expression containing the polynomials B i, could be replaced with an umbrally equivalent expression containing the polynomials B i,. The polynomials B i, will be called (incomplete) umbral exponential Bell polynomials. The combinatorics underlain the polynomial B i, is the following: the set [i] is partitioned in blocs, to eachof them one associatesthe umbra α nj obtainedfirstly replacing the elements in the j-th bloc with the umbra α and then labelling all blocs so that powers belonging

7 to different blocs result uncorrelated. Replacing in (4) the products α n αn2 2 α n with the umbrally corresponding U statistic (2), we get for i n B i, (α,α 2,,α ) n.(χα n )n.(χα n2 ) n.(χα n ), (5) by which we are able to give the umbral -statistics. Indeed, the α cumulant umbra κ α is similar to χ.α, so that, being (χ) (u < > ), from (2) and (5) it is (χ.α) i i ( ) ( )! n.(χα n )n.(χα n2 ) n.(χα n ). (6) Since n.(χα ni ) is umbrally equivalent to a symmetric power sum polynomial, equation (6) gives the moments of the α cumulant umbra in terms of power sum polynomials, i.e. the umbral form of - statistics. Note that the symmetric power sum polynomials in (6) are correlated. So, in order to mae formula(6) effective, we need adevice by which to evaluate the product n.(χα n )n.(χα n2 ) n.(χα n ). To this aim, by using the umbral exponential Bell polynomials (4), the moments of the umbra n.(χα) can be evaluate from (2) recalling n.α ni ( + n α) ni and the second equivalence in (8) [n.(χα)] i i (u < > ) n (u < > ) n2 (u < > ) n [n.α n ][n.α n2 ] [n.α n ]. (7) The previous umbral equivalence is suitable to be generalized to the product of umbral polynomials [n.(χp )][n.(χp 2 )] [n.(χp i )] with no disjoint support. Indeed, it results [n.(χp )] [n.(χp i )] i (u < > ) n (u < > ) n [n.p A ] [n.p A ] (8) where P Aj = n j t= p j t and p jt are the polynomials indexed by the elements of the bloc A j, as we will suppose from now on. Equivalence (8) is the device required to generate -statistics. Indeed, setting i = and p t = α nt for t =,2,,i, it results: [n.(χα n )] [n.(χα n )] (u j= π Π,j < > ) n (u < > ) nj [n.α m ] [n.α mj ] (9) where m j = n j t= n j t and n jt are indexed by the elements of the bloc A j. Note that the power sum polynomials on the right side of (9) are now uncorrelated so such equivalence gives augmented monomial symmetric polynomials in terms of power sum polynomials, translating Kendall and Stuart tables read downwards [8]. Instead the following formula leads to a symbolic translation of the Kendall and Stuart tables read across (i.e. power sum polynomials in terms of augmented monomial ones): (n.p ) (n.p i ) i P A P A i n.(χp A ) n.(χp A ). (20) The first equivalence in (20) is obtained from () trough analogous considerations used to state (8); the second equivalence comes from (2) replacing α ji i with the umbral polynomial p i, i.e. P A P A 2 P A n.(χp A )n.(χp A2 ) n.(χp A ). 7

8 Set in (20) p t = α nt for t =,2,...,i, we have (n.α n ) (n.α ni ) i (n.χα m )(n.χα m2 ) (n.χα m ) (2) where m j = n j t= n j t and n jt are indexed by the elements of the bloc A j. Example 5. h-statistics. In (9) set n = n and n 2 = = n + = ; from (3) we get the umbral expression of h-statistics. Example 5.2 Joint cumulants. Let p,p 2,...,p i be umbral polynomials. Replacing n with χ in the first equivalence in (20), we have (χ.p )(χ.p 2 ) (χ.p i ) i (χ) P A P A. (22) When the umbral polynomials p i are interpreted as r.v. s, equivalence (22) gives their joint cumulants. So we will call (χ.p )(χ.p 2 ) (χ.p i ) the joint cumulant of p,...,p i. Note that, setting p t = α for t =,2,...,i, one has the i-th ordinary cumulant (χ.α) i. Through this equivalence it results χ.(p + +p i ) χ.p + +χ.p i.nowsupposetosplitthe set{p,p 2,...,p i }intwosubsets{p j,...,p jt }and{p,...,p s } with s+t = i, such that polynomials belonging to different subsets are uncorrelated. Then it is (χ.p )(χ.p 2 ) (χ.p i ) 0. (23) Indeed, setting P = t l= p j l and Q = s l= p l, such polynomials are uncorrelated, so that χ.(p +Q) χ.p +χ.q from (6). Equivalence (23) follows observing that, due to the disjoint sum, products involving powers of χ.p and χ.q vanish. When the umbral polynomials p i are interpreted as r.v. s, equivalence (23) states the following well-nown result: if some of the r.v. s are uncorrelated of all others, then their joint cumulant is zero. Example 5.3 Multivariate -statistics. Equivalence (20) allows a compact expression of multivariate - statistics. Replacing n with χ in its second equivalence, we construct the U statistic of the joint cumulant (χ.p )(χ.p 2 ) (χ.p i ) i (χ) n.(χp A )n.(χp A2 ) n.(χp A ). (24) Again, in the product on the right side of (24) the umbral polynomials are correlated. In order to mae effective the computation, it is necessary to rewrite (24) by using equivalence (8) with P At instead of p t. For instance, in order to express 2, set in (24) i = 3 and p = p 2 = α,p 3 = α 2. It results (χ.α ) 2 (χ.α 2 ) χ n n.(χα2 α 2)+ (χ) 2 (n) 2 { 2n.(χα )n.(χα α 2 )+ n.(χα 2 )n.(χα 2) } Set s p,q n.(α p αq 2 ). It is + (χ) 3 (n) 3 { [n.(χα )] 2 n.(χα 2 ) } (25) n.(χα )n.(χα α 2 ) (u < > ) 2 n.(α 2 α 2 )+(u < > ).2 n.α n.(α α 2 ) s 2, +s,0 s, (26) n.(χα 2 )n.(χα 2) (u < > ) 2 n.(α 2 α 2)+(u < > ).2 n.α 2 n.α 2 s 2, +s 2,0 s 0, (27) {n.(χα )} 2 n.(χα 2 ) (u < > ) 3 n.(α 2 α 2)+(u < > ).3 n.α n.α n.α 2 + u < > (u < > ) 2 [n.α 2 n.α 2 +2n.α n.(α α 2 )] 2s 2, s 2,0 s 0, 2s,0 s, +s 2,0s 0, (28) 8

9 Equivalence (26) comes from (8) setting i = 2, p = α and p 2 = α α 2, equivalence (27) comes from (8) setting i = 2, p = α 2 and p 2 = α 2, equivalence (28) comes from (8) setting i = 3, p = p 2 = α and p 3 = α 2. Substituting the above equivalences in (25) and rearranging the terms, we have the expression of 2, 2 (χ.α ) 2 (χ.α 2 ) [ n 2 s 2, 2ns,0 s, ns 2,0 s 0, +2s 2,0 (n) s ] 0,. 3 The expression of generalized statistics (as well as the multivariate ones) in terms of power sums comes from (22) replacing some of the umbrae χ with uncorrelated ones and then constructing the corresponding U statistics. References [] E. Di Nardo, D. Senato, Umbral nature of the Poisson random variables, In Algebraic combinatorics and computer science (eds. Crapo H. and Senato D.), Springer Italia (200), [2] E. Di Nardo, D. Senato, An umbral setting for cumulants and factorial moments, Europ. Jour. Combinatorics, (2005) to appear. [3] P. Doubilet, On the foundations of combinatorial theory VII: Symmetric functions through the theory of distribution and occupancy, Stud. Appl. Math., (972) [4] R.A. Fisher, Moments and product moments of sampling distributions, Proc. London Math. Soc. (2) 30, (929) [5] W. Hoeffding, A class of statistics with asymptotically normal distribution, Ann. Math. Stat. 9, (948) [6] G.-C. Rota, B.D. Taylor, The classical umbral calculus, SIAM J. Math. Anal. 25, (994) [7] T. P. Speed, Cumulants and partition lattices II: Generalized -statistics, J. Aust. Math. Soc., Ser. A 40, (986) [8] A. Stuart, J.K. Ord, Kendall s Advanced Theory of Statistics, Vol., Charles Griffin and Company Limited, London, (987). [9] B.D. Taylor, Difference equations via the classical umbral calculus In Mathematical Essays in Honor of Gian-Carlo Rota (eds. Sagan et al.), Birhauser Boston (998),