arxiv:math/ v1 [math.pr] 22 Dec 2006

Transcription

1 IMS Lecture Notes Monograph Series High Dimensional Probability Vol c Institute of Mathematical Statistics 26 DOI:.24/ Karhunen-Loève expansions of mean-centered Wiener processes arxiv:math/62693v [math.pr] 22 Dec 26 Paul Deheuvels L.S.T.A. Université Pierre et Marie Curie Paris 6 Abstract: For γ > we provide the Karhunen-Loève expansion of the 2 weighted mean-centered Wiener process defined by W γt {W t W u du for t ]. We show that the orthogonal functions in these expansions have simple expressions in term of Bessel functions. Moreover we obtain that the L 2 [] norm of W γ is identical in distribution with the L 2 [] norm of the weighted Brownian bridge t γ Bt.. Introduction and results.. KL expansions of mean-centered Wiener processes Let {Wt : t denote a standard Wiener process and let. {Bt : t {Wt tw : t denote a standard Brownian bridge where denotes equality in distribution. As a motivation to the present paper we start by establishing in Theorem. below the Karhunen-Loève [KL] expansion of the mean-centered Wiener process.2 W t : Wt Wudu t []. We recall the following basic facts about KL expansions or representations. Let d be a positive integer. It is well-known see e.g. [ 3 9] and Ch. in [8] that a centered Gaussian process {ζt : t [] d with covariance function K ζ st Eζsζt in L 2 [] d [] d admits the convergent in expected mean squares KL expansion.3 ζt ω k λk e k t k where{ω k : k isasequenceofindependentandidenticallydistributed[iid]normal N random variables and the {e k : k form an orthonormal sequence L.S.T.A. Université Paris 6 7 avenue du Château F-9234 Bourg-la-Reine France pd@ccr.jussieu.fr AMS 2 subject classifications: primary 62G; secondary 6F5 6G5 6H7 62G3. Keywords and phrases: Gaussian processes Karhunen-Loève expansions Wiener process Brownian bridge quadratic functionals. 62

2 in L 2 [] d fulfilling.4 Karhunen-Loève Expansions 63 [] d e k te l tdt { if k l if k l with dt denoting Lebesgue s measure. The λ λ 2 in.3 are the eigenvalues of the Fredholm operator h L 2 [] d T ζ h L 2 [] d defined via.5 T ζ ht K ζ sthsds for t [] d. [] d We have namely T ζ e k λ k e k for each k. A natural consequence of the KL representation.3 is the distributional identity.6 ζ 2 tdt λ k ωk. 2 [] d k Given these preliminaries we may now state our first theorem. Theorem.. The KL expansion of {W t : t [] is given by.7 W t Wt Wudu k ω k 2 coskπt kπ for t []. The proof of Theorem. is postponed until Section 2.. In Remark. below we will discuss some implications of this theorem in connection with well-known properties of the Brownian bridge as defined in.. Remark.. We will provide in the forthcoming Theorem.3 in Section.4 a weighted version of the KL expansion of W as given in.7. These KL expansions are new up to our best knowledge. 2 The well-known see e.g. [2] and [7] KL expansion of the Brownian bridge. is very similar to.7 and given by.8 Bt Wt tw k ω k 2 sinkπt kπ for t. As a direct consequence of we obtain the distributional identities.9 { Wt 2dt Wudu B 2 tdt k ω 2 k k 2 π 2. The first identity in.9 is given p.57 of [5] as a consequence of Fubini-Wiener arguments in the spirit of the results of [6]. The second identity in.9 follows directly from.6 and is well-known see e.g. [4]. The remainder of our paper is organized as follows. In Section.2 below we mention as a straightforward but nevertheless useful observation that the knowledge of the distribution of the L 2 norm of a Gaussian process characterizes the eigenvalues of its KL expansion. In Section.3 we extend our study to Gaussian processes related to the Wiener sheet in [] d. The results of [5] will be instrumental in this case to establish a series of distributional identities of L 2 norms between

3 64 P. Deheuvels various Gaussian processes of interest. In Section.4 we provide the KL expansion of the weighted mean-centered Wiener process in dimension d. The results of this section are as one could expect closely related to [4] where related KL decompositions of weighted Wiener processes and Brownian bridges are established. In particular in these results we will make an instrumental use of Bessel functions. In the case of a general d we provide KL expansions for a general version of the mean-centered Wiener sheet. Finally in Section 2 we will complete the proofs of the results given in Section..2. The L 2 norm and KL eigenvalues A question raised by.9 is as follows. Let ζ and ζ 2 be two centered Gaussian processes on [] d with covariance functions in L 2 [] d [] d and KL expansions given by for t [] d. ζ j t ω k λkj e kj t for j 2. k Quad Making use of the notation of [5] we write ζ ζ 2 when the L 2 [] d norms of these two processes are identical in distribution. We may therefore write the equivalence. ζ Quad ζ 2 [] d ζ 2 tdt [] d ζ 2 2 tdt. What can be said of the eigenvalue sequences {λ kj : k j 2 when. is fulfilled? The answer to this question is given below. Theorem.2. The condition ζ Quad ζ 2 is equivalent to the identity.2 λ k λ k2 for all k. Proof. The fact that.2 implies ζ Quad ζ 2 is trivial via.6. A simple proof of the converse implication follows from the expression of the moment-generating functions [mgf] see e.g. pp. 6 6 in [4] for j 2 {.3 E exp z ζj 2 tdt [] d { /2 2zλ kj k for Rez < 2λ j. A variety of methods are available to show that the equality of the mgf s in.3 for j 2implies.2. A simple argumentsuggestedby D. M. Masonpersonal communication uses the fact that the large deviations of the L 2 [] norms of the ζ j are governed by λ j j 2 see e.g. Lemma. in [4]. This allows to show that λ λ 2. The proof is completed by a straightforward induction after substracting from ζ j j 2. the first components of their respective KL expansions..3. Multivariate Wiener sheets and Brownian Bridges Inspired by Theorems.-.2 and Remark. we will devote the remainder of our paper to derive of a series of new KL expansions of Gaussian processes in

4 Karhunen-Loève Expansions 65 the spirit of.7. To give an additional motivation to the forthcoming results we introduce the following notation and definitions. For any integer d the d-variate Wiener process or Brownian sheet is a centered Gaussian process Wt defining a continuous function of t t...t d R d + with covariance function given by for s s...s d R d + and t t...t d R d +.4 E WsWt d si t i. For each i...d denote respectively by i Σ i and Θ i the operators which map a L [] d function f t of t t...t d [] d into respectively i i f t f t t i f t...t i t i+...t d Σ i f t f t f t...t i...t d dti Θ i f t f t f t...t i t i+...t d. The d-variate tied-down Brownian bridge is a centered Gaussian process B t which is a continuous function of t t...t d [] d defined in terms of the d-variate Wiener process Wt via the distributional identity.8 B t... d W t where denotes the composition of applications. We define likewise the d-variate mean-centered Wiener sheet by setting.9 W M t Σ... Σ d W t. In.8 we use the notation B to distinguish the tied-down Brownian bridge B from the usual d-variate standard Brownian bridge B the latter being classically defined via the distributional identity.2 B t { d W t t i W.... When d the processes W and B B reduce respectively to the standard Wiener process W and to the standard Brownian bridge B via the distributional identities i.2 W W and B B B. Ontheotherhandford 2the processesb andbhavedifferentdistributions.in particular their covariancefunctions are defined respectively fors s...s d R d + and t t...t d R d + by E B sb t d { si t i s i t i i E BsBt d { d { si t i si t i. i i

5 66 P. Deheuvels InthesequelwewillusetheboldfacenotationWB andbinthegenerald-variate framework when d is arbitrary and limit the formerly used notation W and B to the univariate case when d. Let now γ γ...γ d R d be a vector of constants. We define respectively the weighted Wiener sheet W γ and the weighted tied-down Brownian bridge B γ by.24 W γ t t γ...tγ d d W t and B γ t t γ...tγ d d B t when t t...t d ] d. For convenience we set W γ t B γ t when t i for some i...d. Introduce now the upper-tail Wiener sheet defined for t t...t d [] d by.25 Wγ t u γ...uγ d d Wdu...du d. [t ] [t d ] It is readily checked that whenever γ i > 2 for i...d we have for all s s...s d [] d and t t...t d [] d E Wγ s W γ t d i d i s i t i u 2γi i du i { s 2γ i+ i t 2γi+ i i so that we have the distributional identity see e.g. 3. p.55 in [5].26 Wγ t { d i W t... t d d. i The following additional distributional identities will be useful in view of the definitions.6 and.7 of Σ i and Θ i for i...d. We set for convenience... We define the mean-centered weighted upper-tail Wiener sheet by setting for t t...t d [] d..27 Wγ M t Σ Σ d Wγ t Lemma.. For each t [] d we have.28 W t W t... t d Θ Θ d W t and.29 W M Σ Σ d W t Σ Σ d W M W t. Proof. The proofs of.28 and.29 are readily obtained by induction on d. For d we see that.28 is equivalent to the identity W t Wt W which is obvious. Likewise.29 reduces to the formula Wt W {Wu Wdu Wt Wudu.

6 Karhunen-Loève Expansions 67 We now assume that.28 holds at rank d so that W t... t d t d Θ... Θ d Wt...t d. We now make use of the observation that W t... t d t d Θ d W t... t d t d. This in combination with the easily verified fact that the operators Θ...Θ d commute readily establishes.28 at rank d. The completion of the proof of.29 is very similar and omitted. Under the above notation Theorem 3. in [5] establishes the following fact. Fact.. For d 2 and γ 2 d we have.3 B γ Quad W γ M. Remark.2. Theorem 3. in [5] establishes.3 and likewise Corollary 3. of [5] establishes the forthcoming.3 only for d 2. It is natural to extend the validity of.3 to the case of d. In the forthcoming Section.5 we will make use of KL expansions to establish a result of the kind. Remark.3. For d 2 we may rewrite.3 into the distributional identity for γ > 2 and δ > 2.3 s 2γ t 2δ{ 2 Wst swt tws+stw {s γ t δ Wst u γ t δ Wutdu s γ v δ Wsvdv + u γ v δ Wuvdudv 2dsdt. Bycombining.29with.3takenwith γ δ weobtainthe distributional identity.32 { 2 Wst swt tws+stw { Wst Wsvdv + Wu tdu Wuvdudv 2dsdt..4. Weighted mean-centered Wiener processes d In this section we establish the KL expansion of the univariate mean-centered weighted Wiener process defined for γ > 2 and t [] by.33 W γ t {W t W u du.

7 68 P. Deheuvels Quad In view of.24 when γ we have W γ B γ therefore by Theorem.2 the eigenvalues of the KL expansions of W γ and B γ must coincide in this case. We will largely extend this result by giving in Theorem.3 below the complete KL expansion of W γ for an arbitrary γ > 2. We need first to recall a few basic facts about Bessel functions we refer to [2] and to Section 2 in [4] for additional details and references. For each ν R the Bessel function of the first kind of index ν is defined by.34 J ν x 2 x ν 4 x2 k Γν +k +Γk +. k To render this definition meaningful when ν { 2... is a negative integer we use the convention that a/ for a. Since when ν n is a negative integer Γν +k + Γn+k + for k...n the corresponding terms in the series.34 vanish allowing us to write.35 J n x n J n x. One of the most important properties of Bessel functions is related to the second order homogeneous differential equation.36 x 2 y +xy +x 2 ν 2 y. When ν R is nonintegerthe Besselfunctions J ν and J ν provideapairoflinearly independent solutionsof.36 on. On the otherhand when ν nis integer J n x and J n x are linearly dependent via.35. To cover both of these cases it is useful to introduce the Bessel function of the second kind of index ν. Whenever ν is noninteger this function is defined by.37 Y ν x J νxcosνπ J ν x sinνπ and whenever ν n is integer we set J ν xcosνπ J ν x.38 Y n x lim. ν n sinνπ In view of the definitions we see that for an arbitrary ν R J ν and Y ν provideapair oflinearlyindependent solutionsof.36 on. The behavior ofthebesselfunctionsoffirstandsecondkind largelydifferat.inparticularwhen ν > we have as x see e.g. p.82 in [4].39 and.4 J ν x +o 2 ν x ν Γν + Y ν x +o Γν π 2 x ν. When ν > the positive roots or zeros of J ν are isolated see e.g. Fact 2. in [4] and form an increasing sequence.4 < z ν < z ν2 < such that as k.42 z νk { k + 2 ν 2 π +o. The next fact is Theorem.4 of [4].

8 Karhunen-Loève Expansions 69 Fact.2. For any γ > or equivalently for each ν /2+γ > the KL expansion of B γ t t γ Bt on ] is given by.43 t γ Bt ω k λk e k t k where the {ω k : k are i.i.d. random variables and for k and t ] { 2ν 2 {.44 λ k and e k t t Jν zνk t 2ν 2ν 2. z νk ν Jν zνk Theorem.3. Let γ > 2 or equivalently let < ν /2+γ <. Then the KL expansion of W γ is given by.45 W γ t {W t W u du ω k λk e k t where the {ω k : k are i.i.d. random variables and for k and t ] { 2ν 2 J.46 λ k and e k t at ν zνk t 2ν 2ν 2 z νk νjν z νk. The proof of Theorem.3 is given in Section 2.2. As an immediate consequence of this theorem in combination with Fact.2 we obtain that the relation.47 W γ Quad B γ holds for each γ > 2. A simple change of variables transforms this formula into.48 2 { t 2γ Wt 2γ + t 2γ{ 2dt. Wt tw.5. Mean-centered Wiener processes d k s 2γ Wsds 2dt In this section we establish the KL expansion of the unweighted multivariate mean-centered Wiener process defined for t [] d by.49 W M t Σ Σ d Wt. We obtain the following theorem. Theorem.4. The KL expansion of W M is given by.5 W M t... k { d 2 cosk i πt i ω k...k d k i π k d where {ω k...k d : k...k d denotes an array of i.i.d. normal N random variables. i The proof of Theorem.4 is postponed until Section 2..

9 7 P. Deheuvels 2. Proofs 2.. Proof of Theorems. and.4 In spite of the fact that Theorem. is a particular case of Theorem.3 it is useful to give details about its proof to introduce the arguments which will be used later on in the much more complex setup of weighted processes. We start with the following easy lemma. Below we let W t be as in.2. Lemma 2.. The covariance function of W is given for st by 2. K W st EW sw t s t s t+ 2 s2 + 2 t Proof. In view of.2 we have the chain of equalities for st EW sw t E WsWt Ws Wt s t Wudu+ s udu Wudu WuWvdudv t udu+ from where 2. is obtained by elementary calculations. Recalling the definition.5 of T ζ we set below ζ W. u vdudv Lemma 2.2. Let {yt : t denote an eigenfunction of the Fredholm transformation T W pertaining to the eigenvalue λ >. Then y is infinitely differentiable on [ ] and a solution of the differential equation 2.2 λy t+yt subject to the boundary conditions 2.3 y y. Proof. By 2. we have for each t [] 2.4 λyt t + sysds+t 2 s2 s+ 3 ysds. t yudu ysds+ 2 t2 t ysds It is readily checked that the RHS of 2.4 is a continuous function of t []. This together with the condition that λ > entails in turn that y is continuous on [ ]. By repeating this argument a straightforward induction implies that y is infinitely differentiable on []. This allows us to derivate both sides of 2.4 with respect to t. We so obtain that for t [] 2.5 λy t t ysds + t ysds. By setting successively t and t in 2.5 we get 2.3. Finally2.2 is obtained by derivating both sides of 2.5 with respect to t.

10 Karhunen-Loève Expansions 7 Proof of Theorem.. It is readily checked that the general solution of the differential equation 2.2 is of the form t 2.6 yt acos +b +c λ for arbitrary choices of the constants abc R. The limit conditions 2.3 imply that in 2.6 we must restrict b and λ to fulfill b and λ {/k 2 π 2 : k. We now check that the function yt acoskπt is a solution of the equation 2.4 taken with λ /k 2 π 2. Towards this aim we first notice that yt acoskπt fulfills 2.7 ysds a [ ] t sinkπt kπ. t This in turn readily entails that yt a coskπt satisfies the relation 2.5. By integrating both sides of this relation with respect to t we obtain in turn that yt a coskπt fulfills λyt t + sysds+t t ysds+ 2 t2 t 2 s2 s+ 3 ysds+c ysds for some constant C R. All we need is to check that C for some particular value oft. If we set t and make use of 2.7 this reducesto showby integration by parts that coskπ k 2 π 2 2 s 2 ysds 2kπ kπ 2 [ tcoskπt ] t [ ] t t 2 sinkπt t kπ 2 t kπ s sinkπsds coskπsds coskπ k 2 π 2. The just-proved fact that yt a coskπt satisfies the relation 2.5 implies in turn that this same equation taken with yt acoskπt+c reduces to c k 2 π 2 c 2 s2 s+ 3 ds. Since this relation is only possible for c we conclude that the eigenfunctions of T W are of the form yt acoskπt for an arbitrary a R. Given this fact the remainder of the proof of Theorem. is straightforward. To establish Theorem.4 we will make use of the following lemma. We let W M be defined as in.9 and recall 2.. Lemma 2.3. We have for s s...s d [] d and t t...t d [] d 2.8 E W M sw M s d K W s i t i. i

11 72 P. Deheuvels Proof. It follows from the following simple argument. We will show that for an arbitrary j d E { Σ... Σ j Ws { Σ... Σ j Wt 2.9 { j d K W s i t i i ij+ {s i t i. Since Σ...Σ d are linear mappings the proof of 2.9 is readily obtained by induction on j...d. This in turn implies 2.8 for j d. Proof of Theorem.4. In view of 2.8 the proofof the theorm follows readily from a repeated use of Lemma 4. in [5] which we state below for convenience. Let ζ s ζ 2 t and ζ 3 st be three centered Gaussian processes functions of s [] p and t [] q. We assume that E ζ 3 s t ζ 3 s t E ζ s ζ s E ζ 2 t ζ 2 t. Then if the KL expansions of ζ and ζ 2 are given by ζ s k the KL expansion of ζ 3 is given by ω k λk e k s and ζ 2 t ζ 3 st k l ω k λk2 e k2 t k ω kl λk λ k2 e k se k2 t where {ω kl : k l denotes an array of iid normal N r.v. s Proof of Theorem.3 Recall that 2. W γ t {Wt Wu du. Lemma 2.4. The covariance function of W γ is given for st by 2. K Wγ st EW γ sw γ t 2γ + { s t s t + 2+2γ s2+2γ + 2+2γ t2+2γ γ3+2γ Proof. The proof of 2. being very similar to the above given proof of 2. we omit details. Lemma 2.5. Fix any γ > 2. Let et be an eigenfunction of T W γ pertaining to a positive eigenvalue λ > of this operator. Then the function yx ex / is solution on [ ] of the differential equation λx 2γ y x+yx u 2γ yudu

12 Karhunen-Loève Expansions 73 with boundary conditions 2.3 y y. Proof. Let et fulfill for some λ > λet By 2. we may rewrite this identity into 2.4 2γ +λet t K Wγ stesds. s esds+t esds { s esds t esds + s 2+2γ esds 2+2γ { +2γ + t 2+2γ esds + esds. 2+2γ +γ3+2γ A straightforward induction shows readily that any function e fulfilling 2.4 is infinitely differentiable on [ ]. This in turn allows us to derivate both sides of 2.4 as to obtain the equation t 2.5 λe t t 2γ esds+t esds. Set now et yt in 2.5. By changing variables in the LHS of 2.5 we obtain the equation 2.6 λy t t t esds+t esds. The relation 2.3 follows readily from 2.6 taken successively for t and t. By derivating both sides of 2.6 and after setting es ys we get 2 λy t t 2γ +yt ys ds. After making the change of variables t x / and s u / we may rewrite this last equation into 2 λx 2γ y x+yx which is 2.6. The proof of Lemma 2.5 is now completed. u 2γ yudu Recall the definitions.34 and In view of 2.2 the following fact will be instrumental for our needs refer to Fact 2.3 in [4] and p.666 in []. Fact 2.. Let λ > and β > be real constants. Then the differential equation 2.7 λy x+x 2β yx has fundamental solutions on given by 2.8 x /2 J 2β+ x β+ β + λ and x /2 Y 2β+ x β+ β + λ

13 74 P. Deheuvels when /2β + R and 2.9 x /2 J 2β+ x β+ β + λ and x /2 J 2β+ x β+ β + λ when /2β + is noninteger. Lemma 2.6. Assume that γ > 2. Then the solutions on [] of the differential equation λx 2γ y x+yx with boundary conditions 2.2 y y are of the form 2.22 yx ax /2 J 2+γ for some arbitrary constant a R. x +γ +γ λ Proof. Set β γ/ + 2γ in Fact 2. and observe that the assumption that γ > 2 implies that β > and that /2β+ is noninteger. By Fact 2. the general solution on ] of the homogeneous differential equation 2.2 is of the form 2.23 yx bx /2 J 2+γ x +γ +γ λ +γ x +ax /2 J 2+γ +γ λ where a and b are arbitrary constants. It is straightforward given.39 and.4 that for some constant ρ > as x 2.24 x /2 J 2+γ x +γ +γ λ { +oρ x 2 + +γ 2+γ ρ x whereas for some constant ρ 2 > 2.25 x /2 Y 2+γ x +γ +γ λ { +oρ 2 x 2 +γ 2+γ ρ 2. In view of 2.2 these relations imply that b so that 2.22 now follows from Proof of Theorem.3. Set ν /2+γ. Obviously the condition that γ > 2 is equivalent to < ν <. We will show that the eigenvalues of T Wγ are given by 2.26 λ k { 2ν z νk Given this notation it is readily checked that for k γ ν and ν.

14 Karhunen-Loève Expansions 75 Therefore letting yx be as in 2.22 and setting x t we see that the eigenfunction e k t of T Wγ pertaining to λ k is of the form 2.27 e k t et yt at 2ν 2 Jν z νk t 2ν for some a R. Here we may use Formula 5::2 p.529 in [] namely the relation d { x ρ J ρ x x ρ J ρ+ x dx to show that for some appropriate constant C 2.28 d { x ν J ν zνk x Cx ν J ν zνk x dx for x and x. This in turn allows to check that the function yx in 2.27 fulfills 2.2. Now we infer from 2.27 in combination with Fact 2.2 p.84 in [4] that e 2 k tdt 2νa2 t 2ν J 2 ν z νk t 2ν dt 2ν 2νa 2 ujν 2 zνk u du νa 2 Jν 2 zνk. Given this last result the completion of the proof of Theorem.3 is straightforward. References [] Adler R. J. 99. An Introduction to Continuity Extrema and Related Topics for General Gaussian Processes. IMS Lecture Notes-Monograph Series 2. Institute of Mathematical Statistics Hayward California. MR88478 [2] Anderson T. W. and Darling D. A.952. Asymptotic theory of certain goodness of fit criteria based on stochastic processes. Ann. Math. Statist MR5238 [3] del Barrio E. Cuesta-Albertos J. A. and Matran C. 2. Contributions fo empirical and quantile processes to the asymptotic theory of goodness-of-fit tests. Test MR7943 [4] Deheuvels P. and Martynov G. 23. Karhunen-Loève expansions for weighted Wiener processes and Brownian bridges via Bessel functions. In: Progress in Probability 55. Birkhäuser Basel. pp MR23388 [5] Deheuvels P. Peccati G. and Yor M.26. On quadratic functionals of the Brownian sheet and related processes. Stochastic Processes Appl MR29956 [6] Donati-Martin C. and Yor M. 99. Fubini s theorem for double Wiener integrals and the variance of the Brownian path. Ann. Inst. Henri Poincaré MR8933 [7] Durbin J Distribution Theory for Tests based on the Sample Distribution Function. Regional Conference Series in Applied Mathematics 9. SIAM Philadelphia. MR3557 [8] Kac M. 98. Integration on Function Spaces and some of its Applications. Lezioni Fermiani della Scuola Normale Superiore Pisa.

15 76 P. Deheuvels [9] Kac M. and Siegert A. J. F An explicit representation of a stationary Gaussian process. Ann. Math. Statist MR2672 [] Kamke E Differentialgleichungen Lösungsmethoden un Lösungen. Chelsea New York. [] Spanier J. and Oldham K. B An Atlas of Functions. Hemisphere Publishing Corporation Washington. [2] Watson G. N A Treatise on the Theory of Bessel Functions. Cambridge University Press Cambridge. MR349