arxiv: v1 [math.pr] 26 Jul 2013

Transcription

1 On convergence of general wavelet decompositions of nonstationary stochastic processes Short title: Uniform convergence of wavelet decompositions Yuriy Kozachenko a Andriy Olenko b Olga Polosmak a arxiv: v1 [math.p] 6 Jul 013 Abstract a Department of Probability Theory Statistics and Actuarial Mathematics Kyiv University Kyiv Ukraine b Department of Mathematics and Statistics La Trobe University Victoria 3086 Australia The paper investigates uniform convergence of wavelet expansions of Gaussian random processes. The convergence is obtained under simple general conditions on processes and wavelets which can be easily verified. Applications of the developed technique are shown for several classes of stochastic processes. In particular the main theorem is adjusted to the fractional Brownian motion case. New results on the rate of convergence of the wavelet expansions in the space C[0T] are also presented. Keywords: Convergence in probability Uniform convergence Convergence rate Gaussian process Fractional Brownian motion Wavelets 000 MSC: 60G10 60G15 4C40 1. Introduction In the book [11] wavelet expansions of non-random functions bounded on were studied in different spaces. However developed deterministic methods may not be appropriate to investigate wavelet expansions of stochastic processes. For example in the majority of cases which are interesting from theoretical and practical application points of view stochastic processes have almost surely unbounded sample paths on. It indicates the necessity of elaborating special stochastic techniques. ecently a considerable attention was given to the properties of the wavelet orthonormal series representation of random processes. More information on convergence of wavelet expansions of random processes in various spaces references and numerous applications can be found in [ ]. Most known stochastic results concern the Corresponding author. Phone: Fax: addresses: ykoz@ukr.net Yuriy Kozachenko a.olenko@latrobe.edu.au Andriy Olenko DidenkoOlga@yandex.ru Olga Polosmak Paper will appear in Electronic Journal of Probability May

2 mean-square or almost sure convergence but for various practical applications one needs to require uniform convergence. To give an adequate description of the performance of wavelet approximations in both cases for points the processes are relatively smooth and points spikes occur we can use the uniform distance instead of global integral L p metrics. A more in depth discussion further references and various applications in econometrics simulations of stochastic processes and functional data analysis can be found in [ ]. In his 010 Szekeres Medal inauguration speech an eminent leader in the field Prof. P. Hall stated the development of uniform stochastic approximation methods as one of frontiers in modern functional data analysis. Figures 1 and illustrate some features of wavelet expansions of stochastic processes. Figure 1 presents a simulated realization of the Wiener process and its wavelet reconstructions by two sums with different numbers of terms. The figure has been generated by the package wmtsa []. Besides providing a realization of the Wiener process and its wavelet reconstructions we also plot corresponding reconstruction errors. Figure shows maximum absolute reconstruction errors for 100 simulated realizations. To reconstruct each realization of the Wiener process two approximation sums as in Figure 1 were used. We clearly see that empirical probabilities of obtaining large reconstruction errors become smaller if the number of terms in the wavelet expansions increases. Although this effect is expected it has to be established theoretically in a stringent way for different classes of stochastic processes and wavelet bases. It is also important to obtain theoretical estimations of the rate of convergence for such stochastic wavelet expansions. Wt reconstruction of Wt reconstruction of Wt t t t Fig. 1 Plots of the Wiener process and its wavelet reconstructions max abs reconstruction errors max abs reconstruction errors 1e 1 3e Fig. Plots of reconstruction errors for 100 simulated realizations In this paper we make an attempt to derive general results on stochastic uniform convergence which are valid for wavelet expansions of wide classes of stochastic processes. The

3 paper deals with the most general class of such wavelet expansions in comparison with particular cases considered by different authors see for example [ ]. Applications of the main theorem to special cases of practical importance stationary processes fractional Brownian motion etc. are demonstrated. We also prove the exponential rate of convergence of the wavelet expansions. Throughout the paper we impose minimal assumptions on the wavelet bases. The results are obtained under simple conditions which can be easily verified. The conditions are weaker than those in the former literature. These are novel results on stochastic uniform convergence of general finite wavelet expansions of nonstationary random processes. The specifications of established results are also new for example for the case of stationary stochastic processes compare [15 16]. Finally it should be mentioned that the analysis of the rate of convergence gives a constructive algorithm for determining the number of terms in the wavelet expansions to ensure the uniform approximation of stochastic processes with given accuracy. It provides a practical way to obtain explicit bounds on the sharpness of finite wavelet series approximations. The organization of the article is the following. In the second section we introduce the necessary background from wavelet theory and certain sufficient conditions for mean-square convergence of wavelet expansions in the space L Ω. In 3 we formulate and discuss the main theorem on uniform convergence in probability of the wavelet expansions of Gaussian random processes. The next section contains the proof of the main theorem. Two applications of the developed technique are shown in section 4. In 5 the main theorem is adjusted to the fractional Brownian motion case. Lastly we obtain the rate of convergence of the wavelet expansions in the space C[0 T]. In what follows we use the symbol C to denote constants which are not important for our discussion. Moreover the same symbol C may be used for different constants appearing in the same proof.. Wavelet representation of random processes Let φx x be a function from the space L such that φ0 0 and φy is continuous at 0 φy = e iyx φxdx is the Fourier transform of φ. Suppose that the following assumption holds true: φy +πk = 1 a.e. There exists a function m 0 x L [0π] such that m 0 x has the period π and φy = m 0 y/ φy/ a.e. In this case the function φx is called the f-wavelet. 3

4 Let ψx be the inverse Fourier transform of the function y { ψy = m 0 +π exp i y } φ y. Then the function ψx = 1 e iyx ψydy π is called the m-wavelet. Let φ jk x = j/ φ j x k ψ jk x = j/ ψ j x k jk Z 1 φx and ψx are defined as above. Theconditions φ0 0and φyiscontinuousat0guaranteethecompleteness ofsystem 1 see [1]. Then the family of functions {φ 0k ;ψ jk j N 0 k Z} N 0 := {01...} is an orthonormal basis in L see for example [11]. A necessary and sufficient condition on m 0 is given in [4 5]. Definition 1. Let δxx be a function from the space L. If the system of functions {δx k k Z} is an orthonormal system then the function δx is called a scaling function. emark 1. f-wavelets and m-wavelets are scaling functions. Definition. Let δxx be a scaling function. If there exists a bounded function Φx x 0 such that Φx is a decreasing function δx Φ x a.e. on and Φ x γ dx < for some γ > 0 then δx satisfies assumption S γ. emark. If assumption S γ is satisfied for some γ > 0 then the assumption is also true for all γ 1 > γ. Lemma 1. If for some function Φ φ the f-wavelet φ satisfies assumption S γ then there exist a function Φ ψ such that for the corresponding m-wavelet ψ assumption S γ holds true and Φ ψ x Φ φ x for all x. Proof. The wavelets φ and ψ admit the following representations see [11] φx = h k φx k ψx = λ k φx k h k = φuφu kdu h k < and λ k = 1 1 k h 1 k. If k 0 then h k k 3 Φ φ u Φ φ u k du+ 4 k 3 Φ φ uφ φ u k du

5 k 3 Φ φ k/3 Φ φ u du+ Φ φ k/3 Φk/3 Φ φ u du+ C := 3 k 3 Φ φ u k du Φ φ u k du = CΦ φ k/3 Φ φ u du. Similarly for k 0 we get h k CΦ φ k /3. Thus for all k Z h k CΦ φ k /3. 3 Notethat theseries in the right-handside of converges in thel -norm. Therefore there exists a subsequence of partial sums which converges to ψx a.e. on. Thus by and 3 we obtain ψx C 1 k Φ φ x k Φ φ = 3 = C Φ φ x 1 k Φ φ k /3 =: I x 1 4 a.e. on. If u := x 1 then for u > 0 Iu C Φ φ u k Φ φ k /3 k 3 4 u + Φ φ u k Φ φ k /3 =: CA 1 u+a u. k 3 4 u Notice also that A 1 u Φ φ u/4 Φ φ k /3 Φ φ u/4 Φ φ k /3 k 3 4 u A u Φ φ u/4 Φ φ u k Φu/4 Φ φ u k. k 3 4 u Therefore for u > 0 Iu CΦ φ u/4 φ Φ u k + 5 Φ φ k /3. 5

6 We are to prove that Φ φ u k + φ k /3 is bounded. Φ Note that and similarly Thus Since it follows that k u+1 Φ φ k u k u 1 k u+1 k k 1 Φ φ u k Φ φ u k Φ φ 0+ Φ φ k/3 k=1 k=1 k k 1 Φ φ k /3 Φ φ 0+6 k=1 Thus we conclude that for u > 0 Since for u < 0 it follows that Φ φ v udv Φ φ vdv. Φ φ vdv < Φ φ vdv =: D 1. Φ φ v/3dv = 3 Φ φ udu 0 0 Φ φ udu =: D. Iu CD 1 +D Φ φ u/4. 6 Φ φ u+k = Φ φ u k = Φ φ u k Iu CD 1 +D Φ φ u /4 7 for every u. By and 7 ψx CΦ x 1 φ 4 a.e. on. 8 The desired result follows from 8 if we chose { max1 Φ ψ x := C x 01/ max1 C max Φ φ xφ φ x 1 x 01/. 4 6

7 Motivated by Lemma 1 we will use the following assumption instead of two separate assumptions S γ for the f-wavelet φ and the m-wavelet ψ. Assumption Sγ. For some function Φ and γ > 0 both the father and mother wavelets satisfy assumption S γ. Let {ΩBP} be a standard probability space. Let Xt t be a random process such that EXt = 0 E Xt <. If sample trajectories of this process are in the space L with probability one then it is possible to obtain the representation wavelet representation Xt = ξ 0k φ 0k t+ η jk ψ jk t 9 j=0 ξ 0k = Xtφ 0k tdt η jk = Xtψ jk tdt. 10 The majority of random processes does not possess the required property. For example sample paths of stationary processes are not in the space L a.s.. However in many cases it is possible to construct a representation of type 9 for Xt. Consider the approximants of Xt defined by X nkn t = k k 0 ξ 0k φ 0k t+ n 1 j=0 k k j η jk ψ jk t 11 k n := k 0 k 0...k n 1. Theorem 1 below guarantees themean-square convergence ofx nkn t to Xtif k 0 k j j N 0 and n. The latter means that we increase the number n of multiresolution analysis subspaces which are used to approximate Xt. For each multiresolution analysis subspace j = the number k j of its basis vectors which are used in the approximation increases too as n tends to infinity. Thus for each fixed k and j there is n 0 N 0 that the terms ξ 0k φ 0k t and η jk ψ jk t are included in all X nkn t for n n 0 i.e. each ξ 0k φ 0k t and η jk ψ jk t can be absent only in the finite number of X nkn t. Theorem 1. [18] Let Xt t be a random process such that EXt = 0 E Xt < for all t and its covariance function ts := EXtXs is continuous. Let the f- wavelet φ and the m-wavelet ψ be continuous functions which satisfy assumption S1. Let cx x denote a non decreasing on [0 even function with c0 > 0. Suppose that there exists a function A : 0 0 and a 0 x 0 0 such that cax cx Aa for all a a 0 x x 0. If then cxφ x dx < and tt 1/ ct 1. X nkn t L Ω;. X nkn t Xt in mean square when n k 0 and k j for all j N 0. 7

8 3. Uniform convergence of wavelet expansions for Gaussian random processes In this section we show that under suitable conditions the sequence X nkn t converges in probability in Banach space C[0T] T > 0 i.e. { } P sup Xt X nkn t > ε 0 t T 0 when n k 0 and k j for all j N 0 := {01...}. More details on the general theory of random processes in the space C[0T] can be found in []. Theorem. [19] Let X n t t [0T] be a sequence of Gaussian stochastic processes such that all X n t are separable in [0T]ρ ρts = and sup E Xn t X n s 1/ σh sup n 1 h σh is a function which is monotone increasing in a neighborhood of the origin and σh 0 when h 0. Assume that for some ε > 0 ε lnσ 1 udu < 1 0 σ 1 u is the inverse function of σu. If the random variables X n t converge in probability to the random variable Xt for all t [0T] then X n t converges to Xt in the space C[0T]. emark 3. For example it is easy to check that assumption 1 holds true for σh = C ln β e α + 1 h when C > 0 β > 1/ α > 0 and κ > 0. and σh = Ch κ The following theorem is the main result of the paper. Theorem 3. Let a Gaussian process Xt t its covariance function the f-wavelet φ and the corresponding m-wavelet ψ satisfy the assumptions of Theorem 1. Suppose that i assumption Sγγ 01 holds true for φ and ψ; ii the integrals lnα 1 + u ψu du and lnα 1 + u φu du converge for some α > 1/1 γ; iii there exist constants b 0 and c j j N 0 such that for all integer k E ξ 0k b 0 E η jk c j and cj j j α1 γ <. 13 j=0 8

9 Then X nkn t Xt uniformlyin probabilityon each interval [0T] when n k 0 and k j for all j N 0. emark 4. If both wavelets φ and ψ have compact supports then some assumptions of Theorem 3 are superfluous. In the following theorem we give an example by considering approximants of the form X n t := n 1 ξ 0k φ 0k t+ η jk ψ jk t. j=0 Theorem 4. Let Xt t be a separable centered Gaussian random process such that its covariance function t s is continuous. Let the f-wavelet φ and the corresponding m-wavelet ψ be continuous functions with compact supports and the integrals lnα 1 + u ψu du and lnα 1 + u φu du converge for some α > 1/1 γ γ 01. If there exist constants c j j N 0 such that E η jk c j for all k Z and assumption 13 is satisfied then X n t Xt uniformly in probability on each interval [0T] when n. Proof. The assumptions of Theorem 1 and Sγ0 < γ < 1 are satisfied because φ and ψ have compact supports. Therefore the desired result follows from Theorem 3. emark 5. For example Daubechies wavelets satisfy the assumptions of Theorem Proof of the main theorem To prove Theorem 3 we need some auxiliary results. Lemma. If δx is a scaling function satisfying assumption S γ then sups γ x 3Φ γ 0+4 x 1/ Φ γ tdt 14 S γ x = δx k γ. Proof. The lemma is a simple generalization of a result from [11]. Since S γ x is a periodic function with period 1 it is sufficient to prove 14 for x [01]. Notice that for x [01] and integer k the inequality x k k / holds true. Hence Φ x k Φ k / and S γ x Φ γ x +Φ γ x+1 +Φ γ x 1 + Φ γ k / k 3Φ γ 0+ k= k k 1 Φ γ t/ dt = 3Φ γ 0+4 Φ γ tdt. 1 9

10 Lemma 3. Let ˆδx denote the Fourier transform of the scaling function δx δ jk x := δ j j x k j N 0 k Z. If for some α > 0 ln α 1+ u δu du < then for all xy and k Z 0α := 1 π Proof. Since δx = 1 π δ jk x δ jk y j δ 0k x δ 0k y 0α ln α e α + 1 δ jk x δ jk y j j α 1α ln α e α + 1 e lnα α + u δu du and 1α := 1 π π eixuˆδudu we have e ixuj e iyuj ˆδu du = j π x y j N 0 x y lnα e α + u +1 δu du. x yuj sin ˆδu du. 15 Note that for v 0 the following inequality holds: s lne sin v α + s α lne α + v α. 16 By 15 and 16 we obtain δ jk x δ jk y j πln e α α + 1 x y The assertion of the lemma follows from this inequality. ln α e α + u j ˆδu du. Lemma 4. If a scaling function δx satisfies the assumptions of Lemmata and 3 then for γ 01 and α > 0 : δ jk x δ jk y j +1 j α1 γ 1 γ 1 α 3Φ γ 0+4 Φ γ tdt 1/ ln e α + 1 α1 γ j 0 17 x y δ 0k x δ 0k y 1 γ 0 α 3Φ γ 0+4 Φ γ tdt 1/ ln e α + 1 α1 γ. x y 18 10

11 Proof. By lemma 3 for j 1 we obtain δ jk x δ jk y = δ jk x δ jk y 1 γ δ jk x δ jk y γ ln e α + 1 α1 γ j 1 γ j α 1 α δ jk x δ jk y γ. x y We now make use of the inequality a+b α q α a α + b α { 1 α 1 q α = α 1 α > By lemma we get δ jk x δ jk y γ sup δ jk x γ = jγ +1 sup δ j x k γ x x jγ 3Φ +1 γ 0+4 Φ γ tdt. Inequality 17 follows from this estimate. The proof of inequality 18 is similar. 1/ Now we are ready to prove Theorem 3. Proof. In virtue of Theorem and emark 3 it is sufficient to prove that X nkn t Xt in mean square and E Xnkn t X nkn s 1 C ln e β α + 1 for some C > 0 β > 1/ and α > 0. Since γ < 1 assumption S1 holds true for φx and ψx. Hence by Theorem 1 we get X nkn t Xt in mean square. Note that 11 implies E Xnkn t X nkn s 1/ 1 E ξ 0k φ 0k t φ 0k s k k 0 n 1 1/ + E η jk ψ jk t ψ jk s =: n 1 S + Sj. j=0 k k j j=0 We will only show how to handle S j. A similar approach can be used to deal with the remaining term S. 11

12 S j can be bounded as follows S j = k k j By lemma 4 Similarly Eη jk η jl ψ jk t ψ jk sψ jl t ψ jl s c j ψ jk t ψ jk s. l k j Therefore we conclude that S j j j α1 γ c j L ln e α + 1 α1 γ L := 1 γ 1 α 3Φ γ 0+4 Φ γ tdt. 1/ S b 0 L 1 ln e α + 1 α1 γ L 1 := 1 γ 0 α 3Φ γ 0+4 E Xnkn t X nkn s 1 1/ Φ γ tdt. C α1 γ ln e α + 1 C := b 0 L 1 +L cj j j α1 γ < and β := α1 γ > 1/. j=0 5. Examples In this section we consider some examples of wavelets and stochastic processes which satisfy assumption 13 of Theorem 3. Example 1. Let ψ bealipschitzfunctionoforderκ > 0κ = 1forthecasesup u ψ u C i.e. ψu ψv C u v κ. Assume that for the covariance function t s ts dtds < 1

13 and Since zw z κ w κ dzdw < zw = uve izu e iwv dudv. Now we show that E η jk c j for all k Z and find suitable upper bounds for c j. By Parseval s theorem Eη jk η jl = EXuXv ψ jk uψ jl vdudv = 1 π k ψ jk z = e i j z ψ j/ it follows that 1 Eη jk η jl j π zw zw ψ jk z ψ jl wdzdw. z j ψ z j ψ w j dzdw. By properties of the m-wavelet ψ we have ψ0 = 0. Therefore using the Lipschitz conditions we obtain C Eη jk η jl π j1+κ zw z κ w κ dzdw. This means that c j C/ j/1+κ and assumption 13 holds. In the following example we consider the case of stationary stochastic processes. This case was studied in detail by us in [15]. Note that assumptions in the example are much simpler than those used in [15]. Example. Let Xt be a centered short-memory stationary stochastic process and ψ be a Lipschitz function of order κ > 0. Assume that the covariance function t s := EXtXs satisfies the following condition z z κ dz <. By Parseval s theorem we deduce Eη jk η jl = u vψ jk uduψ jl vdv = 13 π z ψ jk zdzψ jl vdv e ivz

14 1 z ψ jk z π ψ jl z dz = 1 j+1 π Thus by the Lipschitz conditions for all kl Z : Eη jk η jl C π 1+j1+κ z z z κ dz. This means that c j C/ j/1+κ and assumption 13 is satisfied. 6. Application to fractional Brownian motion ψ z j ψ z j dz. In this section we show how to adjust the main theorem to the fractional Brownian motion case. Let W α t t be a separable centered Gaussian random process such that W α t = W α t and its covariance function is ts = EW α tw α s = 1 t α + s α t s α 0 < α <. 0 Lemma 5. If assumption Sγ 0 < γ < 1 holds true and for some α > 0 c ψ := u α ψu du < then for the coefficients of the process W α t defined by 10 for all kl Z. Eη jk η jl C j1+α Proof. Since Eη jk η jl E η jk 1 E η jl 1 it is sufficient to estimate E η jk. By 1 and 0 we obtain E η jk = ts ψ jk tψ jk sdtds = 1 u v j j ψu kψv kdudv j = 1 1 u α v α u v α + ψu kψv kdudv j j j j j 1 u α ψu kψv kdudv 1+j1+α + v α ψu kψv kdudv + u v α ψu kψv kdudv =: z 1 +z +z j1+α 14

15 It follows from assumption Sγ that N := ψu du <. Hence we get the estimate z 1 u α ψu k ψv k dudv = ψv dv u+k α ψu du q α N N k α +c ψ < q α is defined by 19. Using Fubini s theorem and ψudu = 0 we obtain z 1 = u α ψu kdu ψv kdv = 0. Similarly z = 0. Finally we estimate z 3 as follows z 3 u+k v +k α ψu ψv dudv. By the reverse triangle inequality and 19 we obtain Hence z 3 q α α+1 which completes the proof of the lemma. u+k v +k α q α u α + v α. u α ψu du ψv dv = q α c ψ α+1 N 3 Insome case for example for thefractional Brownian motionthe assumption Eξ 0k ξ 0l b 0 of Theorem 3 doesn t hold true. The following theorem gives the uniform convergence of wavelet expansions without this assumption. Theorem 5. Let a random process Xt t the f-wavelet φ and the corresponding m- wavelet ψ satisfy the assumptions of Theorem 1 and assumptions i and ii of Theorem 3. Suppose that there exist iii constants c j j N 0 such that E η jk c j for all k Z and 13 holds true; 15

16 iv some ε > 0 such that S := E ξ 0k φ 0k t φ 0k s k < k 0 C α1 γ α > 1/1 γ ln e α + 1 if < ε. Then X nkn t Xt uniformlyin probabilityon each interval [0T] when n k 0 and k j for all j N 0. Proof. The assertion of the theorem follows from the proof of Theorem 3. Now under some mild additional conditions on the f-wavelet φ we show that estimate iv holds true in the fractional Brownian motion case. Lemma 6. Let the f-wavelet φ satisfy the assumptions of Theorem 1 φz 0 and φ z 0 when z ± ; the integrals u α φu φ u du and lnα 1+ u φ i u du i = 01 converge for some α > 1/1 γ. Then assumption iv of Theorem 5 holds true for W α t. Proof. S can be bounded as follows S k k 0 l k 0 Eξ 0k ξ 0l φ 0k t φ 0k s φ 0l t φ 0l s. Since Eξ0k ξ 0l E ξ0k 1 E ξ 0l 1 it is sufficient to estimate E ξ 0k. Similarly to 1 we get E ξ 0k u α φu kφv kdudv+ v α φu kφv kdudv + u v α φu kφv kdudv. Analogously to and 3 we obtain u α φu kφv k dudv q α M M k α +c φ M := u v α φu kφv k dudv q α c φ M α+1 φu du < c φ := 16 u α φu du <.

17 Then Eξ0k ξ 0l q α M M k α +c φ α +1 1 M l α +c φ α +1 1 q α M M k α + cφ M l α+1 α + cφ α+1. To estimate φ 0k t φ 0k s we use the representations φ 0k z = e ikz φz φ 0k t = 1 e itz e ikz φz dz. π epeatedly using integration by parts and the assumptions of the lemma we obtain that for k 0 : φ 0k t φ 0k s = 1 e itz e isz φz de ikz ikπ = 1 [ πk i te itz se isz φz+ e itz e isz ] φ z de ikz = 1 [ πk t e itz s e isz φz+i te itz se isz φ z + e itz e isz ] φ z e ikz dz 1 t e itz s e isz φz dz πk + te itz se isz φ z dz + e itz e isz φ z dz. 4 By inequalities 8 and 1 given in [15] we get te itz se isz +t e itz e isz c αt +T ln e α α + 1 ln e α + z ln e α + 1 α t e itz s e isz t s +t e itz e isz c αt ln α e α + 1 +T ln ln e α + z e α + 1 c αt and c αt are constants which do not depend on t s and z. Applying these inequalities to 4 we obtain α φ 0k t φ 0k s B φαt k 0 k ln e α α

18 B φαt := 1 c αt φz dz +T ln α π + c αt φ z dz +4T ln α + ln α e α + z φ z dz. e α + z e α + z φz dz φ z dz If k = 0 then φ 00 t φ 00 s 1 π B 0αT := 1 π Consequently we can estimate S as follows e itz e isz φz dz ln α e α + z φz dz. B 0αT ln e α α + 1 S C α1 γ α > 1/1 γ ln e α + 1 C := q α M cφ α+ 1 B 0αT +B φαt k k 0 k 0 M k α + c φ α+1. k Theorem 6. If the assumptions of Lemmata 5 6 and assumptions i and ii of Theorem 3 are satisfied then the wavelet expansions of the fractional Brownian motion uniformly converge to W α t. 7. Convergence rate in the space C[0T] eturning now to the general case introduced in Theorem 3 let us investigate what happens when the number of terms in the approximants 11 becomes large. First we specify an estimate for the supremum of Gaussian processes. Definition 3. [ 3.] A set Q S is called an ε-net in the set S with respect to the semimetric ρ if for any point x S there exists at least one point y Q such that ρxy ε. 18

19 Definition 4. [ 3.] Let { lnnρ Sε if N H ρ Sε := ρ Sε < + ; + if N ρ Sε = + N ρ Sε is the number of point in a minimal ε-net in the set S. The function H ρ Sε ε > 0 is called the metric entropy of the set S. Lemma 7. [ 4.10] Let Yt t [0T] be a separable Gaussian random process ε 0 := sup E Yt 1/ < 0 t T Iε 0 := 1 ε0 Hεdε < 5 0 Hε is the metric entropy of the space [0T]ρ ρts = E Yt Ys 1/. Then { } u 8uIε 0 P sup Yt > u exp 0 t T u > 8Iε 0. Assume that there exists a nonnegative monotone nondecreasing in some neighborhood of the origin function σε ε > 0 such that σε 0 when ε 0 and ε 0 sup ε ts [0T] E Yt Ys 1/ σε. 6 Lemma 8. [16] If C σε = ln β β > 1/ α > 0 7 e α + 1 ε then 5 holds true and Iε 0 δε 0 := γ lnt C β β γ γ := min ε 0 σ T. Lemma 9. If a scaling function δx satisfies assumption S γ then for k 1 T +1. sup x T k k 1 δx k γ k 1 T 1 19 Φ γ tdt+ k 1 1 Φ γ tdt

20 Proof. Since δx k γ Φ γ x+k +Φ γ x k =: z k1 x k k 1 k k 1 z k1 x is an even function. Then the assertion of the theorem follows from sup δx k γ sup z k1 x Φ γ k T+Φ γ k x T 0 x T k k 1 k k 1 k k 1 k Φ γ t Tdt+ k Φ γ tdt Φ γ tdt+ Φ γ tdt. k 1 k 1 k 1 T 1 k 1 1 Now we formulate the main result of this section. Theorem 7. Let a separable Gaussian random process Xt t [0T] the f-wavelet φ and the corresponding m-wavelet ψ satisfy the assumptions of Theorem 3. Then { } { P sup Xt X nkn t > u 0 t T exp u 8uδε kn ε k n u > 8δε kn and the decreasing sequence ε kn is defined by 9 in the proof of the theorem. Proof. Let us verify that Yt := Xt X nkn t satisfies 6 with σε given by 7. First we observe that E Yt Ys 1/ = E ξ 0k φ 0k t φ 0k s k >k 0 n 1 1/ + η jk ψ jk t ψ jk s+ η jk ψ jk t ψ jk s j=0 k >k j j=n 1/ n 1 E ξ 0k φ 0k t φ 0k s + E η jk ψ jk t ψ jk s k >k 0 j=0 k >k j + E η jk ψ jk t ψ jk s 1/ := n 1 S + S j + j. j=n 0 j=0 j=n } 1/

21 We will only show how to handle S j. A similar approach can be used to deal with the remaining terms S and j. By Lemmata and 3 we get S j Eη jk η jl ψ jk t ψ jk s ψ jl t ψ jl s k >k j l >k j c j ψ jk t ψ jk s γ ψ jk t ψ jk s 1 γ k >k j j/ j α 1 γ 1α c j α1 γ ψ jk t ψ jk s γ ln e α + 1 k >k j j/ j α 1 γ 1α c j α1 γ sup ψ jk t γ ln e α + 1 t T k >k j 1α = 1 π Hence B α := c j j+ j α 1α 1 γ α1 γ 3Φ γ 0+4 ln e α + 1 lnα e α + u +1 ψu du. j=0 n 1 S j j=0 From Lemma 4 it follows that B α ln e α + 1 1/ Φ γ tdt α1 γ 8 cj j+/ j α 1α 1 γ 3Φ γ 0+4 Φ γ tdt <. 1/ L j j=n ln j=n e α + 1 L := 1 γ 1 α 3Φ γ 0+4 Similarly to 8 by lemma 8 we obtain S cj j j α1 γ α1 γ 1/ b 0 1 γ 0α α1 γ Φ γ tdt+ ln e α + 1 k 0 T 1 1 Φ γ tdt. k 0 1 Φ γ tdt

22 0α = e 1 π lnα α + u φu du and k 0 T +1. Thus E Yt Ys 1/ = E Xt Xnkn t Xs X nkn s 1/ C := L j=n C α1 γ =: σ α1 γ > 1/ ln e α + 1 cj j j α1 γ +B α +b 0 1 γ 0α k 0 T 1 Φ γ tdt+ k 0 1 Φ γ tdt. Then by lemmata 7 and 8 { } { } P sup Xt X nkn t > u exp u 8uI ε kn 0 t T ε k n ε kn = sup E Xt Xnkn t 1/. 0 t T The proof will be completed by investigating ε kn as a function of k n. Note that E Xt Xnkn t 1/ 1/ E ξ 0k φ 0k t + n 1 + E η jk ψ jk t j=0 k >k j 1/ + k >k 0 E η jk ψ jk t j=n 1/ Let J := min{nmin{j N 0 : k j < j T +1}}. Notice that J when n and k j for all j N 0. By Lemmata 3 and 9 for k 0 T +1 J 1 ε kn b 0 Φ γ tdt+ Φ γ tdt + cj j Φ γ tdt k 0 T 1 k 0 1 j=0 k j j T 1 + Φ γ tdt + cj j 3Φ γ 0+4 Φ γ tdt =: ε kn. 9 k j 1 j=j The choice of J and assumption 13 imply that ε kn 0 when n k 0 and k j for all j N 0. 1/.

23 It is worth noticing that δ is an increasing function Iε 0 δε 0 for any ε 0 and ε kn ε kn. Hence for u > 8δε kn we get u 8uI ε exp kn u 8uδε ε k n exp kn ε k n. Finally an application of Lemmata 7 and 8 completes the proof. emark 6. Note that ε kn 0 if and only if n k 0 and all k jj 0 approach infinity. emark 7. If ε kn 0 then δε kn 0. { Therefore the convergence in the theorem is exponential with the rate bounded by exp const } one can choose const u ε k n for δε kn u. emark 8. In the theorem we only require that k 0 and all k jj 0 approach infinity. If we narrow our general class of wavelet expansions X nkn t by specifying rates of growth of the sequences k n we can enlarge classes of wavelets bases and random processes in the theorem and obtain explicit rates of convergence by specifying ε kn. For instance consider the examples in Section 5. It was shown that c j C/ j/1+κ. Let the sequences k n := k 0 k 0...k n 1 be chosen so that Φ γ tdt C/ Jκ for k := k mink 0 Tk 0 Tk 1 T...k J 1 J 1 T 1. Then by 9 we get ε kn C/ Jκ. emark 9. Lemma 8 and formula 9 provide simple expressions to computer ε kn and δε kn. It allows specifying Theorem 7 for various stochastic processes and wavelets. 8. Acknowledgements The research of first two authors was partially supported by La Trobe University esearch Grant Stochastic Approximation in Finance and Signal Processing. The authors are grateful for the referee s comments which helped to improve the style of the presentation. eferences [1] A. Ayache W. Linde Series representations of fractional Gaussian processes by trigonometric and Haar systems Electron. J. Probab [] V.V. Buldygin Yu.V. Kozachenko Metric Characterization of andom Variables and andom Processes American Mathematical Society Providence.I [3] S. Cambanis E. Masry Wavelet approximation of deterministic and random signals: convergence properties and rates IEEE Trans. Inf. Theory [4] C.K. Chui An Introduction to Wavelets Academic Press New York 199. [5] I. Daubechies Ten Lectures on Wavelets SIAM Philadelphia 199. [6] A. Delaigle P. Hall Methodology and theory for partial least squares applied to functional data. Ann. Statist [7] G. Didier V. Pipiras Gaussian stationary processes: adaptive wavelet decompositions discrete approximations and their convergence J. Fourier Anal. and Appl

24 [8] K. Dzhaparidze H. van Zanten A series expansion of fractional Brownian motion. Probab. Theory elated Fields [9] P.P.B. Eggermont V.N. Laiccia Uniform error bounds for smoothing splines. High Dimensional Probability 0-37 IMS Lecture Notes Monogr. Ser. 51 Inst. Math. Statist. Beachwood OH 006. [10] J. Fan P. Hall M. Martin P. Patil Adaptation to high spatial inhomogeneity using wavelet methods Statist. Sinica [11] W. Hardle G. Kerkyacharian D. Picard A. Tsybakov Wavelets Approximation and Statistical Applications Springer New York [1] E. Hernandez G. Weiss A First Course on Wavelets CC press Inc. Boca atan FL [13] E. Iglói A rate-optimal trigonometric series expansion of the fractional Brownian motion Electron. J. Probab [14] J. Istas Wavelet coefficients of a gaussian process and applications Ann. Inst. H. PoincaréB Probab. Statist [15] Yu.V. Kozachenko A. Olenko O.V. Polosmak Uniform convergence of wavelet expansions of Gaussian random processes Stoch. Anal. Appl [16] Yu.V. Kozachenko A. Olenko O.V. Polosmak Convergence rate of wavelet expansions of Gaussian random processes will appear in Comm. Statist. Theory Methods. 013 [17] Yu.V. Kozachenko A. Olenko O.V. Polosmak Convergence in L p [0T] of wavelet expansions of ϕ-sub-gaussian random processes will appear in Methodol. Comput. Appl. Probab. 014 [18] Yu.V. Kozachenko O.V. Polosmak Uniform convergence in probability of wavelet expansions of random processes from L Ω andom Oper. Stoch. Equ [19] Yu.V. Kozachenko G.I. Slivka Justification of the Fourier method for hyperbolic equations with random initial conditions Theory Probab. Math. Statist [0] O. Kurbanmuradov K. Sabelfeld Convergence of fourier-wavelet models for Gaussian random processes SIAM J. Numer. Anal [1] Y. Meyer F. Sellan M.S. Taqqu Wavelets generalized white noise and fractional integration: the synthesis of fractional Brownian motion J. Fourier Anal. and Appl [] wmtsa: Wavelet Methods for Time Series Analysis available online from accessed 10 August 01 [3] P.C.B. Phillips Z. Liao Series estimation of stochastic processes: recent developments and econometric applications to appear in A. Ullah J. acine and L. Su eds. Handbook of Applied Nonparametric and Semiparametric Econometrics and Statistics Oxford University Press Oxford 013. [4] J. Zhang G. Waiter A wavelet-based KL-like expansion for wide-sense stationary random processes IEEE Trans. Signal Proc