arxiv: v3 [math.pr] 14 Sep 2014

Transcription

1 Cramér large deviation expansions for martingales under Bernstein s condition arxiv:2.298v3 [math.pr] 4 Sep 24 Abstract Xiequan Fan, Ion Grama and Quansheng Liu Université de Bretagne-Sud, LMBA, UMR CNRS 625, Campus de Tohannic, 567 Vannes, France An expansion of large deviation probabilities for martingales is given, which extends the classical result due to Cramér to the case of martingale differences satisfying the conditional Bernstein condition. The upper bound of the range of validity and the remainder of our expansion is the same as in the Cramér result and therefore are optimal. Our result implies a moderate deviation principle for martingales. Keywords: expansions of large deviations; Cramér type large deviations; large deviations; moderate deviations; exponential inequality; Bernstein s condition; central limit theorem 2 MSC: Primary 6G42; 6F; 6E5; Secondary 6F5. Introduction Consider a sequence of independent and identically distributed i.i.d. centered real random variables ξ,...,ξ n satisfying Cramér s condition Eexp{c ξ } <, for some constant c >. Denote σ 2 = Eξ 2 and X n = n ξ i. In 938, Cramér [5] established an asymptotic expansion of the probabilities of large deviations of X n, based on the powerful technique of conjugate distributions see also Esscher [8]. The results of Cramér imply that, uniformly in x = on /2, log PX n > xσ n Φx x 3 = O n as n, where Φx = 2π x exp{ t2 /2}dt is the standard normal distribution. Various large deviation expansions for sums of independent random variables have been obtained by many authors, see for instance Feller [], Petrov [22], Rubin and Sethuraman [27], Statulevičius [29], Saulis and Statulevičius [28] and Bentkus and Račkauskas []. We refer to the book of Petrov Corresponding author. fanxiequan@hotmail.com X. Fan, quansheng.liu@univ-ubs.fr Q. Liu. ion.grama@univ-ubs.fr I. Grama, Preprint submitted to Elsevier April, 28

2 [23] and the references therein for a detailed account. Despite the fact that the case of sums of independent random variables is well studied, there are only a few results on expansions of type for martingales: see Bose [3, 4], Račkauskas [24, 25, 26], Grama [3, 4] and Grama and Haeusler [5, 6]. It is also worth noting that limit theorems for large and moderate deviation principle for martingales have been proved by several authors, see e.g. Liptser and Pukhalskii [2], Gulinsky and Veretennikov [7], Gulinsky, Liptser and Lototskii [8], Gao [2], Dembo [6], Worms [3] and Djellout [7]. However, these theorems are less precise than large deviation expansions of type. Let ξ i,f i i=,...,n be a sequence of square integrable martingale differences defined on a probability space Ω,F,P, where ξ = and {,Ω} = F... F n F. Denote X n = n ξ i. Assume that there exist absolute constants H > and N such that max i ξ i H and n Eξ2 i F i n N 2. Here and hereafter, the equalities and inequalities between random variables are understood in the P-almost sure sense. From the results in Grama and Haeusler [5], it follows that, for any constant α > and α logn x = o n /6, PX n > x n Φx = +O H +N x3 n 2 and, for any x = O logn, PX n > x n Φx = +O H +N+x logn n 3 as n se also [4, 6] for more results in the last range. In this paper we extend the expansions 2 and 3 to the case of martingale differences ξ i,f i i=,...,n satisfying the conditional Bernstein condition, Eξ k i F i 2 k!hk 2 Eξ 2 i F i, for k 3 and i n, 4 where H is a positive absolute constant. Note that in the i.i.d. case Bernstein s condition 4 is equivalent to Cramér s condition see Section 8 and therefore 2 implies Cramér s expansion. It is worth stressing that the remainder in expansion 2 is of the same order as that in in the stated range and therefore cannot be improved. As to the remainder in 3, from the rate of convergence result in Bolthausen [2] we conclude that it is also optimal. Another objective of the paper is to find an asymptotic expansion of large deviation for martingales in a wider range than that of 2. From Theorems 2. and 2.2 of the paper it follows that, for any constant α > and α logn x = o n /2, log PX n > x n Φx x 3 = O n as n. 5 This improves the corresponding result in [5] where 5 has been established only in the range x [α logn,α n /4 ] for some absolute constant α >. The upper bound of the range and 2

3 the remainder in expansion 5 cannot be improved since they are of the same order as in the Cramér s expansion. The idea behind our approach is similar to that of Cramér for independent random variables with corresponding adaptations to the martingale case. We make use of the conjugate multiplicative martingale for changing the probability measure as proposed in Grama and Haeusler [5] see also [9]. However, we refine [5] in two aspects. First, we relax the boundedness condition ξ i L, replacing it by Bernstein s condition 4. Secondly, we establish upper and lower bounds for the large deviation probabilities in the range x [,α n /2 thus enlarging the range x [,α n /4 ] established in [5]. In the proof we make use of a rate of convergence result for martingales under the conjugate measure. It is established under the Bernstein condition 4, unlike [5] where it is established only for bounded martingale differences. As a consequence, we improve the result on the rate of convergence in the central limit theorem CLT due to Bolthausen [2] see Theorem 3. below. The paper is organized as follows. Our main results are stated and discussedin in Section 2. A rate of convergence in the CLT for martingales is given in Section 3. Section 4 contains auxiliary assertions used in the proofs of the main results. Proofs are deferred to Sections 5, 6 and 7. We clarify the relations among the conditions of Bernstein, Cramér and Sakhanenko in Section 8. Throughout the paper, c and c α, probably supplied with some indices, denote respectively a generic positive absolute constant and a generic positive constant depending only on α. Moreover, θ i s stand for values satisfying θ i. 2. Main results 2.. Main theorems Assume that we are given a sequence of martingale differences ξ i,f i i=,...,n, defined on some probability space Ω,F,P, where ξ =, {,Ω} = F... F n F are increasing σ-fields and ξ i,...,n are allowed to depend on n. Set X =, X k = k ξ i, k =,...,n. 6 Let X be the quadratic characteristic of the martingale X = X k,f k k=,...,n : X =, X k = k Eξi 2 F i, k =,...,n. 7 In the sequel we shall use the following conditions: A There exists a number ǫ, ] such that 2 Eξ k i F i 2 k!ǫk 2 Eξ 2 i F i, for k 3 and i n; 3

4 A2 There exists a number δ [, 2 ] such that X n δ2. Note that in the case of normalized sums of i.i.d. random variables conditions A and A2 are satisfied with ǫ = σ and δ = see conditions n A and A2 below. In the case of martingales ǫ and δ usually depend on n such that ǫ = ǫ n and δ = δ n. The following two theorems give upper and lower bounds for large deviation probabilities. Theorem 2.. Assume conditions A and A2. Then, for any constant α, and all x αǫ, we have PX n > x {c } Φx exp α x 3 ǫ+x 2 δ 2 +c α +xǫ logǫ +δ 8 and PX n < x Φ x exp {c } α x 3 ǫ+x 2 δ 2 +c α +xǫ logǫ +δ, 9 where the constant c α does not depend on ξ i,f i i=,...,n, n and x. Theorem 2.2. Assume conditions A and A2. Then there is an absolute constant α > such that, for all x α ǫ and δ α, PX n > x { c Φx exp α x 3 ǫ+x 2 δ ++xǫ logǫ +δ } 2 and PX n < x Φ x exp { c α x 3 ǫ+x 2 δ ++xǫ logǫ +δ } 2, where the constants α and c α do not depend on ξ i,f i i=,...,n, n and x. Using the inequality e x e α x valid for x α, from Theorems 2. and 2.2, we obtain the following improvement of the main result of [5]. Corollary 2.. Assume conditions A and A2. Then there is an absolute constant α > such that, for all x α min{ǫ logǫ,δ }, PX n > x Φx = exp{θ c α x 3 ǫ} +θ 2 c α +xǫ logǫ +δ 2 and PX n < x Φ x = exp{θ 3 c α x 3 ǫ} +θ 4 c α +xǫ logǫ +δ, 3 where c α does not depend on n,x but θ i possibly depend on ξ i,f i i=,...,n, n and x. For bounded martingale differences ξ i ǫ under condition A2, Grama and Haeusler [5] proved the asymptotic expansions 2 and 3 for x [,α min{ǫ /2,δ }] and some small absolute constant α, ]. Thus Corollary 2. extends the asymptotic expansions of [5] to 8 a larger range x [,α min{ǫ logǫ,δ } and non bounded martingale differences. 4

5 2.2. Remarks on the main theorems Combining the inequalities 8 and, we conclude that under A and A2 there is an absolute constant α > such that, for all x α ǫ and δ α, log PX n > x Φx c α x 3 ǫ+x 2 δ 2 ++xǫ logǫ +δ. 4 We show that this result can be regarded as a refinement of the moderate deviation principle MDP in the framework where A and A2 hold. Assume that A and A2 are satisfied with ǫ = ǫ n and δ = δ n as n. Let a n be any sequence of real numbers satisfying a n and a n ǫ n as n. Then inequality 4 implies the MDP for X n n with the speed a n and rate function x 2 /2. Indeed, using the inequalities we deduce that, for any x, 2π+x e x2 /2 Φx lim n a 2 n logpx n > a n x = x2 2. By a similar argument, we also have, for any x, lim n a 2 n logpx n < a n x = x2 2. π+x e x2 /2, x, The last two equalities are equivalent to the statement that: for each Borel set B, x 2 inf liminf logp X x B o 2 n a 2 n B n a n x 2 limsup logp X n B inf n a n x B 2, a 2 n where B o and B denote the interior and the closure of B respectively, see Lemma 4.4 of [2]. Similar results can be found in Gao [2] for the martingale differences satisfying the conditional Cramér condition Eexp{c ξ i } F i <. To show that our results are sharp, assume that ξ i = η i / n, where η i,f i,...,n is a sequence of martingale differences satisfying the following conditions: A Bernstein s condition There exists a positive absolute constant H such that Eη k i F i 2 k!hk 2 Eη 2 i F i, for k 3 and i n; A2 There exists an absolute constant N such that n Eη2 i F i n N 2. 5

6 These conditions are satisfied with some H > and N = if, for instance, η,η 2,...,η n are i.i.d. random variables with finite exponential moments see Section 8 for an explicit expression of the positive absolute constant H. Corollary 2.2. Assume conditions A and A2. Then there is an absolute constant α 2 > such that for any absolute constant α > and all α logn x α2 n /2, we have log P n η i > x n = O H +N x3 5 Φx n and as n. log P n η i < x n Φ x = O H +N x3 n It is worth noting that the remainders of the expansions 5 and 6 are of the same order as in and therefore are optimal. Corollary 2.3. Assume conditions A and A2. Then, for all x = O logn, P n η i > x n = +O H +N+x logn Φx n and as n. P n η i < x n Φ x = +O H +N+x logn n Notice that 7 extends expansion 3 proved in Grama and Haeusler [5] to the case of martingale differences satisfying the conditional Bernstein condition A. The Remark 2. of [5]andthesharprateofconvergence inthecltduetobolthausen[2]hintthattheremainders of the expansions 7 and 8 are sharp. Corollary 2.4. Assume conditions A and A2. Then, for any absolute constant α > and α logn x = o n /6, P n η i > x n = +O H +N x3 9 Φx n and as n. P n η i < x n = +O H +N x3 Φ x n The remainders of the expansions 9 and 2 are of the same order as in in the stated range and therefore cannot be improved. Remark 2.. The results formulated above are proved under Bernstein s condition A. But they are also valid under some equivalent conditions which are stated in Section

7 3. Rates of convergence in the CLT Let ξ i,f i i=,...,n be a sequence of martingale differences satisfying condition A and X = X k,f k k=,...,n be the corresponding martingale defined by 6. For any real λ satisfying λ < ǫ, consider the exponential multiplicative martingale Zλ = Z k λ,f k k=,...,n, where Z k λ = k e λξ i Ee λξ i Fi, k =,...,n, Z λ =. For each k =,...,n, the random variable Z k λ defines a probability density on Ω,F,P. This allows us to introduce, for λ < ǫ, the conjugate probability measure P λ on Ω,F defined by dp λ = Z n λdp. 2 Denote by E λ the expectation with respect to P λ. For all i =,...,n, let η i λ = ξ i b i λ and b i λ = E λ ξ i F i. We thus obtain the well-known semimartingale decomposition: X k = Y k λ+b k λ, k =,...,n, 22 where Yλ = Y k λ,f k k=,...,n is the conjugate martingale defined as Y k λ = and Bλ = B k λ,f k k=,...,n is the drift process defined as B k λ = k η i λ, k =,...,n, 23 k b i λ, k =,...,n. In the proofs of Theorems 2. and 2.2, we make use of the following assertion, which gives us a rate of convergence in the central limit theorem for the conjugate martingale Yλ under the probability measure P λ. Lemma 3.. Assume conditions A and A2. Then, for all λ < ǫ, sup P λ Y n λ x Φx cλǫ+ǫ logǫ +δ. x If λ =, then Y n λ = X n and P λ = P. So Lemma 3. implies the following theorem. Theorem 3.. Assume conditions A and A2. Then sup PX n x Φx cǫ logǫ +δ. 24 x 7

8 Remark 3.. By inspecting the proof of Lemma 3., we can see that Theorem 3. holds true when condition A is replaced by the following weaker one: C There exists a number ǫ, ] depending on n such that 2 Eξ k i F i ǫ k 2 Eξ 2 i F i, for k = 3,5 and i n. Remark 3.2. Bolthausen see Theorem 2 of [2] showed that if ξ i ǫ and condition A2 holds, then sup PX n x Φx c ǫ 3 nlogn+δ. 25 x We note that Theorem 3. implies Bolthausen s inequality 25 under the less restrictive condition A. Indeed, by condition A2, we have 3/4 X n nǫ 2 and then ǫ 3/4n. For ǫ /2, it is easy to see that ǫ 3 nlogn 3ǫ logǫ /4. Thus, inequality 24 implies 25 with c = 4c/3. 4. Auxiliary results In this section, we establish some auxiliary lemmas which will be used in the proofs of Theorems 2. and 2.2. We first prove upper bounds for the conditional moments. Lemma 4.. Assume condition A. Then and Eξ k i F i 6k!ǫ k, for k 2, E ξ i k F i k!ǫ k 2 Eξ 2 i F i, for k 2. Proof. By Jensen s inequality and condition A, from which we get Eξ 2 i F i 2 Eξ 4 i F i 2ǫ 2 Eξ 2 i F i, Eξ 2 i F i 2ǫ 2. We obtain the first assertion. Again by condition A, for k 3, Eξ k i F i 2 k!ǫk 2 Eξ 2 i F i 6k!ǫ k. If k is even, the second assertion holds obviously. If k = 2l +, l, is odd, by Hölder s inequality and condition A, it follows that E ξ i 2l+ F i E ξi l ξ i l+ F i E ξi 2l F i E ξ 2l+ i F i 2 2l!2l+2!ǫ 2l Eξ 2 i F i 2l+!ǫ 2l Eξ 2 i F i. 8

9 This completes the proof of Lemma 4.. The following lemma establishes a two sided bound for the drift process B n λ. Lemma 4.2. Assume conditions A and A2. Then for any constant α, and all λ αǫ, Proof. By the relation between E and E λ on F i, we have B n λ λ λδ 2 +c α λ 2 ǫ. 26 b i λ = Eξ ie λξ i F i Ee λξ i Fi, i =,...,n. Jensen s inequality and Eξ i F i = imply that Ee λξ i F i. Since Eξ i e λξ i F i = E ξ i e λξ i F i, for λ, by Taylor s expansion for e x, we find that B n λ Eξ i e λξ i F i = E ξ i e λξ i F i = λ X n + + k=2 ξi λξ i k E k! F i. 27 Using condition A, we obtain, for any constant α, and all λ αǫ, + ξi λξ i k + k! F i E ξ k+ λ k i F i k! k=2 k=2 + 2 λ2 ǫ X n k +λǫ k 2 k=2 c α λ 2 ǫ X n. 28 Using condition A2, we get X n 2 and, for any constant α, and all λ αǫ, + E ξi λξ i k k! i F 2c α λ 2 ǫ. 29 k=2 Condition A2 together with 27 and 29 imply the upper bound of B n λ: for any constant α, and all λ αǫ, B n λ λ+λδ 2 +2c α λ 2 ǫ. 9

10 Using Lemma 4., we have, for any constant α, and all λ αǫ, E + e λξ i F i + E λξi k k! i F +6 k=2 + k=2 λǫ k +c,α λǫ 2. 3 This inequality together with condition A2 and 29 imply the lower bound of B n λ: for any constant α, and all λ αǫ, +c,αλǫ 2 B n λ Eξ i e λξ i F i + λ X n E ξi λξ i k k! F i +c,αλǫ 2 k=2 λ λδ 2 2c α λ 2 ǫ +c,α λǫ 2 λ λδ 2 2c α +αc,α λ 2 ǫ, where the last line follows from the following inequality, for any constant α, and all λ αǫ, λ λδ 2 2c α λ 2 ǫ λ λδ 2 2c α +αc,α λ 2 ǫ+c,α λ 3 ǫ 2 λ λδ 2 2c α +αc,α λ 2 ǫ +c,α λǫ 2. The proof of Lemma 4.2 is finished. Now, consider the predictable cumulant process Ψλ = Ψ k λ,f k k=,...,n related with the martingale X as follows: k Ψ k λ = loge e λξ i F i. 3 We establish a two sided bound for the process Ψλ. Lemma 4.3. Assume conditions A and A2. Then, for any constant α, and all λ αǫ, Ψ nλ λ2 2 c αλ 3 ǫ+ λ2 δ 2 2.

11 Proof. Since Eξ i F i =, it is easy to see that Ψ n λ = logee λξ i F i λeξ i F i λ2 2 Eξ2 i F i + λ2 2 X n. Using a two-term Taylor s expansion of log+x,x, we obtain Ψ n λ λ2 2 X n = Ee λξ i F i λeξ i F i λ2 2 Eξ2 i F i 2 + θ Ee λξ i Fi k=3 2 Ee λξ i F i 2. Since Ee λξ i F i, we find that Ψ nλ λ2 2 X n Eeλξ i F i λeξ i F i λ2 2 Eξ2 i F i + 2 Ee λξ i F i 2 + λ k k! Eξk i F i λ k 2 k! Eξk i F i. In the same way as in the proof of 28, using condition A and the inequality Eξi 2 F i 2ǫ 2 cf. Lemma 4., we have, for any constant α, and all λ αǫ, Ψ nλ λ2 2 X n c αλ 3 ǫ X n. Combining this inequality with condition A2, we get, for any constant α, and all λ αǫ, Ψ nλ λ2 2 2c αλ 3 ǫ+ λ2 δ 2 2, which completes the proof of Lemma Proof of Theorem 2. For x <, the assertion follows from Theorem 3.. It remains to prove Theorem 2. for any α, and all x αǫ. Changing the probability measure according to 2, we have, for all λ < ǫ, PX n > x = E λ Zn λ {Xn>x} = E λ exp{ λxn +Ψ n λ} {Xn>x} = E λ exp{ λyn λ λb n λ+ψ n λ} {Ynλ+B nλ>x}. 32 k=2

12 Let λ = λx be the largest solution of the equation λ+λδ 2 +c α λ 2 ǫ = x, 33 where c α is given by inequality 26. The definition of λ implies that there exist c α,,c α, > such that, for all x αǫ, c α, x λ = 2x +δ2 2 +4c α xǫ++δ 2 x 34 and λ = x c α, θ x 2 ǫ+xδ 2 [c α,,αǫ ]. 35 From 32, using Lemmas 4.2, 4.3 and equality 33, we obtain, for all x αǫ, PX n > x e c α,2λ 3 ǫ+λ 2 δ 2 λ 2 /2 E λ e λynλ {Ynλ>}. 36 It is easy to see that E λ e λynλ {Ynλ>} = Similarly, for a standard gaussian random variable N, we have E e λn {N>} = From 37 and 38, it follows E λ e λynλ {Ynλ>} E e λn {N>} 2sup y λe λy P λ < Y n λ ydy. 37 λe λy P < N ydy. 38 P λ Y n λ y Φy. Using Lemma 3., we obtain the following bound: for all x αǫ, E λ e λynλ {Ynλ>} E e λn {N>} c λǫ+ǫ logǫ +δ. 39 From 36 and 39 we find that, for all x αǫ, PX n > x e c α,2λ 3 ǫ+λ 2 δ 2 λ 2 /2 E e λn {N>} +c λǫ+ǫ logǫ +δ. Since e λ2 /2 E e λn {N>} = e y+λ2 /2 dy = Φλ 4 2π 2

13 and, for all λ c α,, Φλ 2π+λ e λ2 /2 c α, 2π+cα, λ e λ2 /2 4 see Feller [], we obtainthefollowing upper boundontail probabilities: forall x αǫ, PX n > x Φ λ 3 2 ec α,2λ ǫ+λ δ 2 +c α,3 λ 2 ǫ+λǫ logǫ +λδ. 42 Next, we would like to compare Φλ with Φx. By 34, 35 and 4, we get λ exp{ t2 /2}dt x exp{ t2 /2}dt = + x λ exp{ t2 /2}dt x exp{ t2 /2}dt +c α,4 xx λexp{x 2 λ 2 /2} exp{c α,5 x 3 ǫ+x 2 δ 2 }. 43 So, we find that Φ λ = Φx exp { θ c α,5 x 3 ǫ+x 2 δ 2 }. 44 Implementing 44 in 42 and using 34, we obtain, for all x αǫ, PX n > x Φx exp{c α,6 x 3 ǫ+x 2 δ 2 } +c α,7 x 2 ǫ+xǫ logǫ +xδ exp{c α,6 x 3 ǫ+x 2 δ 2 } exp{c α,8 x 3 ǫ+x 2 δ 2 } +c α,7 x 2 ǫ +c α,7 xǫ logǫ +δ +c α,7 xǫ logǫ +δ. Taking c α = max{c α,7,c α,8 }, we prove the first assertion of Theorem 2.. The second assertion follows from the first one applied to the martingale X k k=,...,n. 6. Proof of Theorem 2.2 For x <, the assertion follows from Theorem 3.. It remains to prove Theorem 2.2 for x α ǫ, where α > is an absolute constant. Let λ = λx be the smallest solution of the equation λ λδ 2 c /2 λ 2 ǫ = x, 45 wherec α isgiven byinequality 26. Thedefinitionofλimpliesthat, forall x.c /2 ǫ, it holds 2x x λ = δ 2 + 2x 46 δ 2 2 4c /2 xǫ 3

14 and λ = x+c θ x 2 ǫ+xδ 2 [,.2c /2 ǫ ]. 47 From 32, using Lemmas 4.2, 4.3 and equality 45, we obtain, for all x.c /2 ǫ, PX n > x e c λ 3 ǫ+λ 2 δ 2 λ 2 /2 E λ e λy nλ {Ynλ>}. 48 In the subsequent we distinguish two cases. First, let λ α min{ǫ /2,δ }, where α > is a small absolute constant whose value will be given later. Note that inequality 39 can be established with λ replaced by λ, which, in turn, implies PX n > x e c λ 3 ǫ+λ 2 δ 2 λ 2 /2 E e λn {N>} c2 λǫ+ǫ logǫ +δ By 4 and 4, we obtain the following lower bound on tail probabilities: PX n > x Φλ e c λ 3 ǫ+λ 2 δ 2 c 2 λ 2 ǫ+λǫ logǫ +λδ. 49 Taking α = 8c 2, we deduce that, for all λ α min{ǫ /2,δ }, c 2 λ 2 ǫ+λǫ logǫ +λδ exp { 2c 2 λ 2 ǫ+λǫ logǫ +λδ }. 5 Implementing 5 in 49, we obtain PX n > x { exp c 3 λ 3 ǫ+λǫ logǫ +λδ +λ 2 δ 2} 5 Φλ which is valid for all λ α min{ǫ /2,δ }. Next, we consider the case of α min{ǫ /2,δ } λ α ǫ and δ α. Let K be an absolute constant, whose exact value will be chosen later. It is easy to see that E λ e λy nλ {Ynλ>} Eλ e λynλ {<Ynλ Kγ} e λkγ P λ < Y n λ Kγ where γ = λǫ+ǫ logǫ +δ 4α /2, if α. From Lemma 3., we have P λ < Y n λ Kγ P < N Kγ c 5 γ Taking α = /6K 2, we find that P λ < Y n λ Kγ Kγe K2 γ 2 /2 c 5 γ Ke 8K2 α c 5 γ. 4 2 K c 5 γ.., 52

15 Letting K 8c 5, it follows that Choosing K = max we deduce that P λ < Y n λ Kγ 3 8 Kγ 3 8 Kmax{ λ 2 ǫ,λδ } λ } {8c 5, 8α 2 3 and taking into account that α π min{ǫ /2,δ } λ α ǫ, P λ < Y n λ Kγ. πλ. Since the inequality πλ e λ2 /2 Φλ is valid for λ see Feller [], it follows that, for all α min{ǫ /2,δ } λ α ǫ, P λ < Y n λ Kγ Φλ e λ2 /2. 53 From 48, 52 and 53, we obtain PX n > x Φλ { exp c α,6 λ 3 ǫ+λǫ logǫ +λδ +λ 2 δ 2} 54 which is valid for all α min{ǫ /2,δ } λ α ǫ. Putting 5 and 54 together, we obtain, for all λ α ǫ and δ α, PX n > x Φλ { exp c α,7 λ 3 ǫ+λǫ logǫ +λδ +λ 2 δ 2}. 55 As in the proof of Theorem 2., we now compare Φλ with Φx. By a similar argument as in 43, we have Φλ = Φx exp { θ c 3 x 3 ǫ+x 2 δ 2 }. 56 Combining 46, 55 and 56, we obtain, for all x α ǫ and δ α, PX n > x Φx exp { c α,8 x 3 ǫ+xǫ logǫ +xδ +x 2 δ 2} 57 which gives the first conclusion of Theorem 2.2. The second conclusion follows from the first one applied to the martingale X k k=,...,n. 5

16 7. Proof of Lemma 3. The proof of Lemma 3. is a refinement of Lemma 3.3 of Grama and Haeusler [5] where it is assumed that η i 2ǫ, which is a particular case of condition A. Compared to the case where η i are bounded, the main challenge of our proof comes from the control of I defined in 64 below. In this section, α denotes a positive absolute number satisfying α,, ϑ denotes a real number satisfying ϑ, which is different from θ, and ϕt denotes the density function of the standard normal distribution. For the sake of simplicity, we also denote Yλ,Y n λ and ηλ by Y,Y n and η, respectively. We want to obtain a rate of convergence in the central limit theorem for the conjugate martingale Y = Y k,f k k=,...,n, where Y k = k η i. Denote the quadratic characteristic of the conjugate martingale Y by Y k = i k E ληi 2 F i, and set Y k = E λ ηk 2 F k. It is easy to see that, for k =,...,n, Y k = E λ ξk b k λ 2 F k = Eξ2 k eλξ k Fk Ee λξ k Fk Eξ ke λξ k Fk 2 Ee λξ k Fk Since Ee λξ i F i and η i k 2 k ξ i k + E λ ξ i F i k, using condition A and Lemma 4., we obtain, for all k 3 and all λ 4 ǫ, E λ ηi k F i 2 k E λ ξi k +E λ ξ i F i k F i 2 k E λ ξi k F i 2 k E ξ i k exp{ λξ i } F i c2 k k!ǫ k 2 E ξ 2 i F i. Using Taylor s expansion for e x and Lemma, we have, for all λ 4 ǫ, Y k X k Eξk 2eλξ k Fk Ee λξ k Fk Eξ2 k F k + Eξ k e λξ k Fk 2 Ee λξ k Fk 2 Eξ 2 k e λξ k F k Eξ 2 k F k Ee λξ k F k +Eξ k e λξ k F k 2 Eξ l+2 k F k λl l! + X k l= 2 + Eξ l+ k F k λl l! l= l= Eξ l k F k λl l! cλǫ X k. 59 Therefore, Y n Y n X n + X n cλǫ X n +δ 2. 6

17 Thus the martingale Y satisfies the following conditions analogous to conditions A and A2: for all λ 4 ǫ, B E λ η i k F i c k ǫ k 2 Eξ 2 i F i, 5 k 3; B2 Y n cλǫ+δ 2. We first prove Lemma 3. for λ < ǫ. Without loss of generality, we can assume that λ 4 ǫ, otherwise we take c 4 in the assertion of the lemma. Set T = + δ 2 and introduce a modification of the quadratic characteristic X as follows: V k = X k {k<n} +T {k=n}. 6 NotethatV =,V n = T andthat V k,f k k=,...,n isapredictable process. Set γ = λǫ+δ, where λ [,ǫ. Let c 4 be a free absolute constant, whose exact value will be chosen later. Consider the non-increasing discrete time predictable process A k = c 2 γ 2 +T V k,k =,...,n. For any fixed u R and any x R and y >, set for brevity, Φ u x,y = Φu x/ y. 6 In the proof we make use of the following two assertions, which can befound in Bolthausen s paper [2]. Lemma 7.. [2] Let X and Y be random variables. Then sup u PX u Φu c sup PX +Y u Φu +c 2 E Y 2 X /2. u Lemma 7.2. [2] Let Gx be an integrable function of bounded variation, X be a random variable and a, b > are real numbers. Then X +a EG c sup PX u Φu +c 2 b. b u Let N c 2 γ 2 = N,c γ be a normal random variable independent of Y n. Using a well-known smoothing procedure which employs Lemma 7., we get sup u P λ Y n u Φu c sup E λ Φ u Y n,a n Φu +c 2 γ u E λ Φ u Y n,a n E λ Φ u Y,A c sup u +c sup u = c sup u +c sup u E λ Φ u Y,A Φu +c 2 γ E λ Φ u Y n,a n E λ Φ u Y,A Φ u Φu c 2 γ 2 +T +c 2γ c sup E λ Φ u Y n,a n E λ Φ u Y,A +c 3 γ, 62 u 7

18 where E λ Φ u Y n,a n = P λ Y n +N c 2 γ 2 u and E λφ u Y,A = P λ N c 2 γ 2 +T u. By simple telescoping, we find that E λ Φ u Y n,a n E λ Φ u Y,A = E λ k= Φ u Y k,a k Φ u Y k,a k. From this, taking into account that η i,f i i=,...,n is a P λ -martingale and that we obtain where I = E λ I 2 = 2 E λ I 3 = E λ k= 2 x 2Φ ux,y = 2 y Φ ux,y, E λ Φ u Y n,a n E λ Φ u Y,A = I +I 2 I 3, 63 k= Φ u Y k,a k Φ u Y k,a k x Φ uy k,a k η k 2 2 x uy k,a k ηk 2, 64 2 x 2Φ uy k,a k Y k V k, 65 k= Φ u Y k,a k Φ u Y k,a k y Φ uy k,a k V k. 66 We now give estimates of I, I 2 and I 3. To shorten notations, set T k = u Y k / A k. a Control of I. Using a three-term Taylor s expansion, we have I = E λ k= 6A 3/2 k ϕ T k ϑ kη k Ak η 3 k. 67 In order to bound ϕ we distinguish two cases as follows. Case : η k / A k T k /2. In this case, by the inequality ϕ t ϕt+t 2, it follows ϕ T k ϑ kη k ϕ T k ϑ kη k + T k ϑ 2 kη k Ak Ak Ak sup ϕt+t 2 t T k T k /2 ϕt k /2+4T 2 k. 8

19 Define g t = sup t z 3 f z, where f t = ϕt/2 + 4t 2. It is easy to see that g t is a symmetric integrable function of bounded variation, non-increasing in t. Therefore, ϕ T k ϑ kη k Ak { η k / A k T k /2} g T k. 68 Case 2: η k / A k > T k /2. Since ϕ t 2, it follows that ϕ T k ϑ kη k Ak { η k / A k > T k /2} 2 { Tk <2} + 4η2 k Tk 2 A k { Tk 2} Now we bound the conditional expectation of η k k. Using condition B, we have E λ η k 3 F k cǫ X k and E λ η k 5 F k cǫ 3 X k,. 69 where X k = X k X k. From the definition of the process V see 6, it follows that X k V k = V k V k, E λ η k 3 F k c V k ǫ and E λ η k 5 F k c V k ǫ 3. 7 Thus, from 68, we obtain ϕ E λ T k ϑ kη k η k 3 Ak { ηk / A k T k /2} F k c 4 g T k V k ǫ. 7 From 69, by 7 and the inequality ǫ2 A k c 2, we find ϕ E λ T k ϑ kη k η k 3 { ηk / A Ak k > T k /2} F k g 2 T k V k ǫ, 72 where g 2 t = 2c { t <2} +4 t 2 { t 2}. Set Gt = c 4 g t+g 2 t. Then Gt is a symmetric integrable function of bounded variation, non-increasing in t. Returning to 67, by 7 and 72, we get where I E λ [ k= 6A 3/2 k ϕ E λ T k ϑ kη k η k 3 k ] Ak F J, 73 J = cǫe λ k= A 3/2 k Let us introduce the time change τ t as follows: for any real t [,T], GT k V k. 74 τ t = min{k n : V k > t}, where min = n. 75 9

20 It is clear that, for any t [,T], the stopping time τ t is predictable. Let σ k k=,...,n+ be the increasing sequence of moments when the increasing stepwise function τ t, t [,T], has jumps. It is clear that V k = [σ k,σ k+ dt and that k = τ t, for t [σ k,σ k+. Since τ T = n, we have k= A 3/2 k GT k V k = = k= T [σ k,σ k+ A 3/2 τ t A 3/2 τ t GT τt dt. GT τt dt Set, for brevity, a t = c 2 γ2 +T t. Since V τt 2γ 2, we see that Taking into account that c 4, we have t V τt V τt + V τt t+2γ 2, t [,T] a t A τt = c 2 γ2 +T V τt a t, t [,T]. 77 Since Gz is symmetric and is non-increasing in z, the last bound implies that T u Y τt J cǫ E a 3/2 λ G dt. 78 t a /2 t By Lemma 7.2, it is easy to see that u Yτt E λ G c a /2 sup P λ Y τt z Φz +c 2 at. 79 t z Since V τt = V τt V τt, V τt t cf. 76 and V τt 2γ 2, we get V n V τt V n V τt + V τt 2γ 2 +T t a t. 8 Thus E λ Yn Y τt 2 F τt = Eλ k=τt E λ ηk 2 F k F τ t ce λ k=τ t X k F τt = ce λ X n X F τt τ t ce λ V n V τt F τt ca t. 2

21 Then, by Lemma 7., we find that, for any t [,T], sup z From 78, 79 and 8, we obtain P λ Y τt z Φz c sup P λ Y n z Φz +c 2 at. 8 z T J c ǫ dt a 3/2 t T sup P λ Y n z Φz +c 2 ǫ z By elementary computations, we see that since λ Then T dt a 3/2 t c c λǫ c c ǫ and T dt a t. 82 dt a t c logǫ. 83 I J c sup PY n z Φz +c 2 ǫ logǫ. 84 c z b Control of I 2. Set Gz = sup v 2 ψz +v, where ψz = ϕz+z 2 3/2. Then Gz is a symmetric integrable function of bounded variation, non-increasing in t. Since A k = V k, we have I 2 I 2, +I 2,2, where I 2, = E λ k= I 2,2 = E λ k= 2A k ϕ T k V k X k, 2A k ϕ T k Y k X k. We first deal with I 2,. Since ϕ z ψz Gz, for any real z, we have ϕ T k GT k. 85 Note that V k X k 2δ 2 {k=n}, A n = c 2 γ2 and c 4. Then, using 85, we get the estimations I 2, c 2 c E λ GTn, and, by 79 with G = G and 8 with t = T, I 2, c sup P λ Y n z Φz +c 2 γ. c We next consider I 2,2. By 59, we easily obtain the bound z Y k X k cλǫ X k cλǫ V k. 2

22 With this bound, we get I 2,2 cλǫe λ k= 2A k ϕ T k V k. Since ϕ z ψz Gz, the right-hand side can be bounded exactly in the same way as J in 74, with A k replacing A 3/2 k. What we get is cf. 82 T I 2,2 c λǫ dt sup P λ Y n z Φz +c 2 λǫ a t z T dt a /2 t. By elementary computations, we see that T dt a /2 t T dt T t c 2, and, taking into account that a t c 2 γ 2, Then T dt c T a t c λǫ Collecting the bounds for I 2, and I 2,2, we get c Control of I 3. By Taylor s expansion, I 3 = 8 E λ dt a /2 t c 2 c λǫ. I 2,2 c sup P λ Y n z Φz +c 2 λǫ. c z I 2 c sup P λ Y n z Φz +c 2 γ. 86 c k= Since A k = V k 2γ 2 and c 4, we have z u Yk A 2 A k ϑ k A k 2ϕ k Ak ϑ k A. k A k A k ϑ k A k c 2 γ2 +T V k +2γ 2 2A k. 87 Using 87 and the inequalities ϕ z ψz Gz, we obtain I 3 cγ 2 E λ A 2 k= k G Tk 2 V k. 22

23 Proceeding in the same way as for estimating J in 74, we get I 3 c sup P λ Y n z Φz +c 2 γ. 88 c z We are now in a position to end the proof of Lemma 3.. From 63, using 84, 86 and 88, we find E λ Φ u Y n,a n E λ Φ u Y,A c sup P λ Y n z Φz +c 2 λǫ+ǫ logǫ +δ. c Implementing the last bound in 62, we come to sup P λ Y n z Φz c sup z c from which, choosing c = max{2c,4}, we get z z P λ Y n z Φz +c 2 λǫ+ǫ logǫ +δ, sup P λ Y n z Φz 2c 2 λǫ+ǫ logǫ +δ, 89 z which proves Lemma 3. for λ < ǫ. For λ <, we can prove Lemma 3. similarly by taking γ = ǫ logǫ +δ. We only need to note that in this case, instead of 83, T dt a 3/2 t c c ǫ lnǫ and T dt a t c logǫ Equivalent conditions In the following we give several equivalent conditions to the Bernstein condition A. In the independent case equivalent conditions can be found in Saulis and Statulevičius [28]. For the convenience of the readers and motivated by the fact that in [28] the conditions are rather different from those used here, we decided to include independent proofs. Proposition 8.. The following three conditions are equivalent: I Bernstein s condition A. II Sakhanenko s condition There exists some positive absolute constant K such that KE η i 3 exp{k η i } F i Eη 2 i F i, for i n. III There exists some positive absolute constant ρ such that E η i k F i 2 k!ρk 2 Eη 2 i F i, for k 3 and i n. 23

24 Proof. First we prove that I implies II. Let t,. By condition I and Lemma 4., we find that E η i 3 e th η i th k F i = E η i k+3 F i k! k= th k k +3!H k+ Eη k! i F 2 i k= HEηi 2 F k +3! i t k k! k= =: ftheη 2 i F i. 9 Since gt = tft is a continuous function in [, ] and satisfies g = and 2 g 3, there 2 exists t, such that gt 2 =. Taking K = t H, we obtain condition II from 9. Next we show that II implies III. By the elementary inequality x k k!e x, for k and x, it follows that, for k 3, Using condition II, for k 3, E η i k F i = E η i 3 K 3 k Kη i k 3 F i k 3!K 3 k E η i 3 exp{ Kη i } F i. E η i k F i k 3!K 2 k Eη 2 i F i 2 k!ρk 2 Eη 2 i F i, where ρ =, which proves condition III. K It is obvious that III implies I with H = ρ. Proposition 8.2. If η,...,η n are i.i.d., then Bernstein s condition, Cramér s condition and Sakhanenko s condition are all equivalent. Proof. According to Theorem 8., we only need to prove that Cramér s condition and Bernstein s condition are equivalent. We can assume that, a.s., η. First, from 3, we find that Bernstein s condition A implies Cramér s condition: Ee 2 H η <. Second, we show that Cramér s condition, i.e. Ee c η := c <, implies Bernstein s condition A. By the inequality x k k!e x, for k and x, it follows that Then, it is easy to see that, for k 3, Eη k ck E c η k k!c k Eec η = k!c k c. Eη k 2c 2 2 k!ck 2 c Eη 2 σ 2 2 k!hk 2 Eη 2, where σ 2 = Eη 2 and H = max { c, 2c3 c σ 2 }, which proves that condition A is satisfied. 24

25 Acknowledgements We would like to thank the two referees for their helpful remarks and suggestions. The work has been partially supported by the National Natural Science Foundation of China Grant no. 39 and Grant no. 744, and Hunan Provincial Natural Science Foundation of China Grant No.JJ2. Fan was partially supported by the Post-graduate Study Abroad Program sponsored by China Scholarship Council. References [] Bentkus, V. and Račkauskas, A., 99. On probabilities of large deviations in Banach spaces. Probab. Theory Relat. Fields, 86, [2] Bolthausen, E., 982. Exact convergence rates in some martingale central limit theorems. Ann. Probab.,, [3] Bose, A., 986a. Certain non-uniform rates of convergence to normality for martingale differences. J. Statist. Plann. Inference, 4, [4] Bose, A., 986b. Certain non-uniform rates of convergence to normality for a restricted class of martingales. Stochastics, 6, [5] Cramér, H., 938. Sur un nouveau théorème-limite de la théorie des probabilités. Actualite s Sci. Indust., 736, [6] Dembo, A., 996. Moderate deviations for martingales with bounded jumps. Electron. Comm. Proba.,, 7. [7] Djellout, H., 22. Moderate deviations for martingale differences and applications to φ mixing sequences. Stochastic Stochastic Rep., 73, [8] Esscher, F., 932. On the probability function in the collective theory of risk. Skand. Aktuarie Tidskr., 5, [9] Fan, X., Grama, I. and Liu, Q., 22. Hoeffding s inequality for supermartingales. Stochastic Process. Appl., 22, [] Feller, W., 943. Generalization of a probability limit theorem of Cramér. Trans. Amer. Math. Soc., [] Feller, W., 97. An introduction to probability theory and its applications, J. Wiley and Sons. [2] Gao, F. Q., 996. Moderate deviations for martingales and mixing random processes. Stochastic Process. Appl., 6, [3] Grama, I., 995. The probabilities of large deviations for semimartingales. Stochastic Stochastic Rep., 54, 9. [4] Grama, I., 997. On moderate deviations for martingales. Ann. Probab., 25,

26 [5] Grama, I. and Haeusler, E., 2. Large deviations for martingales via Cramér s method. Stochastic Process. Appl., 85, [6] Grama, I. and Haeusler, E., 26. An asymptotic expansion for probabilities of moderate deviations for multivariate martingales. J. Theoret. Probab., 9, 44. [7] Gulinsky, O. V. and Veretennikov, A. Yu., 993. Large deviations for discrete-time processes with averaging. VSP, Utrecht. [8] Gulinsky, O. V., Liptser, R. S. and Lototskii, S. V., 994. Large deviations for unbounded additive functionals of Markov processes with discrete time. J. Appl. Math. Stochastic Anal., 7. [9] Hall, P. and Heyde, C. C., 98. Martingale Limit Theory and Its Application. Academic Press. [2] Huang, C., 22. Moments, moderate and large deviations for a branching process in a random environment. Stochastic Process. Appl., 22, [2] Liptser, R.S. and Pukhalskii, A. A., 992. Limit theorems on large deviations for semimartingales. Stochastic Stochastic Rep., 38, [22] Petrov, V. V., 954. A generalization of Cramér s limit theorem. Uspekhi Math. Nauk, 9, [23] Petrov, V. V., 975. Sums of Independent Random Variables. Springer-Verlag. Berlin. [24] Račkauskas, A., 99. On probabilities of large deviations for martingales. Liet. Mat. Rink., 3, [25] Račkauskas, A., 995. Large deviations for martingales with some applications. Acta Appl. Math., 38, [26] Račkauskas, A., 997. Limit theorems for large deviations probabilites of certain quadratic forms. Lithuanian Math. J., 37, [27] Rubin, H. and Sethuraman, J., 965. Probabilities of moderate deviations. Sankhyā Ser. A, 37, [28] Saulis, L. and Statulevičius, V. A., 978. Limit theorems for large deviations. Kluwer Academic Publishers. [29] Statulevičius, V. A., 966. On large deviations. Probab. Theory Relat. Fields, 6, [3] Worms, J., 2. Moderate deviations for some dependent variables, part I: Martingales. Math. Methods Statist.,,