arxiv: v1 [math.pr] 22 Apr 2016

Transcription

1 Optimal caling of the Ranom Walk Metropoli algorithm uner L p mean ifferentiability arxiv: v1 math.pr Apr 016 Alain Durmu Sylvain Le Corff Eric Mouline Gareth O. Robert Abtract Thi paper conier the optimal caling problem for high-imenional ranom walk Metropoli algorithm for enitie which are ifferentiable in L p mean but which may be irregular at ome point like the Laplace enity for example an / or are upporte on an interval. Our main reult i the weak convergence of the Markov chain appropriately recale in time an pace to a Langevin iffuion proce a the imenion goe to infinity. Becaue the log-enity might be non-ifferentiable the limiting iffuion coul be ingular. The caling limit i etablihe uner aumption which are much weaker than the one ue in the original erivation of 6. Thi reult ha important practical implication for the ue of ranom walk Metropoli algorithm in Bayeian framework bae on parity inucing prior. 1 Introuction A wealth of contribution have been evote to the tuy of the behaviour of high-imenional Markov chain. One of the mot powerful approache for that purpoe i the caling analyi introuce by 6. Aume that the target itribution ha a enity with repect to the - imenional Lebegue meaure given by: π x = πx i. 1 The Ranom Walk Metropoli-Hating RWM upating cheme wa firt applie in 4 an procee a follow. Given the current tate Xk a new value Yk+1 = Y k+1i i obtaine by moving inepenently each coorinate i.e. Yk+1i = X ki + l 1/ Zk+1 where l > 0 i a caling factor an Z k k 1 i a equence of inepenent an ientically itribute i. i.. Gauian ranom variable. Here l govern the overall ize of the propoe jump an play a crucial role in etermining the efficiency of the algorithm. The propoal i then accepte or rejecte accoring to the acceptance probability αxk Y k+1 where αx y = 1 π y /π x. If the propoe value i accepte it become the next current value otherwie the current value i left unchange: Xk+1 = Xk + l 1/ Zk+11 A k+1 } A k+1 = U k+1 πxki + l 1/ Zk+1i/πX ki 3 1 LTCI CNRS an Télécom PariTech. Laboratoire e Mathématique Oray Univ. Pari-Su CNRS Univerité Pari-Saclay. 3 Centre e Mathématique Appliquée Ecole Polytechnique. 4 Univerity of Warwick Department of Statitic. 1

2 Durmu et al. Optimal caling uner L p mean ifferentiability where U k k 1 of i. i.. uniform ranom variable on 0 1 inepenent of Z k k 1. Uner certain regularity aumption on π it ha been prove in 6 that if the X0 i itribute uner the tationary itribution π then each component of Xk k 0 appropriately recale in time converge weakly to a Langevin iffuion proce with invariant itribution π a +. Thi reult allow to compute the aymptotic mean acceptance rate an to erive a practical rule to tune the factor l. It i hown in 6 that the pee of the limiting iffuion ha a function of l ha a unique maximum. The correponing mean acceptance rate in tationarity i equal to Thee reult have been erive for target itribution of the form 1 where πx exp V x where V i three-time continuouly ifferentiable. Therefore they o not cover the cae where the target enity i continuou but not mooth for example the Laplace itribution which play a key role a a parity-inucing prior in high-imenional Bayeian inference. The aim of thi paper i to exten the caling reult for the RWM algorithm introuce in the eminal paper 6 Theorem 3 to enitie which are abolutely continuou enitie ifferentiable in L p mean DLM for ome p but can be either non-ifferentiable at ome point or are upporte on an interval. A hown in 3 Section 17.3 ifferentiability of the quare root of the enity in L norm implie a quaratic approximation property for the log-likelihoo known a local aymptotic normality. A hown below the DLM permit the quaratic expanion of the log-likelihoo without paying the twice-ifferentiability price uually emane by uch a Taylor expanion uch expanion of the log-likelihoo play a key role in 6. The paper i organie a follow. In Section the target enity π i aume to be poitive on R. Theorem prove that uner the DLM aumption of thi paper the average acceptance rate an the expecte quare jump itance are the ame a in 6. Theorem 3 how that uner the ame aumption the recale in time Markov chain prouce by the RWM algorithm converge weakly to a Langevin iffuion. We how that thee reult may be applie to a enity of the form πx exp λ x + Ux where λ 0 an U i a mooth function. In Section 3 we focu on the cae where π i upporte only on an open interval of R. Uner appropriate aumption Theorem 4 an Theorem 5 how that the ame aymptotic reult limiting average acceptance rate an limiting Langevin iffuion aociate with π hol. We apply our reult to Gamma an Beta itribution. The proof are potpone to Section 4 an Section 5. Poitive Target enity on R The key of the proof of our main reult will be to how that the acceptance ratio an the expecte quare jump itance converge to a finite an non trivial limit. In the original proof of 6 the enity of the prouct form 1 with πx exp V x 4 i three-time continuouly ifferentiable an the acceptance ratio i expane uing the uual pointwie Taylor formula. More preciely the log-ratio of the enity evaluate at the propoe value an at the current tate i given by V i where Vi = V Xi V Xi + l 1/ Zi 5 an where X i itribute accoring to π an Z i a -imenional tanar Gauian ranom variable inepenent of X. Heuritically the two leaing term are l 1/ V X i Z i

3 Durmu et al. Optimal caling uner L p mean ifferentiability an l 1 V Xi Z i / where V an V are the firt an econ erivative of V repectively. By the central limit theorem thi expreion converge in itribution to a zero-mean Gauian ranom variable with variance l I where I = V xπxx. 6 R Note that I i the Fiher information aociate with the tranlation moel θ πx + θ evaluate at θ = 0. Uner appropriate technical conition the econ term converge almot urely to l I/. Auming that thee limit exit the acceptance ratio in the RWM algorithm converge to E1 expz where Z i a Gauian ranom variable with mean l I/ an variance l I; elementary computation how that E1 expz = Φ l/ I where Φ tan for the cumulative itribution function of a tanar normal itribution. For t 0 enote by Yt the linear interpolation of the Markov chain Xk k 0 after time recaling: Y t = t t X t + t t X t 7 = X t + t t l 1/ Z t 1 A 8 t where an enote the lower an the upper integer part function. Note that for all k 0 Y k/ = X k. Denote by B t t 0 the tanar Brownian motion. Theorem 1 6. Suppoe that the target π an the propoal itribution are given by 1-4 an repectively. Aume that i V i twice continuouly ifferentiable an V i Liphitz continuou ; ii E V X 8 < an E V X 4 < where X i itribute accoring to π. Then Yt1 t 0 where Yt1 i the firt component of the vector Yt efine in 7 converge weakly in the Wiener pace equippe with the uniform topology to the Langevin iffuion Y t = hlb t 1 hl V Y t t 9 where Y 0 i itribute accoring to π hl i given by hl = l Φ l I 10 an I i efine in 6. Wherea V i aume to be twice continuouly ifferentiable the ual repreentation of the Fiher information E V X = E V X = I allow u to remove in the tatement of the theorem all mention to the econ erivative of V which hint that two erivative might not really be require. For all θ x R efine ξ θ x = πx + θ 11 For p 1 enote f p πp = fx p πxx. Conier the following aumption: H1. There exit a meaurable function V : R R uch that: 3

4 Durmu et al. Optimal caling uner L p mean ifferentiability i There exit p > 4 C > 0 an β > 1 uch that for all θ R V + θ V θ V C θ β. πp ii The function V atifie V < +. π6 Lemma 1. Aume H1. Then the family of enitie θ π +θ i Differentiable in Quaratic Mean DQM at θ = 0 with erivative V i.e. there exit C > 0 uch that for all θ R where ξ θ i given by 11. Proof. The proof i potpone to Section 4.1. R ξ θ x ξ 0 x + θ V xξ 0 x/ x 1/ C θ β The firt tep in the proof i to how that the acceptance ratio P A1 = E1 exp V i } an the expecte quare jump itance EZ1 1 exp V i } both converge to a finite value. To that purpoe we conier Z E q q = E 1 1 exp Vi 1 expυ where V i i given by 5 υ = l 1/ Z 1 V X 1 + b Xi Zi 1 b x z = lz V x + E ζ X 1 Z 1 l ζ x z = exp V x V x + l 1/ z 4 V x 13 } / Propoition 1. Aume H1 hol. Let X be a ranom variable itribute accoring to π an Z be a zero-mean tanar Gauian ranom variable inepenent of X. Then for any q 0 lim + E q = 0. Proof. The proof i potpone to Section 4.. Propoition 1 how that it i enough to conier υ to analye the aymptotic behaviour of the acceptance ratio an the expecte quare jump itance a +. By the central limit theorem the term l Z i / V Xi in 1 converge in itribution to a zeromean Gauian ranom variable with variance l I where I i efine in 6. By Lemma 4 Section 4.3 the econ term which i E ζ X1 Z1 = E ζ X1 Z1 converge to l I/4. The lat term converge in probability to l I/4. Therefore the two lat term play a imilar role in the expanion of the acceptance ratio a the econ erivative of V in the regular cae. Theorem. Aume H1 hol. Then lim + P A 1 = al where al = Φ Il/. Proof. The proof i potpone to Section

5 Durmu et al. Optimal caling uner L p mean ifferentiability The econ reult of thi paper i that the equence Yt1 t 0 N } efine by 7 converge weakly to a Langevin iffuion. Let µ 1 be the equence of itribution of Yt1 t 0 N }. Propoition. Aume H1 hol. Then the equence µ 1 i tight in W. Proof. The proof i aapte from ; it i potpone to Section 4.4. By the Prohorov theorem the tightne of µ 1 implie that thi equence ha a weak limit point. We now prove that any limit point i the law of a olution to 9. For that purpoe we ue the equivalence between the weak formulation of tochatic ifferential equation an martingale problem. The generator L of the Langevin iffuion 9 i given for all φ Cc R R by Lφx = hl V x φx + φx 15 where for k N an I an open ubet of R Cc k I R i the pace of k-time ifferentiable function with compact upport enowe with the topology of uniform convergence of all erivative up to orer k. We et Cc I R = k=0 Ck c I R an W = CR + R. The canonical proce i enote by W t t 0 an B t t 0 i the aociate filtration. For any probability meaure µ on W the expectation with repect to µ i enote by E µ. A probability meaure µ on W i ai to olve the martingale problem aociate with 9 if the puhforwar of µ by W 0 i π an if for all φ Cc R R the proce φw t φw 0 LφW u u 0 t 0 i a martingale with repect to µ an the filtration B t t 0 i.e. if for all t R + t E φw µ t φw 0 LφW u u B = φw φw 0 LφW u. 0 0 µ a.. H. The function V i continuou on R except on a Lebegue-negligible et D V an i boune on all compact et of R. If V atifie H 7 Lemma 1.9 Theorem 0.1 Chapter 5 how that any olution to the martingale problem aociate with 9 coincie with the law of a olution to the SDE 9 an converely. Therefore uniquene in law of weak olution to 9 implie uniquene of the olution of the martingale problem. Propoition 3. Aume H hol. Aume alo that for all φ Cc R R m N g : R m R boune an continuou an 0 t 1 t m t: lim + Eµ φ W t φ W Lφ W u u g W t1... W tm = Then every limit point of the equence of probability meaure µ 1 on W i a olution to the martingale problem aociate with 9. Proof. The proof i potpone to Section 4.5. Theorem 3. Aume H1 an H hol. Aume alo that 9 ha a unique weak olution. Then Y t1 t 0 N } converge weakly to the olution Y t t 0 of the Langevin equation efine by 9. Furthermore hl i maximize at the unique value of l for which al = 0.34 where a i efine in Theorem. 5

6 Durmu et al. Optimal caling uner L p mean ifferentiability Proof. The proof i potpone to Section 4.6. Example 1 Bayeian Lao. We apply the reult obtaine above to a target enity π on R given by x e V x / R e V y y where V i given by V : x Ux + λ x where λ 0 an U i twice continuouly ifferentiable with boune econ erivative. Furthermore R x 6 e V x x < +. Define V : x U x + λ ignx with ignx = 1 if x 0 an ignx = 1 otherwie. We firt check that H1i hol. Note that for all x y R x + y x ignxy y 1 R+ y x 17 which implie that for any p 1 there exit C p uch that V + θ V θ V U + θ U θu πp + λ + θ θ ign πp πp U θ + θ λπ θ θ} 1/p C θ p+1/p θ. Aumption H1ii an H are eay to check. The uniquene in law of 9 i etablihe in 1 Theorem 4.5 i. Therefore Theorem 3 can be applie. 3 Target enity upporte on an interval of R We now exten our reult to enitie upporte by a open interval I R : πx exp V x1 I x where V : I R i a meaurable function. Note that by convention V x = for all x / I. Denote by I the cloure of I in R. The reult of Section cannot be irectly ue in uch a cae a π i no longer poitive on R. Conier the following aumption. G1. There exit a meaurable function V : I R an r > 1 uch that: i There exit p > 4 C > 0 an β > 1 uch that for all θ R V + θ V }1 I + rθ1 I + 1 rθ θ V C θ β πp with the convention 0 = 0. ii The function V atifie V π6 < +. iii There exit γ 6 an C > 0 uch that for all θ R 1 I cx + θπxx C θ γ. R A an important conequence of G1iii if X i itribute accoring to π an i inepenent of the tanar ranom variable Z there exit a contant C uch that P X + l 1/ Z I c C γ/. 18 6

7 Durmu et al. Optimal caling uner L p mean ifferentiability Theorem 4. Aume G1 hol. Then lim + P A 1 = al where al = Φ Il/. Proof. The proof i potpone to Section 5.1. We now etablihe the weak convergence of the equence Yt1 t 0 N } following the ame tep a for the proof of Theorem 3. Denote for all 1 µ the law of the proce Y t1 t 0. Propoition 4. Aume G1 hol. Then the equence µ 1 i tight in W. Proof. The proof i potpone to Section 5.. Contrary to the cae where π i poitive on R we o not aume that V i boune on all compact et of R. Therefore we conier the local martingale problem aociate with 9: with the notation of Section a probability meaure µ on W i ai to olve the local martingale problem aociate with 9 if the puhforwar of µ by W 0 i π an if for all ψ C R R the proce ψw t ψw 0 0 LψW u u t 0 i a local martingale with repect to µ an the filtration B t t 0. By 1 Theorem 1.7 any olution to the local martingale problem aociate with 9 coincie with the law of a olution to the SDE 9 an converely. If 9 amit a unique olution in law thi law i the unique olution to the local martingale problem aociate with 9. We firt prove that any limit point µ of µ 1 i a olution to the local martingale problem aociate with 9. G. The function V i continuou on I except on a null-et D V with repect to the Lebegue meaure an i boune on all compact et of I. Thi conition oe not preclue that V i unboune at the bounary of I. Propoition 5. Aume G1 an G hol. Aume alo that for all φ C c I R m N g : R m R boune an continuou an 0 t 1 t m t: lim + Eµ φ W t φ W Lφ W u u g W t1... W tm = Then every limit point of the equence of probability meaure µ 1 on W i a olution to the local martingale problem aociate with 9. Proof. The proof i potpone to Section 5.3. Theorem 5. Aume G1 an G hol. Aume alo that 9 ha a unique weak olution. Then Y t1 t 0 N } converge weakly to the olution Y t t 0 of the Langevin equation efine by 9. Furthermore hl i maximize at the unique value of l for which al = 0.34 where a i efine in Theorem. Proof. The proof i along the ame line a the proof of Theorem 3 an i potpone to Section 5.4. The conition for uniquene in law of ingular one-imenional tochatic ifferential equation are given in 1. Thee conition are rather involve an ifficult to ummarize in full generality. We rather illutrate Theorem 5 by two example. 7

8 Durmu et al. Optimal caling uner L p mean ifferentiability Example Application to the Gamma itribution. Define the cla of the generalize Gamma itribution a the family of enitie on R given by / π γ : x x a1 1 exp x a 1 R + x y a1 1 exp y a y R + with two parameter a 1 > 6 an a > 0. Note that in thi cae I = R + for all x I V γ : x x a a 1 1 log x an V γ : x a x a 1 a 1 1/x. We check that G1 hol with r = 3/. Firt we how that G1i hol with p = 5. Write for all θ R an x I where V γ x + θ V γ x} 1 I x + 1 rθ1 I x + rθ θ V γ x = E 1 + E + E 3 E 1 = θ V γ x 1 I x θ/1 I x + 3θ/ 1} E = 1 a 1 log1 + θ/x θ/x} 1 I x θ/1 I x + 3θ/ E 3 = x + θ a x a a θx a 1 1 I x θ/1 I x + 3θ/. It i enough to prove that there exit q > 5 uch that for all i 1 3} I E i 5 π γ xx C θ q. The reult i prove for θ < 0 the proof for θ > 0 follow the ame line. For all θ R uing a 1 > 6 R + E 1 5 π γ xx C θ 5 3 θ / 0 1/x 5 + x 5a 1} x a1 1 e xa x 3/ 3/ C θ a1 x a1 6 e θ xa x + θ 5a x 5a 1+a1 1 e θ xa x 0 C θ a1 + θ 5a+a1. 0 On the other han a for all x > 1 x/x + 1 log1 + x x for all θ < 0 an x 3 θ / log1 + θ/x θ/x θ x 1 + θ/x 3 θ /x where the lat inequality come from θ /x /3. Then it yiel R + E x 5 π γ xx C θ θ / 0 x a1 11 e xa x x a1 11 e xa x C θ a1 + θ For the lat term for all θ < 0 an all x 3 θ / uing a Taylor expanion of x x a there exit ζ x + θ x uch that Then R + x + θ a x a a θx a 1 C θ ζ a C θ x a. + E 3 x 5 π γ xx C θ 10 x 5a +a1 1 e xa x C θ 5a+a1 + θ θ / 8

9 Durmu et al. Optimal caling uner L p mean ifferentiability Combining 0 1 an uing that a 1 > 6 conclue the proof of G1i for p = 5. The proof of G1ii follow from V γ x 6 π γ xx C x a1 1+6a 1 e xa x + x a1 7 e xa x < R + R + R + an G1iii follow from R 1 I cx + θπ γxx C θ a1. Now conier the Langevin equation aociate with π γ given by Y t = V γ Y t t+ B t with initial itribution π γ. Thi tochatic ifferential equation ha 0 a ingular point which ha right type 3 accoring to the terminology of 1. On the other han ha type A an the exitence an uniquene in law for the SDE follow from 1 Theorem 4.6 viii. Since G i traightforwar Theorem 5 can be applie. Example 3 Application to the Beta itribution. Conier now the cae of the Beta itribution π β with enity x x a1 1 1 x a x with a 1 a > 6. Here I = 0 1 an the log-enity V β an it erivative on I are efine by V β x = a 1 1 log x a 1 log1 x an V β x = a 1 1/x a 1/1 x. Along the ame line a above π β atifie G1 an G. Hence Theorem 4 can be applie if we etablih the uniquene in law for the Langevin equation aociate with π β efine by Y t = V β Y t t + B t with initial itribution π β. In the terminology of 1 0 ha right type 3 an 1 ha left type 3. Therefore by 1 Theorem.16 i ii the SDE ha a global unique weak olution. To illutrate our fining conier the Beta itribution with parameter a 1 = 10 an a = 10. Define the expecte quare itance by ESJD l = E X1 X0 where X0 ha itribution π β an X 1 i the firt iterate of the Markov chain efine by the Ranom Walk Metropoli algorithm given in. By Theorem 4 an Theorem 5 we have lim + ESJD l = hl = l al. Figure 1 iplay an empirical etimation for the ESJD for imenion = a a function of the empirical mean acceptance rate. We can oberve that a expecte the ESJD converge to ome limit function a goe infinity an thi function ha a maximum for a mean acceptance probability aroun Proof of Section For any real ranom variable Y an any p 1 let Y p := E Y p 1/p. 4.1 Proof of Lemma 1 Let θ V x = V x V x + θ. By efinition of ξ θ an π where ξ θ x ξ 0 x + θ V xξ 0 x/ Aθ x + B θ x} πx A θ x = exp θ V x/ 1 θ V x/ B θ x = θ V x + θ V x /4. 9

10 Durmu et al. Optimal caling uner L p mean ifferentiability Figure 1: Expecte quare jumpe itance for the beta itribution with parameter a 1 = 10 an a = 10 a a function of the mean acceptance rate for = By H1i B θ πp C θ β. For A θ note that for all x R expx 1 x x 4 expx+1. Then A θ xπxx C θ V x e θv x πxx R R C θ V x 4 + θ V x 4 πxx. The proof i complete writing the ame inequality hol for θ V : θ V x 4 πxx C θ V x θ V 4 x πxx + θ 4 R R R an uing H1i-ii. 4. Proof of Propoition 1 Define R Rx = R i the remainer term of the Taylor expanion of x log1 + x: x We preface the proof by the following Lemma. 0 V 4 xπxx x u u u 3 log1 + x = x x / + Rx. 4 Lemma. Aume H1 hol. Then if X i a ranom variable itribute accoring to π an Z i a tanar Gauian ranom variable inepenent of X 10

11 Durmu et al. Optimal caling uner L p mean ifferentiability i lim + ζ X Z + lz V X/ = 0. ii lim + V X V X + lz/ + lz V X/ p = 0. iii lim R ζ X Z 1 = 0 where ζ i given by 14. Proof. Uing the efinition 11 an 14 of ζ an ξ θ ζ x z = ξ lz 1/x/ξ 0 x 1. 5 i The proof follow from Lemma 1 uing that β > 1: ζ X Z + lz V X/ Cl β β E Z β. ii Uing H1i we get that V X V X + lz/ + lz V X/ p Cl βp βp/ E Z βp p an the proof follow ince β > 1. iii Note that for all x > 0 u 0 x x u1+u 1 x an the ame inequality hol for x 1 0 an u x 0. Then by 3 an 4 for all x > 1 Rx x log1 + x. Then by 50 etting Ψ x z = Rζ x z Ψ x z ξ lz 1/x/ξ 0 x 1 V x + lz 1/ V x /. Since for all x R expx 1 x expx + 1 thi yiel Ψ x z 4 1 V x + lz 1/ V x 3 exp V x V x + lz 1/ which implie that Ψ x z πxx 4 1 R R + 1 V x + lz 1/ V x 3 πx + πx + lz 1/ }x. By Höler inequality an uing H1i lz 1/ Ψ x z πxx C 3 V x 4 3/4 πxx + lz 1/ 3β. R R The proof follow from H1ii ince β > 1. For all 1 let X be itribute accoring to π an Z be -imenional Gauian ranom variable inepenent of X et J = V i b Xi Zi } 1 where V i an b are efine in 5 an 13 repectively. 11

12 Durmu et al. Optimal caling uner L p mean ifferentiability Lemma 3. lim + J = 0. = log 1 + ζ Xi Z i an uing 4 we get Proof. Noting that Vi 3 J J i = ζ Xi Zi + + lz i V X i E ζ X i Z i 1 ζ Xi Zi l 4 V Xi + R ζ Xi Z i 1 where R i efine by 3. By Lemma i the firt term goe to 0 a goe to + ince J 1 ζ X1 Z1 lz + 1 V X 1. Conier now J. We ue the following ecompoition for all i ζ Xi Zi l 4 V Xi = ζ Xi Zi + l Z i V X i ζ X i Z i + l Z V i Xi l Z i V X i + l Z 4 i 1 } V Xi. Then J ζ X1 Z1 + l Z V 1 X1 + l V Xi Zi 1 } l V X1 Z1 ζ X1 Z1 + l Z V 1 X1. 1 Uing H1ii Lemma i an the Cauchy-Schwarz inequality how that the firt an the lat term converge to zero. For the econ term note that E Z i 1 = 0 o that 1 V Xi Zi 1 } 1 1/ Var V X1 Z1 1 } 1/ 0. Finally lim J 3 = 0 by 4 an Lemma iii. Proof of Propoition 1. Let q > 0 an Λ = l 1/ Z1 V X1 + V i. By the triangle inequality E q E 1q + E q where Z E q } 1q = E 1 1 exp Vi 1 exp Λ } E q = E Z 1 q 1 exp Λ } 1 exp υ }. Since t 1 e t i 1-Lipchitz by the Cauchy-Schwarz inequality we get E 1q Z 1 q V1 + l 1/ Z1 V X1. q By Lemma ii E 1q goe to 0 a goe to +. Conier now E q. Uing again that t 1 e t i 1-Lipchitz an Lemma 3 E q goe to

13 Durmu et al. Optimal caling uner L p mean ifferentiability 4.3 Proof of Theorem Following we introuce the function G efine on R + R by: exp a b Φ b a a if a 0 + Ga b = 0 if a = + exp b 1b>0} if a = 0 where Φ i the cumulative itribution function of a tanar normal variable an Γ: Φ b + exp a b a Φ b a a if a Γa b = if a = + exp if a = 0. b+ 6 7 Note that G an Γ are boune on R + R. G an Γ are ue throughout Section 4. Lemma 4. Aume H1 hol. For all N let X be a ranom variable itribute accoring to π an Z be a tanar Gauian ranom variable in R inepenent of X. Then where I i efine in 6 an ζ in 14. Proof. By 14 E ζ X1 Z1 = E = E The proof i then complete by Lemma i. R R lim E ζ X1 Z1 = l + 4 I π x + l 1/ Z1 π xx 1 π x + l 1/ Z 1 π x x Proof of Theorem. By efinition of A 1 ee 3 P A } 1 = E 1 exp Vi = E ζ X 1 Z 1 }. where Vi = V X0i V X 0i + l 1/ Z1i an where X 0 i itribute accoring to π an inepenent of the tanar -imenional Gauian ranom variable Z1. Following the ame tep a in the proof of Propoition 1 yiel: lim P A 1 E 1 exp Θ } = 0 8 where + Θ = l 1/ Z1i V X0i l V X 0i /4 + 1E ζ X 01 Z

14 Durmu et al. Optimal caling uner L p mean ifferentiability Conitional on X0 Θ i a one imenional Gauian ranom variable with mean µ an variance σ efine by µ = l V X0i /4 + 1E ζ X01 Z11 σ = l 1 V X0i. Therefore ince for any G N µ σ E1 expg = Φµ/σ + expµ + σ /Φ σ µ/σ taking the expectation conitional on X 0 we have E 1 exp Θ } = E Φµ /σ + expµ + σ /Φ σ µ /σ = E Γσ µ where the function Γ i efine in 7. By Lemma 4 an the law of large number almot urely lim + µ = l I/ an lim + σ = l I. Thu a Γ i boune by Lebegue ominate convergence theorem: The proof i then complete by 8. lim E 1 exp Θ } = Φ + l I/. 4.4 Proof of Propoition By Kolmogorov criterion it i enough to prove that there exit a non-ecreaing function γ : R + R + uch that for all 1 an all 0 t Y E t1 Y1 4 γtt. The inequality i traightforwar for all 0 t uch that = t. For all 0 t uch that t Y t1 Y 1 = X t 1 X 1 Then by the Höler inequality where we have ue Y E t1 Y1 4 C t t + The proof i complete uing Lemma 5. t t + lz t 1 1 A + t lz 1 1 A. 4 t + E X t 1 X 1 t + t t. Lemma 5. Aume H1. Then there exit C > 0 uch that for all 0 k 1 < k X E k1 Xk 4 11 C 4 p= k k 1 p p. 14

15 Durmu et al. Optimal caling uner L p mean ifferentiability Proof. For all 0 k 1 < k X E k1 Xk 4 11 = l4 E Therefore by the Höler inequality k k=k 1+1 Z k1 X E k1 Xk l4 k k 1 + 8l4 E k k=k 1+1 k k=k Zk11 A k c. The econ term can be written: k 4 E Zk11 A k c = 4 E Zm i11 A mi c k=k Zk11 A k c. 9 where the um i over all the quaruplet m i 4 atifying m i k k } i = The expectation on the right han ie can be upper boune epening on the carinality of m 1... m 4 }. For all 1 j 4 efine I j = m 1... m 4 k k } ; #m 1... m 4 } = j}. 30 Let m 1 m m 3 m 4 k k } 4 an X k k 0 be efine a: X 0 = X0 an X k+1 = X k l + 1 k / m1 1m 1m 3 1m 4 1} Z k+11ã k+1 with à k+1 U = } k+1 exp Ṽ ki where for all k 0 an all 1 i Ṽki i efine by Ṽ ki = V X ki V X ki + l Zk+1i. Note that on the event } 4 c j=1 A m j the two procee Xk k 0 an X k k 0 are equal. Let F be the σ-fiel generate by X k. a #m 1... m 4 } = 4 a the are inepenent conitionally to F 4 E j=1 Z m j11 A m j c k 0 } U mj Zm j1... Zm j F = = 4 j=1 1 j 4 E Zm j11 c F à m j 4 E j=1 Z m j1ϕ where ϕx = 1 e x +. Since the function ϕ i 1-Lipchitz we get ϕ Ṽ m j 1i Ṽ m j 1i F. ϕ l V X mj 11Zm j1 + Ṽ m j 1i Ṽ m j 11 + l V X mj 11Zm j1. 15

16 Durmu et al. Optimal caling uner L p mean ifferentiability Then where Z A m j = E Bm j = E 4 E m j1 Z m j1 j=1 Z m j11 A m j c 4 E j=1 } A mj + B mj Ṽ m j 11 + l V X mj 11Zm j1 F 1 exp l V X mj 11Zm j1 + Ṽ m j 1i By the inequality of arithmetic an geometric mean an convex inequalitie 4 E Zm j11 c A m j 8E A mj + B mj. j=1 j=1 } + F. By Lemma ii an the Höler inequality there exit C > 0 uch that E A m j 4 C. On the other han by Lemma 6 ince Zm j1 i inepenent of F Bm j = E l l V X mj 11G V X m j 11 Ṽ m j 1i F where the function G i efine in 6. By H1ii an ince G i boune EBm j 4 C. Therefore E 4 j=1 Z m j11 A mj c C howing that 4 E Zm i11 A mi c C k k m 1m m 3m 4 I 4 b #m 1... m 4 } = 3 a the } U mj Zm j1... Zm j are inepenent conition- 1 j 3 ally to F E Zm A m 1 c j= Z m j11 A m j c Z F 3 E m11 j= F F E Zm j11 c à m j 3 Then following the ame tep a above an uing Holer inequality yiel 3 E 3 Zm j11 c A m j CE A mj + B mj C 1 j= j= j= F E Zm j11 c à m j. an m 1m m 3m 4 I 3 4 E Zm i11 A mi c C k k 1 C 3 k k

17 Durmu et al. Optimal caling uner L p mean ifferentiability c If #m 1... m 4 } = two cae have to be coniere: Z E m11 1 Ã m 1 c Z Z Z m1 1A m c E m11 E m1 1 3 E Z m 1 4 π. Thi yiel m 1m m 3m 4 I E Z m11 3 1A m 1 cz m 11 A m c 4 E Zm i11 A mi c E Zm k k 1 k k 1 1 Ck k π 4 Z If #m 1... m 4 } = 1: E Zm i11 A mi c 4 E m11 3 then m 1m m 3m 4 I 1 4 E Zm i11 A mi c 3k k The proof i complete by combining 9 with an Proof of Propoition 3 We preface the proof by a preliminary lemma. Lemma 6. Aume that H1 hol. Let µ be a limit point of the equence of law µ 1 of Y t1 t 0 N }. Then for all t 0 the puhforwar meaure of µ by W t i π. Proof. By 7 Y lim E t1 X t 1 = 0. + Since µ 1 converge weakly to µ for all boune Lipchitz function ψ : R R E µ ψw t = lim + EψYt1 = lim + EψX t 1. The proof i complete upon noting that for all N an all t 0 X t 1 i itribute accoring to π. Proof of Propoition 3. Let µ be a limit point of µ 1. It i traightforwar to how that µ i a olution to the martingale problem aociate with L if for all φ Cc R R m N g : R m R boune an continuou an 0 t 1 t m t: E φ µ W t φ W Lφ W u u g W t1... W tm = Let φ Cc R R m N g : R m R continuou an boune 0 t 1 t m t an W V = w W w u D V for almot every u t}. Note firt that w W c V if an only if 1 D V w u u > 0. Therefore by H an Fubini theorem: E µ 1 D V W u u = E µ 1 D V W u u = 0 17

18 Durmu et al. Optimal caling uner L p mean ifferentiability howing that µw c V = 0. We now prove that on W V Ψ t : w φw t φw } Lφw u u gw t1... w tm 36 i continuou. It i clear that it i enough to how that w Lφw uu i continuou on W V. So let w W V an w n n 0 be a equence in W which converge to w in the uniform topology on compact et. Then by H for any u uch that w u / D V Lφwu n converge to Lφw u when n goe to infinity an Lφ i boune. Therefore by Lebegue ominate convergence theorem t Lφwn uu converge to Lφw uu. Hence the map efine by 36 i continuou on W V. Since µ 1 converge weakly to µ by 16: which i preciely 35. µ Ψ t = lim + µ Ψ t = Proof of Theorem 3 By Propoition 3 it i enough to check 16 to prove that µ i a olution to the martingale problem. The core of the proof of Theorem 3 i Propoition 6 for which we nee two technical lemmata. Lemma 7. Let X Y an U be R-value ranom variable an ɛ > 0. Aume that U i nonnegative an boune by 1. Let g : R R be a boune function on R uch that for all x y ɛ ɛ + gx gy C g x y. i For all a > 0 E U gx gy C g E U X Y where ocg = upg infg. ii If there exit µ R an σ C X R + uch that then + ocg P X ɛ + a 1 E U X Y + P ɛ < X < ɛ + a } up P X x Φx µ/σ C X x R E U gx gy C g E U X Y } + ocg C X + E U X Y πσ 1/ + ɛπσ 1/. Proof. i Conier the following ecompoition E U gx gy = E U gx gy 1 XY ɛ } XY ɛ+ } + E U gx gy 1 X ɛɛ} + 1 X< ɛ} Y ɛ} X>ɛ} Y ɛ}. 18

19 Durmu et al. Optimal caling uner L p mean ifferentiability In aition for all a > 0 X < ɛ} Y ɛ} X > ɛ} Y ɛ} Then uing that U 0 1 we get ɛ < X < ɛ + a} X ɛ + a} X Y a}. E U gx gy C g E U X Y + ocg P X < ɛ + a + a 1 E U X Y. ii The reult i traightforwar if E U X Y = 0. Aume E U X Y > 0. Combining the aitional aumption an the previou reult E U gx gy C g E U X Y + ocg } C X + ɛ + aπσ 1/ + a 1 E U X Y. A thi reult hol for all a > 0 the proof i conclue by etting a = E U X Y πσ 1/ /. Lemma 8. Aume H1 hol. Let X be itribute accoring to π an Z be a -imenional tanar Gauian ranom variable inepenent of X. Then lim + E = 0 where } E = E V X1 l G V X1 Vi l G V X1 b i V i an b i are rep. given by 5 an 13. Proof. Set for all 1 Ȳ = V i an X = b i. By 6 bga b = Ga b/ + exp b /8a/ πa. A G i boune an x x exp x i boune on R + we get up a R+; b a bga b < +. Therefore there exit C 0 uch that for all a R 1/4 + an b 1 b a 1/4 a 1/4 + Ga b 1 Ga b C b 1 b. 37 By efinition of b i 13 X may be expree a X = σ S + µ where µ = 1E ζ X1 Z1 l 1 E V X 4 1 σ = l E V X 1 + l4 16 E V X 1 E V X 1 S = σ 1 βi l βi = lzi V Xi 4 V X i E V X i. By H1ii the Berry-Een Theorem 5 Theorem 5.7 can be applie to S. Then there exit a univeral contant C uch that for all > 0 1/ up P S x Φx 1 C/. x R 19

20 Durmu et al. Optimal caling uner L p mean ifferentiability It follow that up P X x Φx µ / σ C/ x R where σ = 1σ /. By thi reult an 37 Lemma 7 can be applie to obtain a contant C 0 inepenent of uch that: G E l V X 1 / Ȳ G l V X 1 / X X 1 C ε + 1/ + ε π σ 1/ + l V X 1 /π1/ σ where ε = E X Ȳ. Uing thi reult we have E C ε + 1/ + ε π σ 1/ E V X1 +l 1/ E V X1 3/ π 1/ σ 1/}. 38 By Lemma 3 ε goe to 0 a goe to infinity an by H1ii lim + σ = l E V X. Combining thee reult with 38 it follow that E goe to 0 when goe to infinity. For all n 0 efine F n = σx k k n} an for all φ C c R R Mnφ = l n 1 } φ Xk1 Zk+111 A k+1 E Z k+111 A k+1 F k k=0 + l n 1 } φ X k1 Zk+11 1 A k+1 E Z k+11 1 A k+1 F k. 39 k=0 Propoition 6. Aume H1 an H hol. Then for all t an all φ Cc R R t lim E φyt1 φy1 LφYr1r M t φ M φ = 0. + Proof. Firt ince Y r1 = l Z r 1 1 A r r φy t1 φy 1 = l φ Y r1z r 1 1 A r r. 40 A φ i C 3 uing 7 an a Taylor expanion for all r t there exit χ r uch that: X r 1 Y r1 φ Yr1 = φ X r 1 + l r r φ X r 1 Z r 1 1 A r + l r r φ 3 χ r Z r 1 1A. r 0

21 Durmu et al. Optimal caling uner L p mean ifferentiability Plugging thi expreion into 40 yiel: φy t1 φy 1 = l φ X r 1 Z r 1 1 A r r + l r r φ X r 1 Z r 1 1 A + l3 r r r φ 3 χ r Z r A r A φ 3 i boune t lim E 1/ r r φ 3 χ r Z r A r r = 0. On the other han I = φ X r 1 r r Z r 1 1 A r = I 1 + I with r r r. Note that I 1 = I = 1 / + φ X r 1 r r 1/Z r 1 1 A r r t / φ X r 1 Z r 1 1 A r. r I 1 = 1 φ X 1 Z 1 1 A + 1 t tt t φ X t 1 Z t 1 1 A t howing a φ i boune that lim + E I 1 = 0. Therefore lim E φy t1 φy1 I t = 0 + where Write I t = I t l } φ X r 1 Z r 1 + l φ X r 1 Z r 1 / 1 A r. r LφYr1r M t φ M φ = T1 + T + T3 T4 + T5 1

22 Durmu et al. Optimal caling uner L p mean ifferentiability where T 1 = T = T 3 = T 4 = T 5 = φ X r 1 l E Z r 1 1 A r l φ X r 1 E Z r 1 1 A LφY r /1 LφY r1 r F r + hl r l t t φ X t 1 Z t 1 1 A t E F r hl φ X t 1 Z t 1 1 A E t + l t t l φ X 1 Z 1 1 A E Z t 1 1 A t V X r 1 r r F t Z t 1 1 A t Z 1 1 A F F t + l φ X 1 Z 1 1 A E Z 1 1 A F. It i now prove that for all 1 i 5 lim + E T i = 0. Firt a φ an φ are boune Denote for all r t an 1 Vri = V X r i Ξ r = 1 exp Υ r = 1 exp E T 4 + T 5 C 1/. 41 V X r i + l 1/ Z r i lz r 1 V X r 1 / + lz r 1 V X r 1 / + b r i V ri where for all k i 0 b ki = b X ki Z k+1i an for all x z R b x y i given by 13. By the triangle inequality where t T 1 φ X r 1 A1r + A r + A 3r r 4 A 1r = l E Z r 1 1 A Υ F r r r A r = l E Z r 1 Υ r Ξ r F r A 3r = l E Z r 1 Ξ r F r + V X r 1 hl/. Since t 1 expt i 1-Lipchitz by Lemma ii E A 1r goe to 0 a + for almot all r. So by the Fubini theorem the firt term in 4 goe to 0 a +. For A r by } }

23 Durmu et al. Optimal caling uner L p mean ifferentiability Lemma 6 E A r E l V X l V X r 1 r 1 G Vri l V X r 1 G b r i} where G i efine in 6. By Lemma 8 thi expectation goe to zero when goe to infinity. Then by the Fubini theorem an the Lebegue ominate convergence theorem the econ term of 4 goe 0 a +. For the lat term by Lemma 6 again: l E Z r 1 Ξ r F r G l = l V X r 1 V X r i l V X r i 4 1E ζ X Z 43 where X i itribute accoring to π an Z i a tanar Gauian ranom variable inepenent of X. A G i continuou on R + R \ 0 0} ee Lemma by H1ii Lemma 4 an the law of large number almot urely lim + l G l V X r i l V X r i 4 1E ζ X Z = l G l E V X l E V X = hl/ 44 where hl i efine in 10. Therefore by Fubini Theorem 43 an Lebegue ominate convergence theorem the lat term of 4 goe to 0 a goe to infinity. The proof for T follow the ame line. By the triangle inequality T φ X r 1 l / E Z r 1 1 A Ξ F r r r r + φ X r 1 l / E Z r 1 Ξ r F r hl/ r. 45 By Fubini Theorem Lebegue ominate convergence theorem an Propoition 1 the expectation of the firt term goe to zero when goe to infinity. For the econ term by Lemma 6 A.5 l /E Z r 1 1 exp lz r 1 V X r 1 + b r i } F r = B 1 + B B 3 / 46 3

24 Durmu et al. Optimal caling uner L p mean ifferentiability where B 1 = l l Γ V X r i l V X r i 4 1E ζ X Z B = l4 V X r 1 l G V X r i l V X r i 4 1E ζ X Z B 3 = l4 V X r 1 1/ πl V X r i / 1Eζ X Z + l /4 V exp X r i l V X r i / where Γ i efine in 7. A Γ i continuou on R + R \ 0 0} ee Lemma by H1ii Lemma 4 an the law of large number almot urely l lim + l Γ V X r i l V X r i 4 1E ζ X Z By Lemma 4 by H1ii an the law of large number almot urely lim exp + 1Eζ X Z + l /4 l V X r i / = l Γ l E V X l E V X = hl. 47 V X r i } = exp l 8 E V X. Then a G i boune on R + R t lim E φ X r 1 B B 3 r + = Therefore by Fubini Theorem an Lebegue ominate convergence theorem the econ term of 45 goe to 0 a goe to infinity. Write T 3 = hl/t 31 T 3 where T 31 = T 3 = φ X r 1 φ Yr1 } r V X r 1 φ X r 1 V Yr1 φ Yr1 } r. It i enough to how that E T 31 an E T 3 go to 0 when goe to infinity to conclue the proof. By 7 an the mean value theorem for all r t there exit χ r X r 1 Y r1 uch that φ X r 1 φ Yr1 = φ 3 χ r r r l/ Z r 1 1 A. r 4

25 Durmu et al. Optimal caling uner L p mean ifferentiability Since φ 3 i boune it follow that lim + E T 31 = 0. On the other han T 3 = V X r 1 V Yr1 } φ X r 1 r + φ X r 1 φ Yr1 } V Y r1 r. Since φ ha a boune upport by H Fubini theorem an Lebegue ominate convergence theorem the expectation of the abolute value of the firt term goe to 0 a goe to infinity. The econ term i ealt with following the ame tep a for T 31 an uing H1ii. Proof of Theorem 3. By Propoition Propoition 3 an Propoition 6 it i enough to prove that for all φ Cc R R p 1 all 0 t 1 t p t an g : R p R boune an continuou function lim E M t φ M φgy t Yt p = 0 where for n 1 M nφ i efine in 39. But thi reult i traightforwar taking ucceively the conitional expectation with repect to F k for k = t Proof of Section Proof of Theorem 4 The proof of thi theorem follow the ame tep a the the proof of Theorem. Note that ξ θ an ξ 0 given by 11 are well efine on I x R x + rθ I}. Let the function υ : R R be efine for x θ R by υx θ = 1 I x + rθ1 I x + 1 rθ. 49 Lemma 9. Aume G1 hol. Then there exit C > 0 uch that for all θ R I ξ θ x ξ 0 x} υx θ + θ V xξ 0 x/ x 1/ C θ β. Proof. The proof follow a Lemma 1 an i omitte. Lemma 10. Aume that G1 hol. Let X be a ranom variable itribute accoring to π an Z be a tanar Gauian ranom variable inepenent of X. Define Then i lim + D I = X + rl 1/ Z I} X + 1 rl 1/ Z I}. 1 DI ζ X Z + lz V X/ = 0. ii Let p be given by G1i. Then 1DI lim V X V X + lz/ } + lz V X/ = 0. + p 5

26 Durmu et al. Optimal caling uner L p mean ifferentiability iii lim 1 DI log1 + ζ X Z ζ X Z + ζ X Z/ 1 = 0 where ζ i given by 14. Proof. Note by efinition of ζ an ξ θ 11 for x I an x + rl 1/ z I ζ x z = ξ lz 1/x/ξ 0 x Uing Lemma 9 1 DI ζ X Z + lz V X/ = E υx lz 1/ ξ lz 1/x ξ 0 x} + lz V xξ 0 x/ x I Cl β β E Z β. The proof of i i complete uing β > 1. For ii write for all x I an x + lz 1/ z I V x z = V x V x + lz 1/. By G1i 1 DI V X Z + lz V X/ p = E υx lz 1/ V X Z + lz V x/ p πxx p I Cl βp βp/ E Z βp an the proof of ii follow from β > 1. For iii note that for all x > 0 u 0 x x u1 + u 1 x an the ame inequality hol for x 1 0 an u x 0. Then by 3 an 4 for all x > 1 log1 + x x + x / = Rx x log1 + x. Then by 50 for x I an x + l 1/ z I log1 + ζ x z ζ x z + ζ x z/ ξ lz 1/x/ξ 0 x 1 logξ lz 1/x/ξ 0 x ξ lz 1/x/ξ 0 x 1 V x + lz 1/ V x /. Since for all x R expx 1 x expx + 1 thi yiel log1 + ζ x z ζ x z + ζ x z/ V x + lz 1/ V x 3 exp V x V x + lz 1/ + 1 /4. Therefore υx lz 1/ log1 + ζ x z ζ x z + ζ x z/ πxx I1 + I /4 where I I 1 = I = I I υx lz 1/ V x + lz 1/ V x 3 πxx υx lz 1/ V x + lz 1/ V x 3 πx + lz 1/ x. 6

27 Durmu et al. Optimal caling uner L p mean ifferentiability By Höler inequality a change of variable an uing G1i lz 1/ I 1 + I C 3 V x πxx 4 3/4 + lz 1/ 3β. I The proof follow from G1ii an β > 1. For eae of notation write for all 1 an i j 1... } } } DIj = Xj + rl 1/ Zj I Xj + 1 rl 1/ Zj I D Ii:j = j DIk. 51 k=i Lemma 11. Aume that G1 hol. For all 1 let X be itribute accoring to π an Z be -imenional Gauian ranom variable inepenent of X. Then lim + J I = 0 where J } I = 1 D V I: i + lz i V X i E 1 D Ii ζ Xi Zi + l 4 V Xi. 1 Proof. The proof follow the ame line a the proof of Lemma 3 an i omitte. Define for all 1 Z E I = E exp D I1: V i } 1 exp l 1/ Z 1 V X 1 + b IXi Zi } where Vi i given by 5 for all x I z R b Ix z = lz V x + E 1 D I1 ζ X1 Z1 l 4 V x 5 an ζ i given by 14. Propoition 7. Aume G1 hol. Let X be a ranom variable itribute accoring to π an Z be a zero-mean tanar Gauian ranom variable inepenent of X. Then lim + E I = 0. Proof. Let Λ = l 1/ Z1 V X1 + V i. By the triangle inequality E E 1 + E + E 3 where Z E } 1I = E 1 1D I1: 1 exp Vi 1 exp Λ } Z E I = E 1 1D I: 1 exp Λ } 1 exp l 1/ Z1 V X1 + b Xi Zi } } Z E 3I = E 1 1D c1 exp l I: 1/ Z1 V X1 + b Xi Zi 7

28 Durmu et al. Optimal caling uner L p mean ifferentiability Since t 1 e t i 1-Lipchitz by the Cauchy-Schwarz inequality we get Z E 1I E 1 1D V I1 1 + l 1/ Z1 V X1 Z1 4 1 D I1 V1 + l 1/ Z1 V X1. By Lemma ii E 1I goe to 0 a goe to +. Uing again that t 1 et i 1-Lipchitz an Lemma 11 E I goe to 0 a well. Note that a Z 1 an 1 D c I: are inepenent by 18 D E } c 3I P I1 C 1 γ/. Therefore E 3I goe to 0 a goe to + by G1iii. Lemma 1. Aume G1 hol. For all N let X be a ranom variable itribute accoring to π an Z be a tanar Gauian ranom variable in R inepenent of X. Then where I i efine in 6 an ζ in 14. lim E 1 D + I1 ζ X1 Z1 = l 4 I Proof. Noting that for all θ R 1 I x + rθ1 I x + 1 rθπx + θx = I I 1 I x + r 1θ1 I x rθπxx. the proof follow the ame tep a the the proof of Lemma 4 an i omitte. Proof of Theorem 4. The proof follow the ame line a the proof of Theorem an i therefore omitte. 5. Proof of Propoition 4 A for the proof of Propoition the proof follow from Lemma 13. Lemma 13. Aume G1. Then there exit C > 0 uch that for all 0 k 1 < k X E k1 Xk 4 11 C 4 p= k k 1 p p. Proof. We ue the ame ecompoition of EXk 1 X k 11 4 a in the proof of Lemma 5 o that we only nee to upper boun the following term: k 4 E Zk11 A k c = 4 E Zm i11 A mi c k=k 1+1 where the um i over all the quaruplet m p 4 p=1 atifying m p k k } p = Let m 1 m m 3 m 4 k k } 4 an X k k 0 be efine a: X 0 = X 0 an X k+1 = X k + 1 k / m1 1m 1m 3 1m 4 1}l 1/ Z k+11ã k+1 8

29 Durmu et al. Optimal caling uner L p mean ifferentiability where for all k 0 an all 1 i à k+1 = U k+1 exp Ṽ ki = V X ki V Ṽ ki } X ki + l 1/ Zk+1i. Define for all k k k 1 i j } } D k Ij = X kj + rl 1/ Zk+1j I X kj + 1 rl 1/ Zk+1j I D k Ii:j = j l=i D k Il. c Note that by convention V x = for all x / I à k k+1 D I1: à o that k+1 may c c be written à k+1 = I1: c Dk à k+1 Dk I1:. Let F be the σ-fiel generate by X k. Conier the cae #m 1... m 4 } = 4. The cae #m 1... m 4 } = 3 i ealt k 0 with imilarly an the two } other cae follow the ame line a the proof of Lemma 13. A U mj Zm j1 Zm j are inepenent conitionally to F 4 E j=1 Z m j11 A m j c F = 1 j 4 4 j=1 E 1 Dm j 1 I1: cz m j1 F + E 1 Dm j 1 I1: } 1 à cz m m j1 j F. A U mj i inepenent of Zm j1 Zm j conitionally to F the econ term may be written: E 1 Dm j 1 I1: 1 à cz m m j1 j F = E 1 Dm j 1 Zm j1 I1: Since the function x 1 e x + i 1-Lipchitz on 1 exp Ṽ m j 1i } + D mj 1 I1: 1 exp Ṽ m j 1i } + F. Θ mj Ṽ m j 11 + l 1/ V X mj 11Zm j1 where Θ mj where = 1 exp l 1/ V X mj 11Zm j1 + Ṽ m } j 1i +. Then } E 1 Dm j 1 Zm j1 1 exp Ṽ m j 1i I1: F A m j + Bm j A m j Bm j = Z = E m j1 E 1 Dm j 1 I: 1 Dm j 1 Ṽ m j 11 + l 1/ V X I1 mj 11Zm j1 F Z m j1θ mj F. + 9

30 Durmu et al. Optimal caling uner L p mean ifferentiability By Jenen inequality 4 E j=1 Z m j11 A m j c 4 E E j=1 4 CE j=1 1 Dm j 1 I1: E 1 Dm j 1 I1: c Z m j1 F c Zm j1 4 F + } + A m j + Bm j 4 4 A mj + B mj By G1iii an Holer inequality applie with α = 1/1 /γ > 1 for all 1 j 4 E 1 Dm j 1 I1: c Zm j1 4 E 1 Dm j 1 I1 c Z m j1 4 + E 1 Dm j 1 Ii E Zm j1 4α/α 1 α 1/α γ/α + 1 γ/ C 1 γ/. c By Lemma 10ii an the Holer inequality there exit C > 0 uch that E A m j 4 C. On the other han by Lemma 6 ince Z m j1 i inepenent of F Bm j = E 1 Dm j 1 l 1/ V X I: mj 11G l 1 V X mj 11 Ṽ m j 1i F where the function G i efine in 6. By G1ii an ince G i boune EB m j 4 C. Since γ 6 in G1iii E 4 j=1 Z m j11 A mj c C howing that m 1m m 3m 4 I 4 4 E Zm i11 A mi c C k k Proof of Propoition 5 Lemma 14. Aume that G1 hol. Let µ be a limit point of the equence of law µ 1 of Y t1 t 0 N }. Then for all t 0 the puhforwar meaure of µ by W t i π. Proof. The proof i the ame a in Lemma 6 an i omitte. We preface the proof by a lemma which provie a conition to verify that any limit point µ of µ 1 i a olution to the local martingale problem aociate with 9. Lemma 15. Aume G1. Let µ be a limit point of the equence µ 1. If for all φ Cc I R the proce φw t φw 0 0 LφW uu t 0 i a martingale with repect to µ an the filtration B t t 0 then µ olve the local martingale problem aociate with 9. 30

31 Durmu et al. Optimal caling uner L p mean ifferentiability Proof. A for all t 0 an 1 Yt1 I for all 1 µ CR + I = 1. Since CR + I i cloe in W we have by the Portmanteau theorem µcr + I = 1. Therefore we only nee to prove that for all ψ C I R the proce ψw t ψw 0 0 LψW uu t 0 i a local martingale with repect to µ an the filtration B t t 0. Let ψ C I R. Suppoe firt that for all ϖ Cc Then conier the equence of topping time efine for k 1 by τ k = inft 0 W t k} an a equence ϖ k k 0 in Cc I R atifying: 1. for all k 1 an all x I k k ϖ k x = ψx. lim k + ϖ k = ψ in C I R. Since for all k 1 I R ϖw t ϖw t 0 LϖW uu t 0 i a martingale. τk ψw t τk ψw 0 LψW u u 0 t 0 = ϖ k W t τk ϖ k W 0 τk 0 Lϖ k W u u t 0 an the equence τ k k 1 goe to + a k goe to + almot urely it follow that ψw t ψw 0 0 LψW uu t 0 i a local martingale with repect to µ an the filtration B t t 0. It remain to how that for all ϖ Cc I R ϖw t ϖw 0 0 LϖW uu t 0 i a martingale uner the aumption of the propoition. We only nee to prove that for all ϖ Cc I R 0 t m N g : R m R boune an continuou an 0 t 1 t m t: E ϖ µ W t ϖ W Lϖ W u u g W t1... W tm = Let φ k k 0 be a equence of function in C c I R an converging to ϖ in C c I R. Firt note that for all u t µ-almot everywhere lim φ kw u = ϖw u. 55 k + By Lemma 14 for all u t the puhforwar meaure of µ by W u ha enity π with repect to the Lebegue meaure an µ-almot everywhere lim k + Lφ k W u = LϖW u. On the other han there exit C 0 uch that for all k 0 Lφ k W u C1 + V W u. Then E µ 1 + V W u u t + t E µ V W u u 1 + V x πxx Therefore µ-almot everywhere by G1ii an the Lebegue ominate convergence theorem we get lim k + Lφ k W u u = I LϖW u u. 56 Therefore 54 follow from 55 an 56 uing again the Lebegue ominate convergence theorem an G1ii.. 31

32 Durmu et al. Optimal caling uner L p mean ifferentiability Proof of Propoition 5. Let µ be a limit point of µ 1. By Lemma 15 we only nee to prove that for all φ Cc I R the proce φw t φw 0 0 LφW uu t 0 i a martingale with repect to µ an the filtration B t t 0. Then the proof follow the ame line a the proof of Propoition 3 an i omitte. 5.4 Proof of Theorem 5 Lemma 16. Aume G1 hol. Let X be itribute accoring to π an Z be a -imenional tanar Gauian ranom variable inepenent of X. Then lim + E = 0 where E = E V X 1 1 D G l V I: X 1 / Ȳ G l V X 1 / X } where Ȳ = V i V i an DI: are given by 5 an 51 an X = b Ii b Ii = b I X i Z i with b I given by 5. Proof. Set for all 1 Ȳ = V i an X = b Ii. By efinition of b I 5 X may be expree a X = σ S + µ where µ = 1E 1 D I1 ζ X1 Z1 σ = l E V X 1 + l4 16 E S = σ 1 βi l βi = lzi V Xi 4 l 1 E V X 4 1 V X 1 E V X 1 V X i E V X i. By G1ii the Berry-Een Theorem 5 Theorem 5.7 can be applie to S. Then there exit a univeral contant C uch that for all > 0 up P 1 S x Φx C/. x R It follow with σ = 1σ / that up P X x Φx µ / σ C/. x R By thi reult an 37 Lemma 7 can be applie to obtain a contant C 0 inepenent of uch that: G E 1 D l V I: X 1 / Ȳ G l V X 1 / X X 1 C E 1 D X I: Ȳ + 1/ + E 1 D X I: Ȳ π σ 1/ + l V X 1 /π1/ σ. 3

33 Durmu et al. Optimal caling uner L p mean ifferentiability Uing thi reult we have E C l 1/ E V X1 3/ π 1/ σ 1/ + E V X1 57 E 1 D X I: Ȳ + 1/ + E 1 D X I: Ȳ } π σ 1/. By Lemma 11 E1 D I: X Ȳ goe to 0 a goe to infinity an by G1ii lim + σ = l E V X. Combining thee reult with 57 it follow that E goe to 0 when goe to infinity. For all n 0 efine F n = σx k k n} an for all φ C c R R Mnφ = l n 1 } φ Xk1 Zk+111 A k+1 E Z k+111 A k+1 F k k=0 + l n 1 } φ X k1 Zk+11 1 A k+1 E Z k+11 1 A k+1 F k. 58 k=0 Propoition 8. Aume G1 an G hol. Then for all t an all φ Cc R R t lim E φyt1 φy1 LφYr1r M t φ M φ = 0. + Proof. Uing the ame ecompoition a in the proof of Propoition 6 we only nee to prove that for all 1 i 5 lim + E Ti = 0 where T 1 = T = T 3 = T 4 = T 5 = φ X r 1 l E Z r 1 1 A r l φ X r 1 E Z r 1 1 A LφY r /1 LφY r1 r F r + hl r l t t φ X t 1 Z t 1 1 A t E F r hl φ X t 1 Z t 1 1 A E t + l t t l φ X 1 Z 1 1 A E Z t 1 1 A t V X r 1 r r F t Z t 1 1 A t Z 1 1 A F F t + l φ X 1 Z 1 1 A E Z 1 1 A F. Firt a φ an φ are boune E T 4 + T 5 C 1/. Denote for all r t an 1 Vri = V X r i V X r i + l 1/ Z r i } Ξ r = 1 exp lz r 1 V X r 1 / + b r Ii 33

34 Durmu et al. Optimal caling uner L p mean ifferentiability where for all k i 0 b k Ii = b I X ki Z k+1i an for all x z R b I x y i given by 5. For all k 0 1 i j efine } } D k Ij X = kj + rl 1/ Zk+1j I Xkj + 1 rl 1/ Zk+1j I D k Ii:j = j l=i D k Il. By the triangle inequality where T 1 Π r = 1 exp Since t 1 expt i 1-Lipchitz φ X r 1 A1r + A r + A 3r + A 4r r 59 l 1/ Z r 1 V X r 1 + V ri A 1r = l E Z r 1 1 A 1 r r D Πr F r I1: A r = l E Z r 1 1 D Π r r Ξ r F r I1: A 3r = l E Z r 1 1 D cξ r r F r I1: A 4r = l E Z r 1 Ξ r + V X r 1 hl/. E A 1r l E 1 r D I1: l E 1 D r I1 Z r 1 Z r 1 F r l Z 1D E r 1 r V I1 Vr1 l 1/ Z r 1 V X r 1 Vr1 l 1/ Z r 1 V X r 1 r1 l 1/ Z r 1 V X r 1 an E A 1r goe to 0 a + for almot all r by Lemma 10ii. So by the Fubini theorem the firt term in 59 goe to 0 a +. For A r note that Then by Lemma 6 A r E A r E l V X r 1 1 D r I: l E Z r 1 1 D Π r r Ξ r F r. I: } l V X r 1 G Vri l V X r 1 G b r Ii } where G i efine in 6. By Lemma 16 thi expectation goe to zero when goe to infinity. Then by the Fubini theorem an the Lebegue ominate convergence theorem the econ term 34

35 Durmu et al. Optimal caling uner L p mean ifferentiability of 59 goe 0 a +. On the other han by G1iii an Holer inequality applie with α = 1/1 /γ > 1 for all 1 j 4 E Z A 3r l E l E r 1 1 D r c + I1 E 1 D r Ii c Z mj1 α/α 1 α 1/α γ/α + 1 γ/ C 3/ γ/ an E A 3r goe to 0 a + for almot all r. Define V 1 = V X r i an V = V 1 V X r 1. For the lat term by Lemma 6: l E Z r 1 Ξ r F r = l V X r 1 l G V l 1 V 4 1E 1 DI ζ X Z } 60 where D I = X + l 1/ Z I } X i itribute accoring to π an Z i a tanar Gauian ranom variable inepenent of X. A G i continuou on R + R \ 0 0} ee Lemma by G1ii Lemma 1 an the law of large number almot urely lim + l G l V1 / l V / 4 1E 1 DI ζ X Z = l G l E V X l E V X = hl/ 61 where hl i efine in 10. Therefore by Fubini Theorem 60 an Lebegue ominate convergence theorem the lat term of 59 goe to 0 a goe to infinity. The proof for T follow the ame line. By the triangle inequality T t φ X r 1 l / E Z r 1 1 A Ξ F r r r + φ X r 1 l / E Z r 1 Ξ r r F r hl/ r. 6 By Fubini Theorem Lebegue ominate convergence theorem an Propoition 7 the expectation of the firt term goe to zero when goe to infinity. For the econ term by Lemma 6 A.5 l /E Z r 1 1 exp lz r 1 V X r 1 + b r Ii } F r = B 1 + B B 3 / 63 35

36 Durmu et al. Optimal caling uner L p mean ifferentiability where B 1 = l Γ l V1 / l V / 4 1E 1 DI ζ X Z B = l4 V X r 1 G l V1 / l V / 4 1E 1 DI ζ X Z B 3 = l4 V X r 1 πl V1 / 1/ 1E1DI ζ X Z + l /4 exp V } l V 1 / where Γ i efine in 7. A Γ i continuou on R + R \ 0 0} ee Lemma by G1ii Lemma 1 an the law of large number almot urely lim + l Γ l V1 / l V / 4 1E 1 DI ζ X Z } = l Γ l E V X l E V X = hl. 64 By Lemma 1 by G1ii an the law of large number almot urely 1E1DI ζ X Z + l /4 V } lim exp + l V 1 / } = exp l 8 E V X. Then a G i boune on R + R t lim E φ X r 1 B B 3 r + = Therefore by Fubini Theorem an Lebegue ominate convergence theorem the econ term of 6 goe to 0 a goe to infinity. The proof for T3 follow exactly the ame line a the proof of Propoition 6. Proof of Theorem 5. Uing Propoition 4 Propoition 5 an Propoition 8 the proof follow the ame line a the proof of Theorem 3. Acknowlegment The work of A.D. an E.M. i upporte by the Agence Nationale e la Recherche uner grant ANR-14-CE3-001 COSMOS. Reference 1 A. S. Cherny an H.-J. Engelbert. Singular tochatic ifferential equation volume 1858 of Lecture Note in Mathematic. Springer-Verlag Berlin 005. B. Jourain T. Lelievre an B. Miaojeow. Optimal caling for the tranient phae of the ranom walk Metropoli algorithm: the mean-fiel limit. The annal of Applie Probability