arxiv: v1 [math.pr] 17 Oct 2014

Transcription

1 DETERMINISTIC WALK IN AN EXCITED RANDOM ENVIRONMENT IVAN MATIC AND DAVID SIVAKOFF arxiv: v [math.pr] 7 Oct 204 Abstract. Deterministic walk in an excited random environment is a non-markov integer-valued process X n n=0, whose jump at time n depends on the number of visits to the site X n. The environment can be understood as stacks of cookies on each site of Z. Once all cookies are consumed at a given site, every subsequent visit will result in a walk taking a step according to the direction prescribed by the last consumed cookie. If each site has exactly one cookie, then the walk ends in a loop if it ever visits the same site twice. If the number of cookies per site is increased to two, the walk can visit a site infinitely many times and still not end in a loop. Nevertheless the moments of X n are sub-linear in n and we establish monotonicity results on the environment that imply large deviations.. Introduction The deterministic walk in excited random environment in one dimension is a discrete time process, X t t=0 : Ω Z0,,.... For L, M N, the set of environments is Ω = ΩL, M = ω [ L, L] Z 0 Z : ωj, z = ωm, z for each j M and each z Z, where [a, b] := a, a +,..., b. We imagine Ω as stacks of M cookies, ω0, z,..., ωm, z, at each site z Z, each with an arrow pointing to the right or to the left by at most L. We assume that Ω is equipped with the product measure P = P L,M such that ωj, z : j [0, M ], z Z are i.i.d. with distribution µ supported on [ L, L]. Note the abuse of notation here, that ω Ω is both an element of the set of environments, and a random element via the identity map with distribution P. We further assume that µk > 0 for all k [ L, L]. To define the deterministic walk in excited random environment, first let L t z = L t ω, z denote the number of times that the walker visited z in the time interval [0, t ], L t z = 0 j < t : X j = z, where A denotes the cardinality of the set A. For each ω Ω, we define X t = X t ω recursively as X 0 = 0, X t+ = X t + ωl t X t, X t. The main result of this paper is the large deviations estimate of the probability that X n is located at a distance of order On from the origin. Theorem. Fix M 3. There exists a function φ : [0, L], 0] such that for each λ [0, L] lim n n log P X n λn = φλ. Date: May 4, 208.

2 2 IVAN MATIC AND DAVID SIVAKOFF Remark. The assumption of an i.i.d. environment can be weakened, and we make this assumption merely for the ease of exposition. For instance, the proof of Theorem holds with minor modification if the cookies at a given site are jointly distributed such that every combination of M cookies has strictly positive probability, while the cookies at distinct sites are independent and identically distributed. In particular, this includes the case where each layer of cookies has a different distribution. Also with minor modifications to the proofs, all of our results can be established under the weaker assumption that µk > 0 for k [ L, L] \ 0. Remark 2. The function φ is concave on [0, L], with φ0 = 0 and φλ < 0 for λ 0, L]. This is proved in section 6. Remark 3. We expect Theorem to hold when M = 2, and can prove that it does when L 2. However, our proof for M 3 does not work when M = 2 and L 3. The case M = was proved using a different method in [2]. The model studied in this paper traces its origins to the study of stochastic partial differential equations. The viscosity solutions to random Hamilton-Jacobi and Hamilton-Jacobi-Bellman equations can be represented using variational formulas [, 7, 8]. The controls in the formulas are solutions to ordinary differential equations or stochastic differential equations in random environments whose discrete analogs are deterministic walks in random environments DWRE and random walks in random environments RWRE, respectively [7]. DWERE is a non-markov process that generalizes DWRE in the same way as RWERE generalizes RWRE by allowing several cookies on each site. Large deviations for RWRE were studied in the past and various results were obtained [3, 6, 20, 2, 22]. The approaches from these papers cannot be applied to DWRE or DWERE because the latter models do not possess the quenched ellipticity property. Results related to the laws of large numbers for non-elliptic random walks were established in [3]. In the case of RWRE, one can assume ellipticity and use the point of view of the particle to see the process as a Markov chain on a probability space with sufficient compactness to apply the Donsker Varadhan theory [9, 2]. Large deviations analogous to Theorem, but in all dimensions, were proved for DWRE by an analysis of loops[2]. However, this loop analysis is not applicable to large deviations of DWERE. The process that we are studying is also related to the Lorentz mirror model. In the case of the mirror problem it is conjectured that the paths are almost surely finite [5] which in our model is an easy consequence of Lemma 2. Recent progress on the mirror problem establishes a lower bound on the probability that the rays reach distances of order n []. RWERE was introduced in the paper of Benjamini and Wilson [2]. In more general versions of excited random walks, the number of cookies per site is greater than one. A number of results were established about recurrence, balisticity, monotonicity, and return times to zero [6, 8, 9, 0, 4]. Some of these excited random walks are known to converge to Brownian motion [4]. Large deviations for random walks in excited random environments were studied in [5]. In the case of random walks in excited random environments very little is known in dimensions greater than and in the cases when the steps are not nearest-neighbor. Our main proof is also restricted to dimension, however we are allowing our walk to make jumps of sizes bigger than. The case M = corresponds to DWRE and Theorem can be obtained in arbitrary dimension d [2]. The main argument of the proof used the fact that once the walk visits a site it has visited before, it will end in a loop. This can be simply stated as the 0 principle, meaning that in DWRE the number of times a given site can be visited by the walk is zero, one, or infinity.

3 DETERMINISTIC WALK IN AN EXCITED RANDOM ENVIRONMENT 3 However, we will see in Theorem 2 that DWERE is a much richer model, and that a site can be visited arbitrarily many times. The key ingredient in the proof of Theorem is Lemma 4 that establishes a monotonicity property among favorable environments. A configuration of cookies on Z is called a favorable environment if it enables the walk starting at 0 to reach λn in fewer than n steps. Lemma 4 states that for every favorable environment one can change several cookies in [0, O n] to make another favorable environment that also allows the walk to avoid any backtrackings over 0. This result was the key to establishing a sub-additivity necessary for proving large deviations. In the case when the maximal jump size is L = 2 one can replace O n in Lemma 4 with a finite number. It remains unknown whether O n can be replaced by a finite number when L 3. Before delving into properties of the model, it is instructive to consider one concrete example. Example. Assume that the random environment is created in the following way. Each site of Z independently choses a sequence of two integers from 3, 2,..., 3. In the picture below the site 0 has cookies 3, 2, while the site 2 has cookies 2,. We will denote the cookies at 0 by ω0, 0 = 3 and ω, 0 = 2. Similarly, ω0, 2 = 2 and ω, 2 =. If the cookies are as shown in the picture above, then the first 0 steps of the walk are X 0 = 0, X = 3, X 2 = 0, X 3 = 2, X 4 = 0, X 5 = 2, X 6 = 3, X 7 = 0, X 8 = 2, X 9 = 3, and X 0 = Properties of excited random environments The results in this section serve to outline some of the major differences between excited and non-excited environments. In regular deterministic walks in non-excited random environments, the number of visits to any particular site can be 0,, or infinity. The last case corresponds to the situation in which the walk ends in a loop passing through a prescribed number of sites infinitely many times. In an excited environment, the walker may revisit 0, for instance, any number of times, 2,...,. However, the probability of revisiting 0 a large finite number of times decays exponentially, as the next theorem demonstrates. For convenience, we let µ min = minµk : k [ L, L], and µ max = maxµk : k [ L, L]. Theorem 2. Assume that L 2 and M 2. Let D 0 be the cardinality of the set n : X n = 0. For each k N the following inequality holds µ min 4Mk P D 0 = k 2 µ min 2M+L 2 k/2lm Proof. The lower bound follows from Lemma below.

4 4 IVAN MATIC AND DAVID SIVAKOFF Lemma. There exist two functions f, g : Z 2,,, 2 such that the deterministic sequence x n defined by x 0 = 0 and fxn, if x x n+ = x n + n x 0,..., x n, gx n, if x n x 0,..., x n contains exactly k terms equal to 0 and has 2k x n 2k for all n. Indeed, if we find two such functions, then the event E D 0 = k can be constructed as follows: E = ω Ω : ω0, z = gz and ωi, z = fz for i and 2k z 2k. We have P E µ min 4Mk > 0, so P D 0 = k µ min 4Mk. For the upper bound, suppose that V j 0 is the time of the jth visit to 0. If V k 0 < and V0 k+ =, then the walker cannot get stuck in a loop that includes 0, but clearly must return to 0 k times. Therefore, between consecutive visits to 0, the walker must see at least one new cookie, otherwise it will be stuck in a loop containing 0. That is, for each 0 j k, there exists x X V j, X 0 V j +,..., X 0 V j+ such that L 0 V jx M. Therefore, by time V0 k, the walker 0 must have visited at least k/m distinct vertices. Furthermore, this implies that the walker must have visited at least k/lm regions of the form [il, i + L ] for i Z. That is, i Z : [il, i + L ] X t : 0 t V0 k k LM. In order for the walker to revisit 0 at time V0 k, none of the regions [il, i + L ] that the walker visits before this time can be a trap where the walker gets stuck in a loop. An example of a trapping configuration on the interval [il, i + L ] has ωj, il = = ωj, il + for j 0 and ω0, il + x = x for x = 2,..., L. Therefore, the probability that [il, i + L ] is a trapping region is at least µ min 2M+L 2. Finally, observe that the set of i Z such that the walker visits [il, i + L ] by time V k 0 must be a set of consecutive integers containing 0, since the walker cannot jump over any such region. Therefore, the walker must either visit every such region for 0 i k/2lm, or every such region for k/2lm + i 0. The probability that none of these regions is a trap gives the upper bound. Proof of Lemma. Let us first define f and g on the set Z of negative numbers, i.e. Z =..., 3, 2,. If z Z is odd we set fz = gz = 2, and if z Z is even we set fz = 2 and gz =. For i 0,,..., 2k 3 we define gi = 2, if i is even,, if i is odd; and fi = 2, if i is even, 2, if i is odd. We finally define f2k = g2k = and f2k 2 = g2k 2 =.

5 DETERMINISTIC WALK IN AN EXCITED RANDOM ENVIRONMENT 5 We will prove that x 2ii+ = 0 for i 0,, 2,..., k and that all other terms of the sequence x n n=0 are non-zero. We will now use induction on i to prove that for each i 0,,..., k the following holds: 2 x 2ii+ = 0 and x 0,..., x 2ii+ = 2i, 2i +,..., 0,,..., 2i. This is easy to verify for i = 0 and i =. Assume that the statement is true for some i and let us prove it for i +. Let us denote R i = x 0,..., x 2ii+ = 2i,..., 2i. Then we have that x 2ii+ = 0, and since 0 R i we have that x 2ii++ = 0 + f0 = 2. Since 2 R i we get x 2ii++2 = 2 2 = 4, and so on. We obtain that x 2ii++i = 2i R i which implies that x 2ii++i+ = 2i 2 R i. Therefore x 2ii++i+2 = 2i 2 + g 2i 2 = 2i 2 + = 2i R i. Hence x 2ii++i+3 = 2i + g 2i = 2i + R i. This implies that x 2ii++i+4 = 2i + 3 R i. Continuing this way we obtain that x 2ii++i+2i+2 = 2i R i and x 2ii++i+2i+3 = 2i + R i. Therefore x 2ii++3i+4 = 2i + + g2i + = 2i R i and x 2ii++3i+5 = 2i + f2i = 2i 2 R i. We now have x 2ii++3i+6 = 2i 4 R i and continuing this way we obtain x 2ii++3i+i+4 = 0. This implies that x 2ii++4i+ = 0 which is the same as x 2i+i+2 = 0. In addition, x 0,..., x 2i+i+2 = R i 2i +, 2i, 2i, 2i + = 2i 2,..., 2i, 2i + thus the proof of 2 is complete. Placing i = k in the first equation in 2 we obtain x 2kk = 0, and similarly as in the previous proof we get that x 2ii++3i+4 = 2i = 2k 2. However, since g2k 2 = we get that x 2ii++3i+5 = 2k and subsequently that x 2ii++3i+6 = 2k +g2k = 2k 2. This implies that x 2ii++3i+7 = 2k 2 + f2k 2 = 2k and x 2ii++3i+8 = 2k + f2k = 2k 2. From now on the sequence is periodic and none of the terms will be zero. This proves that there are exactly k terms equal to 0, and since it is stuck in a loop, no vertices outside [ 2k, 2k ] are visited. 3. Laws of large numbers In this section we assume that the walk is in R d for any d N. We prove that the walk is almost surely bounded. As a consequence, the law of large numbers holds with the limiting velocity equal to 0. Moreover, all of the moments of the process X n have growth that is slower than any function fn that satisfies lim n fn = +. This means that the central limit theorem also does not have the classical form for this model. The following lemma will be essential for the proofs of the boundedness of the walk. This lemma establishes the exponential decay of the probabilities that the walk reaches the annulus A k defined

6 6 IVAN MATIC AND DAVID SIVAKOFF in the following way: A k = [ k + L, k + L] d \ [ kl, kl] d. This way, A 0 is the cube [ L, L] d, while for k, A k is an annulus. Lemma 2. There exists a positive real number c 0, and an integer k 0 such that holds for all k k 0. P T Ak < + c k Proof. For x Z d let us denote by Gx the event that all cookies at x are zero-cookies. In other words, Gx = ωx, i = 0 for all 0 i M. On the event Gx the walk would get stuck at the location x if it ever reaches it. We obviously have the following relation P T Ak+ < + C P T Ak < +, G X TAk. The required inequality would be established if we manage to prove that for every k 0 the following inequality holds: C 3 P T Ak < +, G X TAk µ M min P TAk < +. For each x A k let us introduce the following event Ω x = T Ak < + and X TAk ω = x. The event Ω x is in the sigma field generated by the cookies inside the set A 0 A k. Therefore, Ω x and G x are independent. We now have C P T Ak < +, G X TAk = Ω x G x C x A k P = P Ω x P G x C x A k µ M min P Ω x x A k = µ M min P TAk < +. This completes the proof of 3, and hence the proof of the required inequality. A consequence of Lemma 2 is that the sequence X n is almost surely bounded. We present this result in the following lemma. Lemma 3. Denote by B the event that X n is a bounded sequence. More precisely, B = M such that X n M for all n 0, where x denotes the biggest coordinate of the d-dimensional vector x. Then P B =.

7 DETERMINISTIC WALK IN AN EXCITED RANDOM ENVIRONMENT 7 Proof. On the event B C we must have T Ak < + for all k N. However, Lemma 2 implies that P T Ak < + < c k for each k k 0, hence P B = P T Ak < + c k, k for every k k 0 which is only possible if P B = 0. Corollary. For every function f : N R such that lim n fn = + the following limit holds almost surely: X n lim n fn = Large deviations In this section we prove Theorem. For λ [0, L] we want to show the existence of the limit lim n n log P X n λn. As stated earlier, we will prove this under the assumption that there are at least 3 cookies on each site, i.e. M 3. Before we can prove the theorem we need to introduce the following notation. For k N and x Z let us denote by Vx k the time of the kth visit to the site x. The hitting time Vx k can be inductively defined as: Vx ω = infm : X m ω = x, Vx i+ ω = infm > Vxω i : X m ω = x for i. Instead of Vx we will often write V x. For any A R let us define T A = infn : X n A. If x > 0 we will write T x instead of T [x,+. The following two inequalities are easy to establish: 4 5 P X n λn P T λn n and P X n λn P T λn n, ωj, x = 0 for all j and x [λn, λn + L] CP T λn n, for some constant C independent of n. Therefore, it is sufficient to prove that lim exists. Let A n := T λn n, inf X k 0 k T λn n n log P T λn n denote the event that the walk reaches λn by time n before backtracking to the left of 0. It is trivially true that A n T λn n so P A n P T λn n. 4.. Definitions. If a = a l K l= Z where K N and B Z, then the restriction of a to B is denoted a B, and is the sequence of terms in a that belong to B with their order intact. For t t 2, let X [t,t 2 ]ω = X t ω, X t +ω,..., X t2 ω denote the sequence of locations of the walker from steps t through t 2.

8 8 IVAN MATIC AND DAVID SIVAKOFF Definition. For ω, ω T l < and 0 m < l, let ω l,m ω denote the following relationship between environments ω and ω. ω j, x = ωj, x for all x > m and all j 0; 2 X [0,Tl ω ]ω [m,l] = X [0,Tl ω]ω [m,l] ; 3 The sequence X [0,Tl ω ]ω is a subsequence of X [0,Tl ω]ω. In other words, we will write ω l,m ω if the two environments are identical to the right of m, 2 the walkers on both environments visit the same sites in the same order to the right of m and until exceeding l, but 3 the walker on ω may avoid some parts of the path followed by the walker on ω to the left of m. Observe that l,m gives a partial ordering of the environments in T l < Monotonicity results. The next theorem provides the asymptotic equivalence of probabilities P T λn n and P A n on the logarithmic scale. Theorem 3. There exists C R +, depending on L, M and µ, such that the following inequality holds for all n: 6 C n P A n P T λn n. Proof. We will use the following result whose proof will be presented later. Lemma 4. Assume that n > 2L 2. λ For each ω Tλn n there exists ω T λn n such that ω λn,2l n ω and X [0,Tλn ω ]ω, ] =. For given ω T λn n we can apply Lemma 4 to obtain a new environment ˆω T λn n such that inf 0 k T λn ˆω X kˆω = 0. Let us denote by ω the environment defined by: i For x [0, 2L n] and j 0,..., M : ωj, x = ωj, x. ii For x [0, 2L n] and j 0,..., M : ωj, x = ˆωj, x. Since ˆω and ω coincide on sites in [0, + and Xˆω does not visit negative sites, we conclude that X ω does not visit negative sites. Therefore, for each ω T λn n there exists ω A n such that ω and ω coincide on all sites except possibly for the sites in [0, 2L n]. We can now define a function f : T λn n A n in the following way. Let us fix n. We can now define ˆP on the restriction ˆΩ of Ω that corresponds to the portion of the integer axis between the numbers Ln and Ln. The purpose of this restriction is so that ˆPω > 0 for each ω ˆΩ. Formally, ˆΩ = [ L, L] [0,M ] [ Ln,Ln], and ˆP is defined to be the restriction of P. Then we have ˆP T λn n = P T λn n and ˆPA n = P A n, where each ω Ω is identified with an element of ˆΩ by truncation, which will also be denoted ω. It suffices to prove that there is C R + independent of n such that 7 ˆP T λn n C nˆpan.

9 DETERMINISTIC WALK IN AN EXCITED RANDOM ENVIRONMENT 9 M Let C = µmax µ min and C2 = 2L + M. We will prove inequality 7 for C = C C 2 2L. ˆP T λn n = ˆPω C 2L n ˆPfω ω T λn n = C 2L n = C 2L n = C 2L n = C 2L n ω T λn n ω T λn n ω A n ω T λn n ˆPω ω A n ˆPω ω A n ˆPω fω=ω ω A n ˆPω fω=ω ω T λn n f ω. fω=ω If fω = ω then the environments ω and ω coincide outside of [0, 2L n]. Since there could be at most C 2L n 2 different environments that coincide with ω outside of [0, 2L n], we obtain ˆP T λn n C 2L n C 2L n 2 ˆPω = C nˆpan. ω A n This completes the proof of inequality 7 which is equivalent to 6. Lemma 5. Fix ω Ω. Suppose a, b Z with a b L, and 0 t a < t b are such that X ta ω = a, X tb ω = b, and one of the following two conditions is satisfied: a L ta ω, a < M ; b X ta+ω = b. Then there exists ω Ω such that i X [0,ta]ω = X [0,ta]ω; ii X [ta+, ω = X [tb, ω; iii ω j, x = ωj, x for all x / X [ta,t b ]ω and all j 0. Proof. Let C x = L tb ω, x L ta ω, x be the number of times the site x is visited by the sequence X [ta,tb ]ω. Under the assumption a we obtain the environment ω from ω by removing the cookies visited by the walker Xω in the time interval [t a +, t b ] and rewiring the top cookie at a at time t a to point at b. That is, ωj, x for x / X [ta,tb ]ω and all j 0 ωj, x for x X [ta,tb ]ω, 0 j < L ta ω, x ω j, x = ωj + C x, x for x X [ta,tb ]ω, x a, j L ta ω, x ωj + C a, a for x = a, j > L ta b a for x = a, j = L ta ω, a. From the definition of ω, it is clear that iii is satisfied, and i is satisfied because, from the perspective of the walker, ω and ω are identical up until time t a. Finally, ii is satisfied because the remaining environments at time t b in Xω and at time t a + in Xω are identical. The

10 0 IVAN MATIC AND DAVID SIVAKOFF assumption a guarantees that rewiring the top cookie at a is allowed, since rewiring the M th cookie would require modifying all cookies j M, which might affect the future path of the walk. If b is assumed instead of a, then no rewiring is necessary since the cookie at a at the time t a points to b in both ω and ω, i.e. ω L ta + C a, a = b a and we can keep the same definition for ω as when working under the assumption a. Proof of Lemma 4. Let Gω = ω T λn n : ω λn,2l n ω. Let σ be the element or one of the elements of Gω such that 8 T λn σ = min T λnω. ω Gω The above σ exists because T λn ω is an integer for each ω. If X [0,Tλn σ]σ, ] = we may take ω = σ. Assume therefore that there exists x < 0 such that x X [0,Tλn σ]σ. Let us define α = max 0 k < V x σ : X k σ > x, β = min k > V x σ : X k σ > x. The times α and β are well defined because x < 0 and σ T λn n. Let a = X α σ and b = X β σ. Clearly, a, b x, x + L]. Assume that L α σ, a < M. Then we can apply Lemma 5 to a = a, b = b, t a = α, and t b = β. The application of the lemma allows us to obtain an environment σ T λn n from the original environment σ such that σ λn,2l n σ. Since one visit to x is avoided in σ we would have T λn σ T λn σ which contradicts 8. Therefore we must have L α σ, a M recall that this means the walker is visiting a for at least the M th time. We now consider the sequence of times Va σ, Va 2 σ,..., Va M σ at which the visits to a have occurred. Assume that for some s,..., M we have X [V s a σ,v s+ a σ] σ, 2L n ]. By applying Lemma 5 with assumption b to a = X V s a σ, b = a, t a = Va s σ, and t b = Va s+ we obtain an environment σ T λn < n such that σ λn,2l n σ and L Tλn σ σ, a L Tλn σσ, a, which contradicts 8. Let us now define We must have a L n. α 2 = max 0 k < V 2 a σ : X k σ > a, β 2 = min k > V 2 a σ : X k σ > a. We can be certain that α 2 is well defined because X [V a σ,v 2 a σ] 2L n, +. The time β 2 is also well defined because σ T λn n. Let a 2 = X α2 σ and b 2 = X β2 σ. According to the construction we must have a 2, b 2 a, a + L]. Using the same argument as above we have that L α2 σ, a 2 M, and that for each s, 2,... M we have X [V s a2 σ,v s+ a 2 σ] σ 2L n, +.

11 DETERMINISTIC WALK IN AN EXCITED RANDOM ENVIRONMENT Having defined a < < a i and assuming that a i < L n we inductively define the times α i+ and β i+ in the following way: α i+ = max 0 k < V 2 a i σ : X k σ > a i, β i+ = min k > V 2 a i σ : X k σ > a i. Then we define a i+ = X αi+ σ and b i+ = X βi+ σ. Clearly, a i+, b i+ a i, a i + L]. As above, we are certain that 9 L αi+ σ, a i+ M, and for each s, 2,..., M the following property holds: 0 X [ ] σ 2L n, +. Va s i+ σ,va s+ i+ σ We can continue the induction until we have x < a < < a I where I is the smallest index such that a I L n. Since a i+ a i L for each i I, we must have I n. From 9, we have that for each i I, before the second visit to the site a i, the walk Xσ visits the site a i+ at least M times. Furthermore, 0 implies that Va s+ i σ Va s i σ n for each i I and s M, that is, the walk spends at least n steps between consecutive visits to each site a i. Now we will use our assumption that M 3. We know that a is visited at least three times before x is visited for the first time. Between the second and third visit to a the walk spent at least n steps. Therefore V x σ Va 3 σ Va 2 σ + n. The second visit to a has occurred after the site a 2 is visited at least M times, hence the second visit to a occurred after the third visit to a 2. Therefore Va 2 σ Va 3 2 σ Va 2 2 σ + n. Thus V x σ Va 2 2 σ + 2 n. Since the second visit to a 2 occurred after M visits to a 3 we know that the second visit to a 2 occurred after the third visit to a 3. Thus Va 2 2 σ Va 3 3 σ Va 2 3 σ + n and V x σ Va 2 3 σ + 3 n. Continuing in this fashion, we obtain that V x σ Va 2 I σ + I n Va 2 I σ + n n, which contradicts the assumption that V x σ < T λn σ n. This completes the proof of Lemma Large deviations. In this subsection we provide the proof to Theorem. Proof of Theorem. It suffices to prove that P A m+n P A n P A m. We notice the following inclusion: A n+m = T λn+m n, infx k : 0 k T λn+m 0 A n T λn+m n, infx k : 0 k T λn+m 0. Let us define the walk ˆXω for ω A n T λn n, infx k : 0 k T λn 0 in the following way: ˆXk ω = X k+tλn ω X Tλn ω. The walk ˆX starts at X Tλn. In analogy to the stopping time

12 2 IVAN MATIC AND DAVID SIVAKOFF T x for the walk X we define ˆT x for the walk ˆX. The precise definition is: ˆT x ω = T XTλn +xω T λn ω. In analogy to A n we define the event Âm for the walk ˆX: Â m = ˆTλm m, inf ˆXk : 0 k ˆT λm 0. On the event A n Âm, by time T λn + ˆT λm the walk X reaches the site X Tλn + ˆX ˆTλm λ n + m. Therefore A n Âm A n+m. We will now prove that P A n Âm = P A n P Âm. For each x [λn, λn + L], conditioned on T λn = x, the events A n and Âm are independent. Therefore P A n Âm = P A n Âm T λn = x P T λn = x = x [λn,λn+l] x [λn,λn+l] Since P Âm T λn = x = P Âm we obtain P A n Âm = P Âm P A n T λn = x P Âm Tλn = x P T λn = x. x [λn,λn+l] = P Âm P A n, P A n T λn = x P T λn = x which implies the inequality P A n+m P A n P A m for all n, m > 0. The proof is completed using the inequalities 4 and 5 and Theorem Case L = 2 or M = In the case when L = 2 or the number of cookies per site is 0, then we can obtain the exponential decay of probabilities P X n λξn for every positive function ξ that satisfies ξn + ξm ξn + m. In particular this holds for ξx = x θ for θ 0,. Theorem 4. Let ξ : R + R + be a positive super-additive function and assume that either L = 2 or M =. Then there is a function ϕ : R + R such that for every λ > 0 the following holds: lim n n log P X n λξn = ϕλ. Proof. We will prove the theorem for the case L = 2. The proof when M = is a simple generalization of the proof from the case of deterministic walks in random environments. First of all, the following inequality is obtained in the same way as in the proof of Theorem : 2 3 lim inf n log P T λξn n lim inf n log P X n λξn lim sup n log P X n λξn lim sup n log P T λξn n. Let A n := T λξn n, inf k Tλξn X k 0. We have P A n P T λξn n. We will now prove that P T λξn n CP A n for certain constant C independent on n.

13 DETERMINISTIC WALK IN AN EXCITED RANDOM ENVIRONMENT 3 Lemma 6. For each ω T λξn n there exists an ω A n such that Proof. Assume the contrary and consider the set and an element σ Gω such that Let us define the following times: ω λξn,2 ω. Gω = ω T λξn n : ω λξn,2 ω T λξn σ = min T λξnω. ω Gω α = supk < T,0 σ : X k σ 0, β = infk > α : X k σ 0. Clearly, X α, X β 0, since L = 2. If L α σ, X α < M, then we can apply Lemma 5 to a = X α, b = X β, t a = α, and t b = β. We obtain an environment σ λξn,2 σ in which at least one visit to, 0 is avoided implying that T λξnσ < T λξn σ. Therefore L α σ, X α M which implies that X α X β and X α, X β = 0,. Let σ be the environment obtained from σ in the following way: σ σj, x for j, x M, X α j, x = X β X α for j, x = M, X α. Since every visit to, 0 in σ must start from X α and end at X β we conclude that σ λξn,2 σ and X 0,Tλξn σ, 0 = which contradicts our minimality assumption on σ. This completes the proof of Lemma 6. In the same way as in the proof of inequality 6 we now establish P T λξn n CP A n. An argument analogous to the one presented in the proof of Theorem allows us to prove the existence of the function ϕ such that lim n n log P A n = ϕλ. The inequalities 2 and 3 allow us to conclude. 6. Properties of the rate function The next theorem states that the rate function φ from is concave in λ. Theorem 5. Assume that α, β > 0 are real numbers such that α + β =. Then for any λ, µ > 0 the following inequality holds φαλ + βµ αφλ + βφµ. Moreover, φ0 = 0, φλ < 0 for λ > 0, and φλ = for λ > L.

14 4 IVAN MATIC AND DAVID SIVAKOFF Proof. Assume that α n n= and β n n= are sequences of rational numbers for which nα n, nβ n N, 0 α α n min 2λn, n, and 0 β βn min 2µn, n. Notice that T αλ+βµn n, inf X k 0 0 k T αλ+βµn T αλ+βµn n, inf X k 0, T αnλn α n n 0 k T αλ+βµn. Analogously as in the proof of Theorem we define the process ˆX as ˆX k ω = X k+tαnλn ω X Tαnλn ω. Also, denote by ˆT x the hitting time of the walk ˆX, i.e. ˆT x = T XTαnλn +x T αnλn. We now obtain 4 T αλ+βµn n, inf X k 0, T αnλn α n n 0 k T αλ+βµn T αλ+βµn n, inf X k 0, T αnλn α n n, 0 k T αλ+βµn inf X k 0, ˆT βnµn β n n, inf ˆXk 0. 0 k T αnλn 0 k ˆT βnµn Let us define by X the walk defined as X k = ˆX k+ ˆTβnµn ˆX ˆTβnµn, and by T x the stopping time T x = ˆT ˆX ˆTβnµn +x ˆT βnλn. Now we can conclude from the inclusion 4 that T αλ+βµn n, inf X k 0, T αnλn α n n 0 k T αλ+βµn T αλ+βµn n, inf X k 0, T αnλn α n n, 0 k T αλ+βµn = inf X k 0, ˆT βnµn β n n, inf ˆXk 0, 0 k T αnλn 0 k ˆT βnµn T αλ+βµ αnλ βnµn α n β n n, inf Xk 0 0 k T αλ+βµ αnλ βnµn T αnλn α n n, inf X k 0, ˆT βnµn β n n, inf ˆXk 0, 0 k T αnλn 0 k ˆT βnµn T αλ+βµ αnλ βnµn α n β n n, inf Xk 0 0 k T αλ+βµ αnλ βnµn.

15 DETERMINISTIC WALK IN AN EXCITED RANDOM ENVIRONMENT 5 From our choice of sequences α n n= and β n n= we derive the following two inequalities The previous inequalities imply P αλ + βµ α n λ β n µ n 2, and α n β n n 2. T αλ+βµ αnλ βnµn α n β n n, inf Xk 0 0 k T αλ+βµ αnλ βnµn µ 2 min. Since the walks X, ˆX and X occupy disjoint parts of the environment on the events that there are no backtrackings to the left of 0, by independence we obtain P T αλ+βµn n, inf X k 0 0 k T αλ+βµn P T αnλn α n n, inf X k 0 0 k T αnλn P ˆT βnµn β n n, inf ˆXk 0 0 k ˆT βnµn µ 2 min. Taking logarithms of both sides of the last inequality, dividing by n, and taking the limit as n we conclude φαλ + βµ lim n n log µ 2 5 min + lim n n P T αnλn α n n, inf X k 0 0 k T αnλn + lim n n log P ˆT βnµn β n n, inf ˆXk 0. 0 k ˆT βnµn The first limit on the right-hand side of the last inequality is equal to 0. For the second limit we use that α n n is a positive integer, hence lim n n P T αnλn α n n, inf X k 0 0 k T αnλn α n = lim n α n n P T αnλn α n n, inf X k 0 0 k T αnλn = lim α n lim n n α n n P T αnλn α n n, inf X k 0 0 k T αnλn = αφλ. Similarly we obtain that the last term on the right-hand side of 5 is equal to βφµ which completes the proof of the convexity. The equality φλ = for λ > L is trivial because P X n > Ln = 0. We will now prove the equality φ0 = 0. The event X n 0 contains the event ωi, 0 = 0 for all i 0,, 2,..., M, that is, the event that all cookies at 0 point to 0. The probability of this event is greater than µ M min, hence P X n 0 µ M min. On the other hand, the complement of X n 0 contains

16 6 IVAN MATIC AND DAVID SIVAKOFF the event that the first cookie at 0 points to and all cookies at are equal to 0. Thus, P X n 0 µ M+ min, and we conclude that 0 = lim n n log µm min lim n n log P X n 0 lim n n log µ M+ min = 0. Assume now that λ 0, L]. Let k = λn. We will prove that φλ, 0 using Lemma 2. Let A k = [ k + L, k + L] \ [ kl, kl]. Since X n λn T Ak < + we use Lemma 2 to conclude that P X n λn c k for some constant c. For sufficiently large n we have that λn nλ 2 hence P X n λn c λ/2 n. This implies that φλ lim n n log c λ/2 n < 0. The finiteness of φλ follows from the fact that T λn n contains the event G = ω0, 0 = ω0, L = ω0, 2L = = ω0, nl = L, which is the event that the top cookies at each of the sites 0, L, 2L,..., nl point to the location that is L units to its right. The probability of the last event is at least µ n min hence φλ log µ min. This completes the proof of the theorem. References [] S. Armstrong, H. Tran, and Y. Yu. Stochastic homogenization of a nonconvex Hamilton Jacobi equation. Submitted arxiv: [2] I. Benjamini and D. B. Wilson. Excited random walk. Electron. Comm. Probab., 8, [3] F. den Hollander, R. dos Santos, and V. Sidoravicius. Law of large numbers for non-elliptic random walks in dynamic random environments. Stoch. Proc. Appl., 23:56 90, 203. [4] D. Dolgopyat and E. Kosygina. Scaling limits of recurrent excited random walks on integers. Electron. Commun. Probab., 735, 202. [5] G. R. Grimmett, M. V. Menshikov, and S. E. Volkov. Random walks in random labyrinths. Markov Processes and Related Fields, 2:69 86, 996. [6] E. Kosygina and T. Mountford. Limit laws of transient excited random walks on integers. Ann. Inst. Henri Poincaré Probab. Stat., 472: , 20. [7] E. Kosygina, F. Rezakhanlou, and S. R. S. Varadhan. Stochastic homogenization of Hamilton Jacobi Bellman equations. Comm. Pure Appl. Math., 590:489 52, [8] E. Kosygina and M. Zerner. Positively and negatively excited random walks on integers, with branching processes. Electron. J. Probab., 364: , [9] E. Kosygina and M. Zerner. Excited random walks: results, methods, open problems. Bull. Inst. Math. Acad. Sin., 8:05 57, 203. [0] E. Kosygina and M. Zerner. Excursions of excited random walks on integers. Electron. J. Probab., 925: 25, 204. [] G. Kozma and V. Sidoravicius. Lower bound for the escape probability in the lorentz mirror model on z2 lower bound for the escape probability in the lorentz mirror model on z2 lower bound for the escape probability in the Lorentz mirror model on Ϝ d [2] I. Matic. Large deviations for processes in random environments with jumps. Electron. J. Probab., 687: , 20. [3] J. Peterson. Large deviations and slowdown asymptotics for one-dimensional excited random walks. Electron. J. Probab., 848: 24, 202. [4] J. Peterson. Strict monotonicity properties in one-dimensional excited random walks. Markov Processes and Related Fields., 94:72 734, 203. [5] J. Peterson. Large deviations for random walks in a random environment on a strip. ALEA, Lat. Am. J. Probab. Math. Stat., : 4, 204.

17 DETERMINISTIC WALK IN AN EXCITED RANDOM ENVIRONMENT 7 [6] F. Rassoul-Agha, T. Seppalainen, and A. Yilmaz. Quenched free energy and large deviations for random walks in random potentials. Comm. Pure Appl. Math., 662: , 203. [7] F. Rezakhanlou. A prelude to the theory of random walks in random environments. Bull. Iranian Math. Soc., 372:5 20, 20. [8] P. E. Souganidis. Stochastic homogenization of Hamilton Jacobi equations and some applications. Asymptot. Anal., 20:, 999. [9] S. R. S. Varadhan. Large deviations for random walks in a random environment. Comm. Pure Appl. Math., 56: , [20] S. R. S. Varadhan. Random walks in a random environment. Proc. Indian Acad. Sci. Math. Sci., 44:309 38, [2] A. Yilmaz. Harmonic functions, h-transform and large deviations for random walks in random environments in dimensions four and higher. Ann. Probab., 392:47 506, 20. [22] A. Yilmaz and O. Zeitouni. Differing averaged and quenched large deviations for random walks in random environments in dimensions two and three. Comm. Math. Phys., 300:243 27, 200. Department of Mathematics, Baruch College, New York, NY 000, USA Department of Statistics and Department of Mathematics, Ohio State University, Columbus, OH 4320, USA