arxiv:submit/ [math.pr] 9 Sep 2016

Transcription

1 Importance sampling of heavy-tailed iterated random functions By Bohan Chen, Chang-Han Rhee & Bert Zwart arxiv:submit/ [math.pr] 9 Sep 2016 Centrum Wiskunde & Informatica Science Park 123, 1098 XG Amsterdam, Netherlands September 9, 2016 Abstract We consider a stochastic recurrence equation of the form Z n+1 = A n+1z n + B n+1, where E[log A 1] < 0, E[log + B 1] < and {A n, B n} n N is an i.i.d. sequence of positive random vectors. The stationary distribution of this Markov chain can be represented as the distribution of the random variable Z n Bn+1 k=1 A k. Such random variables can be found in the analysis of probabilistic algorithms or financial mathematics, where Z would be called a stochastic perpetuity. If one interprets log A n as the interest rate at time n, then Z is the present value of a bond that generates B n unit of money at each time point n. We are interested in estimating the probability of the rare event {Z > }, when is large; we provide a consistent simulation estimator using state-dependent importance sampling for the case, where log A 1 is heavy-tailed and the so-called Cramér condition is not satisfied. Our algorithm leads to an estimator for P Z >. We show that under natural conditions, our estimator is strongly efficient. Furthermore, we etend our method to the case, where {Z n} n N is defined via the recursive formula Z n+1 = Ψ n+1z n and {Ψ n} n N is a sequence of i.i.d. random Lipschitz functions. 1 Introduction We consider an R-valued Markov chain {Z n } n N defined by Z n+1 = Ψ n+1 Z n, 1 where {Ψ n } n N is a sequence of i.i.d. positive random Lipschitz functions and Z 0 R is arbitrary but independent of the sequence {Ψ n } n N. For k < n, define the backward iteration as Ψ k:n z Ψ k Ψ k+1 Ψ n z. Define Z n z 0 Ψ 1:n z 0. Under some mild conditions cf. Assumption 2 below, the sequence {Z n z 0 } n N converges a.s. to some random variable Z. Moreover, this limit does not depend on the choice of the initial condition z 0 cf. Dyszewski, 2016, Theorem 3.1 and has the same distribution as the stationary solution to 1. For simplicity we set Z n Z n 0. 2 We assume that Ψ n is such that Z n is increasing in n. Define T = inf{n 0 : Z n > }. This paper develops efficient simulation methods for estimating the tail probability of Z, i.e. we are interested in computing PZ > = PT <, when is large. 1

2 The main eample we have in mind, is the so called stochastic perpetuity also known as infinite horizon discounted reward. More precisely, we consider the random difference equation, where Ψ n is an affine transformation, that is Ψ n z = A n z + B n. The formula 1 can be written as Z n+1 = A n+1 Z n + B n+1, 3 for n N. It is well known that if E[log A 1 ] < 0 and E[log + B 1 ] <, then the Markov chain given by 3 has a unique stationary distribution, which has the same distribution as the random variable Z B n+1 e Sn, where S n S n 1 + X n, S 0 0 and X n log A n. Such random variables can be found in the analysis of probabilistic algorithms or financial mathematics, where Z would be called a stochastic perpetuity. If one interprets log A n as the interest rate at time n, then Z is the present value of a bond that generates B n unit of money at each time point n. Perpetuities also occur in the contet of ruin problems with investments, in the study of financial time series such as ARCH-type processes cf. e.g. Embrechts, Klüppelberg, & Mikosch, 1997, in tail asymptotics for eponential functionals of Lévy processes see e.g. Maulik & Zwart, 2006, etc. A book devoted to 3 is Buraczewski, Damek, and Mikosch Although some particular cases eist that allow for an eplicit analysis see e.g. Vervaat, 1979, it is hard to come up with eact results for the distribution of Z in general. Thus Monte Carlo simulation arises as a natural approach to deal with the analysis of stochastic perpetuities, including the large deviations regime where in PT < is large, which is the focus of this paper. In this paper we develop a state-dependent importance sampling algorithm that can be proved to be strongly efficient. By state-dependent, we mean that the importance sampling distribution for generating Z n+1 is dependent on the current state Z n. We say that an estimator L for PT < is strongly efficient for a discussion of efficiency in rare-event simulation, see e.g. Asmussen & Glynn, 2007 if sup >1 EL 2 <. 4 PT < 2 To eplain the idea behind our algorithm, consider a stochastic perpetuity, where B n = 1. One difficulty that arises in our setting where log A 1 is heavy-tailed is that the Cramér condition is not satisfied a study of the Cramér case can be found in Blanchet, Lam, & Zwart, 2012, and hence, standard techniques such as eponential change of measure cannot be used. The algorithm we provide in the present paper is based on the fact that the stochastic perpetuity is closely related to the maimum of a random walk. More precisely, for γ 0, EX 1 we observe that { Z = eps n = ep{s n + nγ} ep nγ ep ma S n + nγ } e γ For a general sequence {Ψ n } n N, we construct a slightly more involved upper bounding random walk and use it to construct a coupling. This allows us to leverage an importance sampling algorithm designed for random walks, in Blanchet and Glynn We can etend this idea to a general Markov chain given by 1. The tail asymptotics in this case have been derived by Dyszewski Our etension of 5 leads to a shorter proof of the asymptotic upper bound given in that paper. Note that Z is defined over an infinite horizon, and hence, requires an infinite amount of computational effort for generating each sample; a natural approach to address such an issue is to work with approimations by finite-time truncation. In this paper we study the bias introduced by such approimations and show that our estimator has a vanishing relative bias as. We also study the asymptotic behavior of the bias with respect to the truncation time. We show that the relative bias converges to 0 at a polynomial rate, which depends on the moment condition of log A 1. It should be mentioned that such a convergence rate is due to the heavy-tailed nature of log A 1 ; in case Cramér condition holds for log A 1, geometric convergence rates typically ensue, i.e, the relative bias converges eponentially to 0 cf. e.g. Basrak, Davis, & Mikosch, 2002, Theorem 2.8. By identifying such a convergence rate and proving a uniform bound on the relative moment of the associated estimator slightly 2

3 stronger statement than the strong efficiency proved in Blanchet & Glynn, 2008, we show that one can apply the bias elimination technique studied in Rhee and Glynn 2015 to construct strongly efficient and unbiased estimators. The rest of the paper is organized as follows. In Section 2 we briefly review an efficient simulation algorithm for the maimum of heavy-tailed random walks proposed by Blanchet and Glynn In Section 3 we introduce the random objects that can be handled by our algorithm. In Section 4 and 5 we use the result from Section 3 to prove an asymptotic upper bound of PZ >. Moreover, we construct an efficient algorithm for estimating PZ > and analyze its relative bias. The main result of this paper is given as Theorem 6. In Section 6 we analyze the asymptotic behavior of the bias with respect to the truncation time, based on a simple eample; we apply the method studied in Rhee and Glynn 2015 to obtain an unbiased estimator. In Section 7 we present our computational results. 2 Notations and Preliminary Results In this section we will first introduce several notations, then we will recall some well known preliminary results. Let + = ma, 0 denote the positive part of and let log + = malog, 0 = log ma, 1. We first recall the following lemma, which will be very useful in validating our new estimator. Lemma 1 Glynn, Let {Y n } n N be a sequence of random variables on the probability space Ω, F, P. Let {M n } n N be a non-negative martingale that is adapted to {Y n } n N for which EM 0 = 1. Let T be a stopping time adapted to {Y n } n N. Define a sequence of probability measures as P n A = E1 A M n, for A F. Then there eists a probability measure P, such that PA = P n A, for A F and n N. Furthermore, we have that E1 {T < } = Ẽ1 {T < }M 1 T. Our goal is to find a suitable martingale M n such that the strong efficiency criterion in 4 is satisfied. Here we consider first a useful eample proposed by Blanchet and Glynn 2008, where the authors develop an efficient state-dependent importance sampling strategy for estimating the tail probability of a random walk crossing a certain level. Before we go through the details of the eample, we introduce the following definition. Definition 1. A random variable X is said to posses a long tail, if for every c R, we have that PX > t + c PX > t as t. X is called subeponential if PX X+ 2 > t 2PX+ > t as t, where X 1 and X 2 are independent copies of X. Moreover, X is said to belong to the family S if the following holds as t. 2EX + PX > t t 0 PX > t spx > sds If X 1 belongs to S, then both the distribution of X 1 and its integrated tail are subeponential cf. Klüppelberg, 1988, Theorem 3.2 and, in particular, long tailed. Furthermore, the Pakes-Veraverbeke s theorem cf. e.g. Veraverbeke, 1977 and Zachary, 2004 says as, where S n = S n 1 + X n. P ma S n > 1 EX 1 PX 1 > tdt, 6 Eample 1. Consider a random walk {S n } n N generated by a sequence of i.i.d. random variables {X n } n N, i.e, S n = S n 1 + X n, S 0 = 0. Assume that EX 1 < 0 and X 1 belongs to S. We are interested in estimating P τ < = Pma S n >, where τ = inf{n 0 : S n > }. Let vz be a positive function on,, let P y, dz denote the transition kernel of the random walk. Instead of P y, dz, one can simulate the random walk via another transition kernel Qy, dz = P y, dz vz, y, ], z R, 7 wy 3

4 where wy is the normalization constant that is given by wy = vzp y, dz. Choosing R M 1 n = n k=1 ws k 1 vs k and applying Lemma 1, this yields a potential candidate of the estimator, which has the form L = 1 {τ< } M 1 1 τ. It is a potential candidate because for each a 0, any Mn constructed by the pair w + a and v + a is also a possible choice. Define a non-negative random variable W that is independent of {X n } n N with tail probability [ PW > t min 1, 1 ] PX 1 > sds. 8 EX 1 Blanchet and Glynn 2008 propose to choose and t vz PW > z, 9 wy PX 1 + W > y. 10 From 6 we can see that the choice above of v and w leads to a good approimation of the socalled zero-variance importance distribution, which involves sampling from the conditional distribution of the random walk given {τ < } cf. Blanchet & Glynn, 2008, Theorem 1. By showing wy vy = o PX 1 > y, as y, 11 for details see Blanchet & Glynn, 2008, Proposition 3 and, for each δ 0, 1, the eistence of a constant a = a δ, 0] such that δ v2 y w 2 y PX 1 > ywy, y + a, 12 the authors were able to control the second moment of the estimator via a Lyapunov bound for details see Blanchet & Glynn, 2008, Theorem 2, Proposition 2, Proposition 3. We summarize one of their results in the net theorem, which will prove to be useful in our contet. Theorem 2. Blanchet & Glynn, 2008, Theorem 3 Suppose that EX 1 < 0 and X 1 belongs to S. Let v and w be defined as in 9 and 10. For fied δ 0, 1, set a = a δ 0 satisfying 12. Let an unbiased estimator of Pma n N S n > be given by τ L τ = 1 {τ< } k=1 ws k 1 + a vs k + a. Then where E Qa kernel sup >0 E Qa L 2 τ 2 <, P ma S n > denotes the epectation w.r.t. the random process {S n } n N having a one-step transition Q a y, dz = P y, dz vz + a wy + a = Py + X 1 dzvz + a wy + a = Py + X 1 dz X 1 + W > y a. 4

5 Theorem 2 implies that the following algorithm is strongly efficient. Algorithm 1. STEP 0. For fied δ 0, 1, set a a δ 0 satisfying 12. STEP 1. Initialize s 0 and L 1. STEP 2. Set s s, generate a random variable Y with the distribution given by PY dz = Ps + X 1 dz X 1 + W > s a, where W is defined as in 8. Update s s + Y and L ws + a vs + a L. STEP 3. If s > then return L. Otherwise, go to STEP 2. 3 Stochastic Perpetuity and Iterated Random Functions In this section we specify the random object that can be handled by our algorithm. We start with an eample of stochastic perpetuity and construct a stochastic upper bound that can be written as a functional of a suitable random walk S n γ, which will be defined in three different levels of generality Eample 2, general stochastic perpetuities, and stochastic recursions of the form 19. Furthermore, using the upper bound we can define crossing levels s which will be defined in three different levels of generality as well and a stopping time such that τ γ = inf{n 0 : S n γ > s}, {Z > } {ma S nγ > s} and τ γ T. 13 Since the change of measure proposed in Blanchet and Glynn 2008 is strongly efficient for estimating the tail probability of the maimum of heavy-tailed random walks, a natural strategy is to keep track of the random process {S n γ} n N while simulating Z m, until the stopping time τ γ. By doing this, we can construct a state-dependent change of measure using the path of the random walk until τ γ according to the method introduced in Eample 1. Then we simulate the path of the random walk after τ γ under the original measure. In the second step we etend the method to the general case. Other properties such as efficiency will be discussed in Section 4 and Stochastic Perpetuity To illustrate our idea, let us consider a simple eample, namely, a stochastic perpetuity that generates eact one unit of money at each time point n. Eample 2. Consider the Markov chain defined via the random difference equations Z n+1 = A n+1 Z n + 1, t N, 14 where E[log A 1 ] < 0 and {A n } n N is an i.i.d. sequence of positive random variables, which is independent of Z 0. The unique stationary distribution of this Markov chain has the same distribution as the random variable Z e Sn, where S n S n 1 + X n, S 0 0 and X n log A n. Let γ 1 0, EX 1 be fied. For the stochastic perpetuity Z, we observe that { } Z = eps n = ep{s n + nγ 1 } ep nγ 1 ep ma S 1 n + nγ γ1 1 e 5

6 Using 15 we can define s log + log1 e γ1 and τ γ inf{n 0 : S n + nγ 1 > s}, such that 13 holds. To see τ γ T, suppose τ γ = N τ, we have that ma n Nτ 1 S n γ s. Combining this with the fact that N τ 1 eps n = we can conclude that T N τ = τ γ. N τ 1 ep{s n + nγ 1 } ep nγ 1 { } 1 e N ep ma S τ n + nγ 1 n N τ 1 1 e γ1 1 ep s 1 e γ1 =, Eample 2 shows that we can bound Z by a functional of the mean-shifted random walk, if we assume that there is no randomness in B n. However, etending the idea to general stochastic perpetuities is not straightforward. The reason is that we can not deal B n separately due to the potential dependence structure between {A n } n N and {B n } n N. To be precise, consider the Markov chain defined via the stochastic difference equations Z n+1 = A n+1 Z n + B n+1, n N, where E[log A 1 ] < 0, E[log + B 1 ] < and {A n, B n } n N is an i.i.d. sequence of positive random vectors that are independent of Z 0. First we need to assume the following. Assumption 1. Assume that A 1, B 1 satisfies the conditions as follows. a Let A 1, B 1 >0 a.s, E[log A 1 ] < 0 and E[log + B 1 ] <. b E[log + maa 1, B 1 1+η ] <, for some η > 0. c For A 1, B 1 we have that PA 1 >, B 1 = opmaa 1, B 1 >. Under Assumption 1, it is well known cf. Buraczewski et al., 2016 and Dyszewski, 2016 that the unique stationary distribution of this Markov chain eists, has right-unbounded support and has the same distribution as the random variable Z B n+1 e Sn, where S n S n 1 + X n, S 0 0 and X n log A n. In the net step we want to construct an upper bound for Z, which can be written as a functional of a suitable random walk S n γ. We have the following Lemma. Lemma 3. Under Assumption 1, there eists a constant γ 2 such that E[ma log + B 1 γ 2, log A 1 ] < 0. Moreover, there eists a constant γ 1 0, E malog + B 1 γ 2, log A 1 such that Z e γ2 } e S n e γ ep {ma S 2 nγ, 16 γ1 1 e where γ = γ 1, γ 2, S n = S n 1 + malog + B n γ 2, log A n and S n γ = S n + nγ 1. 6

7 Proof. Under Assumption 1 a we obtain that lim γ 2 malog+ B 1 γ 2, log A 1 = log A 1, a.s, since log + B 1 and log A 1 are finite a.s. Furthermore, we have that malog + B 1 γ 2, log A 1 malog + B 1, log A 1 + log A Using Assumption 1 b we have that E log + A 1 E log + ma A 1, B 1 <. Since E log A 1 < 0, we conclude that E log A 1 <. Combining this with 17 we have that for any γ 1 > 0, E malog + B 1 γ 1, log A 1 E malog + B 1, log A 1 + E log A1 = E log + mab 1, A 1 + E log A1 <. Using the dominated convergence theorem we obtain the eistence of γ 2. For the stochastic perpetuity Z and the constant γ 2 > 0, we have that Z ma B n+1, 1 e Sn = e γ2 e log+ B n+1 γ 2+S n e γ2 e S n, 18 where S n = S n 1 + malog + B n γ 2, log A n. To see the last inequality, comparing S n+1 with log + B n+1 γ 2 + S n component wise, we have that log + B n+1 γ 2 + Sn = log + n B n+1 γ 2 + log A k k=1 malog + B n+1 γ 2, log A n+1 + n malog + B k γ 2, log A k = S n+1. Now let γ 1 0, E malog + B 1 γ 2, log A 1 be fied. From 18, we observe that Z e γ2 e S n = e γ 2 k=1 { } e ep{s n γ + nγ 1 } ep nγ 1 ep ma S 2 nγ 1 e, γ1 where γ = γ 1, γ 2 and S n γ S n 1 γ + malog + B n γ 2, log A n + γ 1 = S n + nγ 1. Now from 16 we can define s log γ 2 +log1 e γ1 and τ γ inf{n 0 : S n γ > s}, such that 13 holds. 3.2 Iterated Random Functions As we indicated in the introduction, stochastic perpetuities can be considered as a special case of 1 with Ψ n being an affine transformation. Thus, it is natural to consider the Markov chain given by 1, where for each Ψ n there eists a random vector A n, B n, D n satisfying A n z + B n D n Ψ n t A n z + + B + n + D n, 19 for z R. We assume that {A n, B n, D n } n N are i.i.d. and {Ψ n } n N is a sequence of i.i.d. positive random Lipschitz functions with LipΨ n sup Ψ n t 1 Ψ n t 2 t 1 t 2. t 1 t 2 Analogous to Assumption 1, we assume the following holds. Assumption 2. Assume that Ψ n is such that Z n defined as in 2 is increasing in n. Moreover, assume that 19 hold, and that A 1, B 1, D 1 satisfies the following conditions: 7

8 a A 1, D 1 > 0 a.s, E[log A 1 ] > and E[log LipΨ 1 ] < 0. Moreover, E [ log + B D 1 ] < and E [ log + B 1 D 1 ] <. b E [ log + maa 1, B 1 1+η] <, for some η > 0. c The following tail behaviors and hold. PmaA 1, B D 1 > PmaA 1, B 1 >, PmaA 1, B 1 D 1 > PmaA 1, B 1 > PA 1 >, B 1 D 1 = opmaa 1, B 1 > Remark 1. We want to mention that there are interesting eamples that satisfy the increasing property of the backward iteration. For instance, consider the stochastic equation given by Z n+1 = A n+1 Z n 2 + B n+1 Z n + C n+1. This corresponds to a second order random polynomial equation, which is studied by Goldie Define Z lim n Ψ 1:n 0. Recall that cf. Dyszewski, 2016, under Assumption 2, the unique stationary solution to 1 eists, has the same distribution as Z, has right-unbounded support and can be bounded from above with a stochastic perpetuity Z, which is given by Z B n+1 e Sn, where B n ma B + n + D n, 1, S n S n 1 + loga n and S 0 0 cf. Dyszewski, Analogous to the previous section, our goal should be to construct an upper bound for Z and thus for Z that can be written as a functional of the maimum of a suitable random walk S n γ. First we claim the following lemma. Lemma 4. Under Assumption 2, there eists a constant γ 2 such that E [ ma log + B D 1 γ2, log A 1 ] < 0. Moreover, there eists a constant γ 1 0, E malog + B 1 γ 2, log A 1 such that } Z e γ2 e S n e γ ep {ma S 2 nγ, 20 γ1 1 e where γ = γ 1, γ 2, S n = S n 1 + ma log + B + n + D n γ 2, log A n and Sn γ = S n + nγ 1. Proof. Analogous to the proof of Lemma 3. Now from 20 we can define s log γ 2 +log1 e γ1 and τ γ inf{n 0 : S n γ > s}, such that 13 holds. 4 Asymptotic Upper Bound and Strong Efficiency Recall that in Section 3 we have developed a stochastic upper bound for each of our random objects. Moreover, using these upper bounds we also have defined a crossing level s and a stopping time τ γ = inf{n 0 : S n γ > s}, such that {Z > } {ma S n γ > s} and τ γ T, for each case respectively. It turns out that the upper bounds we derived in the previous section are not only helpful for constructing our algorithm, they can also be used to derive an asymptotic upper bound for PZ > as. In this section, we first analyze the asymptotic behavior of PZ >. After that, we show that our estimator is strongly efficient. 8

9 4.1 Asymptotic Upper Bound In the theory of large deviations, one is interested in results such as the asymptotic behavior of PZ > as. More precisely, we are interested in finding a function f such that PZ > f as. Usually, obtaining an asymptotic lower bound is easier than obtaining an upper bound. It turns out that the stochastic upper bounds we derived for Z can be used in deriving the asymptotic upper bound of PZ >. To illustrate this, let us get back to our eample. Eample 2 continued. Consider a stochastic perpetuity with B n = 1, i.e. Z = esn. Moreover, assume that the integrated tail of X 1 is subeponential. On the one hand, using 18, we obtain that PZ > P ma S nγ > s. Since the integrated tail of X 1 + γ 1 is also subeponential, applying the Pakes-Veraverbekes Theorem we have that P ma S nγ > s lim sup PZ > log PX 1 > tdt Letting γ 1 0 we conclude that lim inf lim sup PZ > log PX 1 > tdt lim sup log PX 1 > tdt PZ > log PX 1 > tdt 1. EX 1 On the other hand we observe that Z ep ma S n. Veraverbekes Theorem we obtain that P ma Combining 21 and 22 we conclude that lim inf PZ > 1 EX 1 1 =. 21 EX 1 + γ 1 Therefore applying again the Pakes- S n > log log PX 1 > tdt log P X 1 > t dt. = 1 EX Consider the stationary distribution of the Markov chain given by 1. As we indicated earlier, Dyszewski 2016 shows that under subeponential assumptions on the random variable log + maa 1, B 1 the tail asymptotics can be described using the integrated tail function of log + maa 1, B 1. However, the upper bound we derived in Section 3.2 yields us a shorter proof for the asymptotic upper bound in Dyszewski 2016, Theorem 3.1. Lemma 5. A shorter proof of the asymptotic upper bound in Dyszewski, 2016, Theorem 3.1 Let Assumption 2 hold. Furthermore, assume that the integrated tail of log maa 1, B 1 is subeponential. Then we have that lim sup PZ > F I log 1 E[logA 1 ], where F I denotes the integrated tail of log maa 1, B 1. Proof. From the upper bound we constructed in Section 3.2, we know that PZ > P ma S nγ > s. 23 Due to Assumption 2 c we know that the integrated tail of logmaa 1, B D 1, 1 is also subeponential. Moreover, we have the following inequality: log ma A 1, B D 1, 1 γ 2 log ma A 1, e γ2 B D 1, 1 log ma A1, B D 1, 1. 9

10 The increments of the random walk S n γ have a subeponential integrated tail. Using the Pakes- Veraverbeke theorem we get the following relationship for the RHS of 23, namely P ma S 1 nγ > s E[ma B FI log γ 2, log A 1 ] + γ 1 Now, letting γ 2 and γ 1 0 yields the result. Remark 2. Note that the assumption of an increasing backward iteration of Ψ n is not needed in the proof of Lemma 5. Therefore, it provides indeed a shorter proof of the asymptotic upper bound given in Dyszewski 2016, Theorem Strong Efficiency Given the asymptotic behavior of PZ >, we are able to show the strong efficiency of our estimator. Recall that, based on 13, our algorithm constructs a state-dependent change of measure according to the methods introduced by Blanchet and Glynn Define the following elements, which are needed for the change of measure, via and PW γ > t min [ 1, 1 ES 1 γ t ] PS 1 γ > sds, v γ z PW γ > z s, 25 w γ y PS 1 γ + W γ > y s. 26 We propose an estimator and show its strong efficiency in the following theorem. Theorem 6. Suppose that ES 1 γ < 0 and S 1 γ belongs to S. Let v γ and w γ be defined as in 25 and 26. For fied δ 0, 1, one can choose a = a δ 0 so that Let δ v2 γy w 2 γy PX 1 > yw γ y, y s + a. τ γ L T 1 {T < } k=1 Then L T is an unbiased estimator of PZ > and E Qγ a L 2 T sup >1 PZ > 2 <, w γ S k 1 γ + a v γ S k γ + a. 27 where E Qγ a denotes the epectation w.r.t. the Markov chain {S n γ} n N having a one-step transition kernel Q γ a y, dz = P y, dz v γz + a w γ y + a. Proof. Let M 1 n = n k=1 w γ S k 1 γ + a v γ S k γ + a. Obviously, {M n } n N is a martingale, and therefore, {M n τγ} n N is also a martingale. Since τ γ T, applying Lemma 1, we can conclude that E Qγ a L T = PT < = PZ >. 10

11 For the strong efficiency we have that E Qγ a L 2 T PZ > 2 Q E γ a = = E Qγ a E Qγ a [ 1{Z>} Mτ 2 γ PZ > [ 2 1 {ma [ ] Snγ>s} Mτ 2 γ PZ > 2 1 {ma Snγ>s} Mτ 2 γ P ma S nγ > s ] ] P 2 ma S nγ > s P Z > where the first term in the last equation is guaranteed to be bounded over 1, due to Theorem 2. Hence, only the latter term remains to be analyzed. Define P ma S nγ > s χ =. P Z > From Dyszewski 2016, Theorem 3.1 we have that lim inf 2, PZ > F I log E log A 1 Since by assumption the integrated tail F I is subeponential, it is in particular long tailed. Combining 24 and 28 we obtain that E log A 1 lim sup χ E[ma B γ 2, log A 1 ] + γ 1 Using the fact that χ is bounded over a compact interval, we obtain that P ma S nγ > s sup <. >1 P Z > 5 Asymptotic Unbiasedness The estimator derived in Theorem 6 requires the computation of 1 {Z>}, and hence, is unbiased only if we can generate Z in finite time. Generating a perfect sample from Z in our current setting is not straightforward, although there is plenty of literature on this topic; see, for eample, Blanchet and Wallwater 2015 and Blanchet and Sigman Conditional on {τ γ < }, using the strong Markov property, we have that Z = Ψ 1:τγ Z, where Z lim M Ψ τγ+1:τ γ+m 0 d = Z is independent of Ψ 1:τγ. Therefore, a natural choice for approimating the distribution of Z is a truncated sum. More precisely, letting M N be fied; our modified estimator takes the form L T, M = 1 {τγ<, Ψ 1:τγ Z M >} τ γ k=1 w γ S k 1 γ + a v γ S k γ + a, where Z M Ψ τγ+1:τ γ+m 0. To illustrate this, let us consider an etension of Eample 2. 11

12 Eample 2 continued. Consider a stochastic perpetuity with B n = 1. Moreover, for α > 0, assume that X 1 is regularly varying with inde α + 1; i.e, for the tail distribution of X 1, we have that F α 1 L with L being a slowly varying function. Let a denote the auiliary function of X 1 c.f, e.g. Asmussen & Klüppelberg, 1996 that is given by a = /α in the regularly varying case. On the set {τ γ < }, using the strong Markov property, we have that Z = e Sn = A Z + B, where A = e S τγ, B = τ γ 1 e Sn, and Z = es τγ +n S τγ is a random variable that is independent of A, B. Our modified estimator takes the form τ γ L T, M = 1 {τγ<, A Z M +B >} k=1 w γ S k 1 γ + a v γ S k γ + a, where Z M = M es τγ +n S τγ. The relative bias is defined as E Qγ a L T, M PT <, M = PT <. From {τ γ <, τ γ+m e Sn > } {T < } {τ γ < } we obtain that P ma S nγ > s, M = Θ, M, 30 PZ > where Θ, M = P A Z M + B, A Z + B > τ γ < log Z M = P alog log B log A log Z < alog alog alog τ γ < log Z M = P alog log B S τ γγ τ γ γ log Z < alog alog alog τ γ <. Note that we have seen in the proof of Theorem 6, the latter term in the RHS of 30 is bounded. Therefore, to show that the relative bias vanishes as, it is enough to show that Θ, M 0 as. In the following corollary we derive the limiting distribution of ξ conditional on {τ γ < }, where ξ log B alog S τ γγ τ γ γ alog = log 1 B alog S τ γγ log alog + τ γγ alog. Proposition 7. Let µ EX 1. Conditional on {τ γ < }, ξ converges in distribution to ξ d = γv α /µ γ T α as, where V α is a positive random variable and its tail is given by Ḡ α = PV α > = 1 + /α α, > 0, and T α is defined on the same probability space, such that PV α >, T α > y = Ḡα + y. Moreover, the density of ξ is given by f ξ y = µ γ µ 1 y α 1 1 {y<0} + µ γ 1 + α µ α 1 µ γy 1{y 0}. αγ 12

13 Since both random variables log Z M /alog and log Z /alog converge in probability to 0 as, the relative bias vanishes. It should be noted that the result from the eample above remains valid, if we assume that X 1 belongs to the maimum domain of attraction of the Gumbel distribution. However, we want to show the result of vanishing relative bias in a general contet as described in Section 3.2. Moreover, we are only assuming that the integrated tail of logmaa n, B n is subeponential. We need the following Lemma, of which the proof uses a similar technique as the proof of Theorem 1 in Palmowski and Zwart Lemma 8. Let µ EX 1 and µ γ ES 1 γ. For ν, K > 0 consider the sets and E 1 n = E 1 n K, ν = {S j j µ + ν K, jµ ν + K, j n}, E 2 n = E 2 n K, ν = {S j γ jµ γ + ν K, jµ γ ν + K, j n}, E 3 n = E 3 n K, ν = { B j e νj+k, j n }, where B j = B j D j. Then, for ν, ɛ > 0, there eists K > 0, such that P E n 1 E n 2 E n 3 1 ɛ. n 1 Proof. In the proof of Theorem 1 in Palmowski and Zwart 2007, the authors state that for any ν > 0 and any i.i.d. sequence {Y n } with E [ log + Y 1 ] <, it holds that as K uniformly with respect to n. P Y j e νj+k, j n 1, Using this argument we conclude that P E 3 n 1 as K uniformly with respect to n. Further, combining this fact with the SLLN for {S n } and {S n γ} for details see eg. Asmussen, Schmidli, & Schmidt, 1999, Lemma 3.1, we can always take K large enough such that P E n 1 E n 2 E n 3 for all n N. Finally, since the sequence of sets 1 ɛ, { E n 1 E n 2 E n 3 inclusion, we obtain the result. { } Due to the fact that τ γ <, Ψ 1:τγ Z M > vanishing relative bias result, it is sufficient to show that lim inf P τ γ <, Ψ 1:τγ P T < } is decreasing in the sense of {T < }, in order to prove the Z M > In the following theorem we use a similar proof technique as in the proof of Theorem 3.1 in Dyszewski Theorem 9. Let Assumption 2 hold. Moreover, we are assuming that the integrated tail of logmaa 1, B 1 is subeponential. Then 31 holds. Proof. Define E n = E n 1 E n 2 E n 3 { ma A n+1, B n+1 > e nµ+ν+l+k, B n+1 e nµ ν K} {Z 1 > ν}, 13

14 where L > 0 is chosen to be large enough, such that the sets {E n } are disjoint. Moreover, we can show that E n {τ γ = n + 1, Ψ 1:τγZ 1 > } {τ γ <, Ψ 1:τγZ M > }. To see this, on E n we have that n 1 Ψ 1:n+1 Z 1 k B k+1 k=0 j=1 n 1 B k+1 k=0 A j + B n+1 + Z 1 n An+1 j=1 A j k n A j + B n+1 + e nµ ν K + Z 1 An+1 A j e nµ ν K j=1 e 2K 1 e µ+2ν + minν, 1 ma A n+1, B n+1 + e nµ ν K e nµ+ν K e 2K 1 e µ+2ν + minν, 1 ma A n+1, B n+1 e nµ+ν K e 2K 1 e µ+2ν + minν, 1eL >, for sufficiently large L that does not depend on. Since {S j γ} j n is bounded by K, µ > µ γ and S n+1 γ = S n γ + log ma Bn+1 e γ2, A n+1 + γ1 j=1 > n µ γ + ν K + log ma B n+1, A n+1 γ2 + γ 1 > log + n µ µ γ + L γ 2 + γ 1 > log + L γ 2 + γ 1 > s, n A j for sufficiently large L that does not depend on, we can also conclude that τ γ = n + 1 < by taking sufficiently large. This implies that P τ γ <, Ψ 1:τγZ M > PE n 1 ɛpz 1 > ν { P ma A 1, B 1 > e nµ+ν+l+k j=1 P A 1 > e nµ+ν+l+k, B 1 < e nµ ν+k }. 32 From Assumption 2c we conclude that, for any ɛ > 0, by taking sufficiently large, the following holds P A 1 > e nµ+ν+l+k, B 1 < e nµ ν+k P A 1 > e nµ ν+k, B 1 < e nµ ν+k ɛ P ma A 1, B 1 > e nµ ν+k. Combining this with 32, we obtain that P τ γ <, Ψ 1:τγZ M > { 1 ɛpz 1 > ν P ma A 1, B 1 > e nµ+ν+l+k Since P ma A 1, B 1 > y is decreasing in y, we observe that, for any n, P ma A 1, B 1 > e nµ+ν+l+k 1 µ + ν ɛ P ma A 1, B 1 > e nµ ν+k }. 33 log +L+K+n+1µ+ν log +L+K+nµ+ν 14 P log ma A 1, B 1 > y dy,

15 and that P ma A 1, B 1 > e nµ ν+k 1 µ ν log +K+nµ ν log +K+n 1µ ν Moreover, using the fact that F I is long tailed, we obtain from 33 that P τ γ <, Ψ 1:τγZ M > 1 ɛpz 1 > ν 1 µ + ν F I log + L + K ɛ 1 ɛpz 1 > ν 1 µ + ν ɛ µ ν µ1 ɛpz 1 > ν 1 µ + ν ɛ µ ν P log ma A 1, B 1 > y dy. µ ν F I log + L + K µ ν F I log PT <. 34 where in 34 we use Dyszewski 2016, Theorem 3.1. Letting ɛ, ɛ, ν 0 we obtain the result. This result implies that the relative bias converge to 0, since the numerator in 31 is always smaller than the denominator. Let the conditions in Theorem 6 and Theorem 9 be satisfied. The following algorithm for estimating PZ > has bounded relative error and vanishing relative bias as. Algorithm 2. STEP 0. For fied δ 0, 1, set a a δ 0 satisfying 12. STEP 1. Initialize s 0, z 1 and L 1. STEP 2. Set s s and z z. Run Algorithm 1 until the random walk S n γ crosses s. Meanwhile, update s and L according to STEP 2 of Algorithm 1, then update z via the backward iteration. STEP 3. Set i 0, s s and z z. While i < M, update z via the backward iteration, z z and i i + 1. STEP 4. If z > then return L. Otherwise, return 0. 6 Truncation Inde and Unbiased Estimator In this section we analyze the asymptotic behavior of the relative bias as M for fied, based on which we propose an unbiased estimator for PZ > using the technique studied in Rhee and Glynn We first go back to the Eample 2 i.e., the stochastic perpetuity eample with B n = 1. Eample 2 continued. Consider the Markov chain given by 14. From 30 we know that in order to analyze the relative bias we need to consider the term Θ, M, which is given by Θ, M = P A Z M + B, A Z + B > τ γ <. Let P denote the conditional probability of P τ γ < and E the corresponding epectation operator. Note that Θ, M = 1 { } dp Z M B A,Z > B A = P Z M y, Z > y P ξ dy { } = P Z > y P Z M > y P ξ dy, 35 15

16 { } where 35 follows from the fact that Z M > y {Z > y}. Using the strong Markov property we have that Z M d = Z M and Z = d Z under P. Therefore, we can write 35 as { } Θ, M = P Z > y P Z M > y P ξ dy. Combining this with the fact that the backward iteration Z M has the same distribution as Z M, we obtain that Θ, M = {P Z > y P Z M > y} P ξ dy d T V Z M, Z 36 where d T V denotes the total variation distance. To get a handle on this quantity, we apply the Lyapunov criterion in Jarner and Roberts 2002, Theorem 3.6, which implies a polynomial convergence rate of the M-step transition kernel to the invariant distribution in the total variation norm. We assume that the Markov chain {Z n } n N given by 14 is irreducible and aperiodic; this is the case, for eample, if A 1 has a Lebesgue density Buraczewski et al., 2016, Lemma Moreover, assume that there eists an integer q 2 such that E X 1 q <. In order to establish the Lyapunov condition, let V = 1 log q. Note that V = log q 1 {>e} +1 { e} and hence the binomial epansion gives P V = E [ log A q 1 {A1+1>e} + 1 {A1+1 e} [ = E log A q ] log 1{A1+1>e} + 1 {A1+1 e} [ q q = E log q 1 {A1+1>e} + log q i log A i {A1+1>e} + 1 {A1+1 e}] i i=1 = V + Elog q 1 {A+1>e} 1 {>e} + E1 {A1+1 e} 1 { e} + qlog q 1 E log A {A1+1>e} ] + E For > e, P V V + PA e + qlog q 1 E log A q q + log q i E i q i=2 q log q i log A i 1 {A1+1>e} i 1{A1+1>e} [ log A i=2 Note that log A {A1+1>e} log A1 + C for some constant C and noting that the right-handside doesn t depend on and has finite q-th moment, there has to be c i s such that q [ q log q i E log A i q 2 1{A1+1>e}] c i log i ɛlog q 1 i i=2 i=0 i 1{A1+1>e}]. for sufficiently large. On the other hand, note that log A1+1 1 {A1+1>e} converges to X 1 = log A 1 almost surely as and hence by dominated convergence E log A1+1 1 {A1+1>e} E log A1 < 0. Therefore, for any fied ɛ > 0, qlog q 1 E log A {A1+1>e} qex 1 + ɛlog q 1 for sufficiently large. Choosing ɛ so that qex 1 + 3ɛ < 0 and noting that PA e 0 as, as well as log q 1 = log q q 1 q 1 {>e} + 1 { e} K such that for > e, we conclude that there eists P V V + ɛlog q 1 + qex 1 + ɛlog q 1 + ɛlog q 1 V cv q 1/q 16

17 for > K, where c = qex 1 + 3ɛ > 0. Finally, since P V, V and V q 1/q are bounded on C = [0, K], there eists a constant b such that P V V cv q 1/q + b1 C, which is the sufficient condition in Jarner and Roberts 2002, Theorem 3.6 for polynomial ergodicity; we conclude that the M-step transition kernel converges to the stationary distribution in the total variation norm at a polynomial rate with order q 1, i.e., there eists a constant κ satisfying Θ, M d T V Z M, Z < κm q 1, 37 for all M N. It should be noted that an eact epression of the constant κ can be obtained in a few special cases for eample, see e.g. Douc, Moulines, and Soulier 2007, Kalashnikov and Tsitsiashvili 1999 and the references therein. However, applying the method studied in Rhee and Glynn 2015 we can get rid of this constant altogether and obtain an unbiased, strongly efficient estimator. In order to apply the method, a sufficient condition is to bound E Qγ a L T, M L T 2 PZ > 2 38 by a decreasing function of M independent of. Once we can have such a bound, we can construct an unbiased estimator that is given by whose second moment is L RG T N i=0 L T, 2i L T, 2i 1, 39 PN i E Qγ a L T, 2i 1 L T 2 E Qγ a L T, 2i L T 2, PN i i=0 where N is a random truncation inde independent of everything else and L T, 2i is interpreted as 0 if i < 0 for details see Rhee & Glynn, 2015, Theorem 1. It turns out that such a bound on 38 can be derived easily, if E Qγ a [ L T, 2 i L T 2] E Qγ a P Z > 2 = sup >0 E Qγ a L 2+ɛ T < 40 PZ > 2+ɛ holds for some ɛ > 0. In case this is possible for some positive ɛ > 0, we can proceed as follows: let E i = A Z 2i + B and E = A Z + B. For β 0, 1, using the Hölder s inequality we get that [ ] 1{τγ<,E i,e >}Mτ 1 γ 2 E Qγ a = E Qγ a = PZ > [ 2 1{τγ<,Ei,E>}Mτ 1 γ PZ > 2 [ 1{τγ<,E i,e >}Mτ 1 γ PZ > β [ E Q γ a 1 {τγ<,e i,e >}Mτ 1 γ PZ > β ] 2 β 1{T < } M 1 ] β Q E γ a τ γ [ 1{T < } M 1 τ γ 2 β 1 β PZ > 2 β ] β 2 β 1 β EQγ 1 β a LT. 41 PZ > 2 β 1 β The first term in 41 is bounded by κ2 iq 1 β due to 37, and the second term is uniformly bounded w.r.t.. Therefore, the second moment relative to P Z > 2 can be bounded uniformly ] 1 β 17

18 w.r.t., if we choose β and N in a suitable way. For eample, setting β 1+2ɛ q 1 where ɛ > 0 is small enough to ensure that β < 1, and then N such that PN i = 2 i1+ɛ, one can achieve the purpose. Finally, we are left with verifying 40, which turns out to be possible by adapting the idea as described in Blanchet and Glynn Using the same argument as in the proof of Theorem 6, it is sufficient to analyze the term that is given by 2+ɛ. 42 P τ γ < E Qγ a L 2+ɛ τ γ The following Lemma, which can be considered as an etension of Theorem 2, proves that the estimator L RG defined in 39 is an unbiased estimator of PZ > and is strongly efficient. T Lemma 10. Suppose that EX 1 < 0 and X 1 belongs to S. Fi γ 0, EX 1. Let v γ and w γ be defined as in 25 and 26. Let ɛ > 0. For fied δ 0, 1, one can choose a = a δ 0 so that Let δ v2+ɛ γ y wγ 2+ɛ y PX 1 > ywγ 1+ɛ y, y s + a. L τγ 1 {τγ< } τ γ k=1 w γ S k 1 + a v γ S k + a. Then L τγ is an unbiased estimator of Pma n N S n > s under P Qa, and sup >0 E Qa L 2+ɛ τ γ P ma S n > s 2+ɛ <, where P Qa denotes the probability measure associated with the random walk {S n } n N having the onestep transition kernel Q a y, dz = P y, dz v γz + a w γ y + a, and E Qa denotes the corresponding epectation operator. Proof. The proof including the eistence of a can be found in Appendi B. Note that the above discussion can easily be etended to cover the general stochastic recursion. We conclude this section with the following theorem. Theorem 11. Suppose that ES 1 γ < 0, S 1 γ belongs to S and Assumption 2 holds. Let v γ and w γ be defined as in 25 and 26. For fied δ 0, 1 and β 0, 1, set a = a δ 0 satisfying 2 β 2 β δ v 1 β 1 β γ y wγ y, y s + a PX 1 > yw 1. 1 β y γ Moreover, assume that E log A 1 q + E log B 1 q <. Then, it is possible to choose N independently of, such that E Qγ a L T, 2i 1 L T 2 PZ > 2 PN i i=0 converges, and hence, the estimator L RG defined in 39 is unbiased and strongly efficient. T Remark 3. Note that, in general, the bias elimination scheme of Rhee and Glynn 2015 is not guaranteed to produce non-negative estimators, which might not be ideal in the contet of estimating rare event probabilities. However, in our case, L T, M increases w.r.t. M, and hence, the resulting unbiased estimator L RG is always non-negative. T 18

19 10-3 Estimates for = Estimates for = Estimates for = Estimates for = Figure 1: Estimated probabilities for changing values of M. The y-ais values indicate the estimated rare-event probabilities and the vertical bars indicate the 95% confidence intervals. The -ais values indicate the truncation inde M. In each of the subplot, we can see that as M increases, the estimated probability converges to a fied value, which suggests that our estimator is consistent with respect to M. Comparing the four subplots for different value of, one can see that the relative bias for small M decreases as grows. 7 Numerical Results Here we investigate our algorithm numerically based on a stochastic perpetuity with B n = 1. d consider the increment X n = W 3/2 where W is a random variable with Weibull distribution: PW > t = ep 2t 1/2. We For the algorithmic parameters, we chose a = 10, γ = 0.5. Moreover, we use a geometric distributed random truncation inde with parameter 0.5. Figure 1 shows the change of estimated probability with respect to the different choice of M for 4 different values of = 10 8, = 10 16, = 10 32, and = in each of the four plots. One can see that the estimated probability stabilizes as M grows, which suggests that our estimator is consistent as M. Comparing the four plots, one can also tell that the initial bias for small M decrease as increases, which is consistent with the conclusion of Theorem 9 vanishing relative bias. Table 1 reports the estimated probabilities, their 95%-confidence intervals and the estimated coefficients of variation, that is, the estimated standard deviation divided by the sample mean based on samples, for different values of and M. In the last column, we present the results produced with the unbiased algorithm as introduced in Section 6. We can see that, on the one hand the ratio between the estimated probability and the standard deviation stays roughly constant over a range of values and M values; on the other hand, the estimated probability using the fi truncation method tend to converge to the estimated probability produced with the unbiased algorithm as M grows. These observations are consistent with the strong efficiency predicted in Theorem 6 and Theorem 11 of our estimators. 19

20 Est CI CV = 10 8 = = = M = 2 2 M = 2 4 M = 2 6 M = 2 8 RG ± ± ± ± ± ± ± ± ± ± ± ± ± ± ± ± ± ± ± ± Table 1: Estimated rare-event probability and 95% confidence intervals. One can see that, on the one hand the ratio between the standard deviation and the estimated probability stays roughly constant for different combinations of and M, on the other hand, as M grows, the estimated probability produced with the fi truncation method tends to converge to the estimated probability produced with the unbiased algorithm, which suggests the consistency and the strong efficiency of our estimators predicted by Theorem 6 and Theorem 11. Appendi A Proof of Proposition 7 First we claim that, conditional on {τ γ < }, the first term in ξ converges to 0 in probability. Let ɛ > 0 be arbitrary, we have that P log 1 B ɛ alog τ γ < B = P 1 ɛ α τ γ <. Let M τγ denote the maimum of {S i γ} i τγ 1. It is well known that M τγ = O1 cf. the proof of Theorem 1.1 in Asmussen & Klüppelberg, Moreover, B is bounded by B = τ γ 1 e Sn = τ γ 1 e Snγ nγ e M τγ τ γ 1 e nγ e M τγ 1 e γ 1. Therefore, for α > 0, we have that B P 1 ɛ α τ γ < P M τγ log log1 e γ log1 ɛ α τγ < Mτγ = P alog log alog log1 e γ log1 ɛ α alog alog τ γ < 0, 43 as, since log /alog = α. The convergence of the last two terms in ξ is an application of Asmussen and Klüppelberg 1996, Theorem

21 B Proof of Lemma 10 First notice that the numerator in 42 is equal to EL 1+ɛ τ γ. Analogous to Blanchet and Glynn 2008, Theorem 2, we can derive a similar result for EL 1+ɛ τ γ simply by replacing r with r 1+ɛ, where ry, z = vz wy, and v, w are defined in the corresponding way as in 7. Based on this observation we claim the following Proposition cf. Blanchet & Glynn, 2008, Proposition 2: Proposition 12. Let P y, dz denote the transition kernel of the random walk {S n } n N. Assume that wy > 0 for y s and that there eists a finite-valued function h : R [δ 1, satisfying w 1+ɛ y vzhzp y, dz hyv 2+ɛ y, 44 for y s. If hz 1 for z > s and vz δ 2 > 0 for z > s, then we have that EL 1+ɛ τ γ δ1 1 δ 2+ɛ 2 v 2+ɛ yhy. Recall that v γ defined as in 25 depends implicitly on. The Pakes-Veraverbeke s Theorem implies that Pτ γ < v γ y for every fied y as. This observation gives us a way to prove Lemma 10: first find a suitable function h such that 44 holds with v and w being defined as in 21 and 22, then the result can be yielded using Proposition 12. Define hy = 1,s a ]y + 1 δ1 s a, y. Now 44 is equivalent to cf. the proof of Theorem 3 in Blanchet & Glynn, 2008 δ v2+ɛ γ y + a wγ 2+ɛ y + a PX 1 > y a wγ 1+ɛ, y s. y + a Using the definition of w γ and noticing the non-negativity of W γ, 11 implies particularly that wy vy = owy, as y. Therefore, such a can be found. References Asmussen, S., & Glynn, P Stochastic simulation: Algorithms and analysis 1st ed., Vol. 57. Springer-Verlag New York. Asmussen, S., & Klüppelberg, C Large deviations results for subeponential tails, with applications to insurance risk. Stochastic Processes and their Applications, 64 1, Asmussen, S., Schmidli, H., & Schmidt, V. 1999, June. Tail probabilities for non-standard risk and queueing processes with subeponential jumps. Advances in Applied Probability, 31 2, Basrak, B., Davis, R., A., & Mikosch, T Regular variation of GARCH processes. Stochastic Processes and their Applications, 99 1, Blanchet, J., & Glynn, P. 2008, August. Efficient rare-event simulation for the maimum of heavytailed random walks. The Annals of Applied Probability, 18 4, Blanchet, J., Lam, H., & Zwart, B Efficient rare-event simulation for perpetuities. Stochastic Processes and their Applications, 122, Blanchet, J., & Sigman, K. 2011, August. On eact sampling of stochastic perpetuities. Journal of Applied Probability, 48A, Blanchet, J., & Wallwater, A. 2015, November. Eact sampling of stationary and time-reversed queues. ACM Transitions on Modeling and Computer Simulation, 25 4, 26:1 26:27. Buraczewski, D., Damek, E., & Mikosch, T Stochastic models with power-law tails: The equation =a+b 1st ed.. Springer International Publishing. 21

22 Douc, R., Moulines, E., & Soulier, P. 2007, August. Computable convergence rates for sub-geometric ergodic Markov chains. Bernoulli, 13 3, Dyszewski, P Iterated random functions and slowly varying tails. Stochastic Processes and their Applications, 126 2, Embrechts, P., Klüppelberg, C., & Mikosch, T Modelling etremal events for insurance and finance 1st ed., Vol. 33. Springer-Verlag Berlin Heidelberg. Glynn, P Lecture notes for MS&E Stochastic Calculus and Control. Stanford University. Goldie, M., Charles Implicit renewal theory and tails of solutions of random equations. The Annals of Applied Probability, 1 1, Jarner, S. F., & Roberts, G. O. 2002, 02. Polynomial convergence rates of Markov chains. The Annals of Applied Probability, 12 1, Kalashnikov, V., & Tsitsiashvili, G Tails of waiting times and their bounds. Queueing Systems, 32 1, Klüppelberg, C. 1988, March. Subeponential distributions and integrated tails. Journal of Applied Probability, 25 1, Maulik, K., & Zwart, B Tail asymptotics for eponential functionals of Lévy processes. Stochastic Processes and their Applications, 116, Palmowski, Z., & Zwart, B Tail asymptotics of the supremum of a regenerative process. Journal of Applied Probability, 44 2, Rhee, C.-H., & Glynn, P Unbiased estimation with square root convergence for SDE models. Articles in Advance, Veraverbeke, N Asymptotic behaviour of Wiener-Hopf factors of a random walk. Stochastic Processes and their Applications, 5 1, Vervaat, W On a stochastic difference equation and a representation of non-negative infinitely divisible random variables. Advances in Applied Probability, 11 4, Zachary, S. 2004, January. A note on Veraverbeke s theorem. Queueing Systems, ,