arxiv: v1 [math.pr] 7 Aug 2014

Transcription

1 A Correction Term for the Covariance of Renewal-Reward Processes with Multivariate Rewards Brendan Patch, Yoni Nazarathy, and Thomas Taimre. August 18, 218 arxiv: v1 [math.pr] 7 Aug 214 Abstract We consider a renewal-reward process with multivariate rewards. Such a process is constructed from an i.i.d. sequence of time periods, to each of which there is associated a multivariate reward vector. The rewards in each time period may depend on each other and on the period length, but not on the other time periods. Rewards are accumulated to form a vector valued process that exhibits jumps in all coordinates simultaneously, only at renewal epochs. We derive an asymptotically exact expression for the covariance function (over time of the rewards, which is used to refine a central limit theorem for the vector of rewards. As illustrated by a numerical example, this refinement can yield improved accuracy, especially for moderate timehorizons. Keywords renewal process, renewal-reward process, multivariate rewards, covariance time curve, central limit theorem. 1 Introduction Probabilistic modeling and analysis has a long tradition in dealing with the behaviour of regenerative processes. Such processes restart probabilistically at renewal instances, forming a sequence of independent and identically distributed (i.i.d. sub-processes. They are used in stochastic simulation, reliability analysis, actuarial studies, queueing theory, and other aspects of applied probability and statistics. An illustrative example is that of natural disasters. When a natural disaster occurs there are several simultaneous costs (e.g. personal property loss and infrastructure damage, which may be distributed across different locations. These costs (rewards are typically dependent and may also depend on the time elapsed since the previous disaster. If we assume that the system resets after such an event then the situation is well described by a renewal-reward process with multivariate rewards which we will refer to simply as a multivariate renewal-reward process. The multivariate renewal-reward process is constructed on a probability space supporting {Z n } n, a sequence of (L + 1-dimensional independent random vectors with possibly dependent coordinates. The first coordinate of Z n, denoted T n, signifies the time between events, which we call renewals, and is assumed non-negative. The remaining L coordinates, denoted X 1,n,...,X L,n are the rewards and are not sign restricted. Assume that {Z n } n1 are i.i.d. and, as is standard in renewal theory (see e.g. [1] or [5], Z may follow a different distribution. We refer to the case of T and all X i, as ordinary; otherwise the process is delayed. To avoid trivialities assume that T n and all X i,n are almost surely not zero for n 1. Let S n n i T i, so that {S n } n are the renewal times. Taking N(t min{n : S n > t} the multivariate renewal-reward process is {R(t : t }, or simply R(, where R(t N(t 1 n X 1,n,..., N(t 1 n X L,n. (1 We treat the summations in R(t as empty for t < T, since N(t there. For L > 2 the i-th coordinate of R( is denoted R i (. For L 2 the coordinates are R x ( and R y (, and the n-th reward Corresponding author. b.patch@uq.edu.au The School of Mathematics and Physics, The University of Queensland, Qld 4169, Australia.

2 vector [X 1,n, X 2,n ] is written simply as [X n, Y n ], where we represent all vectors as rows. Note that in the ordinary case, N( 1 and in the delayed case N(. We focus on the case of moderate or large t and aim to approximate the distribution of R(t. In the illustrative example of natural disasters, this is the multivariate distribution describing the different types of losses accumulated during the first [, t] time units. In some very special cases the distribution of R(t admits an explicit form. If, for example, the coordinates of Z n are mutually independent and T n is exponentially distributed, then N( is a Poisson process and R( is a vector of independent compound Poisson processes. In general, however, the distribution of R(t is not easily obtainable, in which case asymptotic approximations become particularly appealing. Under regularity conditions (described in the next section it is well known that R(t obeys a normal central limit theorem (CLT as t, where the mean and covariance terms appearing in the CLT are determined by moments of Z 1. Brown and Solomon further established in [4] that for a renewal-reward process satisfying suitable regularity conditions with univariate rewards (L 1, ER x (t a x t+b x +o(1 and Var ( R x (t c x t+d x +o(1, where o(1 is a function that vanishes as t. Here, the constants a x and c x are determined by moments (including cross moments of (T 1,X 1 and the constants b x and d x are determined by moments of (T,X and (T 1,X 1. Expressions for a x and c x, as well as a version of b x with rewards independent of renewals, were found by Smith in [7]. Subsequently, in [4], Brown and Solomon extended to find b x and d x for the general univariate renewal-reward process. The main contribution of the current paper is to generalize the result of [4] to multivariate rewards. We prove that, under regularity conditions, Cov ( R x (t, R y (t c x,y t+d x,y +o(1. As before, c x,y depends on the moments of Z 1 and d x,y depends on the moments of both Z 1 and Z. Expressions for c x,y appeared in [7], although without an explicit proof for this form of the covariance curve. Our expression for d x,y is new and generalizes d x of [4]. The multivariate CLT for R(t first appeared in [7]. The CLT uses a covariance matrix with elements c x,y (or c x on the diagonal. Our refined asymptotics suggest an improved approximation to R(t based on this CLT, our new d x,y term, and the previously known d x term. We illustrate the usefulness of this improved approximation in an example. A further (minor contribution of the current paper is in casting Smith s CLT in a modern form. A related presentation is in Section 7.4 of [9], where functional CLTs are given. The case handled there is one dimensional and assumes rewards are independent of renewals. The remainder of the paper is structured as follows. In Section 2 we present our main result on correction terms to the covariance curve of the multivariate renewal-reward process as well as the CLT and the improved approximation to R(t. Section 3 demonstrates the usefulness of our correction terms through a numerical illustration. Proofs are in Section 4. We conclude in Section 5. 2 Main Results Our results arestated in terms ofmoments (and crossmoments ofz and Z 1. It is useful to denote some of the moments of Z 1 as follows: µ i ET1 i, λ i EX1 i, α i EY1 i, m i,j ET1 ixj 1, n i,j ET1 iy j 1, and p i,j,k ET1 ixj 1 Y 1 k. Denote the distribution function of T by F ( and that of T 1 (and subsequent inter-event times by F(. We call F( non-lattice if the corresponding probability measure df( is not concentrated on a set of the form {δ,2δ,...}. A distribution function is said to have the stronger property of being spread out if F (n (, the n-th convolution of F(, has a component that is absolutely continuous (e.g. [1, Sec 7.1]. The growth rate a x λ 1 /µ 1 is well known. In [4], it was further established: Theorem 1 (Restatement of [4], Lemma 1 For F( non-lattice and µ 2, λ 1, and m 1,1 finite, ER x (t a x t+b x +o(1, (2 where a x λ 1 /µ 1 and b x µ 1 1 µ 2 a x /2 µ 1 1 m 1,1 +EX a x ET. 2

3 In order to state our main result, consider an ordinary renewal-reward process where the rewards are distributed as the product X 1 Y 1. For ordinary R( denote the i-th reward coordinate by R i (. In particular, for L 2, we write R x (, R y (, and R xy ( for the two rewardcoordinates and the associated product reward coordinate. Applying Theorem 1 above, we have that E R xy (t E N(t 1 n1 X n Y n can be represented as E R xy (t a xy t+ b xy +o(1, with a xy µ 1 1 p,1,1 and b xy µ 1 1 a xyµ 2 /2 µ 1 1 p 1,1,1. (3 Our main theorem is a generalization of the key results in [4]. It utilizes the expressions for a xy, b xy as well as a x, a y α 1 /µ 1, and the corresponding correction terms in the ordinary case, bx µ 1 1 a x µ 2 /2 µ 1 1 m 1,1 and by µ 1 1 a y µ 2 /2 µ 1 1 n 1,1. Theorem 2 For F( spread out and µ 3, λ 2, α 2, m 1,2, n 1,2, p 1,1,1, ET 2, and EX Y finite, Cov ( R x (t, R y (t c x,y t+d x,y +o(1, where Further, c x,y µ 1 1 Cov( X 1 a x T 1, Y 1 a y T 1 axy +a x by +a y bx. d x,y d x,y c x,y ET +a x a y Var(T +Cov(X, Y a x Cov(T, Y a y Cov(T, X, (4 with d x,y b x by + b xy +2a x l y +2a y l x, where, l x µ 3 1 λ 1 µ 2 2 /4 µ 2 1 λ 1 µ 3 /6+µ 1 1 m 2,1 /2 µ 2 1 µ 2 m 1,1 /2, (5 l y µ 3 1 α 1 µ 2 2 /4 µ 2 1 α 1 µ 3 /6+µ 1 1 n 2,1 /2 µ 2 1 µ 2 n 1,1 /2. Note that: (i as shown in Lemma 2 below, the quantity l x (as well its y-counterpart is in fact the integrated o(1 term of (2; (ii for y x Theorem 2 reduces to results of [4] with b xy b xx µ 2 1 µ 2 λ 2 /2 µ 1 1 m 1,2 ; and (iii for ordinary R( the terms involving Z vanish, implying d x,y d x,y. For L-dimensional R(, we ine the matrices and vectors: a [a i ] L i1, b [b i ] L i1, C µ 1 1 Cov( [γ i ] L i1, and D [di,j ] n i,j1. Here the elements a i, b i, and d i,j areasined in Theorems1and 2 above, wherexand/ory are replaced by some pair i,j {1,...,L}, and γ i X 1,i a i T 1 for i 1,...,L. The vector a and the covariance matrix C play a role in the CLT which we state now. The vector b and our (new contribution matrix D are the correction terms. These appear in the refinement that follows. Theorem 3 (Originally in [7] If F( is spread out, EX i,1 T 1 <, and EX i,1 X j,1 < then the sequence (in t of random vectors, [ R1 (t a 1 t,..., R ] L(t a L t, t >, t t converges in distribution, as t, to a zero mean normal random vector with covariance matrix C, denoted here by N(,C. Motivated by Theorems 1 3, we suggest the following refined normal approximation to the distribution of the multivariate renewal-reward process at time t: ( d R(t N at+b, Ct+D. (6 Note that the matrix D may not be positive inite (PD in other words not a covariance matrix whereas C always is. When D is not PD, it is easy to see that Ct+D is PD for all t greater than some t >, and is not PD for all t t. Consequently, we only suggest (6 when Ct+D is PD (i.e. t > t. 3

4 3 Numerical Illustration To illustrate the applicability of our refined normal approximation (6 assume that we wish to evaluate m(t E min { R x (t, R y (t }. A simple expression for this expected minimum is generally not available, but by approximating the distribution of [ R x (t, R y (t ] as normal using Theorem 3 we obtain a very good approximation for m(t, which is generally improved using our refinement (6. The expected minimum of a bivariate normal random vector [W, V] is ( ( ( E(V W Φ Var ( W V E(W V EW +Φ Var ( W V E(W V EV φ Var ( W V Var ( W V, (7 where Φ and φ are respectively the cdf and pdf of the standard normal distribution (see e.g. [6]. Thus, using the mean and variance/covariance expansions from Theorems 1 and 2 we can (for fixed t combine (7 with (6 to get an explicit approximation of m(t, denoted m(t. For moderate to large t, we expect using Ct+D as the covariance will yield a better approximation of m(t than only using Ct. That is, we expect that the matrix D, with our newly found covariance refinement term d x,y on the off-diagonals, will improve the approximation. As a specific numerical example consider Z n [ T n, X n, Y n ] [ U1,n +U 4,n, U 2,n +U 4,n, U 3,n +U 4,n ], n,1,2,..., where U i,n are all independent exponential random variables with unit mean for i 1,2,4 and mean 1/2 for i 3. Now, using the expressions of Theorems 1 and 2 we obtain a [ 1, 1 ], b [ 1, 8/7 ] [ ] [ ] 1, 3/8 1/2, 1/2, C, and D. 3/8, 7/16 1/2, 13/64 In this case the refinement to the covariance curve is only applicable for t > t ( 731 3/38.63, since Ct + D is not a PD matrix when t t. We estimated the true m(t by extensive simulation, taking the mean of the minimum over 1 7 sample paths of R( as the estimate m(t. Figure 1 plots the difference between the estimated (true value m(t and two versions of the approximate m(. The solid curve does not use the correction matrix D, i.e. m(t is evaluated assuming covariance C t. The dashed curve is the improved approximation incorporating an asymptotically exact covariance, Ct + D (both curves utilize b. As observed, while both curves converge to zero error as t, the refinement yields smaller error especially in the medium time horizon after t. m(t m(t 1 t t Figure 1: Difference between two analytical approximations m(t and simulation estimate m(t. The dashed curve uses D, while the solid curve does not. The approximations m(t are easy to evaluate using (7 together with our proposed approximation (6. 4 Proof of Main Result Without loss of generality we prove Theorem 2 as stated for the case L 2. In the ordinary case denote M(t EN(t and the closely related D x (t E R x (t (as well as the y-counterpart D y (t. 4

5 Lemma 1 For ordinary R( : E i<j N(t 1 X iy j D x(t sdd y (s. Proof. Let f n df (n /dm. Since M(t n F(n (t for all t, M(t implies all F (n (t, so F (n M and f n is well ined. Now D x (t E i1 X ii {Si t} t i1 E (X i S i sdf (i (s i1 E (X i S i sf i (sdm(s, and therefore dd x (s/dm(s i1 E (X i S i sf i (s. In the following, denote S j i S j S i. Next, E i Y j i<j N(t 1X EX i Y j I {Sj t} ( EE X i Y j i I { Sj i+s i t} S i i<j i<j ( E X i Y j i I { Sj i+ω t} S i ω df (i (ω i<j ω ( E (X i S i ω E E Y j i I { Sj i+ω t} S j i df (i (ω i<j ω ( E (X i S i ω E Y j i I {s t} Sj i s ω df (j i (s ωdf (i (ω i<j ω sω ( E (X i S i ω E Y j i Sj i s ω df (j i (s ωdf (i (ω i<j ω sω ( E (X i S i ω E Y j i Sj i s ω df (j i (s ωdf (i (ω ω sω i1 (j i1 ω sω i1 ω ω sω i1 D y (t ω E (X i S i ω E k1 E (X i S i ω f i (ω ( Y k Sk s ω f k (s ωdm(s ωf i (ωdm(ω E k1 E (X i S i ω f i (ωdm(ω i1 D y (t ωdd x (ω D x (t ωdd y (ω. The next result from [4] deals with r x (t D x (t a x t b x : ( Y k Sk s ω f k (s ωdm(s ωdm(ω ω D y (t ω dd x(ω dm(ω dm(ω Lemma 2 (Restatement of [4], Lemma 3 For the ordinary case, if F( is spread out and µ 3, λ 1, and m 2,1 are finite, then r x (tdt l x, where l x is ined in (5. Moreover, r x ( is directly Riemann integrable and lim t tr x (t. We can now prove Theorem 2, which is the key to our approximation (6. Proof of Theorem 2. Since ET 1 X 1 (ET 1 X1 2EX 1 1/2, ET1 2 X 1 (ET 1 X1 2EX3 1 1/2, and E X 1 Y 1 (EX1 2EX2 1 1/2, it holds that m 1,1, m 2,1, and p,1,1 are finite. Similarly, n 1,1 and n 2,1 are finite. It holds, Cov ( Rx (t, R y (t E R xy (t+2e X i Y j E R x (te R y (t E R xy (t+2 i<j N(t 1 D x (t sdd y (s E R x (te R y (t, (8 5

6 where the second step follows from Lemma 1. We have E R xy (t a xy t + b xy + o(1 from (3 and it follows from Theorem 1 that Now, E R x (te R y (t a x a y t 2 +(a x by +a y bx t+ b x by +o(1. (9 D x (t sdd y (s r x (t sdd y (s+ ( ax (t s+ b x ddy (s. By Lemma2, r x ( is directly Riemann integrable. It thus followsfrom a generalisationofthe keyrenewal theorem to renewal-reward processes (see [3] that r x(t sdd y (s a y l x +o(1. Next, ( t ( ax (t s+ b x ddy (s a x D y (sds+ b x D y (t b x D y (t+a x ry (s+a y s+ b y ds. Now using Lemma 2 we have D x (t sdd y (s a x a y t 2 /2+(a x by +a y bx t+a x l y +a y l x + b x by +o(1. (1 Combining the above into (8 yields the result for the ordinary case. We now move onto the delayed case. Since R x (t I {T t}( X + R x (t T and similarly for R y (t, R x (tr y (t I {T t}( X Y +X Ry (t T +Y Rx (t T + R x (t T R y (t T. Now, EI {T t}x Y E [X Y T s] df (s EX Y +o(1. Next, EI {T t}x Ry (t T E I {T t}e [X T ] ( a y (t T + b y +r y (t T (a y t+ b y EX a y ET X +o(1, since r y (t converges to as t (Theorem 1 and both sup t { r y (t } and E X are finite, it holds that r y(t se [X T s] df (s as t. Similarly for EI {T t}y Rx (t T. Set r(t Cov ( Rx (t, R y (t c x,y t d x,y. Hence, E I {T t} R x (t T R y (t T E I {T t}( cx,y (t T +d x,y +r(t T +(a x (t T + b x +r x (t T (a y (t T + b y +r y (t T E I {T t}( ax a y t 2 +t(c x,y 2a x a y T + b y a x + b x a y + d x,y c x,y T +a x a y T 2 + b x by b x a y T b y a x T +r(t T +r x (t T r y (t T +r x (t T (a y (t T + b y +r y (t T (a x (t T + b x. By Theorem 1 and the result proved above for the ordinary case, r x (t, r y (t, and r(t all converge to. Moreover, sup t { r(t }, sup t { r x (t }, and sup t { r x (t } are finite, thus r(t xdf (x, r x(t xr y (t xdf (x, r x(t xdf (x, and r y(t xdf (x all converge to as t. Further, by Lemma 2, tr x (t and tr y (t also convergeto, and it easily follows that sup t { tr y (t } and sup t { tr y (t } are finite; thus ( E I {T t} ax (t T r y (t T +a y (t T r x (t T which converges to as t. Therefore, ( ax (t T r y (t T +a y (t T r x (t T df (x, E I {T t} R x (t T R y (t T a x a y t 2 +(c x,y 2a x a y ET + b y a x + b x a y t+ d x,y c x,y ET +a x a y ET 2 + b x by b x a y ET b y a x ET +o(1. 6

7 Thus, ER x (tr y (t a x a y t 2 +(c x,y 2a x a y ET + b y a x + b x a y +a x EY +a y EX t+ d x,y c x,y ET +a x a y ET 2 a x ET Y a y ET X +EX Y + b x by b x a y ET b y a x ET + b x EY + b y EX +o(1. By Theorem 1, ER x (ter y (t (a x t+ b x +EX a x ET (a y t+ b y +EY a y ET +o(1 a x a y t 2 +(a x by +a x EY 2a x a y ET + b x a y +a y EX t+ b x by + b x EY b x a y ET + b y EX +EX EY a y EX ET a x by ET a x EY ET +a x a y (ET 2 +o(1. Combining the two expressions above yields the result. 5 Outlook The renewal-reward process with multivariate rewards analysed here often plays a role as part of a more complicated stochastic model for example in multidimensional risk models, such as in [2]. Our results may help analysis of such risk models, at least in some asymptotic regime. We have allowed the distribution of Z n to depend on n in a simple way by allowing Z to follow a different distribution to {Z n } n1. A possible extension of our work is to allow for more general dependencies of Z n on n by partitioning N into possibly infinite subsets. In [8] Spătaru gives a CLT for the case of univariate rewards (L 1 with unit rewards (a renewal process in this setting. Extending Spătaru s result to the univariate or even the multivariate renewal-reward case remains a challenge. Acknowledgements This work was in part carried out as a component of the M.Sc. of BP. YN is supported by Australian Research Council (ARC grants DP and DE References [1] S. Asmussen. Applied Probability and Queues. Springer-Verlag, 23. [2] E.S. Badila, O.J. Boxma, and J.A.C. Resing. Two parallel insurance lines with simultaneous arrivals and risks correlated with inter-arrival times. preprint arxiv: , 214. [3] M. Brown and S.M. Ross. Asymptotic properties of cumulative processes. SIAM Journal on Applied Mathematics, 22:93 15, [4] M. Brown and H. Solomon. A second-order approximation for the variance of a renewal reward process. Stochastic Processes and their Applications, 3:31 314, [5] A. Gut. Stopped Random Walks: Limit Theorems and Applications. Springer, 29. [6] J. Hunter. Renewal theory in two dimensions: asymptotic results. Advances in Applied Probability, 6: , [7] W.L. Smith. Regenerative stochastic processes. Proceedings of the Royal Society of London. Series A, Mathematical and Physical Sciences, 232:6 31, [8] A. Spătaru. A CLT for renewal processes with a finite set of interarrival distributions. Statistics and Probability Letters, 8: , 21. [9] W. Whitt. Stochastic Process Limits. Springer, 22. 7