arxiv: v1 [math.pr] 3 Dec 2015

Size: px
Start display at page:

Download "arxiv: v1 [math.pr] 3 Dec 2015"

Transcription

1 BRIDGES OF MARKOV COUNTING PROCESSES: QUANTITATIVE ESTIMATES GIOVANNI CONFORTI CONTENTS arxiv:52.8v [math.pr] 3 Dec 25 Introduction. Marov Counting processes and their bridges 2.. Duality formula for the bridge of a Marov counting process 2 2. Quantitative estimates Convexity and concavity in time of the mean value Estimates for the marginals Law of large numbers 4 3. Proofs of the results 5 Proof of Theorem 2. 5 Proof of Theorem Proof of Theorem References ABSTRACT. In this paper we investigate the behavior of the bridges of a Marov counting process in several directions. We first characterize convexity(concavity in time of the mean value in terms of lower (upper bounds on the so called reciprocal characteristics. This result gives a natural criterion to determine whether bridges are lazy or hurried. Under the hypothesis of global bounds on the reciprocal characteristics we prove sharp estimates for the marginal distributions and a comparison theorem for the jump times. When the height of the bridge tends to infinity we show the convergence to a deterministic curve, after a proper rescaling. INTRODUCTION Counting processes are among the simplest stochastic processes but still feature a very broad set of applications in social sciences and engineering, see [],[3],[7]. Moreover, some of the prototypes of jump processes, such as the Poisson processes, fall into this class, and the development of a stochastic calculus adjusted to these (and more general pure jump processes led to important contributions, see [2],[8],[]. In this paper we give a new criterion which allows to quantify the behavior of the bridges of a Marov counting process. One of the most popular interpretations is that counting processes model the number of people arriving in a line. Using this interpretation, our aim is to find robust and easy-to-chec conditions on the intensity of the counting process under which we can pull out quantitative information on the conditional distribution of the i-th arrival time, or on how many customers have arrived by time t, given that n customers arrived in a day. Despite the simplicity of the non pinned dynamics, bridges tend to be more complicated to study because their jump intensity is time-dependent and not explicit, but depends on the solution to a Kolmogorov-type equation, which is in general not available. Moreover, jump intensities and bridges are not in one-to one correspondence, in the sense that different counting processes give raise to the same family of bridges. A well nown example of this is the fact that all Poisson processes, independently from their jump intensity, have identical bridges. Good estimates have to tae into account only those features of the jump intensity which play an effective role in the construction of bridges. Our answers are inspired by the theory of reciprocal processes, which provides the main computational tool: the so called reciprocal characteristics. They should be thought at some invariants associated with bridges. Reciprocal characteristics have been first discovered for diffusions in [9] and are by now available for a much larger class of processes, including several classes of jump processes, see e.g.[5]. However, to the best of our nowledge, it is for the first time in this note that such invariants are used to mae quantitative estimates on the behavior of bridges. As a by product of our analysis we also obtain a natural way of defining when a counting process has lazy bridges, meaning that most customers tend to arrive at the end of the day. Date: November 23,25. 2 Mathematics Subject Classification. 6J27,6J75. Key words and phrases. bridges, counting processes, duality formula, tail estimates.

2 2 GIOVANNI CONFORTI It is interesting to remar that, since counting processes are among the building blocs for general queuing models, our results might open the way for a detailed quantitative study of queuing model under partial information, such as the final state of the queue. The paper is organized as follows: in Section we recall some basics about Marov counting processes and recall some results which we are going to use later on. In Section 2 we present our main results,theorem 2., Theorem 2.2, and Theorem 2.3. In Section 3 we mae their proofs.. MARKOV COUNTING PROCESSES AND THEIR BRIDGES The sample path space Ω of the counting processes consists of all càdlàg step functions with finitely many jumps with amplitude + and an initial value in N, from which we exclude paths which jumps either in t = or t =. The space of probability measures over Ω is denoted P(Ω. Any path ω Ω is described by the collection (x; t,..., t n of its initial position x N and its n = ω ω instants of jumps < t < < t n <. We denote T i (ω := t i the i-th instant of jump of ω. The canonical process is denoted by X = (X t t, and we call counting process any probability law on Ω Any counting process P admits an almost surely unique increasing process A : [, ] Ω R + such that P (A( = = and t X t X A(t is a local P -martingale, (see Jacod [8, Thm. 2.], for instance. A characterizes the dynamics of P, and it is called the compensator. When the compensator is absolutely continuous, we call its derivative the intensity of P. We consider Marov counting processes, meaning that the intensity depends only on time and the current state. We assume that the jump intensity l : [, ] N R + satisfies the following: i For all z N, t l(t, z is continuously differentiable in [, ]. ii The function [, ] N t, z [, ], z l(t, z+ l(t, z is globally upper and lower bounded. iii For all z N, t [, ], l(t, z >. From now on, a reference counting process P with intensity satisfying i,ii,iii and whose initial measure has full support is fixed. In the rest of the paper whenever we refer to the intensity of a Marov counting process, we always assume that it satisfies i,ii, and iii even if we do not specify it. i,ii ensure existence and non-explosion of the process, (for the non explosion part, see [, Theorem 2.3.2], while iii ensures that bridges are well defined between any pair of states x, y with x y. We denote by Psu xy the xy bridge between s and u. Psu xy ( := P ( X s = x, X u = y When s =, u = we simply write P xy. We will call u s the length of the bridge whereas y x is the height of the bridge. Moreover, for any s [, ], x N we define P x s ( = P ( X s = x Expectation under P is denoted E P. E P xy su and E P xy,e P x s are defined analogously... Duality formula for the bridge of a Marov counting process. The reciprocal characteristic is a map Ξ l : N [, ] R derived from the intensity of P, which encodes all the necessary and sufficient information on l to construct the family of bridges {Psu xy } x y N,s u. It is defined as : { t log l(t, z + l(t, z + l(t, z, if l(t, z Ξ l (t, z :=, if l(t, z = A short-time probabilistic interpretation of Ξ l can be found in a larger generality in [5, Theorem 2.6]: it describes the asymptotic distribution of jump times in a bridge whose time length is very short. It is part of this paper to extract quantitative bounds in a non asymptotic time scale. At this point, it is worth recalling a duality formula proved in [6], building on earlier wor in [4], characterizing the bridges of P, as we are going to use it in the proofs. To streamline the presentation, we omit some minor details. For precise statements we refer to [6, Theorem 2.2]. The duality formula is an integration by parts formula on the path space Ω which puts in relation a derivative operator with a stochastic integral operator. The derivative operator acts on test functions Φ : Ω R of the form: Φ = ϕ ( X ; T,..., T m, m, ϕ : N [, ] m R where ϕ is such that for all x Z, the partial functions ϕ(x; are C -differentiable. The directions of differentiation are given by the set of periodic functions U = { u C ([, ]; R : u( = u( = } In the definition of the reciprocal characteristic we allowed for l(t, z =, which was excluded by our hypothesis iii. This is because in the proof of Theorem 2. we will consider the reciprocal characteristics of the intensities of the bridges of P, which fail to satisfy iii. However, the reference intensity l always satisfies this condition

3 BRIDGES OF MARKOV COUNTING PROCESSES: QUANTITATIVE ESTIMATES 3 The derivative operator acts as follows on a test function Φ: m D u Φ = tj ϕ(x ; T,..., T m u(t j ( After recalling that the stochastic integral f(t, X t dx t is, as usual, T f(t i< i, X T we can state i the formula. Theorem.. Let P be a counting process of intensity l. Then P xy is the only element of P(Ω such that P xy (X = x, X = y = and ( [ E P xy(d u Φ = E P xy Φ u(t + Ξl (t, X t u(t ] dx t (2 holds for any test function Φ and any u U. 2. QUANTITATIVE ESTIMATES 2.. Convexity and concavity in time of the mean value. Our first result is the equivalence between global bounds on Ξ l and the convexity/concavity of the mean value, as a function of time. Theorem 2.. Let P be a counting process. If inf Ξ l(t, z, t [,],z N then for all s u and for all x y N the function [s, u] t E P xy su (X t is convex. Conversely, if sup Ξ l (t, z, t [,],z N then for all s u, and for all x y N the function [s, u] t E P xy su (X t is concave. Thans to this result, it maes sense to say that the bridges of a counting process are lazy when Ξ l is a non negative function. Indeed, using the interpretation that X t counts the number of arrivals of customers, Theorem 2. states that, on average, customers arrive at a slow rate at the beginning of the day, and this rate always increases over time in order to match the information that y x customers arrived in the whole day: hence arrivals are concentrated towards the end of the day. In particular, at time t, one expects to have observed less than n t arrivals, ad the curve [, ] t E P xy(x t lies below the straight line between x and y. On the contrary, if Ξ l is non-positive we can say that bridges are hurried. Customers arrive very quicly at the beginning, and the graph of [, ] t E P xy(x t lies above the straight line between x and y. The arrival of customers has to slow down as time grows (concavity, due to the constraint that y x customers, and not more, have to be arrived at the end of the day. We refer to Figure for an illustration of these concepts Estimates for the marginals. Next result turns the qualitative statement of Theorem 2. into a quantitative one. We start from the observation that there are three main families of Marov counting processes such that Ξ l is a time-space constant function: The Poisson processes, i.e. l(t, z α >. Regardless of the value of α, their bridges are neither lazy nor hurried. The average rate which customers arrive is constantly equal to y x. Marov counting processes with time homogeneous and space linear rates, i.e. l(t, z = λz + α for some λ, α >. The space-homogeneous counting processes with exponential rate, i.e. l(t, z = α exp(λt, for some λ R, α >. Their bridges may be lazy or hurried, depending on whether λ is positive or not. For this ind of models all sort of explicit computations are possible: we will use them as a benchmar in the next theorem. As we will see in Lemma 3.3, the marginal at time t of the xy bridge of a process with Ξ l λ is a binomial distribution whose parameters are determined by λ, x, y and t. This is a generalization of the well nown fact that marginals of Poisson bridges are binomial distributions. We mae use of this explicit computation to provide estimates for the case when the marginal distributions are not nown in closed form. We shall see that if Ξ l admits a non negative lower bound, say λ, then any bridge of P has marginals which have lighter tails than the marginals of the same bridge built from a process satisfying Ξ l λ. Therefore we prove that the tails are lighter than the tails of a certain binomial law. In this sense, Theorem 2.2 strengthens the definition of lazy bridge, giving a parameter to measure quantitatively such laziness, and creating a partial order in the family of processes with lazy bridges. All statements can be reversed when lower bounds become upper bounds.

4 4 GIOVANNI CONFORTI To state the Theorem, some notation is needed: we denote by B n,p the binomial distribution associated with n trials and probability of success p. ( n n, B n,p ( = p ( p n We define for all λ R the function π λ : [, ] [, ] as π λ (t = exp(λt exp(λ Theorem 2.2. Let P be a counting process of intensity l, x y N. If for some λ R, then for i y x and t [, ]: inf Ξ l(t, z λ (4 t [,],x z y P xy (X t x + i B y x,πλ (t({i,., y x} Conversely, if for some λ R, sup Ξ l (t, z λ t [,],x z y then for any i y x and t [, ]: P xy (X t x + i B y x,πλ (t({i,., y x} Remar 2.. The inequalities we obtain in this Theorem are equalities when Ξ l (t, z λ (see Lemma 3.3, and therefore are sharp. A simple consequence of Theorem 2.2 is the following mean value estimate. Corollary 2.. Let P be a counting process of intensity l, x y N. If then for any x y and t [, ]: inf Ξ l(t, z λ t [,],z N E P xy(x t x + (y x exp(λt exp(λ 2.3. Law of large numbers. Here, we prove an asymptotic result under the hypothesis that the Ξ l (t, z converges as z + to λ R. We will see that as n +, the bridge of length one between and n, after a suitable rescaling, converges to the deterministic curve t π λ (t (see Figure. Theorem 2.3. Let P be a Marov counting process of intensity l. Assume that for some λ R: Then for every ε > : lim lim P N N + sup z + t [,] t [,] Ξ l (t, z λ = (5 ( sup N X t π λ (t ε = (3

5 BRIDGES OF MARKOV COUNTING PROCESSES: QUANTITATIVE ESTIMATES Λ 5 Λ 3 Λ Λ 3 Λ t FIGURE. Top: We plot for λ { 5, 3,, 3, 5} the function t E P,2(X t, where the intensity l of P satisfies Ξ l λ. For negative values of λ we have a concave function, whereas for positive values a convex one. Moreover, we see that, as a function of λ, E P,2(X t is decreasing. Bottom: A sample path of a lazy bridge (λ = 3: it displays very little activity close to zero: almost all jump times accumulate around t =. 3. PROOFS OF THE RESULTS Proof of Theorem 2.. The proof of Theorem 2. builds on the earlier results of [6] and on Lemma 3.below. There, we prove the statement under P instead of P xy. Unless in the rest of the paper, we do not assume l to satisfy point iii in the proof of this theorem. This is because we will eventually apply it to a bridge P xy, whose intensity does not satisfy this condition. Lemma 3.. Let P be a Marov counting process of intensity l. Then inf Ξ l(t, z t [,],z N

6 6 GIOVANNI CONFORTI if and only if for all s, x [, ] N the function [s, ] t E P x s (X t is convex. Conversely, sup Ξ l (t, z t [,],z N if and only if for all s, x [, ] N the function [s, ] t E P x s (X t is concave. Proof. We only prove the convexity statement, the other being analogous. ( Fix s [, ], x N and define ϕ t := E P x s (X t for t [s, ]. Differentiating twice we obtain: ϕ t = E P x s (l(t, X t ϕ t = E P x s ( t l(t, X t + (l(t, X t + l(t, X t l(t, X t = E P x s (Ξ l (t, X t l(t, X t {l(t,xt >} + t l(t, X t {l(t,xt =} Since l(s, z is continuously differentiable and for all t [, ] P (X t X t =, we have that, for a fixed t, l(t, X t = a.s. implies that t l(t, X t =. Therefore by definition of Ξ l we have for all t: E P x s ( t l(t, X t {l(t,xt =} = E P x s ( {l(t,xt =} = E P x s (Ξ l (t, X t l(t, X t {l(t,xt =} and therefore: ϕ t = E P x s (Ξ l (t, X t l(t, X t If inf t,z Ξ l (t, z, we then have ϕ t, which gives the convexity. ( Consider s [, ],x N such that l(s, x > (note that if l(s, x =, Ξ l (s, x = and there is nothing to prove. Then, defining ϕ as above and repeating the same computations we obtain, by evaluating the second derivative at s, and exploiting the fact that X s = x almost surely: ϕ s = Ξ l (s, xl(s, x Since ϕ s by assumption and l(s, x >, then Ξ l (s, x. Because of the arbitrary choice of s and x the conclusion follows. The proof of Theorem 2. becomes now almost straightforward. Proof. We exploit the fact Psu xy is also a counting process whose intensity l x,y s,u(t, z is continuously differentiable on [, N and satisfies: Ξ l x,y(t, z = s,u { Ξ l (t, z, if x z y, < t <, otherwise This is proven in [6, Theorem.]. An application of Lemma 3. gives then the conclusion. Proof of Theorem 2.2. Prior to the proof, we introduce some useful notation which simplifies many computations therein. We call n := y x the total number of jumps that the xy bridge maes. Moreover, we adopt the following conventions: For (t,.., t n [, ] n we adopt the compact notation t. For any i n the vector (t i,.., t is denoted t i,. For i n, s r, we call s,r i, the set : s,r i, := {(t i,..., t [, ] i+ : s < t i < t i+ <.. < t < r} When s =, r =, i =, = n, we simply write n. For any j n we define ξ j : [, ] R as the only primitive of t Ξ l (t, x + j such that ξ j ( =. We then define ξ : n R, ξ(t = ξ j (t j We also define for all i n: ξ i, (t i, = ξ j (t j The proof is structured as follows: we first prove two Lemmas, Lemma 3.2 Lemma 3.3, which contain the two main ingredients of the proof. Then we do the proof of Theorem 2.2, relying on the more technical Lemma 3.4, which is proven later, together with the simple auxiliary Lemma 3.5. Lemma 3.2. The distribution of jump times (T,.., T n under P xy is given by: A n, P xy (T,.., T n A = exp ( ξ(t dt (6 Z l j=i A

7 BRIDGES OF MARKOV COUNTING PROCESSES: QUANTITATIVE ESTIMATES 7 Proof. For convenience, we denote the vector (T,.., T n by T. Let us define the probability measure Q P(Ω by: dq = Z l exp(ξ(tdr xy where R xy is the Poisson bridge from x to y. Thans to the duality formula (2, the Poisson bridge is characterized by: ( Φ, u U, E R xy(d u Φ = E R xy Φ u(t dx t (7 Consider now a test function Φ, using the duality formula (2 and the fact that D u is a true derivative operator satisfying Leibniz s product rule: ( E Q (D u Φ = E R xy exp(ξ(t D u Φ ( [ ] [ ] = E R xy D u exp(ξ(t Φ E R xy (Φ D u exp(ξ(t = }{{} eq. (7+eq.( E R xy = E Q (Φ ( exp(ξ(tφ u(tdx t + E R xy [ u(t + Ξl (t, X t u(t ] dx t ( Φ exp(ξ(t tj ξ(t }{{} =Ξ l (T j,x T j u(t j An application of Theorem. allows to deduce that Q = P xy. Therefore, the density of P xy T with respect to R xy T is proportional to exp(ξ(t. It is well nown that R xy T is the normalized Lebesgue measure on n. The conclusion then follows. Let us compute explicitly the distribution of the jump times of a bridge of a counting process such that Ξ l is constantly equal to λ. Lemma 3.3. Let P be a counting process of intensity l, x y N. Let l be such that for some λ R : t [, ], x z y, Ξ l (t, z = λ Then, for all t [, ], i y x we have that the law of X t x is B y x,πλ (t, where π λ (t is defined by (3. Proof. As a direct consequence of Lemma 3.2 combined with the current hypothesis we have: P xy (X t x + ip xy (T i t = exp(λ t j dt (8 Z λ n {t i t} where Z λ is a normalization constant. Thans to the invariance of the integrand under permutations we have: exp ( λ t j dt = Z λ n {t i t} (exp(λ n exp(λ t j dt (9 A with A := σ S n {t : t σ( <.. < t σ(n, t σ(i t} where S n is the symmetric group with n elements. We can rewrite A in a convenient way, using some simple combinatorial arguments. We have: A := {t [, ] n s.t. {j : t j t} i} But then the right hand side of (9 is nothing but the probability that at least i among n i.i.d. random variables are less than t, each variable being supported on [, ] and having a density proportional to exp(λs. The conclusion then follows after a simple calculation. We can now prove Theorem 2.2. Proof. Because of Lemma 3.2 and Lemma 3.3, and the elementary fact that {X t x + i} = {T i t}, all what we need to do is to prove that for all i n, t : exp(ξ(tdt exp ( λ t j dt ( Z l Z λ t n {t i t} where Z l, Z λ are normalization constants. t n {t i t}

8 8 GIOVANNI CONFORTI To this aim, we define the function ρ : [, ] R + by: t ρ(r := exp(ξ(tdt n {t i r} t exp ( n {t i r} λ n t j dt Observing that ρ( = Z l Z λ, ( is equivalent to ρ(t ρ(, and therefore it is sufficient to prove that ρ is non decreasing. For this, we rewrite ρ(t in a convenient way, by conditioning on the value of t i : r ρ(r = p(sds r q(sds ( with: p(s := q(s := t n {t i=s} = exp(ξ i (s t n {t i=s} exp ( ξ(t dt dt i,n,s = exp(λs,s,s exp ( λ exp ( ξ (t dt t j dt dt i+,n exp ( i λ t j dt s, i+,n s, i+,n exp ( λ exp ( ξ i+,n (t i+,n dt i+,n j=i+ t j dti+,n Let us first show that p/q(s is non decreasing. Lemma 3.4 ensures that both exp(ξ,s (t dt exp(ξ s exp(λ s, i+,n (t i+,n dt i+,n i+,n i dt and s exp(λ n j=i+ t jdt i+,n s, i+,n are non decreasing in s. Moreover, exp(ξ i (s λs is also increasing in s since ξ i ( = Ξ l (, x + i λ by hypothesis. We have thus shown that p/q(s is non decreasing. By Lemma 3.5 and ( we get that ρ is non decreasing too, and the conclusion follows. Lemma 3.4. The functions and are non decreasing in s. s s,s s, i+,n,s s, i+,n exp(ξ (t dt exp(λ i dt exp(ξ i+,n (t i+,n dt i+,n exp(λ n j=i+ t jdt i+,n Proof. We only prove the first statement, the other case being completely analogous. We wor by induction on i. For the case i = 2, we have to show that s s exp(ξ (t dt s exp(λt dt is non decreasing. The assumption of Theorem 2.2 ensures that ξ (t λt is non decreasing, since λ Ξ l (, x = ξ ( by hypothesis. But then we conclude by applying Lemma 3.5. For the inductive step we rewrite {,s and similarly exp(ξ (t dt =,s i exp(λ s t j dt = exp(ξ i (t i s Using the inductive hypothesis, we have that t i,t i,i 2 exp(λt i,t i 2,t i,i 2,t i,i 2 exp(ξ,i 2 (t,i 2 dt,i 2 } dt i i 2 exp( exp(ξ,i 2 (t,i 2 dt,i 2 exp( i 2 t jdt,i 2 t j dt,i 2 dt i

9 BRIDGES OF MARKOV COUNTING PROCESSES: QUANTITATIVE ESTIMATES 9 is increasing. Moreover, t i exp(ξi (ti exp(λt i is also increasing, since by assumption λ Ξ l (, x+i 2 = ξ i (. The conclusion follows by Lemma 3.5. Lemma 3.5. Let p, q be continuously differentiable strictly positive functions such that p q (s is increasing. Then t t p(sds t q(sds (2 is also increasing. Proof. We differentiate 2 in t. We obtain: [ ( t q(sds 2 p(t t q(sds q(t We observe that the conclusion follows if we can prove that Since s t, our hypothesis ensures this. s t t p(tq(s q(tp(s ] p(sds Let us prove Corollary 2. Proof. We simply write: E P xy(x t = x + P xy (T i t }{{} i= Recalling that n y x the conclusion follows. i= Th. 2.2 B n,πλ (t(t i t = x + n exp(λt exp(λ. Proof of Theorem 2.3. Theorem 2.2 can be adapted to the case when we consider bridges of non-unitary length. The proof is basically identical, and we do not include it here. However, we will need this fact. The only difference from Theorem 2.2 is that we allow for initial and final times (s, u of the bridge to be different from (,. Proposition 3.. Let P be a counting process of intensity l, x y N and s < u. If for some λ R, then for i y x and t [s, u]: where inf Ξ l(t, z λ t [s,u],x z y P xy su (X t x + i B y x,π s,u λ (t ({i,., y x} (3 π s,u exp(λ(t s λ (t = exp(λ(u s Given the proposition, we can prove Theorem 2.3 Proof. Fix ε > and 2 ε sup t [,] t π λ (t. We show that: { } { A := sup j N X j π λ ( j n ε 2 Indeed, assume that X A and tae t [, ]. Then t [ j, j+ fact that both N X and π λ ( are non decreasing functions we have: Since X A we have: N X t π λ (t max N X j+ π λ ( j = N X j+ π λ ( j + { N X j+ + π λ( j + sup t [,] N X t π λ (t ε } := B ] for some j. Because of the π λ ( j, π λ( j + N X j π λ( j ε 2 + sup t π(λ, t ε t where the last inequality is justified by the choice of. In the same way one shows that π λ ( j+ N X j ε. Since t can be chosen arbitrarily in [, ], we have shown that A B. Because of this, to prove the theorem, it is sufficient to prove that for any finite collection (t,.., t and any ε > we have: lim P,N ( sup N + l N X t l π λ (t l ε = }

10 GIOVANNI CONFORTI Moreover, since we want to prove convergence to a deterministic limit, it suffices to consider one-time marginals. All we need to show is that for all t [, ], ε ( lim P,N N + N X t π λ (t ε = Fix now t [, ], ε >, and choose δ > small enough such that Because of the assumption (5, there exist such that for all z π λ (t + ε π(λ δ, t (4 sup Ξ l (s, z λ δ. (5 s [,] We choose one such. Let us observe that, if N is large enough we have { } N X t π λ (t ε {T t} (6 Using the Marov property we have, by conditioning on T and using (6: ( ( ( P,N N X t π λ (t ε = E P,N E,N P { N Xt π λ(t ε} T {T t} ( ( = E P,N P,N T, N X t π λ (t ε {T t} ( sup P,N s, s [,t] N X t π λ (t ε Thans to our choice of, see (5, we are entitled to apply Proposition 3.. We get: ( sup P,N s, s [,t] N X t π λ (t ε sup B N,π s, (t({n(π λ(t + ε /N,.., N } λ δ s [,t] }{{} :=ξ n Since π s, λ δ (t is decreasing in s, we have: sup B N,π s, (t(nξ n, N = B N,πλ δ (t(nξ n, N λ δ s [,] With an application of the Law of large numbers, we have that, as N goes to infinity: B N,πλ δ (t(na δ πλ δ (t(a, A [, ] Therefore lim N + B N,πλ δ (t(nξ n, N = if lim inf N + ξ N > π λ δ (t. But this is ensured by our choice of δ, see (4. Therefore we have proven that lim N + P,N ( N X t π λ (t ε =. With a similar argument one shows that lim N + P,N ( N X t π λ (t ε =, from which the conclusion follows. REFERENCES [] P.K. Andersen, O. Borgan, R.Gill, and N. Keiding. Statistical models based on counting processes. Springer Science and Business Media, 22. [2] P. Brémaud. The martingale theory of point processes over the real half line admitting an intensity. In A. Bensoussan and J.L. Lions, editors, Control Theory, Numerical Methods and Computer Systems Modelling, volume 7 of Lecture Notes in Economics and Mathematical Systems, pages Springer, 975. [3] P. Brémaud. Marov chains: Gibbs fields, Monte Carlo simulation, and queues, volume 3. Springer Science & Business Media, 23. [4] E.A. Carlen and E. Pardoux. Differential calculus and integration by parts on Poisson space. In S. Albeverio, Ph. Blanchard, and D. Testard, editors, Stochastics, Algebra and Analysis in Classical and Quantum Dynamics, volume 59 of Mathematics and Its Applications, pages Springer, 99. [5] G. Conforti and C. Léonard. Reciprocal classes of a random wal on graphs. Preprint arxiv: [6] G. Conforti, C. Léonard, R. Murr, and S. Roelly. Bridges of Marov counting processes. Reciprocal classes and duality formulas. Electron. Commun. Probab., 2: 2, 25. [7] T.R. Fleming and D.P. Harrington. Counting Processes and Survival Analysis. Wiley Series in Probability and Statistics. Wiley, 2. [8] J. Jacod. Multivariate point processes: predictable projection, Radon-Niodym derivatives, representation of martingales. Zeitschrift für Wahrscheinlicheitstheorie und Verwandte Gebiete, 3(3: , 975. [9] A. J. Krener. Reciprocal diffusions and stochastic differential equations of second order. Stochastics, 7(4: , 988. [] J.R. Norris. Marov Chains. Cambridge series in statistical and probabilistic mathematics. Cambridge University Press, 999. [] S. Watanabe. On discontinuous additive functionals and Lévy measures of a Marov process. Japanese journal of Mathematics, 964. UNIVERSITÄT LEIPZIG, FAKULTÄT FÜR MATHEMATIK UND INFORMATIK, AUGUSTUSPLATZ, 49 LEIPZIG, GERMANY address: giovanniconfort@gmail.com

Point Process Control

Point Process Control Point Process Control The following note is based on Chapters I, II and VII in Brémaud s book Point Processes and Queues (1981). 1 Basic Definitions Consider some probability space (Ω, F, P). A real-valued

More information

Filtrations, Markov Processes and Martingales. Lectures on Lévy Processes and Stochastic Calculus, Braunschweig, Lecture 3: The Lévy-Itô Decomposition

Filtrations, Markov Processes and Martingales. Lectures on Lévy Processes and Stochastic Calculus, Braunschweig, Lecture 3: The Lévy-Itô Decomposition Filtrations, Markov Processes and Martingales Lectures on Lévy Processes and Stochastic Calculus, Braunschweig, Lecture 3: The Lévy-Itô Decomposition David pplebaum Probability and Statistics Department,

More information

STAT 331. Martingale Central Limit Theorem and Related Results

STAT 331. Martingale Central Limit Theorem and Related Results STAT 331 Martingale Central Limit Theorem and Related Results In this unit we discuss a version of the martingale central limit theorem, which states that under certain conditions, a sum of orthogonal

More information

UPPER DEVIATIONS FOR SPLIT TIMES OF BRANCHING PROCESSES

UPPER DEVIATIONS FOR SPLIT TIMES OF BRANCHING PROCESSES Applied Probability Trust 7 May 22 UPPER DEVIATIONS FOR SPLIT TIMES OF BRANCHING PROCESSES HAMED AMINI, AND MARC LELARGE, ENS-INRIA Abstract Upper deviation results are obtained for the split time of a

More information

Functional Limit theorems for the quadratic variation of a continuous time random walk and for certain stochastic integrals

Functional Limit theorems for the quadratic variation of a continuous time random walk and for certain stochastic integrals Functional Limit theorems for the quadratic variation of a continuous time random walk and for certain stochastic integrals Noèlia Viles Cuadros BCAM- Basque Center of Applied Mathematics with Prof. Enrico

More information

Introduction to self-similar growth-fragmentations

Introduction to self-similar growth-fragmentations Introduction to self-similar growth-fragmentations Quan Shi CIMAT, 11-15 December, 2017 Quan Shi Growth-Fragmentations CIMAT, 11-15 December, 2017 1 / 34 Literature Jean Bertoin, Compensated fragmentation

More information

Brownian Motion. 1 Definition Brownian Motion Wiener measure... 3

Brownian Motion. 1 Definition Brownian Motion Wiener measure... 3 Brownian Motion Contents 1 Definition 2 1.1 Brownian Motion................................. 2 1.2 Wiener measure.................................. 3 2 Construction 4 2.1 Gaussian process.................................

More information

STAT Sample Problem: General Asymptotic Results

STAT Sample Problem: General Asymptotic Results STAT331 1-Sample Problem: General Asymptotic Results In this unit we will consider the 1-sample problem and prove the consistency and asymptotic normality of the Nelson-Aalen estimator of the cumulative

More information

Markov processes and queueing networks

Markov processes and queueing networks Inria September 22, 2015 Outline Poisson processes Markov jump processes Some queueing networks The Poisson distribution (Siméon-Denis Poisson, 1781-1840) { } e λ λ n n! As prevalent as Gaussian distribution

More information

Lecture 6 Random walks - advanced methods

Lecture 6 Random walks - advanced methods Lecture 6: Random wals - advanced methods 1 of 11 Course: M362K Intro to Stochastic Processes Term: Fall 2014 Instructor: Gordan Zitovic Lecture 6 Random wals - advanced methods STOPPING TIMES Our last

More information

Poisson Processes. Stochastic Processes. Feb UC3M

Poisson Processes. Stochastic Processes. Feb UC3M Poisson Processes Stochastic Processes UC3M Feb. 2012 Exponential random variables A random variable T has exponential distribution with rate λ > 0 if its probability density function can been written

More information

arxiv:math/ v4 [math.pr] 12 Apr 2007

arxiv:math/ v4 [math.pr] 12 Apr 2007 arxiv:math/612224v4 [math.pr] 12 Apr 27 LARGE CLOSED QUEUEING NETWORKS IN SEMI-MARKOV ENVIRONMENT AND ITS APPLICATION VYACHESLAV M. ABRAMOV Abstract. The paper studies closed queueing networks containing

More information

Poisson random measure: motivation

Poisson random measure: motivation : motivation The Lévy measure provides the expected number of jumps by time unit, i.e. in a time interval of the form: [t, t + 1], and of a certain size Example: ν([1, )) is the expected number of jumps

More information

An essay on the general theory of stochastic processes

An essay on the general theory of stochastic processes Probability Surveys Vol. 3 (26) 345 412 ISSN: 1549-5787 DOI: 1.1214/1549578614 An essay on the general theory of stochastic processes Ashkan Nikeghbali ETHZ Departement Mathematik, Rämistrasse 11, HG G16

More information

Introduction to Queuing Networks Solutions to Problem Sheet 3

Introduction to Queuing Networks Solutions to Problem Sheet 3 Introduction to Queuing Networks Solutions to Problem Sheet 3 1. (a) The state space is the whole numbers {, 1, 2,...}. The transition rates are q i,i+1 λ for all i and q i, for all i 1 since, when a bus

More information

1 Generating functions

1 Generating functions 1 Generating functions Even quite straightforward counting problems can lead to laborious and lengthy calculations. These are greatly simplified by using generating functions. 2 Definition 1.1. Given a

More information

Solving the Poisson Disorder Problem

Solving the Poisson Disorder Problem Advances in Finance and Stochastics: Essays in Honour of Dieter Sondermann, Springer-Verlag, 22, (295-32) Research Report No. 49, 2, Dept. Theoret. Statist. Aarhus Solving the Poisson Disorder Problem

More information

Logarithmic scaling of planar random walk s local times

Logarithmic scaling of planar random walk s local times Logarithmic scaling of planar random walk s local times Péter Nándori * and Zeyu Shen ** * Department of Mathematics, University of Maryland ** Courant Institute, New York University October 9, 2015 Abstract

More information

SMSTC (2007/08) Probability.

SMSTC (2007/08) Probability. SMSTC (27/8) Probability www.smstc.ac.uk Contents 12 Markov chains in continuous time 12 1 12.1 Markov property and the Kolmogorov equations.................... 12 2 12.1.1 Finite state space.................................

More information

Figure 10.1: Recording when the event E occurs

Figure 10.1: Recording when the event E occurs 10 Poisson Processes Let T R be an interval. A family of random variables {X(t) ; t T} is called a continuous time stochastic process. We often consider T = [0, 1] and T = [0, ). As X(t) is a random variable

More information

Bivariate Uniqueness in the Logistic Recursive Distributional Equation

Bivariate Uniqueness in the Logistic Recursive Distributional Equation Bivariate Uniqueness in the Logistic Recursive Distributional Equation Antar Bandyopadhyay Technical Report # 629 University of California Department of Statistics 367 Evans Hall # 3860 Berkeley CA 94720-3860

More information

Lecture 22 Girsanov s Theorem

Lecture 22 Girsanov s Theorem Lecture 22: Girsanov s Theorem of 8 Course: Theory of Probability II Term: Spring 25 Instructor: Gordan Zitkovic Lecture 22 Girsanov s Theorem An example Consider a finite Gaussian random walk X n = n

More information

2. The averaging process

2. The averaging process 2. The averaging process David Aldous July 10, 2012 The two models in lecture 1 has only rather trivial interaction. In this lecture I discuss a simple FMIE process with less trivial interaction. It is

More information

IEOR 6711: Stochastic Models I, Fall 2003, Professor Whitt. Solutions to Final Exam: Thursday, December 18.

IEOR 6711: Stochastic Models I, Fall 2003, Professor Whitt. Solutions to Final Exam: Thursday, December 18. IEOR 6711: Stochastic Models I, Fall 23, Professor Whitt Solutions to Final Exam: Thursday, December 18. Below are six questions with several parts. Do as much as you can. Show your work. 1. Two-Pump Gas

More information

µ X (A) = P ( X 1 (A) )

µ X (A) = P ( X 1 (A) ) 1 STOCHASTIC PROCESSES This appendix provides a very basic introduction to the language of probability theory and stochastic processes. We assume the reader is familiar with the general measure and integration

More information

Part I Stochastic variables and Markov chains

Part I Stochastic variables and Markov chains Part I Stochastic variables and Markov chains Random variables describe the behaviour of a phenomenon independent of any specific sample space Distribution function (cdf, cumulative distribution function)

More information

LARGE DEVIATIONS OF TYPICAL LINEAR FUNCTIONALS ON A CONVEX BODY WITH UNCONDITIONAL BASIS. S. G. Bobkov and F. L. Nazarov. September 25, 2011

LARGE DEVIATIONS OF TYPICAL LINEAR FUNCTIONALS ON A CONVEX BODY WITH UNCONDITIONAL BASIS. S. G. Bobkov and F. L. Nazarov. September 25, 2011 LARGE DEVIATIONS OF TYPICAL LINEAR FUNCTIONALS ON A CONVEX BODY WITH UNCONDITIONAL BASIS S. G. Bobkov and F. L. Nazarov September 25, 20 Abstract We study large deviations of linear functionals on an isotropic

More information

1 Lyapunov theory of stability

1 Lyapunov theory of stability M.Kawski, APM 581 Diff Equns Intro to Lyapunov theory. November 15, 29 1 1 Lyapunov theory of stability Introduction. Lyapunov s second (or direct) method provides tools for studying (asymptotic) stability

More information

Information and Credit Risk

Information and Credit Risk Information and Credit Risk M. L. Bedini Université de Bretagne Occidentale, Brest - Friedrich Schiller Universität, Jena Jena, March 2011 M. L. Bedini (Université de Bretagne Occidentale, Brest Information

More information

6. Brownian Motion. Q(A) = P [ ω : x(, ω) A )

6. Brownian Motion. Q(A) = P [ ω : x(, ω) A ) 6. Brownian Motion. stochastic process can be thought of in one of many equivalent ways. We can begin with an underlying probability space (Ω, Σ, P) and a real valued stochastic process can be defined

More information

arxiv: v1 [math.pr] 1 Jan 2013

arxiv: v1 [math.pr] 1 Jan 2013 The role of dispersal in interacting patches subject to an Allee effect arxiv:1301.0125v1 [math.pr] 1 Jan 2013 1. Introduction N. Lanchier Abstract This article is concerned with a stochastic multi-patch

More information

NOTES ON EXISTENCE AND UNIQUENESS THEOREMS FOR ODES

NOTES ON EXISTENCE AND UNIQUENESS THEOREMS FOR ODES NOTES ON EXISTENCE AND UNIQUENESS THEOREMS FOR ODES JONATHAN LUK These notes discuss theorems on the existence, uniqueness and extension of solutions for ODEs. None of these results are original. The proofs

More information

IEOR 6711, HMWK 5, Professor Sigman

IEOR 6711, HMWK 5, Professor Sigman IEOR 6711, HMWK 5, Professor Sigman 1. Semi-Markov processes: Consider an irreducible positive recurrent discrete-time Markov chain {X n } with transition matrix P (P i,j ), i, j S, and finite state space.

More information

Synchronized Queues with Deterministic Arrivals

Synchronized Queues with Deterministic Arrivals Synchronized Queues with Deterministic Arrivals Dimitra Pinotsi and Michael A. Zazanis Department of Statistics Athens University of Economics and Business 76 Patission str., Athens 14 34, Greece Abstract

More information

March 1, Florida State University. Concentration Inequalities: Martingale. Approach and Entropy Method. Lizhe Sun and Boning Yang.

March 1, Florida State University. Concentration Inequalities: Martingale. Approach and Entropy Method. Lizhe Sun and Boning Yang. Florida State University March 1, 2018 Framework 1. (Lizhe) Basic inequalities Chernoff bounding Review for STA 6448 2. (Lizhe) Discrete-time martingales inequalities via martingale approach 3. (Boning)

More information

Mean-field dual of cooperative reproduction

Mean-field dual of cooperative reproduction The mean-field dual of systems with cooperative reproduction joint with Tibor Mach (Prague) A. Sturm (Göttingen) Friday, July 6th, 2018 Poisson construction of Markov processes Let (X t ) t 0 be a continuous-time

More information

Asymptotically optimal induced universal graphs

Asymptotically optimal induced universal graphs Asymptotically optimal induced universal graphs Noga Alon Abstract We prove that the minimum number of vertices of a graph that contains every graph on vertices as an induced subgraph is (1+o(1))2 ( 1)/2.

More information

Continuous Time Processes

Continuous Time Processes page 102 Chapter 7 Continuous Time Processes 7.1 Introduction In a continuous time stochastic process (with discrete state space), a change of state can occur at any time instant. The associated point

More information

Riemann integral and volume are generalized to unbounded functions and sets. is an admissible set, and its volume is a Riemann integral, 1l E,

Riemann integral and volume are generalized to unbounded functions and sets. is an admissible set, and its volume is a Riemann integral, 1l E, Tel Aviv University, 26 Analysis-III 9 9 Improper integral 9a Introduction....................... 9 9b Positive integrands................... 9c Special functions gamma and beta......... 4 9d Change of

More information

TAUBERIAN THEOREM FOR HARMONIC MEAN OF STIELTJES TRANSFORMS AND ITS APPLICATIONS TO LINEAR DIFFUSIONS

TAUBERIAN THEOREM FOR HARMONIC MEAN OF STIELTJES TRANSFORMS AND ITS APPLICATIONS TO LINEAR DIFFUSIONS Kasahara, Y. and Kotani, S. Osaka J. Math. 53 (26), 22 249 TAUBERIAN THEOREM FOR HARMONIC MEAN OF STIELTJES TRANSFORMS AND ITS APPLICATIONS TO LINEAR DIFFUSIONS YUJI KASAHARA and SHIN ICHI KOTANI (Received

More information

Putzer s Algorithm. Norman Lebovitz. September 8, 2016

Putzer s Algorithm. Norman Lebovitz. September 8, 2016 Putzer s Algorithm Norman Lebovitz September 8, 2016 1 Putzer s algorithm The differential equation dx = Ax, (1) dt where A is an n n matrix of constants, possesses the fundamental matrix solution exp(at),

More information

Stationary Probabilities of Markov Chains with Upper Hessenberg Transition Matrices

Stationary Probabilities of Markov Chains with Upper Hessenberg Transition Matrices Stationary Probabilities of Marov Chains with Upper Hessenberg Transition Matrices Y. Quennel ZHAO Department of Mathematics and Statistics University of Winnipeg Winnipeg, Manitoba CANADA R3B 2E9 Susan

More information

Quantitative Model Checking (QMC) - SS12

Quantitative Model Checking (QMC) - SS12 Quantitative Model Checking (QMC) - SS12 Lecture 06 David Spieler Saarland University, Germany June 4, 2012 1 / 34 Deciding Bisimulations 2 / 34 Partition Refinement Algorithm Notation: A partition P over

More information

OPTIMAL SOLUTIONS TO STOCHASTIC DIFFERENTIAL INCLUSIONS

OPTIMAL SOLUTIONS TO STOCHASTIC DIFFERENTIAL INCLUSIONS APPLICATIONES MATHEMATICAE 29,4 (22), pp. 387 398 Mariusz Michta (Zielona Góra) OPTIMAL SOLUTIONS TO STOCHASTIC DIFFERENTIAL INCLUSIONS Abstract. A martingale problem approach is used first to analyze

More information

arxiv: v1 [math.pr] 26 Mar 2008

arxiv: v1 [math.pr] 26 Mar 2008 arxiv:0803.3679v1 [math.pr] 26 Mar 2008 The game-theoretic martingales behind the zero-one laws Akimichi Takemura 1 takemura@stat.t.u-tokyo.ac.jp, http://www.e.u-tokyo.ac.jp/ takemura Vladimir Vovk 2 vovk@cs.rhul.ac.uk,

More information

A Simple Solution for the M/D/c Waiting Time Distribution

A Simple Solution for the M/D/c Waiting Time Distribution A Simple Solution for the M/D/c Waiting Time Distribution G.J.Franx, Universiteit van Amsterdam November 6, 998 Abstract A surprisingly simple and explicit expression for the waiting time distribution

More information

LIMITS FOR QUEUES AS THE WAITING ROOM GROWS. Bell Communications Research AT&T Bell Laboratories Red Bank, NJ Murray Hill, NJ 07974

LIMITS FOR QUEUES AS THE WAITING ROOM GROWS. Bell Communications Research AT&T Bell Laboratories Red Bank, NJ Murray Hill, NJ 07974 LIMITS FOR QUEUES AS THE WAITING ROOM GROWS by Daniel P. Heyman Ward Whitt Bell Communications Research AT&T Bell Laboratories Red Bank, NJ 07701 Murray Hill, NJ 07974 May 11, 1988 ABSTRACT We study the

More information

Quitting games - An Example

Quitting games - An Example Quitting games - An Example E. Solan 1 and N. Vieille 2 January 22, 2001 Abstract Quitting games are n-player sequential games in which, at any stage, each player has the choice between continuing and

More information

The Codimension of the Zeros of a Stable Process in Random Scenery

The Codimension of the Zeros of a Stable Process in Random Scenery The Codimension of the Zeros of a Stable Process in Random Scenery Davar Khoshnevisan The University of Utah, Department of Mathematics Salt Lake City, UT 84105 0090, U.S.A. davar@math.utah.edu http://www.math.utah.edu/~davar

More information

ISyE 6761 (Fall 2016) Stochastic Processes I

ISyE 6761 (Fall 2016) Stochastic Processes I Fall 216 TABLE OF CONTENTS ISyE 6761 (Fall 216) Stochastic Processes I Prof. H. Ayhan Georgia Institute of Technology L A TEXer: W. KONG http://wwong.github.io Last Revision: May 25, 217 Table of Contents

More information

Discussion of Hypothesis testing by convex optimization

Discussion of Hypothesis testing by convex optimization Electronic Journal of Statistics Vol. 9 (2015) 1 6 ISSN: 1935-7524 DOI: 10.1214/15-EJS990 Discussion of Hypothesis testing by convex optimization Fabienne Comte, Céline Duval and Valentine Genon-Catalot

More information

Research Reports on Mathematical and Computing Sciences

Research Reports on Mathematical and Computing Sciences ISSN 1342-2804 Research Reports on Mathematical and Computing Sciences Long-tailed degree distribution of a random geometric graph constructed by the Boolean model with spherical grains Naoto Miyoshi,

More information

An introduction to Mathematical Theory of Control

An introduction to Mathematical Theory of Control An introduction to Mathematical Theory of Control Vasile Staicu University of Aveiro UNICA, May 2018 Vasile Staicu (University of Aveiro) An introduction to Mathematical Theory of Control UNICA, May 2018

More information

A NOTE ON STOCHASTIC INTEGRALS AS L 2 -CURVES

A NOTE ON STOCHASTIC INTEGRALS AS L 2 -CURVES A NOTE ON STOCHASTIC INTEGRALS AS L 2 -CURVES STEFAN TAPPE Abstract. In a work of van Gaans (25a) stochastic integrals are regarded as L 2 -curves. In Filipović and Tappe (28) we have shown the connection

More information

Random point patterns and counting processes

Random point patterns and counting processes Chapter 7 Random point patterns and counting processes 7.1 Random point pattern A random point pattern satunnainen pistekuvio) on an interval S R is a locally finite 1 random subset of S, defined on some

More information

Data analysis and stochastic modeling

Data analysis and stochastic modeling Data analysis and stochastic modeling Lecture 7 An introduction to queueing theory Guillaume Gravier guillaume.gravier@irisa.fr with a lot of help from Paul Jensen s course http://www.me.utexas.edu/ jensen/ormm/instruction/powerpoint/or_models_09/14_queuing.ppt

More information

Lecture 10: Semi-Markov Type Processes

Lecture 10: Semi-Markov Type Processes Lecture 1: Semi-Markov Type Processes 1. Semi-Markov processes (SMP) 1.1 Definition of SMP 1.2 Transition probabilities for SMP 1.3 Hitting times and semi-markov renewal equations 2. Processes with semi-markov

More information

Lectures 2 3 : Wigner s semicircle law

Lectures 2 3 : Wigner s semicircle law Fall 009 MATH 833 Random Matrices B. Való Lectures 3 : Wigner s semicircle law Notes prepared by: M. Koyama As we set up last wee, let M n = [X ij ] n i,j= be a symmetric n n matrix with Random entries

More information

Stochastic integration. P.J.C. Spreij

Stochastic integration. P.J.C. Spreij Stochastic integration P.J.C. Spreij this version: April 22, 29 Contents 1 Stochastic processes 1 1.1 General theory............................... 1 1.2 Stopping times...............................

More information

PROBABILITY: LIMIT THEOREMS II, SPRING HOMEWORK PROBLEMS

PROBABILITY: LIMIT THEOREMS II, SPRING HOMEWORK PROBLEMS PROBABILITY: LIMIT THEOREMS II, SPRING 15. HOMEWORK PROBLEMS PROF. YURI BAKHTIN Instructions. You are allowed to work on solutions in groups, but you are required to write up solutions on your own. Please

More information

Ergodic Theorems. Samy Tindel. Purdue University. Probability Theory 2 - MA 539. Taken from Probability: Theory and examples by R.

Ergodic Theorems. Samy Tindel. Purdue University. Probability Theory 2 - MA 539. Taken from Probability: Theory and examples by R. Ergodic Theorems Samy Tindel Purdue University Probability Theory 2 - MA 539 Taken from Probability: Theory and examples by R. Durrett Samy T. Ergodic theorems Probability Theory 1 / 92 Outline 1 Definitions

More information

Recap. Probability, stochastic processes, Markov chains. ELEC-C7210 Modeling and analysis of communication networks

Recap. Probability, stochastic processes, Markov chains. ELEC-C7210 Modeling and analysis of communication networks Recap Probability, stochastic processes, Markov chains ELEC-C7210 Modeling and analysis of communication networks 1 Recap: Probability theory important distributions Discrete distributions Geometric distribution

More information

Introduction to Machine Learning CMU-10701

Introduction to Machine Learning CMU-10701 Introduction to Machine Learning CMU-10701 Markov Chain Monte Carlo Methods Barnabás Póczos & Aarti Singh Contents Markov Chain Monte Carlo Methods Goal & Motivation Sampling Rejection Importance Markov

More information

DS-GA 1002 Lecture notes 2 Fall Random variables

DS-GA 1002 Lecture notes 2 Fall Random variables DS-GA 12 Lecture notes 2 Fall 216 1 Introduction Random variables Random variables are a fundamental tool in probabilistic modeling. They allow us to model numerical quantities that are uncertain: the

More information

STOCHASTIC DIFFERENTIAL EQUATIONS DRIVEN BY PROCESSES WITH INDEPENDENT INCREMENTS

STOCHASTIC DIFFERENTIAL EQUATIONS DRIVEN BY PROCESSES WITH INDEPENDENT INCREMENTS STOCHASTIC DIFFERENTIAL EQUATIONS DRIVEN BY PROCESSES WITH INDEPENDENT INCREMENTS DAMIR FILIPOVIĆ AND STEFAN TAPPE Abstract. This article considers infinite dimensional stochastic differential equations

More information

FULL LIKELIHOOD INFERENCES IN THE COX MODEL

FULL LIKELIHOOD INFERENCES IN THE COX MODEL October 20, 2007 FULL LIKELIHOOD INFERENCES IN THE COX MODEL BY JIAN-JIAN REN 1 AND MAI ZHOU 2 University of Central Florida and University of Kentucky Abstract We use the empirical likelihood approach

More information

Eötvös Loránd University, Budapest. 13 May 2005

Eötvös Loránd University, Budapest. 13 May 2005 A NEW CLASS OF SCALE FREE RANDOM GRAPHS Zsolt Katona and Tamás F Móri Eötvös Loránd University, Budapest 13 May 005 Consider the following modification of the Barabási Albert random graph At every step

More information

A MODEL FOR THE LONG-TERM OPTIMAL CAPACITY LEVEL OF AN INVESTMENT PROJECT

A MODEL FOR THE LONG-TERM OPTIMAL CAPACITY LEVEL OF AN INVESTMENT PROJECT A MODEL FOR HE LONG-ERM OPIMAL CAPACIY LEVEL OF AN INVESMEN PROJEC ARNE LØKKA AND MIHAIL ZERVOS Abstract. We consider an investment project that produces a single commodity. he project s operation yields

More information

Random Process Lecture 1. Fundamentals of Probability

Random Process Lecture 1. Fundamentals of Probability Random Process Lecture 1. Fundamentals of Probability Husheng Li Min Kao Department of Electrical Engineering and Computer Science University of Tennessee, Knoxville Spring, 2016 1/43 Outline 2/43 1 Syllabus

More information

Exponential martingales: uniform integrability results and applications to point processes

Exponential martingales: uniform integrability results and applications to point processes Exponential martingales: uniform integrability results and applications to point processes Alexander Sokol Department of Mathematical Sciences, University of Copenhagen 26 September, 2012 1 / 39 Agenda

More information

Convexity/Concavity of Renyi Entropy and α-mutual Information

Convexity/Concavity of Renyi Entropy and α-mutual Information Convexity/Concavity of Renyi Entropy and -Mutual Information Siu-Wai Ho Institute for Telecommunications Research University of South Australia Adelaide, SA 5095, Australia Email: siuwai.ho@unisa.edu.au

More information

On a Class of Multidimensional Optimal Transportation Problems

On a Class of Multidimensional Optimal Transportation Problems Journal of Convex Analysis Volume 10 (2003), No. 2, 517 529 On a Class of Multidimensional Optimal Transportation Problems G. Carlier Université Bordeaux 1, MAB, UMR CNRS 5466, France and Université Bordeaux

More information

arxiv: v1 [math.pr] 6 Jan 2014

arxiv: v1 [math.pr] 6 Jan 2014 Recurrence for vertex-reinforced random walks on Z with weak reinforcements. Arvind Singh arxiv:40.034v [math.pr] 6 Jan 04 Abstract We prove that any vertex-reinforced random walk on the integer lattice

More information

Jump-type Levy Processes

Jump-type Levy Processes Jump-type Levy Processes Ernst Eberlein Handbook of Financial Time Series Outline Table of contents Probabilistic Structure of Levy Processes Levy process Levy-Ito decomposition Jump part Probabilistic

More information

GAUSSIAN PROCESSES; KOLMOGOROV-CHENTSOV THEOREM

GAUSSIAN PROCESSES; KOLMOGOROV-CHENTSOV THEOREM GAUSSIAN PROCESSES; KOLMOGOROV-CHENTSOV THEOREM STEVEN P. LALLEY 1. GAUSSIAN PROCESSES: DEFINITIONS AND EXAMPLES Definition 1.1. A standard (one-dimensional) Wiener process (also called Brownian motion)

More information

P i [B k ] = lim. n=1 p(n) ii <. n=1. V i :=

P i [B k ] = lim. n=1 p(n) ii <. n=1. V i := 2.7. Recurrence and transience Consider a Markov chain {X n : n N 0 } on state space E with transition matrix P. Definition 2.7.1. A state i E is called recurrent if P i [X n = i for infinitely many n]

More information

I forgot to mention last time: in the Ito formula for two standard processes, putting

I forgot to mention last time: in the Ito formula for two standard processes, putting I forgot to mention last time: in the Ito formula for two standard processes, putting dx t = a t dt + b t db t dy t = α t dt + β t db t, and taking f(x, y = xy, one has f x = y, f y = x, and f xx = f yy

More information

Stochastic flows associated to coalescent processes

Stochastic flows associated to coalescent processes Stochastic flows associated to coalescent processes Jean Bertoin (1) and Jean-François Le Gall (2) (1) Laboratoire de Probabilités et Modèles Aléatoires and Institut universitaire de France, Université

More information

Citation Osaka Journal of Mathematics. 41(4)

Citation Osaka Journal of Mathematics. 41(4) TitleA non quasi-invariance of the Brown Authors Sadasue, Gaku Citation Osaka Journal of Mathematics. 414 Issue 4-1 Date Text Version publisher URL http://hdl.handle.net/1194/1174 DOI Rights Osaka University

More information

Brownian motion. Samy Tindel. Purdue University. Probability Theory 2 - MA 539

Brownian motion. Samy Tindel. Purdue University. Probability Theory 2 - MA 539 Brownian motion Samy Tindel Purdue University Probability Theory 2 - MA 539 Mostly taken from Brownian Motion and Stochastic Calculus by I. Karatzas and S. Shreve Samy T. Brownian motion Probability Theory

More information

Optimal global rates of convergence for interpolation problems with random design

Optimal global rates of convergence for interpolation problems with random design Optimal global rates of convergence for interpolation problems with random design Michael Kohler 1 and Adam Krzyżak 2, 1 Fachbereich Mathematik, Technische Universität Darmstadt, Schlossgartenstr. 7, 64289

More information

2905 Queueing Theory and Simulation PART III: HIGHER DIMENSIONAL AND NON-MARKOVIAN QUEUES

2905 Queueing Theory and Simulation PART III: HIGHER DIMENSIONAL AND NON-MARKOVIAN QUEUES 295 Queueing Theory and Simulation PART III: HIGHER DIMENSIONAL AND NON-MARKOVIAN QUEUES 16 Queueing Systems with Two Types of Customers In this section, we discuss queueing systems with two types of customers.

More information

1. Stochastic Processes and filtrations

1. Stochastic Processes and filtrations 1. Stochastic Processes and 1. Stoch. pr., A stochastic process (X t ) t T is a collection of random variables on (Ω, F) with values in a measurable space (S, S), i.e., for all t, In our case X t : Ω S

More information

Lecture 1: Brief Review on Stochastic Processes

Lecture 1: Brief Review on Stochastic Processes Lecture 1: Brief Review on Stochastic Processes A stochastic process is a collection of random variables {X t (s) : t T, s S}, where T is some index set and S is the common sample space of the random variables.

More information

1 Sequences of events and their limits

1 Sequences of events and their limits O.H. Probability II (MATH 2647 M15 1 Sequences of events and their limits 1.1 Monotone sequences of events Sequences of events arise naturally when a probabilistic experiment is repeated many times. For

More information

arxiv: v1 [math.pr] 24 Jan 2019

arxiv: v1 [math.pr] 24 Jan 2019 How strong can the Parrondo effect be? arxiv:1901.08257v1 [math.pr] 24 Jan 2019 S. N. Ethier and Jiyeon Lee Abstract If the parameters of the original Parrondo games A and B are allowed to be arbitrary,

More information

Generalized Gaussian Bridges of Prediction-Invertible Processes

Generalized Gaussian Bridges of Prediction-Invertible Processes Generalized Gaussian Bridges of Prediction-Invertible Processes Tommi Sottinen 1 and Adil Yazigi University of Vaasa, Finland Modern Stochastics: Theory and Applications III September 1, 212, Kyiv, Ukraine

More information

ON THE REGULARITY OF SAMPLE PATHS OF SUB-ELLIPTIC DIFFUSIONS ON MANIFOLDS

ON THE REGULARITY OF SAMPLE PATHS OF SUB-ELLIPTIC DIFFUSIONS ON MANIFOLDS Bendikov, A. and Saloff-Coste, L. Osaka J. Math. 4 (5), 677 7 ON THE REGULARITY OF SAMPLE PATHS OF SUB-ELLIPTIC DIFFUSIONS ON MANIFOLDS ALEXANDER BENDIKOV and LAURENT SALOFF-COSTE (Received March 4, 4)

More information

Estimates for probabilities of independent events and infinite series

Estimates for probabilities of independent events and infinite series Estimates for probabilities of independent events and infinite series Jürgen Grahl and Shahar evo September 9, 06 arxiv:609.0894v [math.pr] 8 Sep 06 Abstract This paper deals with finite or infinite sequences

More information

The Laplace Transform

The Laplace Transform C H A P T E R 6 The Laplace Transform Many practical engineering problems involve mechanical or electrical systems acted on by discontinuous or impulsive forcing terms. For such problems the methods described

More information

4. Conditional risk measures and their robust representation

4. Conditional risk measures and their robust representation 4. Conditional risk measures and their robust representation We consider a discrete-time information structure given by a filtration (F t ) t=0,...,t on our probability space (Ω, F, P ). The time horizon

More information

Wiener Measure and Brownian Motion

Wiener Measure and Brownian Motion Chapter 16 Wiener Measure and Brownian Motion Diffusion of particles is a product of their apparently random motion. The density u(t, x) of diffusing particles satisfies the diffusion equation (16.1) u

More information

MATRIX REPRESENTATIONS FOR MULTIPLICATIVE NESTED SUMS. 1. Introduction. The harmonic sums, defined by [BK99, eq. 4, p. 1] sign (i 1 ) n 1 (N) :=

MATRIX REPRESENTATIONS FOR MULTIPLICATIVE NESTED SUMS. 1. Introduction. The harmonic sums, defined by [BK99, eq. 4, p. 1] sign (i 1 ) n 1 (N) := MATRIX REPRESENTATIONS FOR MULTIPLICATIVE NESTED SUMS LIN JIU AND DIANE YAHUI SHI* Abstract We study the multiplicative nested sums which are generalizations of the harmonic sums and provide a calculation

More information

2 Sequences, Continuity, and Limits

2 Sequences, Continuity, and Limits 2 Sequences, Continuity, and Limits In this chapter, we introduce the fundamental notions of continuity and limit of a real-valued function of two variables. As in ACICARA, the definitions as well as proofs

More information

Asymptotically optimal induced universal graphs

Asymptotically optimal induced universal graphs Asymptotically optimal induced universal graphs Noga Alon Abstract We prove that the minimum number of vertices of a graph that contains every graph on vertices as an induced subgraph is (1 + o(1))2 (

More information

MATH 205C: STATIONARY PHASE LEMMA

MATH 205C: STATIONARY PHASE LEMMA MATH 205C: STATIONARY PHASE LEMMA For ω, consider an integral of the form I(ω) = e iωf(x) u(x) dx, where u Cc (R n ) complex valued, with support in a compact set K, and f C (R n ) real valued. Thus, I(ω)

More information

THE MALLIAVIN CALCULUS FOR SDE WITH JUMPS AND THE PARTIALLY HYPOELLIPTIC PROBLEM

THE MALLIAVIN CALCULUS FOR SDE WITH JUMPS AND THE PARTIALLY HYPOELLIPTIC PROBLEM Takeuchi, A. Osaka J. Math. 39, 53 559 THE MALLIAVIN CALCULUS FOR SDE WITH JUMPS AND THE PARTIALLY HYPOELLIPTIC PROBLEM ATSUSHI TAKEUCHI Received October 11, 1. Introduction It has been studied by many

More information

LAW OF LARGE NUMBERS FOR THE SIRS EPIDEMIC

LAW OF LARGE NUMBERS FOR THE SIRS EPIDEMIC LAW OF LARGE NUMBERS FOR THE SIRS EPIDEMIC R. G. DOLGOARSHINNYKH Abstract. We establish law of large numbers for SIRS stochastic epidemic processes: as the population size increases the paths of SIRS epidemic

More information

Stochastic Differential Equations.

Stochastic Differential Equations. Chapter 3 Stochastic Differential Equations. 3.1 Existence and Uniqueness. One of the ways of constructing a Diffusion process is to solve the stochastic differential equation dx(t) = σ(t, x(t)) dβ(t)

More information

SUMMARY OF RESULTS ON PATH SPACES AND CONVERGENCE IN DISTRIBUTION FOR STOCHASTIC PROCESSES

SUMMARY OF RESULTS ON PATH SPACES AND CONVERGENCE IN DISTRIBUTION FOR STOCHASTIC PROCESSES SUMMARY OF RESULTS ON PATH SPACES AND CONVERGENCE IN DISTRIBUTION FOR STOCHASTIC PROCESSES RUTH J. WILLIAMS October 2, 2017 Department of Mathematics, University of California, San Diego, 9500 Gilman Drive,

More information