Moment Closure for the Stochastic Logistic Model 1

Size: px
Start display at page:

Download "Moment Closure for the Stochastic Logistic Model 1"

Transcription

1 Momet Closure for the Stochastic Logistic Model 1 Abhyudai Sigh ad João Pedro Hespaha Departmet of Electrical ad Computer Egieerig, Uiversity of Califoria, Sata Barbara, CA Abstract Cotiuous-time birth-death Markov processes serve as useful models i populatio biology. Whe the birth-death rates are oliear, the time evolutio of the first order momets of the populatio is ot closed, i the sese that it depeds o momets of order higher tha. For aalysis purpose, the time evolutio of the first order momets is ofte made to be closed by approximatig these higher order momets as a oliear fuctio of momets up to order, which we refer to as the momet closure fuctio. I this paper, a systematic procedure for costructig momet closure fuctios of arbitrary order is preseted for the stochastic logistic model. We obtai the momet closure fuctio by first assumig a certai separable form for it, ad the matchig time derivatives of the exact (ot closed) momet equatios with that of the approximate (closed) equatios for some iitial time ad set of iitial coditios. The separable structure esures that the steady-state solutios for the approximate equatios are uique, positive ad real, while the derivative matchig guaratees a good approximatio, at-least locally i time. Moreover, the accuracy of the approximatio ca be improved by icreasig the order of the approximate model.to the best of our kowledge, this paper is the first to propose a systematic procedure to costruct momet closure fuctios of arbitrary order that guaratee biologically meaigful equilibria. A host of other momet closure fuctios previously proposed i the literature are also ivestigated. Amog these we show that oly the oes that achieve derivative matchig provide a close approximatio to the exact solutio. Moreover, we improve the accuracy of several previously proposed momet closure fuctios by forcig derivative matchig. However, for certai rages of parameter models, momet closure fuctios that lack the separability property lead to biologically meaigless scearios of imagiary ad eve stable egative steady-states of the closed momet equatios. Key words: Momet Closure, Stochastic Logistic Model, Stochastic Hybrid Systems 1 This material is based upo work supported by the Istitute for Collaborative Biotechologies through grat DAAD19-03-D-0004 from the U.S. Army Research Office ad by the Natioal Sciece Foudatio uder Grat No. CCR abhi@egieerig.ucsb.edu, hespaha@ece.ucsb.edu Preprit submitted to Elsevier Sciece 16 Jauary 006

2 1 INTRODUCTION Cotiuous-time birth-death Markov processes have bee extesively used for modelig stochasticity i populatio biology (Matis ad Kiffe, 00, 1996; Matis et al., 1998). The time evolutio of these processes is typically described by a sigle equatio for a grad probability fuctio, where time ad species populatios appear as idepedet variables, called the Master or Kolmogorov equatio (Bailey, 1964). However, this equatio ca oly be solved for relatively few, highly idealized cases ad a more reasoable goal is to determie the time evolutio of a few low-order statistical momets. I this paper, a method for estimatig low-order statistical momets is itroduced for the stochastic logistic model. This model was first itroduced by Barlett et al. (1960) ad is a cotiuous-time birth-death Markov process ivolvig a sigle specie, with birth ad death rates beig polyomials of order. Although, oe ca directly use the Kolmogorov equatio to derive differetial equatios for the time evolutio of momets of the process, i this paper we use a alterative method. We model the stochastic logistic model as a Stochastic Hybrid System (SHS) whose state x is the populatio of the specie. The, the time evolutio of the momets is obtaied usig results from the SHS literature (e.g., Hespaha, 004). Details of the stochastic logistic model ad its modelig as a SHS are preseted i Sectio. Table 1 Separable derivative-matchig momet closure fuctio ϕ+1 s (µ) for {,3,4}. = = 3 = 4 ϕ+1 s (µ) µ 3 µ 1 4µ4 3 µ 10µ5 4 µ 1 3 µ 6 µ 1 5µ10 3 Let µ m be the m th order ucetered momet of x, i.e. µ m (t) = E[x(t) m ] where x(t) deotes the populatio of the specie at time t. We will show i Sectio 3 that for the stochastic logistic model the time derivative of µ m is a liear combiatio of momets up to order m + 1. Hece, if oe stacks all momets i a ifiite vector µ = [µ 1, µ, ] T, its dyamics ca be writte as µ = A µ, (1) for some ifiite matrix A. As the above ifiite dimesioal system caot be solved aalytically, we trucate (1) by creatig a vector µ = [µ 1,..., µ ] T, where is the order of the trucatio. Its dyamics, give by µ = Aµ + Bµ +1 () for some matrices A ad B is ot closed, i the sese that the time evolutio of the vector µ depeds o the + 1 th order momet µ +1. For aalysis purposes, we close the above system by approximatig µ +1 as a oliear fuctio ϕ +1 (µ) of

3 momets up to order. This procedure is commoly referred to as momet closure. We call ϕ +1 (µ) as the momet closure fuctio for µ +1. Let ν = [ν 1,...,ν ] T deote the state of the ew closed system. The, its dyamics is give by ν = Aν + Bϕ +1 (ν) (3) ad is referred to as the trucated momet dyamics. We deote the states of () ad (3) usig differet symbols because µ refers to the actual momet dyamics whereas ν to a approximated momet dyamics. I Sectio 4, we cosider momet closure fuctios which have the followig separable form: ϕ+1 s (µ) = µγ 1 1 µγ... µγ for appropriately chose costats γ m R. These costats are obtaied by matchig time derivatives of µ +1 ad ϕ+1 s (µ) i () ad (3) respectively, at some iitial time t 0, for a determiistic iitial coditio x(t 0 ) = x 0 with probability oe. The reaso for this lies i the fact that the class of determiistic distributios forms a atural basis for the ifiite dimesioal space cotaiig the vector µ. We refer to this momet closure as the separable derivative-matchig momet closure. We show that for all, this determies the fuctio ϕ+1 s uiquely, which is idepedet of the birth ad death rates. Table 1 shows the fuctios ϕ+1 s that we obtaied for trucatios of order =, 3 ad 4. The strikig feature of the separable derivative-matchig momet closure is that the accuracy of the approximate momet dyamics improves by icreasig order of trucatio ad the depedece of higher order momets o lower order oes is cosistet with x(t) beig logormally distributed, i spite of the fact that the derivative matchig procedure used to costruct ϕ+1 s did ot make ay assumptio o the distributio of the populatio. Alterative momet closure methods which have appeared i literature typically costruct the momet closure fuctios ϕ by directly assumig the probability distributio to be ormal (Whittle, 1957), logormal (Keelig, 000), poisso or biomial (Nasell, 003a). We refer to them as ormal, logormal, poisso ad biomial momet closures respectively ad review them i Sectio 5. I Sectio 6, they are compared with the separable derivative-matchig momet closure. I Sectio 6.1 the comparisos are doe based o how well the momet closure fuctio ϕ +1 (µ) approximates µ +1. Towards that ed, we itroduce the error e +1 (t) := µ +1 (t) ϕ +1 (µ(t)) = i=0 (t t 0 ) i ε+1 i i! (x 0) where we expaded the error as a Taylor series with ε i +1 (x 0) defied to be ε+1 i (x 0) := di µ +1 (t) t=t0 dt i di ϕ +1 (µ(t)) t=t0 dt i. 3

4 We call ε i +1 (x 0) the i th order derivative matchig error. Ideally oe would like this error to be zero but this is geerally ot possible. Whe x(t 0 ) = x 0 with probability oe, the derivative matchig error is typically a polyomial i x 0. The lesser the order of this polyomial, the lesser is the error e +1 (t), ad hece the better is ϕ +1 (µ) i approximatig µ +1. We show that for =, all the above momet closure fuctios perform derivative matchig except the poisso momet closure fuctio by Nasell (003a). This is because, it has a 0 th order derivative matchig error ε 0 3 (x 0) which grows liearly with x 0 while for separable derivative-matchig, logormal, biomial ad ormal momet closure fuctios the 0 th order error is always zero. Hece, Nasell s poisso momet closure fuctio exhibits a larger iitial error tha the others. We propose a alterative poisso momet closure fuctio, for which ε 0 3 (x 0) = 0, ad show that it performs better tha the oe proposed by Nasell (003a). Although the above momet closures provide good estimates for a secod order of trucatio ( = ), it is typically beeficial to cosider 3 because they lead to better momet approximatios ad reduce the errors by a few orders of magitude. However, for distributios like the ormal ad the logormal, which are characterized by less tha parameters, 3 typically leads to multiple ormal ad logormal momet closure fuctios. I Sectio 6.1. we illustrate how derivative matchig ca be used as a tool for gaugig performaces of these multiple momet closure fuctios ad choosig the oes amog them that yield the least derivative matchig errors. I particular, we show that amog the momet closure fuctios cosistet with the logormal distributio, the separable derivative-matchig momet closure fuctio yields the least order polyomial for the derivative matchig error, ad hece, exhibits the best performace. Based o derivative matchig we also propose families of ormal momet closure fuctios which provide good approximatios for µ +1. Towards the ed, for = 3, we propose a ew momet closure fuctio, for which, ulike the logormal or ormal momet closure fuctios both the 0 th ad 1 st order derivative matchig error are zero, ad hece, provides the best estimates for µ 4 as compared to them, at least locally i time. I Sectio 6. comparisos are doe based o the steady-state solutios of the trucated momet dyamics (3). We show that the separable derivative matchig momet closure, always yields a uique o-trivial positive real steady-state N. Thus, it is preferable to the other momet closures techiques which lack the separable structure ad exhibit spurious, imagiary ad eve stable egative steadystates, which would be biologically meaigless. 4

5 Stochastic Logistic Model.1 Model formulatio The stochastic logistic model is the stochastic birth-death aalogous model of the well-kow determiistic Verhulst-Pearl equatios (Pielou, 1977) ad has bee extesively used for modelig stochasticity i populatio biology (Matis ad Kiffe, 00, 1996; Matis et al., 1998). For this cotiuous-time birth-death Markov process, the coditioal probabilities of a uit icrease ad decrease, respectively, i a ifiitesimal time iterval (t,t + dt] is give by P{x(t + dt) = x + 1 x(t) = x} = { η(x)dt, P{x(t + dt) = x 1 x(t) = x} = χ(x)dt, x U 0, otherwise where x(t) N represets the populatio size at time t, η(x) := a 1 x b 1 x > 0, χ(x) := a x + b x > 0, x (0,U) (4) ad U := a 1 /b 1 N, a 1 > 0, a > 0, b 1 > 0, b 0. We assume that the iitial coditio satisfies x(t 0 ) {1,,...,U}, ad hece, x(t) {0, 1,...,U}, t [0, ) with probability oe. We call U the populatio limit.. Statioary ad Quasi-Statioary Distributios Sice the birth ad death rates are zero for x = 0 (η(0) = χ(0) = 0) we have that x = 0 is a absorbig state ad evetual covergece to the origi is certai. Thus, the statioary distributio is degeerate with probability oe at the origi. However, though out this paper we assume the mea time to extictio to be very large, i which case there exists a quasi-statioary distributio (Nasell, 001). Barlett et al. (1960) shows that a good approximate for P x (the probability that x = x at quasi-equilibrium ) ca be umerically obtaied usig the followig recurrece relatioship χ(x) P x = η(x 1) P x 1, x {,3,...,U}. (5) 5

6 .3 Trasiet Distributios Ideally oe would like to determie the exact probability distributio of x(t) at ay time t. It ca be show that the probability P x (t) that x(t) = x satisfies the followig differetial equatios Ṗ 0 (t) = χ(1)p 1 (t) Ṗ 1 (t) = χ()p (t) [η(1) + χ(1)]p 1 (t) Ṗ x (t) = χ(x + 1)P x+1 (t) [η(x) + χ(x)]p x (t) + η(x 1)P x 1 (t),. Ṗ U (t) = χ(u)p U (t) + η(u 1)P U 1 (t) (6a) (6b) (6c) (6d) (Bailey, 1964). These differetial equatios are commoly referred to as the Master or Kolmogorov equatios. If the populatio limit U is small, the above system of equatios ca be solved umerically. However, for large U, a more reasoable goal (ad oe that is of primary iterest i applicatios) is to determie the evolutio of the some lower-order momets of x(t). 3 Time Evolutio of Momets 3.1 Modelig the Stochastic Logistic Model To model the time evolutio of x(t), we cosider a special class of systems kow as Stochastic Hybrid Systems (SHS). These systems were itroduced by Hespaha ad Sigh (005) to model the stochastic time evolutio of the populatios of differet species ivolved i a chemical reactio. More specifically, to fit the framework of our problem, these system are characterized by two reset maps: x φ 1 (x) := x + 1, x φ (x) := x 1 (7) oe correspodig to a birth ad the other to a death, with associated trasitio itesities give by λ 1 (x) := η(x), λ (x) := χ(x). (8) Betwee births ad deaths the populatio remais costat ad thus ẋ = 0. I essece, wheever a birth evet or a death evet takes place, the correspodig reset φ i (x) is activated ad x is reset accordigly, furthermore, the probability of the activatio takig place i a ifiitesimal time iterval (t,t +dt] is determied by the associated trasitio itesities λ i (x)dt. 6

7 3. Momet Dyamics Give m {1,,...}, we defie the m th order (ucetered) momet of x to be µ m (t) = x m P x (t) := E[x(t) m ], t 0. (9) x=1 The time evolutio of momets is give by the followig result, which is a straightforward applicatio of Theorem 1 i Hespaha (004) to the above SHS. Theorem 1: The time evolutio of µ m is give by dµ m dt = E [ [(φ i (x)) m x m ]λ i (x) i=1 ]. (10) Usig the above Theorem, we show i Appedix A that oe ca coclude µ m = m+1 C m m+p r f (m + p r, p)µ r, (11) r=1 where we defie C m j ad f ( j, p) as follows 3 j, m, p N. C m j := f ( j, p) := { m! (m j)! j! m j 0 0 m < j 0 j = 0 a 1 + ( 1) j a j > 0, p = 1 b 1 + ( 1) j b j > 0, p =. (1) (13) Oe ca see from the right-had-side of (11), that the time derivative of µ m is a liear combiatio of the momets µ r, up to order r = m + 1. Hece, if oe stacks all momets i a ifiite vector µ = [µ 1, µ, ] T, its dyamics ca be writte as µ = A µ, (14) for some ifiite matrix A. Let µ = [µ 1, µ,..., µ ] T R cotais the top elemets of µ. The, usig (11) the evolutio of µ is give by µ = Aµ + Bµ +1, (15) 3! deotes the factorial of. 7

8 for some ad 1 matrices A ad B which have the followig structure A = , B =., (16) 0 where the deotes o-zero etries. Our goal is to approximate (15) by a fiitedimesioal oliear ODE of the form ν = Aν + Bϕ +1 (ν), ν = [ν 1,ν,...,ν ] T (17) where the map ϕ +1 : R R should be chose so as to keep ν(t) close to µ(t). This procedure is commoly referred to as momet closure. We call (17) the trucated momet dyamics ad ϕ +1 (µ) the momet closure fuctio for µ +1. Whe a sufficietly large but fiite umber of derivatives of µ(t) ad ν(t) match poit-wise, the, the differece betwee solutios to (15) ad (17) remais close o a give compact time iterval. This follows from a Taylor series approximatio argumet. To be more precise, for each δ > 0 ad iteger N, there exists T R, for which the followig result holds: Assume that for every t 0 0, µ(t 0 ) = ν(t 0 ) ad d i µ(t) t=t0 dt i = di ν(t) t=t0 dt i, i {1,...,N} (18) where di µ(t) ad di ν(t) represet the i th time derivative of µ(t) ad ν(t) alog the dt i dt i trajectories of system (14) ad (17) respectively. The, µ(t) ν(t) δ, t [t 0,T ], (19) alog solutios of (14) ad (17), where µ deote the first elemets of µ. I the ext sectio we use (18) to costruct momet closure fuctios ϕ +1 (µ). 4 Separable Derivative-Matchig Momet Closures I this sectio we costruct trucated momet dyamics (17) for the stochastic logistic model usig (18). After replacig (15) ad (17) i (18), equality (18) becomes a PDE o ϕ +1. We will seek for solutios ϕ +1 to this PDE that have the followig separable form ϕ s +1 (µ) = γ µ m m (0) m=1 8

9 for appropriately chose costats γ m R. As we will see i Sectio 6., this separable structure esures that the steady-state solutios for the trucated momet dyamics (17) are uique, positive real, ad hece, biologically meaigful. I the sequel we refer to such ϕ+1 s (µ) as a separable derivative-matchig momet closure fuctio for µ +1. Oe ca see that the ifiite vector µ Ω ca be expressed as E[x(t)] x E[x(t) µ = x E[x(t) 3 = ] x=1 x 3 P x (t)... Hece, the ifiite vectors µ = [x,x,x 3,...] T, which correspods to a determiistic distributio, i.e. x(t) = x with probability oe, form a atural basis for Ω. I particular, we will fid costats γ m which satisfy (18) for each vector µ (t 0 ) belogig to this basis, i.e. for the class of determiistic iitial coditios. However, ofte it is ot possible to fid γ m for which (18) holds exactly. We will therefore relax this coditio ad simply demad the followig µ(t 0 ) = ν(t 0 ) ad d i µ(t) t=t0 dt i = di ν(t) t=t0 dt i + E[ε i (x(t 0 ))], (1) i {1,}, where each elemet of the vector ε i (x(t 0 )) is a polyomial i x(t 0 ). Oe ca thik of (1) as a approximatio to (18) that is valid as log as di µ (t) dt i t=t0 domiates E[ε i (x(t 0 ))]. The followig theorem summarizes the mai result, the proof of which is give i Appedix B. Theorem : Let γ m, m {1,...,} be chose as γ m = ( 1) m C +1 m. () The, for every determiistic iitial coditio ν(t 0 ) = µ(t 0 ) = [x 0,...,x 0 ]T which correspods to x(t 0 ) = x 0 with probability oe, we have dµ(t) dt t=t0 = dν(t) dt t=t0 (3a) d µ(t) t=t0 dt = d ν(t) t=t0 dt + ε (x 0 ), (3b) where di µ(t) represet the i th time derivative of µ(t) ad ν(t) alog the dt i dt i trajectories of the systems (14) ad (17), respectively, ad the th elemet of the vector ε (x 0 ) is a polyomial i x 0 of order with all other elemets beig zero. ad di ν(t) 9

10 Remark 1. Usig (11) it ca be show that d µ (t) is a liear combiatio of momets of x up to order +. Thus, d µ (t) dt dt t=t0 is a polyomial i x 0 of order +, ad hece, for 4 x 0 >> 1, ε (x 0)/ d µ (t) dt elemet of ε (x 0 ). Hece, the term d µ (t) dt t=t0 = O(x0 ), where ε (x 0) is the th t=t0 domiates ε (x 0) by x0. Remark. It ca be verified that the separable derivative-matchig momet closures also matches derivatives of order higher tha i (3) with small errors. For example for {,3,4} ad i {,...,9}, we have dµ(t) dt t=t0 = dν(t) dt t=t0 (4a) d i µ(t) t=t0 dt i = di ν(t) t=t0 dt i + ε i (x 0 ), (4b) where the m th elemet of ε i (x 0 ) is a polyomial i x 0 of order m + i, for m + i ad equal to zero otherwise. We cojecture that the above equality holds N ad i N but we oly verified it for up to 4 ad i up to 9. As above, the elemets of vector di µ(t) dt i t=t0 domiate the correspodig elemets of ε i (x 0 ) by x0, ad hece, with icreasig, the trucated momet dyamics ν(t) should provide a more accurate approximatios to the lower order momets µ(t). 5 Distributio based Momet Closures Most momet closure techiques that appeared i the literature start by assumig a specific class of distributios D for the populatio, ad use this assumptio to express higher order momets as a fuctio of the lower order oes. We refer to such a momet closure fuctio as beig cosistet with the distributio D ad defie them as follows. Defiitio: Let D be a class of distributios parameterized by m parameters (q 1,...,q m ) Q, with the k th order momet µ k give i terms of the q 1,...,q m as follows µ k = f k (q 1,...,q m ), k {1,,...}. (5) The momet closure fuctio ϕ D +1 (µ) for µ +1 is said to be cosistet with the distributio D if, for every (q 1,...,q m ) Q, oe has that µ +1 = f +1 (q 1,...,q m ) = ϕ D +1(µ) (6) 4 O(.) deotes order of. 10

11 Table Uique Momet Closure Fuctios for the m th order trucatio ( = m) ad differet distributios D. where D m Uique momet closure fuctio Normal ϕ g 3 (µ) = 3µ µ 1 µ 3 1 Logormal ϕ l 3 (µ) = µ3 µ 3 1 Poisso 1 ϕ p (µ) = µ 1 + µ 1 Biomial ϕ b 3 (µ) = (µ µ 1 ) µ 1 (µ µ 1 ) + 3µ 1µ µ 3 1 µ 1 f 1 (q 1,...,q m ) µ :=. =.. (7) f (q 1,...,q m ) µ For well kow classes of distributios such as logormal, ormal, poisso, or biomial we simply say that ϕ+1 D is the logormal, ormal, poisso, or biomial momet closure fuctio. 5.1 Techiques for obtaiig ϕ D +1 Geerically, whe the dimesio m of the parameter space Q is the same as the dimesio of the domai of the momet closure fuctio ϕ+1 D (µ), the fuctioal equatio (6) (7) i the ukow ϕ+1 D ( ) has a uique solutio 5. I fact, to determie ϕ+1 D (µ) oe ca start by solvig (7) for q 1,...,q m i terms of µ 1,..., µ m, ad the substitutig these back i (6) to obtai a uique momet closure fuctio ϕ+1 D ( ). As we choose D to be ormal (Whittle, 1957), log-ormal (Keelig, 000), poisso, or biomial (Nasell, 003a), this procedure results i the differet momet closure fuctios show i Table. Difficulties arise whe the dimesio m of the parameter space Q is strictly smaller tha the dimesio of the domai of the momet closure fuctio ϕ+1 D (µ), because i this case the fuctioal equatio (6) (7) does ot have a uique solutio 6 ad oe ca fid ifiitely may momet closure fuctios cosistet with 5 The reader is ivited to covice herself of this by imagiig that all fuctios are locally liear, i which case ϕ+1 D (µ) is represeted by a vector with ukows. Sice (6) must hold for a (local) basis of Q, we have exactly m equatios to determie the = m ukows. 6 I cotrasts to the previous case, we ow have ukows to represet the local li- 11

12 the same family of distributios. However, there is a strog icetive to cosider this case because, as well shall see shortly, large values for geerally lead to sigificatly more accurate momet closures. I the sequel, we illustrate some optios for momet closures with > m, Example 1: Cosider the class of poisso distributios characterized by their expected value θ (m = 1). Their momets are give by µ 1 = f 1 (θ) := θ µ = f (θ) := θ(1 + θ) µ 3 = f 3 (θ) := θ(1 + 3θ + θ ),... Nasell (003a) proposed the followig poisso momet closure fuctio for = : ϕ p1 3 (µ) = µ 1 + 3µ 1 µ µ 3 1, (8) for which it is straightforward to verify that (6) (7) holds because µ 3 = θ(1 + 3θ + θ ) = ϕ p1 3 (µ), µ = [ θ, θ(1 + θ) ] T. However, a alterative choice for the poisso momet closure fuctio that also satisfies (6) (7) is give by ϕ p 3 (µ) = µ µ 1 + 3µ 1 µ µ 3 1, (9) which, as we will see i the ext sectio, performs better that (8). The explaatio for this lies i the fact that (9) has better derivative matchig properties tha (8), i the sese of (1). I the sequel we refer to (8) ad (9) as the Nasell-poisso ad ew-poisso momet closure fuctio, respectively. Example : Cosider ow the class of ormal distributios parameterized by their mea ω ad variace σ (m = ). Their momets are give by µ 1 = f 1 (θ,σ) := ω µ = f (θ,σ) := ω + σ µ 3 = f 3 (θ,σ) := ω(ω + 3σ ) µ 4 = f 4 (θ,σ) := ω 4 + 6ω σ + 3σ 4,... For = 3, ay fuctio of the followig form is a ormal momet closure fuctio for µ 4 ϕ 4 (µ) := 4µ 1 µ 3 + 3µ 1µ µ 1 + 6µ h(µ 1, µ µ 1,µ 3 3µ µ 1 + µ 3 1 ) earizatio of ϕ+1 D (µ) but a (local) basis of Q oly provides m < equatios. 1

13 where h(x,y,z) is ay fuctio with the property that h(x,y,0) = 0. To verify that this is so, we ote that (6) (7) holds because for µ = [ ω, ω + σ, ω(ω + 3σ ) ] T, we obtai h(µ 1, µ µ 1, µ 3 3µ µ 1 + µ 3 1 ) = h(ω,σ,0) = 0 ad therefore ϕ 4 (µ) = ω 4 + 6ω σ + 3σ 4 = µ 4. Example 3: Fially cosider the class of logormal distributios characterized by the parameters α > 0, β > 0 (m = ), whose momets are give by µ k = f k (α,β) := α k β k, k {1,, }. (30) For every, the separable derivative-matchig momet closure fuctios defied by (0), with coefficiet give by () i Theorem are logormal momet closure fuctios for µ +1. We ca verify this by otig that (6) (7) holds because, from (30) ad (B.1) used i the proof of Theorem (Appedix B) we coclude that ϕ s +1 (µ) = α( m=1 γ mm) β ( m=1 γ mm ) = α ( m=1 γ mc m 1 ) β ( m=1 γ m{c m +Cm 1 }), = α +1 β C+1 +C +1 1 = α +1 β (+1) = µ +1, where we used the facts that k = C k 1, k = C k + Ck 1, k N. 5. Cumulat closure fuctios Most of the literature o momet closure prefers to work with a vector κ = [κ 1,...,κ ] where κ (t) is the th order cumulat 7, istead of the previously itroduced vector µ of ucetered momets i (15). The, istead of doig momet closure oe performs cumulat closure by approximatig κ +1 by a oliear fuctio φ +1 (κ) of κ 1,...,κ, which we refer to as the cumulat closure fuctio. The disadvatage of workig with κ istead of µ is that the dyamics of κ is always oliear. However, for ease of compariso with other papers, we provide i Table the cumulat closure fuctios correspodig to the differet momet closure fuctios 7 The th order cumulat, κ is give as follows i terms of the ucetered momets κ 1 = µ 1, κ = µ µ 1 κ 3 = µ 3 3µ 1 µ + µ 1 3, κ 4 = µ 4 4µ 1 µ 3 3µ + 1µ µ 1 6µ 1 4,... 13

14 Table 3 Momet Closure Fuctios (MCF) for secod order trucatio ( = ) ad correspodig Cumulat Closure Fuctios (CCF) for µ 3 ad κ 3, respectively, correspodig to the differet Momet Closure Techiques (MCT) discussed i this paper. SDM refers to separable derivative-matchig. MCT MCF CCF SDM ϕ3 s(µ) = µ3 µ 1 3 φ3 s(κ) = 3κ + κ3 κ 1 κ1 3 Normal ϕ g 3 (µ) = 3µ µ 1 µ 1 3 φ g 3 (κ) = 0 Logormal ϕ l 3 (µ) = µ3 µ 3 1 Nasell-Poisso New-Poisso φ l 3 (µ) = 3κ κ 1 + κ3 κ 3 1 ϕ p1 3 (µ) = µ 1 + 3µ 1 µ µ 3 1 φ p1 3 (κ) = κ 1 ϕ p 3 (µ) = µ µ 1 + 3µ 1µ µ 3 1 φ p 3 (κ) = κ Biomial ϕ b 3 (µ) = (µ µ 1 ) µ 1 (µ µ 1 ) + 3µ 1µ µ 3 1 φ b 3 (µ) = κ κ 1 κ discussed so far for =. We use superscripts s, l, g, p1, p ad b to deote separable derivative-matchig, logormal, ormal, Nasell-poisso, ew-poisso ad biomial momet closure fuctios, respectively. 6 Compariso of Momet closures I this sectio, we itroduce two criteria to compare the differet momet closure techiques. The first criterio is the error where e +1 (t) := µ +1 (t) ϕ +1 (µ(t)) = i=0 (t t 0 ) i ε+1 i i! (x 0), (31) ε+1 i (x 0) := di µ +1 (t) t=t0 dt i di ϕ +1 (µ(t)) t=t0 dt i. (3) We call ε i +1 (x 0) the derivative matchig error. Ideally, oe would like to have ε i +1 (x 0) = 0, but as already poited out i Sectio 4, this is geerally ot possible. With determiistic iitial coditios µ (t 0 ) = [x 0,x 0,...]T as i Theorem, the derivative matchig error is typically a polyomial i x 0. The lesser the order of this polyomial, the better is ϕ +1 (µ) i approximatig µ +1. The secod criterio is the steady-state solutio of the trucated momet dyamics (17). I particular, we are iterested i determiig if there exists a uique otrivial positive real steady-state which is physically meaigfull. This is importat, 14

15 because it is well-kow that ormal momet closures ca have spurious, imagiary ad sometimes eve stable egative steady-states, which lead to biologically meaigless solutios (Keelig, 000). 6.1 Derivative Matchig Error Momet Closures for = We recall from Table 3 that ϕ3 l (µ) = ϕs 3 (µ), ad therefore we do ot eed to discuss logormal momet closure separately. By substitutig ϕ3 s(µ), ϕg p1 3 (µ), ϕ3 (µ), ϕ p 3 (µ) ad ϕb 3 (µ) from Table 3 i (31) (3), oe obtais the correspodig derivative matchig errors, which will be deoted usig the appropriate superscripts. Usig Table 3 ad symbolic maipulatio i Mathematica, we ca show that s ε 0 3 (x 0) = g ε 0 3 (x 0) = p ε 0 3 (x 0) = b ε 0 3 (x 0) = 0 p1 ε3 0 (x 0) = x 0. ε3 i (x 0) P x0 (i + 1), = {s,g, p1, p,b}, i {1,,...} (33a) (33b) (33c) where P x0 ( j) deotes the set of polyomials i x 0 of order j. Sice p1 ε 0 3 (x 0) = x 0, the Nasell-poisso momet closure fuctio will have a large iitial error, especially for large iitial coditios, whe compared to all other momet closure fuctios. For all, i {1,,...}, all of these momet closure fuctios match derivatives, with the derivative matchig error beig of the same order i x 0. The simulatio results discussed below show that with the exceptio of Nasell-poisso momet closure fuctio, which cosistetly provides the worst estimates, all other momet closure fuctios perform fairly well. Example: We cosider the stochastic logistic model with a 1 =.30, a =.0, b 1 =.015, b =.001, (34) which is used by Matis et al. (1998) to model the populatio dyamics of the Africa Hoey Bee. Usig (17) with the matrices A ad B computed i (11), we have the followig trucated momet dyamics ν = ν ϕ 3 (ν). ν ν 0.03 The time evolutio of the momets correspodig to differet momet closure techiques is obtaied by substitutig the appropriate momet closure fuctio from Table 3 i place of ϕ 3 (ν). Figure 1 plots the differet errors (31) durig the time iterval [0,.5] for x 0 = 5. The error is approximated by the first ie terms of 15

16 ' ( % $!, - *%!$ +!%!(!'!# *$!&!!"# $ $"# % %"# ) Fig. 1. Evolutios of the error e +1 i (31) for the differet momet closure techiques i Table 3, with parameters as i (34) ad x 0 = 5. the series i (31). The letters s, g, p1, p ad b are used to deote the errors correspodig to separable derivative-matchig, ormal, Nasell-poisso, ew-poisso ad biomial momet closure fuctios, respectively. I order to evaluate the performace of these momet closures techiques past the iitial period, we also compute the exact evolutio of the momets. This is oly possible because the populatio limit U = 5 is small ad oe ca obtai the exact solutio by umerically solvig the Kolmogorov equatio (6). Figure cotais plots of the mea ad variace errors, respectively, for the differet momet closure fuctios with x 0 = 5 ad x 0 = 0. The letters s, g, p1, p ad b are used to deote the errors correspodig to separable derivative-matchig, ormal, Nasell-poisso, ew-poisso ad biomial momet closure fuctios, respectively. For x 0 = 0 the biomial momet closure fuctio provides the best estimate both iitially ad at steady-state, whereas for x 0 = 5 the ew-poisso momet closure fuctio does best iitially, but the biomial momet closure fuctio cotiues to provide the most accurate steady-state estimate. As oe would expect from (33), the Nasell-poisso momet closure fuctio performs the worst Momet Closures for 3 All distributios D discussed i Sectio 5 are characterized by at most parameters (m ), hece the correspodig distributio-based momet closure fuctios ϕ+1 D are ot uique for 3. I this sectio we illustrate for logormal ad ormal momet closures, how derivative matchig ca be used as a tool for gaugig their performaces ad choosig the oes that yield the least derivative matchig errors. We also propose a ew momet closure fuctio for = 3, which as we will see guaratees better approximatio at least locally i time, as compared to other oes. 16

17 !&!'!&!#!&!$!!!&!$ + -$,!!!&!#!!&!$.$ + -,!!&!'!!&!) -#.!!&!%!!&!(!!&!)!!&#!!&!".#!!&#$!!&!(!!&#'! " #! #" $! $" %! %" * (a) mea error for x 0 = 5!!&!'! " #! #" $! $" %! %" * (b) mea error for x 0 = 0 $&" &'" $ & )&!'% #&" # ($ + (#!'$!&" * )!'#!'" )",!! + *!!&"! " #! #" $! $" %! %" ' (c) variace error for x 0 = 5!!'"! " # $ % &! &" ( (d) variace error for x 0 = 0 Fig.. Evolutios of the mea error µ 1 ν 1 ad of the variace error (µ µ 1 ) (ν ν 1 ) for the differet momet closures i Table 3 for =, with parameters as i (34) ad x 0 = 5 (left) x 0 = 0 (right). Logormal momet closure: Oe ca see from Example 3 of Sectio 5, that a family of logormal momet closure fuctios for µ +1 is give by ϕ l +1 (µ) = µt 1 1 µ t... µ t, C m 1 t m = C +1 1, m=1 C m t m = C +1. (35) m=1 The derivative matchig errors for these momet closure fuctios are give by l ε 0 +1 (x 0) = 0, l ε i +1 (x 0) P x+0 ( + i + 1 w), i {1,,...} (36) where the costat w {1,,...,} is such that m=1 C m k t m = C +1 k, k {1,...,w}, Ck m t m C +1 k, k {w + 1,...,} m=1 with higher values of w correspod to better approximatios. From (35) ad (36), we coclude that the logormal momet closure guaratees that w. But from (B.1) we see that this ca be improved ad we actually set w = for the separable 17

18 derivatives-matchig momet closure, for which s ε 0 +1 (x 0) = 0, s ε i +1 (x 0) P x+0 (i + 1), i {1,,...}. (37) Thus, the separable derivative-matchig momet closure fuctio leads to the best estimate for µ +1, i the sese that it has the least derivative matchig error amog all the momet closure fuctios cosistet with the logormal distributio. Normal momet closure: We first restrict our attetio to the case = 3. We recall from Example that a family of ormal momet closure fuctios for µ 4 were give by 4µ 1 µ 3 + 3µ 1µ µ 1 + 6µ h(µ 1, µ µ 1,µ 3 3µ µ 1 + µ 3 1 ). Its straight forward to see that the fuctio h(κ 1,κ,κ 3 ) correspods to the cumulat closer fuctio for κ 4. However, oe eeds to be careful i pickig the fuctios h. To demostrate this we cosider the followig ormal momet closure fuctios ϕ g 4 (µ) = 4µ 1µ 3 + 3µ 1µ µ 1 + 6µ 1 4 (38) ϕ g1 4 (µ) = 4µ 1µ 3 + 3µ 1µ µ 1 + 6µ µ 3 3µ 1 µ + µ 1 3 (39) ϕ g 4 (µ) = 4µ 1µ 3 + 3µ 1µ µ 1 + 6µ (µ 3 3µ 1 µ + µ 1 3 )µ 1 (40) which correspod to cumulat closure fuctios h(κ 1,κ,κ 3 ) = 0, κ 3 ad κ 3 κ 1 respectively. Usig symbolic maipulatio i Mathematica we have the followig derivative matchig errors for the ormal momet closure fuctios (38) (40): ε i 4 (x 0) P x0 (i + 1), = {g,g1} g ε i 4 (x 0) P x0 (i + ) for all i {1,,...} ad zero for i = 0. Thus, the ormal momet closure fuctios (38) (39) have derivative matchig errors of the same form as (37), ad provide better approximates for µ 4 as compared to (40), for which the derivative matchig errors are a order higher. I geeral for 3, a family of ormal momet closure fuctios for µ +1 is obtaied usig the cumulat closure fuctio κ +1 = h(κ 1,κ,...,κ ) where the fuctio h is zero if ay of κ 3,...,κ is zero. Usig symbolic maipulatio i Mathematica we foud that choosig cumulat closure fuctios as h(κ 1,κ,...,κ ) = f d κ d d=3 18

19 for some costats f d, typically lead to derivative matchig error of the form (37) ad provides good estimates for µ +1. Zero first-order error momet closure: We ow propose a slight modificatio of the ormal momet closure fuctio (38) which is give by ϕ z 4 (µ) = 4µ 1µ 3 + 3µ 1µ µ 1 + 6µ µ µ 1 (41) ad correspods to the cumulat closure fuctio κ for κ 4. It yields the followig derivative matchig errors z ε i 4 (x 0) = 0, i {0,1} z ε i 4 (x 0) P x0 (i + 1), i. Hece, ulike the separable derivative-matchig ad ormal momet closure fuctios, ϕ z 4 (µ) yields zero 0th ad 1 st order derivative matchig errors, ad hece, provides the best estimates for µ 4 as compared to them, at least ear t = 0. I order to gauge the performaces of the above momet closure fuctios we cosider the stochastic logistic model with parameters as i (34), = 3 ad x 0 = 0. We recall from Table 1 that for = 3, we have the followig separable derivativematchig momet closure fuctio ϕ s 4 (µ) = µ4 1 µ4 3 µ 6 Usig (11), we have the followig trucated momet dyamics ν ν = ν ν 1 ν ν 3. (4) ϕ 3(ν) Substitutig the momet closer fuctios (38) (4) i place of ϕ 3 (ν), we obtai the correspodig approximate time evolutio of momets. Figure 3 cotais plots of the mea, variace, ad third cumulat errors. The letters g, g1, g, z ad s represet these errors for the momet closure fuctios (38) (4), respectively. As expected the ormal momet closure fuctios (38) (39) perform much better tha the ormal momet closure fuctio (40). The separable derivative-matchig momet closure fuctio (4) also provide good estimates. Oe ca also see that the zero first-order error momet closure fuctio (41), which guaratees the best approximatio ear t = 0 actually provides i this case the most accurate estimate for µ 4 for all time. As ca be see from Figure ad 3, the mea ad variace errors for x 0 = 0 with = 3 are a order of magitude smaller as compared to the oes with =. 19

20 !'" ()#!!%!!!'"!#!#'"!$!$'"!%!%'",$!&! " #! #" $! $" %! %" &! * (a) mea error for x 0 = 0 -,# +,!'!)!'!(!'!"!'!&!'!%!'!$!'!#!,$ +!!'!#! " #! #" $! $" %! %" &! * (b) variace error for x 0 = 0,,# -!'$!, +!!'$!!'& -,#!!')!!'(,$!#!#'$! " #! #" $! $" %! %" &! * (c) third cumulat error for x 0 = 0 Fig. 3. Evolutios of the mea error µ 1 ν 1, variace error (µ µ 1 ) (ν ν1 ), ad third cumulat error (µ 3 3µ µ 1 + µ 1 3) (ν 3 3ν ν 1 + ν1 3 ) for the differet momet closure fuctios (38) (4) for = 3, with parameters as i (34) ad x 0 = Steady-State Solutios of the Trucated Momet Dyamics We ow look at the steady-state solutios of the trucated momet dyamics (17) for the differet momet closure techiques Separable Derivative-Matchig Momet closure Cosider the trucated momet dyamics of order N with momet closure fuctios as give i Table 1. From (17), at steady-state we have 0 = Aν s ( ) + Bϕ s +1 (νs ( )) (43) where ν s ( ) deotes the steady-state solutio. Usig (16) at steady-state we have ν s ( ) = c 1ν s 1 ( ). ν s ( ) = c 1 ν s 1 ( ) (44a) (44b) 0

21 ϕ +1 (ν s ( )) = c ν s 1 ( ) (44c) for some positive real umbers c 1,...,c. Usig the above equalities ad Table 1 we coclude that ϕ3 s (νs ( )) = c 3 1, ϕs 4 (νs ( )) = c4 c 6 ν1 s ( ), 1 ϕ s 5 (νs ( )) = c10 1 c5 3 c 10,... (45) for {,3,4,...} respectively. Substitutig (45) i (44) yields the followig uique o-trivial solutio for ν s 1 ( ) c = ν1 s ( ) = = 3 c 3 1 c 6 1 c 3 c 4 c 10 1 c5 3 c 10 c 4 = 4 ad the correspodig ν s ( ),...,νs ( ) ca be calculated from (44). Hece, the separable derivative-matchig momet closure always yields a uique o-trivial positive real steady-state N. I terms of the parameters a 1, b 1, a ad b, the costats c 1, c ad c 3 are give as follows c 1 = K, c = K + σ, c 3 = K 3 + 3Kσ + σσ K = a 1 a b 1 + b, σ = a 1b + b 1 a (b 1 + b ), σ = b b 1 b + b 1, ad hece, ν1 s ( ) = K 1+ σ ) K (1+ 3σ K + σσ K 3 K = (1+ σ K ) 4 = Other Momet closure techiques I this sectio we will see that the momet closure fuctios which lack the separable structure of (0), ca lead to scearios of biologically meaigless steadystate solutios for the trucated momet dyamics (17). Substitutig the momet closure fuctios from Table i (43), we get the followig o-trivial steady-state solutios for = : [ ν g 3 1 ( ) = K 4 ± 1 (1 8σ ) 1 4 K ν p1 1 ( ) = K [ 3 4 ± 1 4 ] ( 1 8(σ 1) ) 1 K ] 1

22 [ ν p 3K 1 1 ( ) = ± 1 ((K + 1) 8σ ) 1 ] 4 4 K ν1 b ( ) = K σ K 1. From the above steady-states we coclude the followig for = : (1) The biomial momet closure fuctio leads to a uique o-trivial attractig real steady-state, which ca be egative for a rage of parameters. () Normal, Nasell-poiso ad ew-poiso momet closure fuctios, yield two o-trivial steady-states, with the oe with the sig beig a spurious steadystate. Followig the defiitio by Nasell (003b), a steady state is spurious, if lim M ν 1 ( ) K, where σ ad K are both O(M). For =, all these spurious steady-states happe to be ustable, ad hece, the trucated model will ot coverge to them. Whe the parameters are chose, such that the term uder the square root sig is egative, the both the o-trivial steady-states would be imagiary, ad hece, biologically meaigless. I geeral for 3, the ormal momet closure fuctios itroduced i Sectio 6.1. yield K 3 o-trivial steady-states with K 1 of them beig spurious. For example, for = 3, the ormal ad the zero first-order error momet closure fuctios (38) ad (41) yield 3 o-trivial steady-state solutios give as the roots of the third order polyomials ad (3c 1 + 4c )ν 1 ( ) 1c 1 ν 1 ( ) + 6ν 1 ( ) 3 = c 3, (3c 1 + 4c 1)ν 1 ( ) 1c 1 ν 1 ( ) + 6ν 1 ( ) 3 = c 3 c 1, respectively, with of them beig spurious. Also for a rage of parameter values, biologically meaigless scearios of a combiatio of imagiary ad egative steady states ca happe. O the other had, the separable derivative-matchig momet closure fuctio with a uique o-trivial positive real steady-state N has a clear advatage. 7 Coclusio ad Future Work A procedure for costructig momet closures for the stochastic logistic model was preseted. This was doe by first assumig a separable form for the momet closure fuctio ϕ +1 (ν), ad the, matchig its time derivatives with µ +1, at some iitial time t 0. We showed that for iitial coditios x(t 0 ) = x 0 with probability oe, there exists a uique separable derivative-matchig momet closure

23 fuctio for which the i th derivative matchig error is a polyomial i x 0 of order i + 1 for all i {1,,...} ad zero for i = 0. Explicit formulas to costruct these momet closure fuctios were provided. Comparisos with alterative momet closure techiques available i literature were carried out based o trasiet performace ad steady-state solutios of the trucated momet dyamics, which led to the followig coclusios: (1) Derivative matchig ca be used as a effective tool for gaugig the performace of momet closure fuctios. We showed that for =, with the exceptio of the Nasell-poisso, all other momet closure fuctios i Table perform derivative matchig ad give fairly good estimates of µ 3. For 3, we showed that amog the momet closure fuctios cosistet with the logormal distributio, the separable derivatives-matchig momet closure fuctio provides the best estimate for µ +1. We also proposed families of ormal momet closure fuctios that perform derivative matchig ad result i good estimates. For = 3, a ew zero first-order error momet closure fuctio was also proposed which guarateed better approximatios, at least locally i time, as compared to the other momet closure fuctios discussed i this paper. () The separable derivative-matchig momet closure, always yields a uique o-trivial positive real steady-state N, ad hece, i some sese superior to the other momet closures, which ca have spurious, imagiary ad eve stable egative steady-states. Possible directios for future research iclude the developmet of a systematic procedure to costruct momet closure fuctios of the form (41) which ca yield zero derivative matchig errors up to ay order ad the extesio of the results i this paper to multi-specie birth-death Markov processes. Primary results regardig the latter ca be foud i Hespaha ad Sigh (005). A Appedix Substitutig (4), (7) ad (8) i (10) ad doig a biomial expasio we have dµ m dt = E[(x + 1) m x m )η(x) + (x 1) m x m )χ(x)] = E = E [ m j=1c mj [(a 1 x b 1 x ) + ( 1) j (a x + b x )]x m j ] [ ] m C m j f ( j, p)x m j+p j=1 (A.1) where C m j ad f ( j, p) are defied i (1) ad (13). Usig (A.1), (1) ad (13) we coclude that the evolutio of µ m, m N, ca be writte as 3

24 µ m = = = m C m j f ( j, p)µ m j+p j=1 m+p 1 C m m+p r f (m + p r, p)µ r, r=p m+1 C m m+p r f (m + p r, p)µ r. r=1 r = m j + p (A.) B Appedix Proof of Theorem : STEP 1: We first show that with γ m chose as the solutio to the liear system of equatios C +1 k = γ m C m k, k = {1,...,}. (B.1) m=1 equalities (3) hold. Usig (15), (16) ad (17) oe ca see that the followig equalities imply (3): µ +1 (t 0 ) = ϕ+1 s (ν(t 0)) (B.) dµ +1 (t) dt t=t0 = dϕs +1 (ν(t)) dt t=t0 + s ε+1(x 1 0 ), (B.3) where s ε 1 +1 (x 0) is a polyomial i x 0 of order. Let γ m be chose as the solutio of (B.1). We show ext that equalities (B.) ad (B.3) hold. With iitial coditios startig o the set of determiistic distributios, we have µ m (t 0 ) = x m 0. From µ(t 0) = ν(t 0 ), (0) ad (B.1) we have µ +1 (t 0 ) = x +1 0 = x m=1 γ mc m 1 0 = ϕ s +1 (µ(t 0)) = ϕ s +1 (ν(t 0)) which proves (B.). From (A.) we have µ +1 (t) = µ +1 (t 0 ) = + r=1 + r=3 C p r f ( p r, p)µ r C p r f ( p r, p)xr 0 + s 1 ε1 +1(x 0 ), (B.4) where s 1 ε1 +1 (x 0) is a polyomial i x 0 of order. Usig (A.) ad (17) we have 4

25 ν m = m+1 C m m+p r f (m + p r, p)ν r, ν +1 = ϕ+1 s (ν). r=1 (B.5) Thus, from (0), (B.1), (B.5) ad ν(t 0 ) = [x 0,...,x 0 ]T dϕ+1 s (ν(t)) = dt = dϕ+1 s (ν(t)) dt t=t0 = = m=1 γ m ν γ 1 1 νγ m 1 m m=1 m=1 m=1 m+1 γ m ν γ 1 r=1 ν γ ν m 1 νγ m 1 m ν γ C m m+p r f (m + p r, p)ν r, m+1 γ m C m m+p r f (m + p r, p)x ( m=1 γ mm)+r m 0 r=1 m+1 γ m C m m+p r f (m + p r, p)x0 +1+r m. r=1 With a chage of variable q = r m, the last equality becomes dϕ+1 s (ν(t)) dt t=t0 = = + q=3 m=1 m=1 + q=+ m γ m C m +1+p q f ( p q, p)xq 0 γ m C m +1+p q f ( p q, p)xq 0 + s ε1 +1(x 0 ), (B.6) where s ε1 +1 (x 0) is a polyomial i x 0 of order. Usig (B.1), equality (B.6) reduces to dϕ+1 s (ν(t)) t=t0 = dt + q=3 C p q f ( p q, p)xq 0 + s ε1 +1(x 0 ). (B.7) Comparig (B.7) with (B.4) oe ca see that (B.3) holds. STEP : We ow show that solutio to (B.1) is uique ad give by (). Towards that ed, we observe that for all z R, oe ca write usig biomial expasio, [1 (1 + z)] +1 = +1 v=0 = 1 + C +1 v ( 1) v (1 + z) v +1 v=1 C +1 v ( 1) v v C v wz w. w=0 (B.8) Equatig coefficiets for z s, s {1,...,} o both sides of (B.8) we have 0 = +1 v=1 C +1 v ( 1) v C v s 5

26 ( 1) C +1 s = C +1 v ( 1) v C v s. (B.9) v=1 Comparig (B.9) with (B.1) oe ca see that a solutio to (B.1) will be (). Also the system of liear equatios (B.1) ca be put ito the form C = Πγ where γ = [γ 1,...,γ ] T, C = [C1 +1,...,C +1 ] T ad C 1 1 C 1... C 1 0 C Π =... C Cm m As the upper triagular matrix Π is o-sigular, the above solutio to γ m is uique. Refereces Bailey, N. T. J., The Elemets of Stochastic Processes. Wiley, New York. Barlett, M. S., Gower, J. S., Leslie, P. H., A compariso of theoretical ad empirical results for some stochastic models. Biometrika 47, Hespaha, J. P., Mar Stochastic hybrid systems: Applicatios to commuicatio etworks. I: Alur, R., Pappas, G. J. (Eds.), Hybrid Systems: Computatio ad Cotrol. No. 993 i Lect. Notes i Comput. Sciece. Spriger-Verlag, Berli, pp Hespaha, J. P., Sigh, A., 005. Stochastic models for chemically reactig systems usig polyomial stochastic hybrid systems. It. J. of Robust ad Noliear Cotrol 15, Keelig, M. J., 000. Multiplicative momets ad measures of persistece i ecology. J. of Theoretical Biology 05, Matis, J. H., Kiffe, T. R., O apprroximatig the momets of the equilibrium distributio of a stochastic logisitc model. Biometrics 5, Matis, J. H., Kiffe, T. R., 00. O iteractig bee/mite populatios: a stochastic model with aalysis usig cumulat trucatio. Evirometal ad Ecological Statistics 9, Matis, J. H., Kiffe, T. R., Parthasarathy, P. R., O the cumulat of populatio size for the stochastic power law logisitc model. Theoretical Populatio Biology 53, Nasell, I., 001. Extictio ad quasi-statioarity i the verhulst logistic model. J. of Theoretical Biology 11, Nasell, I., 003a. A extesio of the momet closure method. Theoretical Populatio Biology 64,

27 Nasell, I., 003b. Momet closure ad the stochastic logistic model. Theoretical Populatio Biology 63, Pielou, E. C., Mathematical Ecology. Wiley, New York. Whittle, P., O the use of the ormal approximatio i the treatmet of stochastic processes. J. Roy. Statist. Soc., Ser. B 19,

Moment Closure Techniques for Stochastic Models in Population Biology

Moment Closure Techniques for Stochastic Models in Population Biology Moment Closure Techniques for Stochastic Models in Population Biology Abhyudai Singh and João Pedro Hespanha Abstract Continuous-time birth-death Markov processes serve as useful models in population biology.

More information

6.3 Testing Series With Positive Terms

6.3 Testing Series With Positive Terms 6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial

More information

Infinite Sequences and Series

Infinite Sequences and Series Chapter 6 Ifiite Sequeces ad Series 6.1 Ifiite Sequeces 6.1.1 Elemetary Cocepts Simply speakig, a sequece is a ordered list of umbers writte: {a 1, a 2, a 3,...a, a +1,...} where the elemets a i represet

More information

Stochastic Simulation

Stochastic Simulation Stochastic Simulatio 1 Itroductio Readig Assigmet: Read Chapter 1 of text. We shall itroduce may of the key issues to be discussed i this course via a couple of model problems. Model Problem 1 (Jackso

More information

ENGI Series Page 6-01

ENGI Series Page 6-01 ENGI 3425 6 Series Page 6-01 6. Series Cotets: 6.01 Sequeces; geeral term, limits, covergece 6.02 Series; summatio otatio, covergece, divergece test 6.03 Stadard Series; telescopig series, geometric series,

More information

Lesson 10: Limits and Continuity

Lesson 10: Limits and Continuity www.scimsacademy.com Lesso 10: Limits ad Cotiuity SCIMS Academy 1 Limit of a fuctio The cocept of limit of a fuctio is cetral to all other cocepts i calculus (like cotiuity, derivative, defiite itegrals

More information

3. Z Transform. Recall that the Fourier transform (FT) of a DT signal xn [ ] is ( ) [ ] = In order for the FT to exist in the finite magnitude sense,

3. Z Transform. Recall that the Fourier transform (FT) of a DT signal xn [ ] is ( ) [ ] = In order for the FT to exist in the finite magnitude sense, 3. Z Trasform Referece: Etire Chapter 3 of text. Recall that the Fourier trasform (FT) of a DT sigal x [ ] is ω ( ) [ ] X e = j jω k = xe I order for the FT to exist i the fiite magitude sese, S = x [

More information

A NEW CLASS OF 2-STEP RATIONAL MULTISTEP METHODS

A NEW CLASS OF 2-STEP RATIONAL MULTISTEP METHODS Jural Karya Asli Loreka Ahli Matematik Vol. No. (010) page 6-9. Jural Karya Asli Loreka Ahli Matematik A NEW CLASS OF -STEP RATIONAL MULTISTEP METHODS 1 Nazeeruddi Yaacob Teh Yua Yig Norma Alias 1 Departmet

More information

Comparison Study of Series Approximation. and Convergence between Chebyshev. and Legendre Series

Comparison Study of Series Approximation. and Convergence between Chebyshev. and Legendre Series Applied Mathematical Scieces, Vol. 7, 03, o. 6, 3-337 HIKARI Ltd, www.m-hikari.com http://d.doi.org/0.988/ams.03.3430 Compariso Study of Series Approimatio ad Covergece betwee Chebyshev ad Legedre Series

More information

Taylor polynomial solution of difference equation with constant coefficients via time scales calculus

Taylor polynomial solution of difference equation with constant coefficients via time scales calculus TMSCI 3, o 3, 129-135 (2015) 129 ew Treds i Mathematical Scieces http://wwwtmscicom Taylor polyomial solutio of differece equatio with costat coefficiets via time scales calculus Veysel Fuat Hatipoglu

More information

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + 62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of

More information

(A sequence also can be thought of as the list of function values attained for a function f :ℵ X, where f (n) = x n for n 1.) x 1 x N +k x N +4 x 3

(A sequence also can be thought of as the list of function values attained for a function f :ℵ X, where f (n) = x n for n 1.) x 1 x N +k x N +4 x 3 MATH 337 Sequeces Dr. Neal, WKU Let X be a metric space with distace fuctio d. We shall defie the geeral cocept of sequece ad limit i a metric space, the apply the results i particular to some special

More information

Product measures, Tonelli s and Fubini s theorems For use in MAT3400/4400, autumn 2014 Nadia S. Larsen. Version of 13 October 2014.

Product measures, Tonelli s and Fubini s theorems For use in MAT3400/4400, autumn 2014 Nadia S. Larsen. Version of 13 October 2014. Product measures, Toelli s ad Fubii s theorems For use i MAT3400/4400, autum 2014 Nadia S. Larse Versio of 13 October 2014. 1. Costructio of the product measure The purpose of these otes is to preset the

More information

Lecture 8: Solving the Heat, Laplace and Wave equations using finite difference methods

Lecture 8: Solving the Heat, Laplace and Wave equations using finite difference methods Itroductory lecture otes o Partial Differetial Equatios - c Athoy Peirce. Not to be copied, used, or revised without explicit writte permissio from the copyright ower. 1 Lecture 8: Solvig the Heat, Laplace

More information

Castiel, Supernatural, Season 6, Episode 18

Castiel, Supernatural, Season 6, Episode 18 13 Differetial Equatios the aswer to your questio ca best be epressed as a series of partial differetial equatios... Castiel, Superatural, Seaso 6, Episode 18 A differetial equatio is a mathematical equatio

More information

Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.

Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n. Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator

More information

CEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering

CEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering CEE 5 Autum 005 Ucertaity Cocepts for Geotechical Egieerig Basic Termiology Set A set is a collectio of (mutually exclusive) objects or evets. The sample space is the (collectively exhaustive) collectio

More information

Lecture 19: Convergence

Lecture 19: Convergence Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may

More information

Convergence of random variables. (telegram style notes) P.J.C. Spreij

Convergence of random variables. (telegram style notes) P.J.C. Spreij Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space

More information

SRC Technical Note June 17, Tight Thresholds for The Pure Literal Rule. Michael Mitzenmacher. d i g i t a l

SRC Technical Note June 17, Tight Thresholds for The Pure Literal Rule. Michael Mitzenmacher. d i g i t a l SRC Techical Note 1997-011 Jue 17, 1997 Tight Thresholds for The Pure Literal Rule Michael Mitzemacher d i g i t a l Systems Research Ceter 130 Lytto Aveue Palo Alto, Califoria 94301 http://www.research.digital.com/src/

More information

MAT1026 Calculus II Basic Convergence Tests for Series

MAT1026 Calculus II Basic Convergence Tests for Series MAT026 Calculus II Basic Covergece Tests for Series Egi MERMUT 202.03.08 Dokuz Eylül Uiversity Faculty of Sciece Departmet of Mathematics İzmir/TURKEY Cotets Mootoe Covergece Theorem 2 2 Series of Real

More information

Chapter 3. Strong convergence. 3.1 Definition of almost sure convergence

Chapter 3. Strong convergence. 3.1 Definition of almost sure convergence Chapter 3 Strog covergece As poited out i the Chapter 2, there are multiple ways to defie the otio of covergece of a sequece of radom variables. That chapter defied covergece i probability, covergece i

More information

CHAPTER 10 INFINITE SEQUENCES AND SERIES

CHAPTER 10 INFINITE SEQUENCES AND SERIES CHAPTER 10 INFINITE SEQUENCES AND SERIES 10.1 Sequeces 10.2 Ifiite Series 10.3 The Itegral Tests 10.4 Compariso Tests 10.5 The Ratio ad Root Tests 10.6 Alteratig Series: Absolute ad Coditioal Covergece

More information

The standard deviation of the mean

The standard deviation of the mean Physics 6C Fall 20 The stadard deviatio of the mea These otes provide some clarificatio o the distictio betwee the stadard deviatio ad the stadard deviatio of the mea.. The sample mea ad variace Cosider

More information

Definition 4.2. (a) A sequence {x n } in a Banach space X is a basis for X if. unique scalars a n (x) such that x = n. a n (x) x n. (4.

Definition 4.2. (a) A sequence {x n } in a Banach space X is a basis for X if. unique scalars a n (x) such that x = n. a n (x) x n. (4. 4. BASES I BAACH SPACES 39 4. BASES I BAACH SPACES Sice a Baach space X is a vector space, it must possess a Hamel, or vector space, basis, i.e., a subset {x γ } γ Γ whose fiite liear spa is all of X ad

More information

Singular Continuous Measures by Michael Pejic 5/14/10

Singular Continuous Measures by Michael Pejic 5/14/10 Sigular Cotiuous Measures by Michael Peic 5/4/0 Prelimiaries Give a set X, a σ-algebra o X is a collectio of subsets of X that cotais X ad ad is closed uder complemetatio ad coutable uios hece, coutable

More information

Subject: Differential Equations & Mathematical Modeling-III

Subject: Differential Equations & Mathematical Modeling-III Power Series Solutios of Differetial Equatios about Sigular poits Subject: Differetial Equatios & Mathematical Modelig-III Lesso: Power series solutios of differetial equatios about Sigular poits Lesso

More information

Lecture 10 October Minimaxity and least favorable prior sequences

Lecture 10 October Minimaxity and least favorable prior sequences STATS 300A: Theory of Statistics Fall 205 Lecture 0 October 22 Lecturer: Lester Mackey Scribe: Brya He, Rahul Makhijai Warig: These otes may cotai factual ad/or typographic errors. 0. Miimaxity ad least

More information

Discrete Mathematics for CS Spring 2008 David Wagner Note 22

Discrete Mathematics for CS Spring 2008 David Wagner Note 22 CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 22 I.I.D. Radom Variables Estimatig the bias of a coi Questio: We wat to estimate the proportio p of Democrats i the US populatio, by takig

More information

Math 312 Lecture Notes One Dimensional Maps

Math 312 Lecture Notes One Dimensional Maps Math 312 Lecture Notes Oe Dimesioal Maps Warre Weckesser Departmet of Mathematics Colgate Uiversity 21-23 February 25 A Example We begi with the simplest model of populatio growth. Suppose, for example,

More information

FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures

FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING Lectures MODULE 5 STATISTICS II. Mea ad stadard error of sample data. Biomial distributio. Normal distributio 4. Samplig 5. Cofidece itervals

More information

Chapter 10: Power Series

Chapter 10: Power Series Chapter : Power Series 57 Chapter Overview: Power Series The reaso series are part of a Calculus course is that there are fuctios which caot be itegrated. All power series, though, ca be itegrated because

More information

Chapter 4. Fourier Series

Chapter 4. Fourier Series Chapter 4. Fourier Series At this poit we are ready to ow cosider the caoical equatios. Cosider, for eample the heat equatio u t = u, < (4.) subject to u(, ) = si, u(, t) = u(, t) =. (4.) Here,

More information

Sequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence

Sequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece 1, 1, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet

More information

A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence

A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece,, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet as

More information

Notes 27 : Brownian motion: path properties

Notes 27 : Brownian motion: path properties Notes 27 : Browia motio: path properties Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces:[Dur10, Sectio 8.1], [MP10, Sectio 1.1, 1.2, 1.3]. Recall: DEF 27.1 (Covariace) Let X = (X

More information

Chapter 9: Numerical Differentiation

Chapter 9: Numerical Differentiation 178 Chapter 9: Numerical Differetiatio Numerical Differetiatio Formulatio of equatios for physical problems ofte ivolve derivatives (rate-of-chage quatities, such as velocity ad acceleratio). Numerical

More information

We are mainly going to be concerned with power series in x, such as. (x)} converges - that is, lims N n

We are mainly going to be concerned with power series in x, such as. (x)} converges - that is, lims N n Review of Power Series, Power Series Solutios A power series i x - a is a ifiite series of the form c (x a) =c +c (x a)+(x a) +... We also call this a power series cetered at a. Ex. (x+) is cetered at

More information

Sequences. Notation. Convergence of a Sequence

Sequences. Notation. Convergence of a Sequence Sequeces A sequece is essetially just a list. Defiitio (Sequece of Real Numbers). A sequece of real umbers is a fuctio Z (, ) R for some real umber. Do t let the descriptio of the domai cofuse you; it

More information

The Growth of Functions. Theoretical Supplement

The Growth of Functions. Theoretical Supplement The Growth of Fuctios Theoretical Supplemet The Triagle Iequality The triagle iequality is a algebraic tool that is ofte useful i maipulatig absolute values of fuctios. The triagle iequality says that

More information

CS284A: Representations and Algorithms in Molecular Biology

CS284A: Representations and Algorithms in Molecular Biology CS284A: Represetatios ad Algorithms i Molecular Biology Scribe Notes o Lectures 3 & 4: Motif Discovery via Eumeratio & Motif Represetatio Usig Positio Weight Matrix Joshua Gervi Based o presetatios by

More information

An Introduction to Randomized Algorithms

An Introduction to Randomized Algorithms A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis

More information

Taylor expansion: Show that the TE of f(x)= sin(x) around. sin(x) = x - + 3! 5! L 7 & 8: MHD/ZAH

Taylor expansion: Show that the TE of f(x)= sin(x) around. sin(x) = x - + 3! 5! L 7 & 8: MHD/ZAH Taylor epasio: Let ƒ() be a ifiitely differetiable real fuctio. A ay poit i the eighbourhood of 0, the fuctio ƒ() ca be represeted by a power series of the followig form: X 0 f(a) f() f() ( ) f( ) ( )

More information

Random Models. Tusheng Zhang. February 14, 2013

Random Models. Tusheng Zhang. February 14, 2013 Radom Models Tusheg Zhag February 14, 013 1 Radom Walks Let me describe the model. Radom walks are used to describe the motio of a movig particle (object). Suppose that a particle (object) moves alog the

More information

μ are complex parameters. Other

μ are complex parameters. Other A New Numerical Itegrator for the Solutio of Iitial Value Problems i Ordiary Differetial Equatios. J. Suday * ad M.R. Odekule Departmet of Mathematical Scieces, Adamawa State Uiversity, Mubi, Nigeria.

More information

Notes on iteration and Newton s method. Iteration

Notes on iteration and Newton s method. Iteration Notes o iteratio ad Newto s method Iteratio Iteratio meas doig somethig over ad over. I our cotet, a iteratio is a sequece of umbers, vectors, fuctios, etc. geerated by a iteratio rule of the type 1 f

More information

A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS

A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS J. Japa Statist. Soc. Vol. 41 No. 1 2011 67 73 A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS Yoichi Nishiyama* We cosider k-sample ad chage poit problems for idepedet data i a

More information

TR/46 OCTOBER THE ZEROS OF PARTIAL SUMS OF A MACLAURIN EXPANSION A. TALBOT

TR/46 OCTOBER THE ZEROS OF PARTIAL SUMS OF A MACLAURIN EXPANSION A. TALBOT TR/46 OCTOBER 974 THE ZEROS OF PARTIAL SUMS OF A MACLAURIN EXPANSION by A. TALBOT .. Itroductio. A problem i approximatio theory o which I have recetly worked [] required for its solutio a proof that the

More information

K. Grill Institut für Statistik und Wahrscheinlichkeitstheorie, TU Wien, Austria

K. Grill Institut für Statistik und Wahrscheinlichkeitstheorie, TU Wien, Austria MARKOV PROCESSES K. Grill Istitut für Statistik ud Wahrscheilichkeitstheorie, TU Wie, Austria Keywords: Markov process, Markov chai, Markov property, stoppig times, strog Markov property, trasitio matrix,

More information

A Note on Matrix Rigidity

A Note on Matrix Rigidity A Note o Matrix Rigidity Joel Friedma Departmet of Computer Sciece Priceto Uiversity Priceto, NJ 08544 Jue 25, 1990 Revised October 25, 1991 Abstract I this paper we give a explicit costructio of matrices

More information

Stochastic Matrices in a Finite Field

Stochastic Matrices in a Finite Field Stochastic Matrices i a Fiite Field Abstract: I this project we will explore the properties of stochastic matrices i both the real ad the fiite fields. We first explore what properties 2 2 stochastic matrices

More information

Polynomial Functions and Their Graphs

Polynomial Functions and Their Graphs Polyomial Fuctios ad Their Graphs I this sectio we begi the study of fuctios defied by polyomial expressios. Polyomial ad ratioal fuctios are the most commo fuctios used to model data, ad are used extesively

More information

7.1 Convergence of sequences of random variables

7.1 Convergence of sequences of random variables Chapter 7 Limit theorems Throughout this sectio we will assume a probability space (Ω, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite

More information

Estimation for Complete Data

Estimation for Complete Data Estimatio for Complete Data complete data: there is o loss of iformatio durig study. complete idividual complete data= grouped data A complete idividual data is the oe i which the complete iformatio of

More information

4. Partial Sums and the Central Limit Theorem

4. Partial Sums and the Central Limit Theorem 1 of 10 7/16/2009 6:05 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 4. Partial Sums ad the Cetral Limit Theorem The cetral limit theorem ad the law of large umbers are the two fudametal theorems

More information

Sequences and Series of Functions

Sequences and Series of Functions Chapter 6 Sequeces ad Series of Fuctios 6.1. Covergece of a Sequece of Fuctios Poitwise Covergece. Defiitio 6.1. Let, for each N, fuctio f : A R be defied. If, for each x A, the sequece (f (x)) coverges

More information

CHAPTER 5. Theory and Solution Using Matrix Techniques

CHAPTER 5. Theory and Solution Using Matrix Techniques A SERIES OF CLASS NOTES FOR 2005-2006 TO INTRODUCE LINEAR AND NONLINEAR PROBLEMS TO ENGINEERS, SCIENTISTS, AND APPLIED MATHEMATICIANS DE CLASS NOTES 3 A COLLECTION OF HANDOUTS ON SYSTEMS OF ORDINARY DIFFERENTIAL

More information

FIR Filter Design: Part II

FIR Filter Design: Part II EEL335: Discrete-Time Sigals ad Systems. Itroductio I this set of otes, we cosider how we might go about desigig FIR filters with arbitrary frequecy resposes, through compositio of multiple sigle-peak

More information

L 5 & 6: RelHydro/Basel. f(x)= ( ) f( ) ( ) ( ) ( ) n! 1! 2! 3! If the TE of f(x)= sin(x) around x 0 is: sin(x) = x - 3! 5!

L 5 & 6: RelHydro/Basel. f(x)= ( ) f( ) ( ) ( ) ( ) n! 1! 2! 3! If the TE of f(x)= sin(x) around x 0 is: sin(x) = x - 3! 5! aylor epasio: Let ƒ() be a ifiitely differetiable real fuctio. At ay poit i the eighbourhood of =0, the fuctio ca be represeted as a power series of the followig form: X 0 f(a) f() ƒ() f()= ( ) f( ) (

More information

Generalized Semi- Markov Processes (GSMP)

Generalized Semi- Markov Processes (GSMP) Geeralized Semi- Markov Processes (GSMP) Summary Some Defiitios Markov ad Semi-Markov Processes The Poisso Process Properties of the Poisso Process Iterarrival times Memoryless property ad the residual

More information

Chapter 6 Infinite Series

Chapter 6 Infinite Series Chapter 6 Ifiite Series I the previous chapter we cosidered itegrals which were improper i the sese that the iterval of itegratio was ubouded. I this chapter we are goig to discuss a topic which is somewhat

More information

Most text will write ordinary derivatives using either Leibniz notation 2 3. y + 5y= e and y y. xx tt t

Most text will write ordinary derivatives using either Leibniz notation 2 3. y + 5y= e and y y. xx tt t Itroductio to Differetial Equatios Defiitios ad Termiolog Differetial Equatio: A equatio cotaiig the derivatives of oe or more depedet variables, with respect to oe or more idepedet variables, is said

More information

Basis for simulation techniques

Basis for simulation techniques Basis for simulatio techiques M. Veeraraghava, March 7, 004 Estimatio is based o a collectio of experimetal outcomes, x, x,, x, where each experimetal outcome is a value of a radom variable. x i. Defiitios

More information

7.1 Convergence of sequences of random variables

7.1 Convergence of sequences of random variables Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite

More information

The axial dispersion model for tubular reactors at steady state can be described by the following equations: dc dz R n cn = 0 (1) (2) 1 d 2 c.

The axial dispersion model for tubular reactors at steady state can be described by the following equations: dc dz R n cn = 0 (1) (2) 1 d 2 c. 5.4 Applicatio of Perturbatio Methods to the Dispersio Model for Tubular Reactors The axial dispersio model for tubular reactors at steady state ca be described by the followig equatios: d c Pe dz z =

More information

Random Variables, Sampling and Estimation

Random Variables, Sampling and Estimation Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig

More information

Research Article A New Second-Order Iteration Method for Solving Nonlinear Equations

Research Article A New Second-Order Iteration Method for Solving Nonlinear Equations Abstract ad Applied Aalysis Volume 2013, Article ID 487062, 4 pages http://dx.doi.org/10.1155/2013/487062 Research Article A New Secod-Order Iteratio Method for Solvig Noliear Equatios Shi Mi Kag, 1 Arif

More information

Ma 530 Introduction to Power Series

Ma 530 Introduction to Power Series Ma 530 Itroductio to Power Series Please ote that there is material o power series at Visual Calculus. Some of this material was used as part of the presetatio of the topics that follow. What is a Power

More information

The z-transform. 7.1 Introduction. 7.2 The z-transform Derivation of the z-transform: x[n] = z n LTI system, h[n] z = re j

The z-transform. 7.1 Introduction. 7.2 The z-transform Derivation of the z-transform: x[n] = z n LTI system, h[n] z = re j The -Trasform 7. Itroductio Geeralie the complex siusoidal represetatio offered by DTFT to a represetatio of complex expoetial sigals. Obtai more geeral characteristics for discrete-time LTI systems. 7.

More information

It is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function.

It is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function. MATH 532 Measurable Fuctios Dr. Neal, WKU Throughout, let ( X, F, µ) be a measure space ad let (!, F, P ) deote the special case of a probability space. We shall ow begi to study real-valued fuctios defied

More information

Math 113 Exam 3 Practice

Math 113 Exam 3 Practice Math Exam Practice Exam 4 will cover.-., 0. ad 0.. Note that eve though. was tested i exam, questios from that sectios may also be o this exam. For practice problems o., refer to the last review. This

More information

Roberto s Notes on Series Chapter 2: Convergence tests Section 7. Alternating series

Roberto s Notes on Series Chapter 2: Convergence tests Section 7. Alternating series Roberto s Notes o Series Chapter 2: Covergece tests Sectio 7 Alteratig series What you eed to kow already: All basic covergece tests for evetually positive series. What you ca lear here: A test for series

More information

The Riemann Zeta Function

The Riemann Zeta Function Physics 6A Witer 6 The Riema Zeta Fuctio I this ote, I will sketch some of the mai properties of the Riema zeta fuctio, ζ(x). For x >, we defie ζ(x) =, x >. () x = For x, this sum diverges. However, we

More information

Statistics 511 Additional Materials

Statistics 511 Additional Materials Cofidece Itervals o mu Statistics 511 Additioal Materials This topic officially moves us from probability to statistics. We begi to discuss makig ifereces about the populatio. Oe way to differetiate probability

More information

10-701/ Machine Learning Mid-term Exam Solution

10-701/ Machine Learning Mid-term Exam Solution 0-70/5-78 Machie Learig Mid-term Exam Solutio Your Name: Your Adrew ID: True or False (Give oe setece explaatio) (20%). (F) For a cotiuous radom variable x ad its probability distributio fuctio p(x), it

More information

(b) What is the probability that a particle reaches the upper boundary n before the lower boundary m?

(b) What is the probability that a particle reaches the upper boundary n before the lower boundary m? MATH 529 The Boudary Problem The drukard s walk (or boudary problem) is oe of the most famous problems i the theory of radom walks. Oe versio of the problem is described as follows: Suppose a particle

More information

Finally, we show how to determine the moments of an impulse response based on the example of the dispersion model.

Finally, we show how to determine the moments of an impulse response based on the example of the dispersion model. 5.3 Determiatio of Momets Fially, we show how to determie the momets of a impulse respose based o the example of the dispersio model. For the dispersio model we have that E θ (θ ) curve is give by eq (4).

More information

Kinetics of Complex Reactions

Kinetics of Complex Reactions Kietics of Complex Reactios by Flick Colema Departmet of Chemistry Wellesley College Wellesley MA 28 wcolema@wellesley.edu Copyright Flick Colema 996. All rights reserved. You are welcome to use this documet

More information

ENGI Series Page 5-01

ENGI Series Page 5-01 ENGI 344 5 Series Page 5-01 5. Series Cotets: 5.01 Sequeces; geeral term, limits, covergece 5.0 Series; summatio otatio, covergece, divergece test 5.03 Series; telescopig series, geometric series, p-series

More information

Discrete Mathematics and Probability Theory Summer 2014 James Cook Note 15

Discrete Mathematics and Probability Theory Summer 2014 James Cook Note 15 CS 70 Discrete Mathematics ad Probability Theory Summer 2014 James Cook Note 15 Some Importat Distributios I this ote we will itroduce three importat probability distributios that are widely used to model

More information

1 Approximating Integrals using Taylor Polynomials

1 Approximating Integrals using Taylor Polynomials Seughee Ye Ma 8: Week 7 Nov Week 7 Summary This week, we will lear how we ca approximate itegrals usig Taylor series ad umerical methods. Topics Page Approximatig Itegrals usig Taylor Polyomials. Defiitios................................................

More information

CS537. Numerical Analysis and Computing

CS537. Numerical Analysis and Computing CS57 Numerical Aalysis ad Computig Lecture Locatig Roots o Equatios Proessor Ju Zhag Departmet o Computer Sciece Uiversity o Ketucky Leigto KY 456-6 Jauary 9 9 What is the Root May physical system ca be

More information

Berry-Esseen bounds for self-normalized martingales

Berry-Esseen bounds for self-normalized martingales Berry-Essee bouds for self-ormalized martigales Xiequa Fa a, Qi-Ma Shao b a Ceter for Applied Mathematics, Tiaji Uiversity, Tiaji 30007, Chia b Departmet of Statistics, The Chiese Uiversity of Hog Kog,

More information

6 Integers Modulo n. integer k can be written as k = qn + r, with q,r, 0 r b. So any integer.

6 Integers Modulo n. integer k can be written as k = qn + r, with q,r, 0 r b. So any integer. 6 Itegers Modulo I Example 2.3(e), we have defied the cogruece of two itegers a,b with respect to a modulus. Let us recall that a b (mod ) meas a b. We have proved that cogruece is a equivalece relatio

More information

Modified Decomposition Method by Adomian and. Rach for Solving Nonlinear Volterra Integro- Differential Equations

Modified Decomposition Method by Adomian and. Rach for Solving Nonlinear Volterra Integro- Differential Equations Noliear Aalysis ad Differetial Equatios, Vol. 5, 27, o. 4, 57-7 HIKARI Ltd, www.m-hikari.com https://doi.org/.2988/ade.27.62 Modified Decompositio Method by Adomia ad Rach for Solvig Noliear Volterra Itegro-

More information

Math 113 Exam 3 Practice

Math 113 Exam 3 Practice Math Exam Practice Exam will cover.-.9. This sheet has three sectios. The first sectio will remid you about techiques ad formulas that you should kow. The secod gives a umber of practice questios for you

More information

Discrete Mathematics and Probability Theory Spring 2012 Alistair Sinclair Note 15

Discrete Mathematics and Probability Theory Spring 2012 Alistair Sinclair Note 15 CS 70 Discrete Mathematics ad Probability Theory Sprig 2012 Alistair Siclair Note 15 Some Importat Distributios The first importat distributio we leared about i the last Lecture Note is the biomial distributio

More information

Section 11.8: Power Series

Section 11.8: Power Series Sectio 11.8: Power Series 1. Power Series I this sectio, we cosider geeralizig the cocept of a series. Recall that a series is a ifiite sum of umbers a. We ca talk about whether or ot it coverges ad i

More information

Series III. Chapter Alternating Series

Series III. Chapter Alternating Series Chapter 9 Series III With the exceptio of the Null Sequece Test, all the tests for series covergece ad divergece that we have cosidered so far have dealt oly with series of oegative terms. Series with

More information

t distribution [34] : used to test a mean against an hypothesized value (H 0 : µ = µ 0 ) or the difference

t distribution [34] : used to test a mean against an hypothesized value (H 0 : µ = µ 0 ) or the difference EXST30 Backgroud material Page From the textbook The Statistical Sleuth Mea [0]: I your text the word mea deotes a populatio mea (µ) while the work average deotes a sample average ( ). Variace [0]: The

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

Lecture 6 Chi Square Distribution (χ 2 ) and Least Squares Fitting

Lecture 6 Chi Square Distribution (χ 2 ) and Least Squares Fitting Lecture 6 Chi Square Distributio (χ ) ad Least Squares Fittig Chi Square Distributio (χ ) Suppose: We have a set of measuremets {x 1, x, x }. We kow the true value of each x i (x t1, x t, x t ). We would

More information

A proposed discrete distribution for the statistical modeling of

A proposed discrete distribution for the statistical modeling of It. Statistical Ist.: Proc. 58th World Statistical Cogress, 0, Dubli (Sessio CPS047) p.5059 A proposed discrete distributio for the statistical modelig of Likert data Kidd, Marti Cetre for Statistical

More information

Law of the sum of Bernoulli random variables

Law of the sum of Bernoulli random variables Law of the sum of Beroulli radom variables Nicolas Chevallier Uiversité de Haute Alsace, 4, rue des frères Lumière 68093 Mulhouse icolas.chevallier@uha.fr December 006 Abstract Let be the set of all possible

More information

THE SOLUTION OF NONLINEAR EQUATIONS f( x ) = 0.

THE SOLUTION OF NONLINEAR EQUATIONS f( x ) = 0. THE SOLUTION OF NONLINEAR EQUATIONS f( ) = 0. Noliear Equatio Solvers Bracketig. Graphical. Aalytical Ope Methods Bisectio False Positio (Regula-Falsi) Fied poit iteratio Newto Raphso Secat The root of

More information

Chapter 6 Overview: Sequences and Numerical Series. For the purposes of AP, this topic is broken into four basic subtopics:

Chapter 6 Overview: Sequences and Numerical Series. For the purposes of AP, this topic is broken into four basic subtopics: Chapter 6 Overview: Sequeces ad Numerical Series I most texts, the topic of sequeces ad series appears, at first, to be a side topic. There are almost o derivatives or itegrals (which is what most studets

More information

It is often useful to approximate complicated functions using simpler ones. We consider the task of approximating a function by a polynomial.

It is often useful to approximate complicated functions using simpler ones. We consider the task of approximating a function by a polynomial. Taylor Polyomials ad Taylor Series It is ofte useful to approximate complicated fuctios usig simpler oes We cosider the task of approximatig a fuctio by a polyomial If f is at least -times differetiable

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013. Large Deviations for i.i.d. Random Variables

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013. Large Deviations for i.i.d. Random Variables MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013 Large Deviatios for i.i.d. Radom Variables Cotet. Cheroff boud usig expoetial momet geeratig fuctios. Properties of a momet

More information

Statistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.

Statistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample. Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized

More information

ECE-S352 Introduction to Digital Signal Processing Lecture 3A Direct Solution of Difference Equations

ECE-S352 Introduction to Digital Signal Processing Lecture 3A Direct Solution of Difference Equations ECE-S352 Itroductio to Digital Sigal Processig Lecture 3A Direct Solutio of Differece Equatios Discrete Time Systems Described by Differece Equatios Uit impulse (sample) respose h() of a DT system allows

More information