Approximat momnt dynamics for polynomial and trigonomtric stochastic systms Khm Raj Ghusinga 1,, Mohammad Soltani 1,, Andrw Lamprski, Sairaj Dhopl, Abhyudai Singh 1 Abstract arxiv:1703.08841v1 [math.oc] 6 Mar 017 Stochastic dynamical systms oftn contain nonlinaritis which mak it hard to comput probability dnsity functions or statistical momnts of ths systms. For th momnt computations, nonlinaritis in th dynamics lad to unclosd momnt dynamics; in particular, th tim volution of a momnt of a spcific ordr may dpnd both on momnts of ordr highr than it and on som nonlinar function of othr momnts. Th momnt closur tchniqus ar usd to find an approximat, clos systm of quations th momnt dynamics. In this work, w xtnd a momnt closur tchniqu basd on drivativ matching that was originally proposd for polynomial stochastic systms with discrt stats to continuous stat stochastic systms to continuous stat stochastic diffrntial quations, with both polynomial and trigonomtric nonlinaritis. W validat th tchniqu using two xampls of nonlinar stochastic systms. I. INTRODUCTION Stochastic dynamical systms appar in numrous contxts in physics, nginring, financ, conomics, and biology (s,.g., [1] [5]). In trms of mathmatical charactrization, th most usful quantity in analysis of stochastic systms is th probability dnsity function (pdf). Howvr, th pdf is analytically intractabl for most systms. So, numrical tchniqus, such as Mont Carlo simulation, ar mployd to comput th pdf [6], [7]. Gnrally spaking, in analysis of many stochastic systms, th goal is oftn lss ambitious than computing th pdf, and knowing only a fw lowr ordr momnts (man, varianc, tc.) might suffic. If th systm undr considration has polynomial dynamics, thn tim volution of various statistical momnts can b computd by solving a systm of coupld linar diffrntial quations. Howvr, a major drawback of using ths momnt quations is that xcpt for a fw spcial cass such as systms with linar dynamics, th diffrntial quations for momnts up to a givn ordr consist of trms involving highr-ordr momnts. This is known as th problm of momnt closur. A typical way around this is to truncat th systm of ODEs to a finit systm of quations, and clos th momnt quations using som sort of approximation for a givn momnt in trms of momnts of lowr ordr [8] [13]. If th systm undr considration involvs nonlinaritis such as trigonomtric functions that oftn aris in swing quations, thn th diffrntial quations dscribing th momnts involv momnts of nonlinar functions of th stat. In such cass, usag of momnt closur schms is rathr limitd. For systms with polynomial dynamics, a numbr of momnt closur tchniqus hav bn proposd to approximat a highr ordr momnt in trms of lowr ordr momnts. Som of ths tchniqus mak prior assumptions on th distribution of th systm, whil othrs attmpt to find a linar or nonlinar approximation of th momnt dynamics [14], [15]. On mthod that falls in th lattr catgory is th drivativ matching basd closur [16]. Hr, a nonlinar approximation of a givn momnt is obtaind in trms of lowr ordr momnts by matching th drivativs of th original momnt dynamics with th proposd approximat dynamics at som initial point in tim. This mthod was originally proposd for approximating momnt dynamics of biochmical raction systms which ar dscribd via discrt stats [16]. Givn th attntion rcivd by this approach and its suprior prformanc than svral momnt closur schms [11], [17], w apply it to clos momnts for nonlinar stochastic systms dscribd via stochastic diffrntial quations (SDEs). W furthr xtnd th mthod to includ trigonomtric functions in th dynamics. Our rsults show that th drivativ matching tchniqu provids rasonably good approximation to th momnt dynamics. Ths authors contributd qually. 1 Khm Raj Ghusinga, Mohammad Soltani, and Abhyudai Singh ar with th Dpartmnt of Elctrical and Computr Enginring, Univrsity of Dlawar, Nwark, DE, USA 19716. {khm,msoltani,absingh}@udl.du Andrw Lamprski, and Sairaj Dhopl ar with th Dpartmnt of Elctrical and Computr Enginring, Univrsity of Minnsota, Minnapolis, MN, USA 55455. {alamprs,sdhopl}@umn.du
Rmaindr of th papr is organizd as follows. In sction II, w dscrib th momnt quations for a stochastic diffrntial quations, and discuss th momnt closur problm. In sction III, w discuss th th drivativ matching momnt closur tchniqu for SDEs and provid a proof for it. W illustrat th tchniqu via xampls in sction IV. Th papr is concludd in sction V, along with a fw dirctions of futur rsarch. Notation: Vctors and matrics ar dnotd in bold. Th st of ral numbrs and non-ngativ intgrs ar rspctivly dnotd by R and Z 0. Th xpctation is rprsntd by angld-brackts,. I is usd to dnot th Idntity matrix. II. MOMENT DYNAMICS OF AN SDE Considr a n-dimnsional stochastic diffrntial quation (SDE) rprsntd as dx = f(x, t) + g(x, t) dw t, (1) whr x = [ ] x 1 x... x n R n is th stat vctor; f(x, t) = [ f 1 (x, t) f (x, t)... f n (x, t) ] : R n [0, ) R n and g(x, t) = [ g 1 (x, t) g (x, t)... g n (x, t) ] : R n [0, ) R n dscrib th systm dynamics; and w t is th n-dimnsional Winr procss satisfying dw t = 0, dw t dw t = I, () whr I is an n n Idntity matrix. W furthr assum that sufficint mathmatical rquirmnts for th xistnc of th solution to (1) ar satisfid (s,.g., [5]). Th momnts of an SDE can b obtaind using th wll-known Itô formula [5]. This formula stats that for any smooth scalar-valud function h(x(t)), th incrmnt is givn by dh(x(t)) = h(x(t)) x (f(x(t)) + g(x(t))dw(t)) + 1 ( Tr h(x(t)) x g(x(t))g(x(t)) ). (3) Taking xpctations and dividing both sids by givs th following diffrntial quation d h(x(t)) h(x(t)) = f(x(t)) + 1 ( ) x Tr h(x(t)) x g(x(t))g(x(t)). (4) Lt h(x) b monomial of th form h(x) = x m1 1 xm... x mn n =: x [m], (5) whr m = [ ] m 1 m... m n Z n 0, thn h(x) rprsnts a momnt of x. For a givn m, w rprsnt th momnt by µ m = x [m]. Using (4), dynamics of µ m volvs according to dµ m n x = f [m] i + 1 n n (gg x [m] ) ij. (6) x i x i x j i=1 i=1 j=1 Th sum n j=1 m j is rfrrd to as th ordr of th momnt. As long as f(x, t) and g(x, t) ar linar in x, a momnt of a crtain ordr is a linar combination of othr momnts of sam or smallr ordr [15]. Hnc, if w construct a vctor µ consisting of all momnts up to th M th ordr momnts of x, its tim volution is capturd by th solution of th following systm of linar diffrntial quations: dµ = a + Aµ. (7) Hr, µ = [ ], µ m1 µ m... µ mk mp Z n 0, p {1,,..., k} is assumd to b a vctor of k lmnts. Th vctor a and th matrix A ar dtrmind by th form of f(x, t) and g(x, t). Undr som mild assumptions, standard tools from linar systms thory can b usd to obtain solution to (7), and it is givn by µ(t) = A 1 a + At ( µ(0) + A 1 a ). (8)
Rmark 1: It is asy to s that thr ar (m + n 1)!/(m!(n 1)!) momnts of ordr m. Thrfor, th dimnsion of th vctor µ in (7) is givn by k = M m=1 (m + n 1)! m!(n 1)! = (M + n)! M!n! 1. (9) Without loss of gnrality, w can assum that th lmnts in µ ar stackd up in gradd lxicographical ordr. That is, th first n lmnts in µ ar th momnts of first ordr, nxt n(n + 1)/ lmnts ar momnts of th scond ordr, and so on. In gnral, whn f(x, t) and g(x, t) ar polynomials in x, th tim drivativ of a momnt might dpnd on momnts of ordr highr than it. To s this, considr th following on dimnsional cubic drift dx = x 3 + dw t. (10) Th tim volution of a momnt of ordr m 1 is givn by d x m x m = x ( x3 ) + 1 x m x (11) = m x m+ m(m 1) + x m 1, (1) which clarly dpnds upon th (m + 1) th momnt. In othr words, th momnt dynamics is not closd. Thus, for systms with nonlinar dynamics, th momnt quations in (7) nd to b modifid to a gnral form dµ = a + Aµ + Bµ, (13) whr µ R r is a vctor of momnts of ordr gratr than or qual to M + 1. Th solution to (13) is gnrally obtaind by approximating th highr ordr momnts in µ as, possibly nonlinar, functions of lowr ordr momnts in µ. Th approximation might b mad by assuming som undrlying distribution, or by applying som othr physical principl [14], [15]. Essntially th momnt closur mthods translat to finding an approximation of (13) by a systm of quations dν = a + Aν + Bϕ(ν), (14a) ν = [ ], ν m1 ν m... ν mk (14b) whr th function ϕ : R k R r is chosn such that µ(t) ν(t). Hr, M is calld th ordr of truncation. If th functions f(x, t) ar not polynomials, thn it may not b possibl to obtain a convnint form lik (13) for th momnts. For instanc, considr th following diffrntial quation Hr, th tim volution of x is givn by dx 1 = x (15) dx = sin x 1 + dw t. (16) d x = sin x 1, (17) which dpnds a nonlinar momnt sin x 1. Although, (4) can b usd to writ th dynamics of sin x 1, it will furthr dpnd on othr trigonomtric momnts. In Sction IV, w will considr a systm of this typ and prform momnt closur. In th nxt sction, w first discuss th drivativ matching closur schm for SDEs.
III. DERIVATIVE MATCHING MOMENT CLOSURE TECHNIQUE FOR SDES In this sction, w dscrib th drivativ matching basd momnt closur tchniqu for SDEs. As th nam suggsts, th closur is prformd by matching tim drivativs of µ(t) and ν(t). This tchniqu was originally proposd for approximating momnt dynamics of discrt stat continuous tim systms [16], [18]. Th drivativ matching tchniqu attmpts to approximat µ(t) by som ν(t) such that a sufficintly larg numbr of thir drivativs match point-wis. Th ida bing that if th valus of ths two vctors at som tim t 0 ar qual, and thir drivativs up to crtain ordr also match, thn thy would closly follow ach othr for som tim intrval aftr t 0. Mor prcisly, for ach δ > 0 and N Z 0, T R such that if µ(t 0 ) = ν(t 0 ) = hold for a t 0 [0, ) and i = 1,,..., N, thn di µ(t) i = di ν(t) i, (18) µ(t) ν(t) δ, t [t 0, T ]. (19) Furthr, on can obtain th bound in (19) for th intrval [t 0, ) undr som appropriat asymptotic conditions [19]. To construct th closd momnt dynamics, w follow similar stps as [16]. Considr a vctor m Z n 0 such that µ m is an lmnt in µ. W approximat µ m as a function of lmnts in th vctor µ. Dnoting th corrsponding approximation of µ m in ϕ(µ) by φ m (µ), th following sparabl form is considrd φ m (µ) = k ( ) αp µmp, (0) whr α p ar appropriatly chosn constants. Gnrally spaking, (18) is a strong rquirmnt and it is not possibl to find th cofficints α p such that it holds for vry initial condition. W, thrfor, considr a rlaxation of this by sking α p such that th drivativs match for a dtrministic initial condition x(t 0 ) = x 0. Nxt, w stat a thorm showing that th cofficints α p can b obtaind by solving a systm of linar quations. Bfor that, w dfin a short-hand notation that is usd in th thorm. For two vctors ˆm = [ ˆm 1 ˆm... ˆm n ] Z n 0 and m = [ m 1 m... m n ] Z n 0, w hav th following notation whr C ˆm m := C ˆm1 m 1 C ˆm m C ˆmn m n, C h l = { h! l!(h l)!, h l, 0, h < l. Thorm 1: For ach lmnt µ m of th vctor µ, assum that th corrsponding momnt closur function φ m(µ) in th vctor ϕ(µ) is chosn according to (0) with th cofficints α p chosn as th uniqu solution to th following systm of linar quations C [m] [m s] = (1a) (1b) α p C [mp] [m s], s = 1,,, k. () Thn, for vry initial condition x(t 0 ) = x 0 R n, w hav that µ(t 0 ) = ν(t 0 ) = dµ(t) = dν(t) = d µ(t) = d ν(t). (3a) (3b)
Proof: It is sufficint to prov that for ach lmnt µ m of µ and its corrsponding momnt closur function φ m (µ), w hav th following: µ m (t 0 ) = φ m (µ(t 0 )), (4a) dµ m(t) = dφ m(µ(t)). (4b) W first show that (4a) holds. Sinc initial conditions ar x(t 0 ) = x 0 with probability on, w hav µ m (t 0 ) = x [m] 0, (5a) k ( ) αp φ m (µ(t 0 )) = = x [ k 0. (5b) x [mp] 0 Rcall Rmark 1, that without loss of gnrality, th momnts in vctor µ can b assumd to b stackd in gradd lxicographical ordr. Thus, th first n lmnts of µ ar momnts of ordr on. This allows us to writ m = [ C m m 1, C m m,..., C m m n ], (6a) m p = [ C mp m 1, C mp m,..., C mp m n ], p = 1,,..., k, whr a vctor m i Z n 0, i = 1,,..., n has 1 at th ith position, and rst of th lmnts ar zro. Using ths rlations, and (1a) for s = 1,,..., n, w obtain m = (6b) α p m p. (7) Substituting this rsult in (5a) provs (4a). Nxt, w prov that (4b) holds. For this part, w assum that x 0 = [ ] x 01, x 0,..., x 0n R n. Considr dφ m (µ(t)) (8a) dµ mp (t) = φ m (µ(t 0 )) α p (8b) µ mp (t 0 ) = α p x [m mp] dµ mp (t) 0. (8c) Assuming m p = [ ] m p1 m p... m pn Z n 0, w can us (6) to obtain th xprssion for dµ m p (t) = d x [mp]. This nabls us to writ dφ m (µ(t)) n = α p x [m] m pi 0 f i (x 0, t 0 ) + 1 n α p x [m] m pi (m pi 1) ( 0 x 0i x g(x0, t 0 )g (x 0, t 0 ) ) ii 0i + 1 = x [m] 0 i=1 α p x [m] 0 n i,j=1 i j n k α pm pi i=1 + 1 x[m] 0 x 0i n i,j=1 i j i=1 m pi m pj x 0i x 0j ( g(x0, t 0 )g (x 0, t 0 ) ) ij (9a) f i (x 0, t 0 ) + 1 x[m] 0 n k α pm pi (m pi 1) ( g(x0, t 0 )g (x 0, t 0 ) ) ii i=1 x 0i k α pm pi m pj x 0i x 0j ( g(x0, t 0 )g (x 0, t 0 ) ) ij. (9b)
Comparing this with th xprssion for dµm computd at t = t 0, which can b calculatd from (6) and assuming m = [ ] m 1, m,..., m n Z n 0, w rquir: α p m pi = m i, α p m pi (m pi 1) α p m pi m pj (30a) = m i(m i 1), (30b) = m im j. (30c) Not that (30a) is nothing but th rlation in (7) writtn lmnt-wis. Furthr, w had assumd that th vctor µ has its lmnts stackd up in gradd lxicographical ordr (Rmark 1). In particular, th momnts of scond ordr start with th (n + 1) th lmnt. In that cas, th quality in (30b) follows whn rlations in (6a) (6b) ar usd in (1a) for s = n + 1, n + 1,, n + 1 (i.., th scond ordr momnts with on of th xponnts as and rst of thm as zros). Likwis, (30c) holds for th rst of th scond ordr momnts whrin two xponnts ar 1 and rst ar zros. Rmark : It is worth noting that whn th drivativ matching tchniqu is applid for a discrt-stat procss, thr is an rror in matching th first two drivativs [16]. Howvr, in cas of a continuous stat stochastic diffrntial quation, th first two drivativs ar matchd xactly. Anothr important diffrnc btwn th discrt stat systms, and continuous stat systms is that in th lattr, th first two drivativs ar matchd xactly rgardlss of th form of f and g whras in th formr, on nds to assum polynomial form for th rats at which th stats ar changd. Rmark 3: Although w do not hav a proof, th solution to th systm of linar quations in () rsults in intgr valus of th cofficints α p for all xampls w hav solvd thus far. IV. NUMERICAL VALIDATION In this sction, w illustrat th drivativ matching tchniqu on two xampls. Th first xampl is a Van dr Pol oscillator that frquntly ariss in many nginring applications [0]. In this cas, th systm dynamics consists of polynomial functions of th stat vctor. Th scond xampl is a swinging pndulum subjct to whit nois. In this xampl, th dynamics consist of polynomial functions in on stat and, and a trigonomtric functions in anothr stat. W show that th drivativ matching tchniqu can b straightforwardly applid to th scond xampl. A. Van dr Pol oscillator In th dtrministic stting, th Van dr Pol oscillator is govrnd by th following scond-ordr diffrntial quation d x ɛ(1 x ) dx + ω nx = A cos(ω g t), (31) whr ɛ is th bifurcation paramtr, ω n is th natural frquncy, ω g is th forc frquncy and A is th forc amplitud. A possibl stochastic dscription of th oscillator could b to assum that th forc is noisy, i.., th actuators that apply th forc also add a zro man nois to th systm. By choosing x 1 = x and x = dx, th oscillator dynamics could b writtn as dx 1 =x, dx = ( ɛ(1 x 1)x ω nx 1 + A cos(ω g t) ) + Adw t. (3a) (3b)
Suppos w ar intrstd in th dynamics of x 1. To this nd, w writ momnt dynamics of this oscillator up to ordr two dx 1 = x, (33a) dx = ɛ(x x 1x ) ωnx 1 + A cos(ω g t), (33b) dx 1 = x 1 x, (33c) dx = ɛ(x x 1x ) ωnx 1 x + Ax cos(ω g t) + A, (33d) dx 1 x = x 1x + ɛ(x 1 x x 3 1x ) ωnx 1 + Ax 1 cos(ω g t). (33) As xpctd, th nonlinaritis in th dynamics manifst in unclosd momnt dynamics, and th momnt quations up to ordr two dpnd upon third and fourth ordr momnts. In trms of notations in (13), w hav µ = [ ] x 1 x x 1 x1 x x, [ and µ = x 1 x x 1 x x3 1 x ]. Applying th drivativ matching closur as dscribd in Sction III, w sk approximations of ach lmnt of µ in trms of thos of µ as in (0). Solving () for ach of ths yilds th following approximations x 1x x 1 x 1x x 1 x, (34a) x 1x x 1 x 1x 4 x x 1 4 x 4, (34b) x 3 1x x 1 3 x 1 x 3 x 1 6 x. (34c) Using th approximations from (34) in (33), w obtain a closd st of momnt quations. Fig. 1 compars th solution of x 1 with that of numrical simulations. Our rsults show an almost prfct match btwn th systm with closur approximation and numrical simulations. A cavat of th proposd drivativ matching approximation is that, as in (34), th man of stats appar in th dnominator. Sinc th oscillator rpatdly crosss th zro, it is possibl that som of ths momnts approach to zro. To avoid this, w add a small trm δ to th dnominator of approximations. Drivativ matching Simulation rsults x 1 Tim (mins) Fig. 1. Drivativ matching tchniqu rplicats th oscillations of th Van dr Pol oscillator quit rasonably. For this plot, th paramtrs valus ar A =.5, ω n = ω g = 10π, and ɛ = 0.1. Th initial conditions ar takn as x 1(0) = x (0) = 0.1.
θ l Air molculs crat friction and add nois m Fig.. Schmatic of a pndulum intracting with air particls. B. Pndulum Swing In th dtrministic stting, dynamics of a simpl pndulum (s Fig. ) ar givn by d θ + k dθ m + g sin θ = 0 (35) l whr g is th acclration du to gravity, l is th lngth of th pndulum, and θ is th angular displacmnt [1]. W also considr friction in our systm, with friction constant k. In th stochastic formulation, w could considr that th dynamics ar affctd by whit nois that ariss du random intraction of pndulum with air molculs. This trm scals invrsly with mass of th pndulum m, i.., th intraction with gas air particls is ngligibl for a larg mass. By choosing x 1 = θ and x = dθ, th dynamics of th pndulum can b rprsntd as dx 1 =x, ( dx = k m x g ) l sin x 1 + 1 m dw t. Hr w hav th trigonomtric function sin x 1, which givs ris to nonlinar bhavior. To illustrat how drivativ matching closur can b usd in this contxt, w approximat sin x 1 using (4). To this nd, w us Eulr s rlation to writ sin x 1 = jx1 jx1. (37) j With a chang of variabls, w can us th Itô formula to transform (36) to th following (36a) (36b) d jx1 = j jx1 x, (38a) d jx1 = j jx1 x, (38b) ( dx = k m x + j g j ) g + 1 l jx1 l jx1 m dw t. (38c) Fo ths dynamics, w can writ th momnt dynamics with momnts of x apparing in th form of monomials, and momnts of x 1 apparing in th form of complx xponntials as blow d jx1 = j jx1 x, (39a) d jx1 = j jx1 x, (39b) dx = k m x + j g j g, l jx1 l jx1 (39c)
d jx1 x = j jx1 x k x m jx1 + j g j g l jx1 l, (39d) d jx1 x = j jx1 x k x m jx1 j g + j g l jx1 l, (39) dx = k m x + j g x l jx1 j g x l jx1 + 1 m, (39f) d jx1 = j jx1 x, (39g) d jx1 = j jx1 x. (39h) On way to intrprt th abov mixd complx xponntial monomial momnt dynamics is to think that sinc all momnts of x ar gnratd by taking xpctations of th monomials 1, x, x,..., w could considr th trms jx1 and jx1 as two diffrnt variabls. Th mixd momnts can thn b gnratd by taking xpctation of th products of th complx xponntials 1, jx1, jx1,... (or 1, jx1, jx1,...) with th monomials 1, x, x,.... Th ordr of th mixd momnt can b thought of as th sum of powrs of th monomials and complx xponntials. Givn th abov intrprtation, th momnt dynamics in (39) ar not closd. As pr notation in (13), w hav µ = [ jx1 x... x, [ ] and µ = x x ] x. x An important point to not is that sinc jx1 jx1 = 1, thr is no nd to considr thir cross-momnts. Thus, w only considr cross momnts of jx1 with x, and jx1 with x. Nxt, w prsnt diffrnt closur schms for approximating momnts in µ as nonlinar functions of momnts up to ordr. As an xampl, considr th third-ordr momnt jx1 x. Th aim of closur is to approximat this momnt as x α1 α x x α3 x α4. (40) Prforming drivativ matching approach as xplaind in Sction III rsults in x x x jx1 x. (41) With a similar approach w can approximat th othr momnts in th vctor µ x x x jx1 x, (4a) x x x jx1, (4b) x x x jx1. (4c) Anothr approximation that can b usd is by assuming that th corrlation in btwn two random variabls is small du to prsnc of nois. Hnc th third ordr momnt jx1 x can b approximatd as x x. (43) Similarly th rst of momnts in µ can b approximatd as x x, (44a) x x, (44b) x x, (44c) x x. (44d) Th rsults of th closur approximations is compard to numrical solutions in Fig. 3. Th rsults show that drivativ matching provids rasonably accurat approximation of th momnt dynamics.
m = 10, k = 10, l = 10, g = 10, x 1 0 = 3, x (0) = 3 Sin x 1 Drivativ matching Man fild approximation 95% confidnc intrvals Tim (mins) m = 4, k = 5, l = 5, g = 10, x 1 0 = 1.8, x (0) = 5 Sin x 1 Drivativ matching Man fild approximation 95% confidnc intrvals Tim (mins) Fig. 3. Drivativ Matching provids accurat approximation of th nonlinar function sin(x 1). For comparison purpos, 95% confidnc intrval of th dynamics as obtaind from numrical simulation, and approximat dynamics from a man fild approximation ar shown. V. CONCLUSION In this papr, w xtndd th drivativ matching basd momnt approximation mthod to stochastic dynamical systms with continuous stat. W furthr illustratd that th mthod is not limitd to polynomial dynamics, and it can b usd to study systms that contain trigonomtric functions. It would b intrsting to xtnd th tchniqu to othr form of mixd functions, and also includ diffrntial algbraic inqualitis. This would opn possibilitis of using th momnt closur tchniqus to study a varity of nonlinaritis, and has potntial applications in powr systms analysis. In addition, whil in this papr w just considrd continuous dynamics modld through SDEs, many modls contain both continuous dynamics and random discrt vnts [] [4]. Driving drivativ matching closur for such hybrid systms will b anothr avnu of rsarch. Finally, w not that dspit th promising rsults obtaind by closur approximations, gnrally thr ar no guarant on th rrors of th closur approximation. Futur work will carry out a dtaild rror analysis using othr mthods of finding bounds on momnts [5]. ACKNOWLEDGMENT AS is supportd by th National Scinc Foundation Grant DMS-13196, Univrsity of Dlawar Rsarch Foundation (UDRF) and Oak Ridg Associatd Univrsitis (ORAU). APPENDIX REFERENCES [1] E. Alln, Modling with Itô stochastic diffrntial quations, vol.. Springr Scinc & Businss Mdia, 007.
[] R. Land, S. Engn, and B.-E. Sathr, Stochastic population dynamics in cology and consrvation. Oxford Univrsity Prss on Dmand, 003. [3] A. G. Malliaris, Stochastic mthods in conomics and financ, vol. 17. North-Holland, 198. [4] C. Gardinr, Handbook of stochastic mthods for physics, chmistry and th natural scincs, Applid Optics, vol. 5, p. 3145, 1986. [5] B. Øksndal, Stochastic diffrntial quations. Springr, 003. [6] J. P. Hspanha, A modl for stochastic hybrid systms with application to communication ntworks, Nonlinar Analysis: Thory, Mthods & Applications, vol. 6, pp. 1353 1383, 005. [7] A. Julius and G. Pappas, Approximations of stochastic hybrid systms, IEEE Transactions on Automatic Control, vol. 54, pp. 1193 103, 009. [8] C. H. L, K. Kim, and P. Kim, A momnt closur mthod for stochastic raction ntworks, Journal of Chmical Physics, vol. 130, p. 134107, 009. [9] A. Singh and J. P. Hspanha, Approximat momnt dynamics for chmically racting systms, IEEE Transactions on Automatic Control, vol. 56, pp. 414 418, 011. [10] C. S. Gillspi, Momnt closur approximations for mass-action modls, IET Systms Biology, vol. 3, pp. 5 58, 009. [11] M. Soltani, C. A. Vargas-Garcia, and A. Singh, Conditional momnt closur schms for studying stochastic dynamics of gntic circuits, IEEE Transactions on Biomdical Systms and Circuits, vol. 9, pp. 518 56, 015. [1] J. Zhang, L. DVill, S. Dhopl, and A. Dominguz-Garcia, A maximum ntropy approach to th momnt closur problm for stochastic hybrid systms at quilibrium, in Proc. of th 53rd IEEE Conf. on Dcision and Control, Los Angls, CA, pp. 747 75, 014. [13] A. Singh and J. P. Hspanha, Stochastic analysis of gn rgulatory ntworks using momnt closur, in Proc. of th 007 Amr. Control Confrnc, Nw York, NY, 006. [14] C. Kuhn, Momnt Closur A Brif Rviw. Undrstanding Complx Systms, Springr, 016. [15] L. Socha, Linarization Mthods for Stochastic Dynamic Systms. Lctur Nots in Physics 730, Springr-Vrlag, Brlin Hidlbrg, 008. [16] A. Singh and J. P. Hspanha, Approximat momnt dynamics for chmically racting systms, IEEE Transactions on Automatic Control, vol. 56, no., pp. 414 418, 011. [17] M. Soltani, C. A. Vargas-Garcia, N. Kumar, R. Kulkarni, and A. Singh, Approximat statistical dynamics of a gntic fdback circuit, Proc. of th 015 Amr. Control Confrnc, Chicago, IL, pp. 444 449, 015. [18] A. Singh and J. P. Hspanha, Lognormal momnt closurs for biochmical ractions, in Procdings of th 45th Confrnc on Dcision and Control, pp. 063 068, 006. [19] J. P. Hspanha, Polynomial stochastic hybrid systms, in Hybrid Systms: Computation and Control, pp. 3 338, 005. [0] S. H. Strogatz, Nonlinar dynamics and chaos: with applications to physics, biology, chmistry, and nginring. Wstviw prss, 014. [1] H. K. Khalil, Nonlinar systms, vol. 3. Prntic Hall, NJ, 1996. [] J. Hspanha, Modlling and analysis of stochastic hybrid systms, IEE Procdings Control Thory and Applications, vol. 153, pp. 50 535, 006. [3] A. R. Tl, A. Subbaraman, and A. Sfrlazza, Stability analysis for stochastic hybrid systms: A survy, Automatica, vol. 50, no. 10, pp. 435 456, 014. [4] J. Hu, J. Lygros, and S. Sastry, Towards a thory of stochastic hybrid systms, in Hybrid Systms: Computation and Control, Lctur Nots in Computr Scinc, pp. 160 173, Springr, 000. [5] A. Lamprski, K. R. Ghusinga, and A. Singh, Analysis and control of stochastic systms using smidfinit programming ovr momnts, arxiv prprint arxiv:170.004, 017.