Information and estimation in Fokker-Planck channels
|
|
- Elinor Pierce
- 6 years ago
- Views:
Transcription
1 Informaion an esimaion in Fokker-Planck channels Anre Wibisono, Varun Jog, an Po-Ling Loh Deparmens of Elecrical & Compuer Engineering an Saisics Universiy of Wisconsin - Maison Maison, WI aywibisono@wisc.eu, vjog@wisc.eu, loh@ece.wisc.eu Absrac We suy he relaionship beween informaion- an esimaion-heoreic quaniies in ime-evolving sysems. We focus on he Fokker-Planck channel efine by a general sochasic ifferenial equaion, an show ha he ime erivaives of enropy, KL ivergence, an muual informaion are characerize by esimaion-heoreic quaniies involving an appropriae generalizaion of he Fisher informaion. Our resuls vasly exen De Bruijn s ieniy an he classical I-MMSE relaion. I. INTODUCTION Informaion heory an saisical esimaion are closely inerwine. Various ieniies an inequaliies arise from funamenal conceps such as muual informaion, Fisher informaion, an esimaion error, an close parallels beween he fiels provie an avenue for evising an eriving new resuls. As a canonical example, he informaion-esimaion resul known as he momen-enropy inequaliy [] saes ha among all coninuous ranom variables wih a fixe variance, Gaussian ranom variables maximize enropy. Furhermore, Sam s inequaliy [2] saes ha for a fixe Fisher informaion, Gaussian ranom variables minimize enropy. The celebrae Cramér-ao boun from saisics [3], which esablishes a lower boun on he variance of an esimaor in erms of he Fisher informaion, follows from he aforemenione facs. In he pas ecae, significan effor has been evoe o uncovering new relaionships beween informaion-heoreic an esimaion-heoreic quaniies, beginning wih he I-MMSE ieniy of Guo e al. [4] for aiive Gaussian noise channels. The ieniy, provie in Theorem below, saes ha he erivaive of he muual informaion beween he channel inpu an oupu wih respec o he signal o noise raio (snr) is proporional o he minimum mean square error (mmse) in esimaing he inpu from he oupu. As erive in Sam [2], he resul is equivalen o De Bruijn s ieniy (cf. equaion (2)). The resaemen of De Bruijn s ieniy in erms of he mmse spawne a hos of aiional informaion-esimaion resuls, incluing an exension o non-gaussian aiive noise [5], a generalizaion o he mismache esimaion seing [6], an several poinwise informaion-esimaion relaions [7]. Differen I-MMSE ype relaions were also obaine for he Poisson channel [8], [9] an Lévy channel [0]. In informaion heory, a channel is a coniional isribuion relaing inpu symbols o oupu symbols. Whereas his coing-heoreic moel is very useful for communicaion channels, however, i possesses cerain rawbacks. Many realworl examples such as weaher sysems an financial markes are bes explaine as sysems evolving in ime accoring o ranom an eerminisic influences. Alhough i is possible o view an evolving sysem as a communicaion channel, where he curren sae is he channel inpu an he sae a a fuure ime is he channel oupu, such an inerpreaion lacks insigh abou he pah of he sysem. Noneheless, informaionheoreic ieas are sill useful in characerizing he behavior of ime-evolving sysems. For insance, one migh characerize how much informaion abou he fuure is conaine in he presen sae using quaniies such as enropy, KL ivergence, an muual informaion. This has been iscusse exensively in he climae science lieraure [], [2], [3], [4]. One of he simples an mos useful ways of moeling evolving sysems is via coninuous-ime Markov chains wih a coninuous sae space, which may be analyze using sochasic ifferenial equaions (SDEs). In paricular, he probabiliy isribuion of such sysems evolves accoring o a parial ifferenial equaion known as he Fokker-Planck equaion. We focus on an informaion-heoreic analysis of ime-evolving sysems escribe by SDEs, an suy he rae of change of various funamenal quaniies as a funcion of ime. We show ha hese raes are convenienly expresse in erms of a generalize Fisher informaion, so our resuls may be inerpree as generalizaions of De Bruijn s ieniy for he SDE or Fokker-Planck seing. Noably, we obain a clean ieniy expressing he ime erivaive of muual informaion in erms of he muual Fisher informaion, allowing us o erive new I- MMSE relaions. Our resuls are reaily specialize o specific sochasic processes, incluing Brownian moion, Ornsein- Uhlenbeck processes, an geomeric Brownian moion. The remainer of he paper is organize as follows: In Secion II, we review exising resuls an presen he family of SDEs o be suie in our paper, as well as he associae Fokker-Planck equaion. In Secion III, we evelop our main resuls concerning he evoluion of enropy, KL ivergence, an muual informaion in erms of esimaion-heoreic quaniies. We conclue in Secion IV wih a iscussion of open quesions. For rigorous proofs of all our resuls, see he exene version of our paper [5].
2 II. BACKGOUND AND POBLEM SETUP We begin by presening formal saemens of De Bruijn s ieniy an he I-MMSE relaion, followe by a eaile characerizaion of he SDE framework iscusse in our paper. A. DeBruijn s ieniy an I-MMSE Consier he aiive Gaussian noise channel X = X 0 + Z () where Z N (0, ) is inepenen of X 0, an > 0 is a ime parameer in his case equal o he variance of he noise ha conrols how much ranomness is ae o he sysem. As increases, we expec he oupu X o be more ranom. De Bruijn s ieniy [2] confirms his inuiion an assers ha H(X ) = 2 J(X ), (2) where H(X )= p (x) log p (x)x is he Shannon enropy wih p enoing he ensiy of X, an J(X ) = E [ ( x log p (X ) ) ] 2 = p (x) 2 x > 0 (3) p (x) is he (nonparameric) Fisher informaion. Anoher common parameerizaion of he channel () is Y snr = snrx + Z where snr > 0 is he signal o noise raio an Z N (0, ) is inepenen of X. Guo e al. [4] esablishe he following I-MMSE relaion, which saes ha he muual informaion I(snr) = I(X; Y snr ) increases a a rae given by he mmse, an showe heir resul is equivalen o De Bruijn s ieniy (2). Theorem (Guo e al. [4]). We have snr I(snr) = 2 mmse(x Y snr), where mmse(x Y snr ) = E[(X E[X Y snr ]) 2 ] enoes he minimum mean square error for esimaing X from Y snr. In erms of he ime parameerizaion (), by seing snr = an X = Y / we see ha Theorem is equivalen o I(X 0; X ) = 2 2 mmse(x 0 X ). (4) B. SDEs an Fokker-Planck equaion Consier a general channel ha oupus a real-value sochasic process (X ) 0 following he SDE X = a(x, ) + σ(x, )W, (5) where (W ) 0 is sanar Brownian moion, an a(x, ) an σ(x, ) > 0 are arbirary real-value smooh funcions. The choice a 0 an σ generaes he Gaussian channel (), bu he SDE framework (5) is consierably more general. The rif a(x, ) is he eerminisic par of he ynamics, an he iffusion σ(x, )W inrouces ranomness by incremenally aing Gaussian noise: For small δ > 0, we have X +δ X + a(x, )δ + σ(x, ) δz where Z N (0, ) is inepenen of X. A convenien way o suy X is via is ensiy p. When X follows he SDE (5), he ensiy funcion p(x, ) = p (x) saisfies a parial ifferenial equaion calle he Fokker-Planck equaion. This resul is classical an echnically requires ha a(x, ) an σ(x, ) saisfy appropriae regulariy an growh coniions (e.g., smoohness an Lipschiz properies [6]). Lemma. The ensiy p(x, ) of he process escribe by equaion (5) saisfies = x (a(x, )p(x, )) + (b(x, )p(x, )), (6) 2 x2 where b(x, ) = σ(x, ) 2. Noe ha Lemma implies he channel (5) is linear in he space of inpu isribuions, which means a mixure of inpus prouces a mixure of oupus. Also noe ha when b(x, ) is inepenen of x, our moel falls uner he PDE framework of Toranzo e al. [7]; however, our SDE framework (5) is somewha more general. Consier he following examples: ) Brownian moion: As iscusse above, he choice a 0 an σ prouces he soluion X = X 0 + W = X0 + Z N (X0, ), which is precisely he Gaussian channel (). The Fokker-Planck equaion is he classical hea equaion = 2 p(x, ) 2 x 2. Any saring poin X 0 = x 0 gives rise o he explici soluion p(x, ) = exp ( (x x 0) 2 ). (7) 2π 2 2) Ornsein-Uhlenbeck process: The SDE is 2 X = αx + W, wih α > 0. This correspons o a(x, ) = αx an σ(x, ) = b(x, ). The Ornsein-Uhlenbeck process is mean-revering an arises in sochasic moeling of ineres raes ( an paricle velociies. The explici soluion is X = e α X 0 + X N (0, ) = 0 eαs W s e α X 0 + ( e )Z, so ) as. The Fokker-Planck equaion is = α x (xp(x, )) + 2 p(x, ) 2 x 2, (8) which may also be solve explicily [8]. Noe ha if α 0, we recover Brownian moion (7). 3) Geomeric Brownian moion: The SDE is X = µx + σx W, where µ an σ > 0. This correspons o a(x, ) = µx, σ(x, ) = σx, an b(x, ) = σ 2 x 2. Geomeric Brownian moion is use o moel asse prices in financial mahemaics, noably in Black-Scholes opion pricing [9]. The explici soluion ( is X N log X 0 + (µ σ2 2 ), σ2 = X 0 exp((µ ) σ2 2 ) + σw ), so log X. The Fokker-Planck equaion is = µ σ2 2 (xp(x, )) + x 2 x 2 (x2 p(x, )), (9) which also has an explici soluion [8].
3 III. MAIN ESULTS We now generalize he informaion-esimaion relaions for he Gaussian channel () o he SDE channel (5). We express he ime erivaives of funamenal informaionheoreic quaniies enropy, relaive enropy, an muual informaion in erms of a generalize Fisher informaion, proucing analogs of De Bruijn s ieniy (2). Alhough enropy is no always increasing, relaive enropy an muual informaion ecrease a a rae given by he relaive an muual Fisher informaion, respecively. We furher inerpre he Fisher informaion via a generalize Bayesian Cramer-ao lower boun an express he muual Fisher informaion as he mmse of esimaing a funcion of he inpu from he oupu, hus proucing generalizaions of he I-MMSE relaion (4). A. Generalize Fisher informaion Le b: (0, ) be a posiive funcion. We efine he Fisher informaion wih respec o b o be [ ( ) ] 2 J b (X)=E b(x) X log p(x) = b(x) p (x) 2 x, (0) where p enoes he isribuion of he ranom variable X. When b, we obain he usual Fisher informaion (3). Our generalize Fisher informaion iffers from oher noions in lieraure in ha we are sill moivae by Shannon enropy. In conras, Toranzo e al. [7] consier φ-fisher informaion o suy φ-enropy, while Luwak e al. [20] an Bercher [2] consier q-fisher informaion o suy q-enropy, which inclues ényi an Tsallis enropies. For isribuions p an q, we efine he relaive Fisher informaion wih respec o b: ( ) 2 J b (p q) = b(x) log x, () x q(x) Alernaively, J b (p q) may be viewe as he Bregman ivergence of J b. ecall ha he KL ivergence, or relaive enropy, may be wrien as he Bregman ivergence of Shannon enropy. Lemma 2. J b (p q) = J b (p) J b (q) J b (q), p q. In paricular, J b (p q) 0 shows ha J b (p) is convex in p. Analogous o he he muual informaion, which measures he reucion in coniional enropy, we efine he muual Fisher informaion of ranom variables X an Y wih respec o b: J b (X; Y ) = J b (Y X) J b (Y ), (2) where J b (Y X) = p X(x)J b (Y X = x) y is he coniional Fisher informaion. Noe ha J b (X; Y ) is he ifference beween E[J b (p Y X ( X))] an J b (E[p Y X ( X)]) = J b (Y ). Since J b is convex, his implies J b (X; Y ) 0. B. From informaion o esimaion In fac, he muual Fisher informaion (2) is equal o a naural generalizaion of he saisical Fisher informaion, a cenral esimaion-heoreic quaniy. ecall ha he poinwise saisical Fisher informaion Φ(y) = Φ(X Y = y) of a parameerize family of isribuions {p X Y ( y)} is 2x. Φ(X Y = y)= p X Y (x y)( y log p X Y (x y)) (3) We efine he saisical Fisher informaion wih respec o b as he weighe average of he poinwise Fisher informaion: Φ b (X Y ) = p Y (y) b(y) Φ(X Y = y) x. (4) The following key resul provies a brige beween informaion an esimaion: Theorem 2. The muual Fisher informaion is equal o he saisical Fisher informaion: J b (X; Y ) = Φ b (X Y ). We now erive wo heorems illusraing he inimae connecions beween he saisical Fisher informaion an quaniies in esimaion heory. ) Esimaion-heoreic lower boun: The poinwise Fisher informaion (3) has a naural esimaion inerpreaion via he Cramer-ao lower boun; similarly, he saisical Fisher informaion (4) provies a lower boun on he esimaion error when we have a prior on he parameers. The following resul is a weighe version of van Trees inequaliy [22]: Theorem 3. Consier a parameerize family of isribuions {p Y X ( x)} wih prior p X (x). For any esimaor T (y) of x, [ ] E (T (Y ) X)2 b(x) Φ b (Y X) + J b (X) = J b (X Y ). Thus, he coniional Fisher informaion J b (X Y ) is inversely proporional o he harness of esimaing X from Y. 2) mmse relaion: We efine he mmse of Y given X wih respec o b as mmse b (Y X) = min T E[b(X)(T (X) Y )2 ], where he minimizaion is over all esimaors T (X). Noe ha he minimizer correspons o he coniional expecaion T (X) = E[Y X], regarless of b. For a paramerize family of isribuions {p Y X ( x)}, consier he poinwise score funcion ϕ(x, y) = y log p Y X(y x). Given a prior p X, by Bayes rule we can efine he oher coniional isribuion p X Y (x y) p X (x)p Y X (y x). Observe ha for every fixe y, if X p X Y ( y), hen ϕ(x, y) is an unbiase esimaor of he nonparameric score funcion: E[ϕ(X, y) Y = y] = y log p Y (y). This fac leas o he following resul: Theorem 4. J b (X; Y ) = mmse b (ϕ(x, Y ) Y ). C. De Bruijn s ieniy We now escribe our generalizaions of De Bruijn s ieniy. In he saemens below, we wrie b (x) = b(x, ) = σ(x, ) 2.
4 ) Time erivaive of enropy: Our firs resul relaes he rae of change of Shannon enropy o he Fisher informaion: Theorem 5. Le X be he oupu of he SDE (5). Then H(X ) = [ 2 J b (X ) + E x a(x, ) 2 ] 2 x 2 b(x, ). Noe ha in he case of hea equaion, when a 0 an b, his resul recovers he classical De Bruijn s ieniy (2). However, in he general case, he enropy oes no necessarily always increase. This may seem o, bu as he resuls below show, we obain monooniciy by consiering relaive enropy. 2) Time erivaive of KL ivergence: Le K(p q) = log q(x) x enoe he KL ivergence. The following resul esablishes ha he relaive enropy beween any wo soluions is always ecreasing, wih a rae given by he relaive Fisher informaion: Theorem 6. Le X, Y enoe he oupu ranom variables of he channel (5) wih isribuions p, q. Then K(p q ) = 2 J b (p q ). Thus, he KL ivergence is a conracing map along any wo rajecories p an q, implying he exisence of a mos one fixe poin of he channel; i.e., a saionary measure p saisfying equaion (6). However, such a isribuion p may no exis, or i may no be a proper probabiliy isribuion (e.g., he Lebesgue measure in he case of he hea equaion). 3) Time erivaive of muual informaion: ecall ha he muual informaion saisfies I(X; Y ) = H(Y ) H(Y X), where H(Y X) = p X(x)H(Y X = x) x is he coniional Shannon enropy. Consier he ime erivaive of I(X 0 ; X ), where X is he oupu of he channel (5) wih inpu X 0. Theorem 5 expresses he ime erivaive of H(X ) in erms of he Fisher informaion J b (X ); since he channel (5) is linear, we also obain a formula for he ime erivaive of he coniional enropy H(X X 0 ) in erms of J b (X X 0 ). ecalling efiniion (2), his yiels he following resul: Theorem 7. The oupu X of he SDE channel (5) wih inpu X 0 saisfies I(X 0; X ) = 2 J b (X 0 ; X ). D. Special cases We specialize our resuls o he examples in Secion II-B. Deails are provie in he exene version of our paper [5]. ) Brownian moion: Since b, he funcion J b is he usual nonparameric Fisher informaion J, an Theorem 5 yiels De Bruijn s ieniy (2). We calculae he coniional Fisher informaion using he coupling X = X0 + Z: J(X X 0 ) = p X0 (x 0 ) J(x 0 + Z) x 0 =. The muual Fisher informaion is Φ(X 0 X ) = J(X ) 0, which implies J(X ). Theorem 7 says ha I(X 0; X ) = ( J(X ) ). 2 Using he formula (7), we may compue he score funcion: ϕ(x 0, x ) = By Theorem 4, we hen obain x log p X X 0 (x x 0 ) = (x x 0 ). Φ(X 0 X ) = 2 mmse((x X 0 ) X ) = 2 mmse(x 0 X ), which, wih Theorem 7, recovers he I-MMSE ieniy (4). 2) Ornsein-Uhlenbeck process: Again, we have J b = J. Applying Theorem 5 yiels H(X ) = 2 J(X ) α. Noe ha if α 0, enropy always increases bu if α > 0, which is he regime of ineres, enropy nee no be monoonic. Using X = e α (X 0 + (e )Z), we may compue he coniional Fisher informaion J(X X 0 ) = e an he muual Fisher informaion Φ(X 0 X ) = e J(X ). Since Φ(X 0 X ) 0, his yiels he boun J(X ) e, which monoonically ecreases o as. Using he explici soluion o equaion (8), we obain ϕ(x 0, x ) = (x e α x 0 ) e. By Theorems 4 an 7, we hen euce he I-MMSE relaion I(X 0; X ) = 2 e ( e ) 2 mmse(x 0 X ). 3) Geomeric Brownian moion: Since b(x, ) = σ 2 x 2, we have J b J. Applying Theorem 5 yiels H(X ) = 2 J b(x ) + µ 2 σ2. Thus, he enropy may no increase monoonically. Using he explici soluion o equaion (9), we may compue ϕ(x 0, x ) = ( ) log x log x 0 α x σ 2 +. Then by Theorem 4, we erive he I-MMSE relaion I(X 0; X ) = 2σ 2 2 mmse(log X 0 X ). E. Mulivariae exension Our resuls exen wihou ifficuly o he mulivariae seing where X is a sochasic process in evolving accoring o he SDE (5), where a(x, ) is a rif vecor, σ(x, ) is a covariance marix, an W is sanar Brownian moion in. The weigh marix is given by b(x, ) = σ(x, )σ(x, ), which is assume o be uniformly posiive efinie.
5 We efine he generalize Fisher informaion (0) wih respec o a posiive efinie marix b(x): [ ] 2 J b (X) = E log p(x) 2 b(x) b(x) = x, where v 2 b(x) = v b(x)v = Tr(b(x)vv ) is he Mahalanobis inner prouc of v. The relaive () an muual Fisher informaion (2) are efine similarly, an he saisical Fisher informaion (4) is efine as Φ b (X Y ) = p Y (y) Tr(b(y)Φ(X Y = y)) y, where Φ(X Y = y) is he usual Fisher informaion marix p X Y (x y)( y log p X Y (x y))( y log p X Y (x y)) x. Wih hese efiniions, all our resuls hol unchange (see he exene version of our paper [5] for more eails). IV. DISCUSSION AND FUTUE WOK We have esablishe informaion-esimaion ieniies for ime-evolving sysems. Our resuls exen he classical De Bruijn s ieniy, which concerns he rae of enropy growh in a Brownian moion process, o he ime erivaives of enropy, KL ivergence, an muual informaion for processes escribe by general SDEs. The preicabiliy of such sysems relies on he informaion conaine in he curren sae regaring fuure saes. A a high level, he curren sae conains progressively less informaion abou fuure saes of he sysem; we erive he specific raes of change in informaion in erms of quaniies arising from esimaion. Theorem 7 relaes he ime erivaive of I(X 0 ; X ) o he saisical Fisher informaion, which by Theorem 3 is inversely proporional o he ifficuly of esimaing X 0 from X. As ime increases, his ifficuly shoul be increasing, suggesing ha I(X 0 ; X ) may ecrease in a convex manner. In he Gaussian seing, Cosa [23] showe ha he enropy of Brownian moion is a convex funcion, an Chen e al. [24] showe ha he firs four erivaives of enropy alernae in sign. We conjecure a similar propery for higher-orer erivaives of muual informaion in general SDEs. We also suspec ha he relaionship beween Fisher informaion an esimaion may be generalize o Bregman ivergences. Our resuls are base on he quaraic funcion f x (y) = 2 b(x)y2, corresponing o Gaussian ranomness generae by he Brownian moion b(x)w. I may be ineresing o invesigae sochasic processeses corresponing o general convex funcions. A final irecion is o explore he connecion o opimal ranspor, which inerpres he Fokker-Planck equaion (6) as he graien flow of relaive enropy in he space of probabiliy ensiies wih respec o he Wassersein meric. Villani [25] iscusses his in eail an inerpres Theorem 6 as he analog of De Bruijn s ieniy, since boh may be viewe as enropy proucion inequaliies. Noe ha such a viewpoin focuses on a PDE raher han SDE formulaion. EFEENCES [] T. M. Cover an J. A. Thomas, Elemens of informaion heory. John Wiley & Sons, 202. [2] A. Sam, Some inequaliies saisfie by he quaniies of informaion of Fisher an Shannon, Informaion an Conrol, vol. 2, no. 2, pp. 0 2, 959. [3] E. L. Lehmann an G. Casella, Theory of poin esimaion. Springer Science & Business Meia, [4] D. Guo, S. Shamai, an S. Verú, Muual informaion an minimum mean-square error in Gaussian channels, IEEE Transacions on Informaion Theory, vol. 5, no. 4, pp , [5] D. P. Palomar an S. Verú, epresenaion of muual informaion via inpu esimaes, IEEE Transacions on Informaion Theory, vol. 53, no. 2, pp , [6] S. Verú, Mismache esimaion an relaive enropy, IEEE Transacions on Informaion Theory, vol. 56, no. 8, pp , 200. [7] K. Venka an T. Weissman, Poinwise relaions beween informaion an esimaion in Gaussian noise, IEEE Transacions on Informaion Theory, vol. 58, no. 0, pp , 202. [8]. Aar an T. Weissman, Muual informaion, relaive enropy, an esimaion in he poisson channel, IEEE Transacions on Informaion heory, vol. 58, no. 3, pp , 202. [9] J. Jiao, K. Venka, an T. Weissman, Poinwise relaions beween informaion an esimaion in he poisson channel, in 203 IEEE Inernaional Symposium on Informaion Theory, pp , IEEE, 203. [0] J. Jiao, K. Venka, an T. Weissman, elaions beween informaion an esimaion in scalar Lévy channels, in 204 IEEE Inernaional Symposium on Informaion Theory, pp , IEEE, 204. [] L.-Y. Leung an G.. Norh, Informaion heory an climae preicion, Journal of Climae, vol. 3, no., pp. 5 4, 990. [2] T. Schneier an S. M. Griffies, A concepual framework for preicabiliy suies, Journal of Climae, vol. 2, no. 0, pp , 999. [3]. Kleeman, Measuring ynamical preicion uiliy using relaive enropy, Journal of he Amospheric Sciences, vol. 59, no. 3, pp , [4] T. DelSole, Preicabiliy an informaion heory. par I: Measures of preicabiliy, Journal of he Amospheric Sciences, vol. 6, no. 20, pp , [5] A. Wibisono, V. Jog, an P.-L. Loh, Informaion an esimaion in Fokker-Planck channels, arxiv preprin, 207. [6] M. C. Mackey, Time s Arrow: The Origins of Thermoynamics Behavior. Springer-Verlag, 992. [7] I. V. Toranzo, S. Zozor, an J.-M. Brossier, Generalizaion of he e Bruijn s ieniy o general φ-enropies an φ-fisher informaions, arxiv preprin arxiv: , 206. [8] S. E. Shreve, Sochasic calculus for finance II: Coninuous-ime moels, vol.. Springer Science & Business Meia, [9] F. Black an M. Scholes, The pricing of opions an corporae liabiliies, The Journal of Poliical Economy, vol. 8, no. 3, pp , 973. [20] E. Luwak, D. Yang, an G. Zhang, epresenaion of muual informaion via inpu esimaes, IEEE Transacions on Informaion Theory, vol. 53, no. 2, pp , [2] J.-F. Bercher, Some properies of generalize fisher informaion in he conex of nonexensive hermosaisics, Physica A: Saisical Mechanics an is Applicaions, vol. 392, no. 5, pp , 203. [22]. D. Gill an B. Y. Levi, Applicaions of he van Trees inequaliy: A Bayesian Cramér-ao boun, Bernoulli, pp , 995. [23] M. Cosa, A new enropy power inequaliy, IEEE Transacions on Informaion Theory, vol. 3, no. 6, pp , 985. [24] F. Cheng an Y. Geng, Higher orer erivaives in Cosa s enropy power inequaliy, IEEE Transacions on Informaion Theory, vol. 6, no., pp , 205. [25] C. Villani, Topics in opimal ransporaion. No. 58, American Mahemaical Soc., 2003.
Chapter Three Systems of Linear Differential Equations
Chaper Three Sysems of Linear Differenial Equaions In his chaper we are going o consier sysems of firs orer orinary ifferenial equaions. These are sysems of he form x a x a x a n x n x a x a x a n x n
More informationD.I. Survival models and copulas
D- D. SURVIVAL COPULA D.I. Survival moels an copulas Definiions, relaionships wih mulivariae survival isribuion funcions an relaionships beween copulas an survival copulas. D.II. Fraily moels Use of a
More informationAn introduction to evolution PDEs November 16, 2018 CHAPTER 5 - MARKOV SEMIGROUP
An inroucion o evoluion PDEs November 6, 8 CHAPTER 5 - MARKOV SEMIGROUP Conens. Markov semigroup. Asympoic of Markov semigroups 3.. Srong posiiviy coniion an Doeblin Theorem 3.. Geomeric sabiliy uner Harris
More informationMutual Information and Minimum Mean-square Error in Gaussian Channels
Muual Informaion an Minimum Mean-square Error in Gaussian Channels Dongning Guo, Shlomo Shamai Shiz), an Sergio Verú arxiv:cs/48v cs.it] 3 Dec 4 Absrac This paper eals wih arbirarily isribue finiepower
More informationOnline Learning with Partial Feedback. 1 Online Mirror Descent with Estimated Gradient
Avance Course in Machine Learning Spring 2010 Online Learning wih Parial Feeback Hanous are joinly prepare by Shie Mannor an Shai Shalev-Shwarz In previous lecures we alke abou he general framework of
More informationREPRESENTATION AND GAUSSIAN BOUNDS FOR THE DENSITY OF BROWNIAN MOTION WITH RANDOM DRIFT
Communicaions on Sochasic Analysis Vol. 1, No. 2 (216) 151-162 Serials Publicaions www.serialspublicaions.com REPRESENTATION AND GAUSSIAN BOUNDS FOR THE DENSITY OF BROWNIAN MOTION WITH RANDOM DRIFT AZMI
More informationWhen to Sell an Asset Where Its Drift Drops from a High Value to a Smaller One
American Journal of Operaions Research, 5, 5, 54-55 Publishe Online November 5 in SciRes. hp://www.scirp.org/journal/ajor hp://x.oi.org/.436/ajor.5.564 When o Sell an Asse Where Is Drif Drops from a High
More informationMatrix Versions of Some Refinements of the Arithmetic-Geometric Mean Inequality
Marix Versions of Some Refinemens of he Arihmeic-Geomeric Mean Inequaliy Bao Qi Feng and Andrew Tonge Absrac. We esablish marix versions of refinemens due o Alzer ], Carwrigh and Field 4], and Mercer 5]
More informationImpact of International Information Technology Transfer on National Productivity. Online Supplement
Impac of Inernaional Informaion Technology Transfer on Naional Prouciviy Online Supplemen Jungsoo Park Deparmen of Economics Sogang Universiy Seoul, Korea Email: jspark@sogang.ac.kr, Tel: 82-2-705-8697,
More informationPhysics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle
Chaper 2 Newonian Mechanics Single Paricle In his Chaper we will review wha Newon s laws of mechanics ell us abou he moion of a single paricle. Newon s laws are only valid in suiable reference frames,
More informationIntegral representations and new generating functions of Chebyshev polynomials
Inegral represenaions an new generaing funcions of Chebyshev polynomials Clemene Cesarano Faculy of Engineering, Inernaional Telemaic Universiy UNINETTUNO Corso Viorio Emanuele II, 39 186 Roma, Ialy email:
More informationThe Fundamental Theorems of Calculus
FunamenalTheorems.nb 1 The Funamenal Theorems of Calculus You have now been inrouce o he wo main branches of calculus: ifferenial calculus (which we inrouce wih he angen line problem) an inegral calculus
More informationGeorey E. Hinton. University oftoronto. Technical Report CRG-TR February 22, Abstract
Parameer Esimaion for Linear Dynamical Sysems Zoubin Ghahramani Georey E. Hinon Deparmen of Compuer Science Universiy oftorono 6 King's College Road Torono, Canada M5S A4 Email: zoubin@cs.orono.edu Technical
More informationA new flexible Weibull distribution
Communicaions for Saisical Applicaions and Mehods 2016, Vol. 23, No. 5, 399 409 hp://dx.doi.org/10.5351/csam.2016.23.5.399 Prin ISSN 2287-7843 / Online ISSN 2383-4757 A new flexible Weibull disribuion
More informationLecture Notes 2. The Hilbert Space Approach to Time Series
Time Series Seven N. Durlauf Universiy of Wisconsin. Basic ideas Lecure Noes. The Hilber Space Approach o Time Series The Hilber space framework provides a very powerful language for discussing he relaionship
More informationTwo-stage Benchmarking of Time-Series Models for. Small Area Estimation. Danny Pfeffermann, Richard Tiller
Two-sage Benchmarking of Time-Series Moels for Small Area Esimaion anny Pfeffermann, Souhampon Universiy, UK & Hebrew universiy, Israel Richar Tiller Bureau of Labor Saisics, U.S.A. Small Area Conference,
More informationCOMPETITIVE GROWTH MODEL
COMPETITIVE GROWTH MODEL I Assumpions We are going o now solve he compeiive version of he opimal growh moel. Alhough he allocaions are he same as in he social planning problem, i will be useful o compare
More informationProblem Set on Differential Equations
Problem Se on Differenial Equaions 1. Solve he following differenial equaions (a) x () = e x (), x () = 3/ 4. (b) x () = e x (), x (1) =. (c) xe () = + (1 x ()) e, x () =.. (An asse marke model). Le p()
More informationLecture 10: The Poincaré Inequality in Euclidean space
Deparmens of Mahemaics Monana Sae Universiy Fall 215 Prof. Kevin Wildrick n inroducion o non-smooh analysis and geomery Lecure 1: The Poincaré Inequaliy in Euclidean space 1. Wha is he Poincaré inequaliy?
More informationHeat kernel and Harnack inequality on Riemannian manifolds
Hea kernel and Harnack inequaliy on Riemannian manifolds Alexander Grigor yan UHK 11/02/2014 onens 1 Laplace operaor and hea kernel 1 2 Uniform Faber-Krahn inequaliy 3 3 Gaussian upper bounds 4 4 ean-value
More informationCash Flow Valuation Mode Lin Discrete Time
IOSR Journal of Mahemaics (IOSR-JM) e-issn: 2278-5728,p-ISSN: 2319-765X, 6, Issue 6 (May. - Jun. 2013), PP 35-41 Cash Flow Valuaion Mode Lin Discree Time Olayiwola. M. A. and Oni, N. O. Deparmen of Mahemaics
More informationAn Introduction to Malliavin calculus and its applications
An Inroducion o Malliavin calculus and is applicaions Lecure 5: Smoohness of he densiy and Hörmander s heorem David Nualar Deparmen of Mahemaics Kansas Universiy Universiy of Wyoming Summer School 214
More informationOn a Fractional Stochastic Landau-Ginzburg Equation
Applied Mahemaical Sciences, Vol. 4, 1, no. 7, 317-35 On a Fracional Sochasic Landau-Ginzburg Equaion Nguyen Tien Dung Deparmen of Mahemaics, FPT Universiy 15B Pham Hung Sree, Hanoi, Vienam dungn@fp.edu.vn
More informationInstitute for Mathematical Methods in Economics. University of Technology Vienna. Singapore, May Manfred Deistler
MULTIVARIATE TIME SERIES ANALYSIS AND FORECASTING Manfred Deisler E O S Economerics and Sysems Theory Insiue for Mahemaical Mehods in Economics Universiy of Technology Vienna Singapore, May 2004 Inroducion
More informationThe expectation value of the field operator.
The expecaion value of he field operaor. Dan Solomon Universiy of Illinois Chicago, IL dsolom@uic.edu June, 04 Absrac. Much of he mahemaical developmen of quanum field heory has been in suppor of deermining
More informationThe consumption-based determinants of the term structure of discount rates: Corrigendum. Christian Gollier 1 Toulouse School of Economics March 2012
The consumpion-based deerminans of he erm srucure of discoun raes: Corrigendum Chrisian Gollier Toulouse School of Economics March 0 In Gollier (007), I examine he effec of serially correlaed growh raes
More informationSeminar 5 Sustainability
Seminar 5 Susainabiliy Soluions Quesion : Hyperbolic Discouning -. Suppose a faher inheris a family forune of 0 million NOK an he wans o use some of i for himself (o be precise, he share ) bu also o beques
More informationSTATE-SPACE MODELLING. A mass balance across the tank gives:
B. Lennox and N.F. Thornhill, 9, Sae Space Modelling, IChemE Process Managemen and Conrol Subjec Group Newsleer STE-SPACE MODELLING Inroducion: Over he pas decade or so here has been an ever increasing
More informationSection 2.6 Derivatives of products and quotients
Secion 2.6 Derivaives of proucs an quoiens (3/19/08) Overview: In his secion, we erive formulas for erivaives of funcions ha are consruce by aking proucs an quoiens of oher funcions, an we use hese formulas
More informationOn Measuring Pro-Poor Growth. 1. On Various Ways of Measuring Pro-Poor Growth: A Short Review of the Literature
On Measuring Pro-Poor Growh 1. On Various Ways of Measuring Pro-Poor Growh: A Shor eview of he Lieraure During he pas en years or so here have been various suggesions concerning he way one should check
More informationOn Customized Goods, Standard Goods, and Competition
On Cusomize Goos, Sanar Goos, an Compeiion Nilari. Syam C. T. auer College of usiness Universiy of Houson 85 Melcher Hall, Houson, TX 7704 Email: nbsyam@uh.eu Phone: (71 74 4568 Fax: (71 74 457 Nana Kumar
More informationClassical Thermodynamics as a Consequence of Spacetime Geometry
Classical Thermoynamics as a Consequence of Spaceime Geomery Jay R. Yablon 9 Norhumberlan Drive Schenecay, New York 239-284 jyablon@nycap.rr.com January 6, 25 Absrac: Jus as Maxwell s magneic equaions
More information5. Stochastic processes (1)
Lec05.pp S-38.45 - Inroducion o Teleraffic Theory Spring 2005 Conens Basic conceps Poisson process 2 Sochasic processes () Consider some quaniy in a eleraffic (or any) sysem I ypically evolves in ime randomly
More information( ) ( ) ( ) ( u) ( u) = are shown in Figure =, it is reasonable to speculate that. = cos u ) and the inside function ( ( t) du
Porlan Communiy College MTH 51 Lab Manual The Chain Rule Aciviy 38 The funcions f ( = sin ( an k( sin( 3 38.1. Since f ( cos( k ( = cos( 3. Bu his woul imply ha k ( f ( = are shown in Figure =, i is reasonable
More informationSettling Time Design and Parameter Tuning Methods for Finite-Time P-PI Control
Journal of Conrol Science an Engineering (6) - oi:.765/8-/6.. D DAVID PUBLISHING Seling ime Design an Parameer uning Mehos for Finie-ime P-PI Conrol Keigo Hiruma, Hisaazu Naamura an Yasuyui Saoh. Deparmen
More informationR t. C t P t. + u t. C t = αp t + βr t + v t. + β + w t
Exercise 7 C P = α + β R P + u C = αp + βr + v (a) (b) C R = α P R + β + w (c) Assumpions abou he disurbances u, v, w : Classical assumions on he disurbance of one of he equaions, eg. on (b): E(v v s P,
More informationGMM - Generalized Method of Moments
GMM - Generalized Mehod of Momens Conens GMM esimaion, shor inroducion 2 GMM inuiion: Maching momens 2 3 General overview of GMM esimaion. 3 3. Weighing marix...........................................
More informationHamilton- J acobi Equation: Weak S olution We continue the study of the Hamilton-Jacobi equation:
M ah 5 7 Fall 9 L ecure O c. 4, 9 ) Hamilon- J acobi Equaion: Weak S oluion We coninue he sudy of he Hamilon-Jacobi equaion: We have shown ha u + H D u) = R n, ) ; u = g R n { = }. ). In general we canno
More informationLecture 20: Riccati Equations and Least Squares Feedback Control
34-5 LINEAR SYSTEMS Lecure : Riccai Equaions and Leas Squares Feedback Conrol 5.6.4 Sae Feedback via Riccai Equaions A recursive approach in generaing he marix-valued funcion W ( ) equaion for i for he
More informationNonlinear Observers for Perspective Time-Varying Linear Systems
Nonlinear Observers for Perspecive Time-Varying Linear Sysems Rixa Abursul an Hiroshi Inaba Deparmen of Informaion Sciences Tokuo Denki Universiy Hikigun, Saiama 355-394 JAPAN Absrac Perspecive ynamical
More informationPhysics 127b: Statistical Mechanics. Fokker-Planck Equation. Time Evolution
Physics 7b: Saisical Mechanics Fokker-Planck Equaion The Langevin equaion approach o he evoluion of he velociy disribuion for he Brownian paricle migh leave you uncomforable. A more formal reamen of his
More informationAn Introduction to Backward Stochastic Differential Equations (BSDEs) PIMS Summer School 2016 in Mathematical Finance.
1 An Inroducion o Backward Sochasic Differenial Equaions (BSDEs) PIMS Summer School 2016 in Mahemaical Finance June 25, 2016 Chrisoph Frei cfrei@ualbera.ca This inroducion is based on Touzi [14], Bouchard
More informationFractional Method of Characteristics for Fractional Partial Differential Equations
Fracional Mehod of Characerisics for Fracional Parial Differenial Equaions Guo-cheng Wu* Modern Teile Insiue, Donghua Universiy, 188 Yan-an ilu Road, Shanghai 51, PR China Absrac The mehod of characerisics
More informationarxiv: v1 [math.pr] 19 Feb 2011
A NOTE ON FELLER SEMIGROUPS AND RESOLVENTS VADIM KOSTRYKIN, JÜRGEN POTTHOFF, AND ROBERT SCHRADER ABSTRACT. Various equivalen condiions for a semigroup or a resolven generaed by a Markov process o be of
More informationState-Space Models. Initialization, Estimation and Smoothing of the Kalman Filter
Sae-Space Models Iniializaion, Esimaion and Smoohing of he Kalman Filer Iniializaion of he Kalman Filer The Kalman filer shows how o updae pas predicors and he corresponding predicion error variances when
More informationdi Bernardo, M. (1995). A purely adaptive controller to synchronize and control chaotic systems.
di ernardo, M. (995). A purely adapive conroller o synchronize and conrol chaoic sysems. hps://doi.org/.6/375-96(96)8-x Early version, also known as pre-prin Link o published version (if available):.6/375-96(96)8-x
More informationCHERNOFF DISTANCE AND AFFINITY FOR TRUNCATED DISTRIBUTIONS *
haper 5 HERNOFF DISTANE AND AFFINITY FOR TRUNATED DISTRIBUTIONS * 5. Inroducion In he case of disribuions ha saisfy he regulariy condiions, he ramer- Rao inequaliy holds and he maximum likelihood esimaor
More informationL07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS. NA568 Mobile Robotics: Methods & Algorithms
L07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS NA568 Mobile Roboics: Mehods & Algorihms Today s Topic Quick review on (Linear) Kalman Filer Kalman Filering for Non-Linear Sysems Exended Kalman Filer (EKF)
More informationVanishing Viscosity Method. There are another instructive and perhaps more natural discontinuous solutions of the conservation law
Vanishing Viscosiy Mehod. There are anoher insrucive and perhaps more naural disconinuous soluions of he conservaion law (1 u +(q(u x 0, he so called vanishing viscosiy mehod. This mehod consiss in viewing
More informationLecture #31, 32: The Ornstein-Uhlenbeck Process as a Model of Volatility
Saisics 441 (Fall 214) November 19, 21, 214 Prof Michael Kozdron Lecure #31, 32: The Ornsein-Uhlenbeck Process as a Model of Volailiy The Ornsein-Uhlenbeck process is a di usion process ha was inroduced
More informationCournot games with limited demand: from multiple equilibria to stochastic equilibrium
Courno games wih limie eman: from muliple equilibria o sochasic equilibrium Io Polak an Nicolas Privaul Division of Mahemaical Sciences School of Physical an Mahemaical Sciences Nanyang Technological Universiy
More informationA dynamic AS-AD Model
A ynamic AS-AD Moel (Lecure Noes, Thomas Seger, Universiy of Leipzig, winer erm 10/11) This file escribes a ynamic AS-AD moel. The moel can be employe o assess he ynamic consequences of macroeconomic shocks
More informationLecture 4: Processes with independent increments
Lecure 4: Processes wih independen incremens 1. A Wienner process 1.1 Definiion of a Wienner process 1.2 Reflecion principle 1.3 Exponenial Brownian moion 1.4 Exchange of measure (Girsanov heorem) 1.5
More informationLecture 6 - Testing Restrictions on the Disturbance Process (References Sections 2.7 and 2.10, Hayashi)
Lecure 6 - esing Resricions on he Disurbance Process (References Secions 2.7 an 2.0, Hayashi) We have eveloe sufficien coniions for he consisency an asymoic normaliy of he OLS esimaor ha allow for coniionally
More informationRecursive Least-Squares Fixed-Interval Smoother Using Covariance Information based on Innovation Approach in Linear Continuous Stochastic Systems
8 Froniers in Signal Processing, Vol. 1, No. 1, July 217 hps://dx.doi.org/1.2266/fsp.217.112 Recursive Leas-Squares Fixed-Inerval Smooher Using Covariance Informaion based on Innovaion Approach in Linear
More informationSingle integration optimization of linear time-varying switched systems
Single inegraion opimizaion of linear ime-varying swiche sysems T. M. Calwell an T. D. Murphey Absrac This paper consiers he swiching ime opimizaion of ime-varying linear swiche sysems subjec o quaraic
More informationT L. t=1. Proof of Lemma 1. Using the marginal cost accounting in Equation(4) and standard arguments. t )+Π RB. t )+K 1(Q RB
Elecronic Companion EC.1. Proofs of Technical Lemmas and Theorems LEMMA 1. Le C(RB) be he oal cos incurred by he RB policy. Then we have, T L E[C(RB)] 3 E[Z RB ]. (EC.1) Proof of Lemma 1. Using he marginal
More informationClassical Thermodynamics Entropy Laws as a Consequence of Spacetime Geometry
Classical Thermoynamics Enropy Laws as a Consequence of Spaceime Geomery Jay R. Yablon 9 Norhumberlan Drive Schenecay, New York 239-284 jyablon@nycap.rr.com January 7, 25 Absrac: Jus as Maxwell s magneic
More informationNotes on Kalman Filtering
Noes on Kalman Filering Brian Borchers and Rick Aser November 7, Inroducion Daa Assimilaion is he problem of merging model predicions wih acual measuremens of a sysem o produce an opimal esimae of he curren
More informationt 2 B F x,t n dsdt t u x,t dxdt
Evoluion Equaions For 0, fixed, le U U0, where U denoes a bounded open se in R n.suppose ha U is filled wih a maerial in which a conaminan is being ranspored by various means including diffusion and convecion.
More informationExplaining Total Factor Productivity. Ulrich Kohli University of Geneva December 2015
Explaining Toal Facor Produciviy Ulrich Kohli Universiy of Geneva December 2015 Needed: A Theory of Toal Facor Produciviy Edward C. Presco (1998) 2 1. Inroducion Toal Facor Produciviy (TFP) has become
More informationA Specification Test for Linear Dynamic Stochastic General Equilibrium Models
Journal of Saisical and Economeric Mehods, vol.1, no.2, 2012, 65-70 ISSN: 2241-0384 (prin), 2241-0376 (online) Scienpress Ld, 2012 A Specificaion Tes for Linear Dynamic Sochasic General Equilibrium Models
More informationACE 562 Fall Lecture 5: The Simple Linear Regression Model: Sampling Properties of the Least Squares Estimators. by Professor Scott H.
ACE 56 Fall 005 Lecure 5: he Simple Linear Regression Model: Sampling Properies of he Leas Squares Esimaors by Professor Sco H. Irwin Required Reading: Griffihs, Hill and Judge. "Inference in he Simple
More information1. (16 points) Answer the following derivative-related questions. dx tan sec x. dx tan u = du d. dx du tan u. du tan u d v.
Exam #2 Soluions. (6 poins) Answer he following eriaie-relae quesions. (a) (8 poins) If y an sec x, fin. This is an applicaion of he chain rule in wo sages, in which we shall le u sec x, an sec x: an sec
More informationChapter 2. First Order Scalar Equations
Chaper. Firs Order Scalar Equaions We sar our sudy of differenial equaions in he same way he pioneers in his field did. We show paricular echniques o solve paricular ypes of firs order differenial equaions.
More information6. Stochastic calculus with jump processes
A) Trading sraegies (1/3) Marke wih d asses S = (S 1,, S d ) A rading sraegy can be modelled wih a vecor φ describing he quaniies invesed in each asse a each insan : φ = (φ 1,, φ d ) The value a of a porfolio
More informationMost Probable Phase Portraits of Stochastic Differential Equations and Its Numerical Simulation
Mos Probable Phase Porrais of Sochasic Differenial Equaions and Is Numerical Simulaion Bing Yang, Zhu Zeng and Ling Wang 3 School of Mahemaics and Saisics, Huazhong Universiy of Science and Technology,
More informationarxiv: v1 [math.pr] 6 Oct 2008
MEASURIN THE NON-STOPPIN TIMENESS OF ENDS OF PREVISIBLE SETS arxiv:8.59v [mah.pr] 6 Oc 8 JU-YI YEN ),) AND MARC YOR 3),4) Absrac. In his paper, we propose several measuremens of he nonsopping imeness of
More informationAnnouncements: Warm-up Exercise:
Fri Apr 13 7.1 Sysems of differenial equaions - o model muli-componen sysems via comparmenal analysis hp//en.wikipedia.org/wiki/muli-comparmen_model Announcemens Warm-up Exercise Here's a relaively simple
More informationStability and Bifurcation in a Neural Network Model with Two Delays
Inernaional Mahemaical Forum, Vol. 6, 11, no. 35, 175-1731 Sabiliy and Bifurcaion in a Neural Nework Model wih Two Delays GuangPing Hu and XiaoLing Li School of Mahemaics and Physics, Nanjing Universiy
More information3. Mathematical Modelling
3. Mahemaical Moelling 3.1 Moelling principles 3.1.1 Moel ypes 3.1.2 Moel consrucion 3.1.3 Moelling from firs principles 3.2 Moels for echnical sysems 3.2.1 Elecrical sysems 3.2.2 Mechanical sysems 3.2.3
More informationMATH 4330/5330, Fourier Analysis Section 6, Proof of Fourier s Theorem for Pointwise Convergence
MATH 433/533, Fourier Analysis Secion 6, Proof of Fourier s Theorem for Poinwise Convergence Firs, some commens abou inegraing periodic funcions. If g is a periodic funcion, g(x + ) g(x) for all real x,
More informationSolutions Problem Set 3 Macro II (14.452)
Soluions Problem Se 3 Macro II (14.452) Francisco A. Gallego 04/27/2005 1 Q heory of invesmen in coninuous ime and no uncerainy Consider he in nie horizon model of a rm facing adjusmen coss o invesmen.
More informationCourse Notes for EE227C (Spring 2018): Convex Optimization and Approximation
Course Noes for EE7C Spring 018: Convex Opimizaion and Approximaion Insrucor: Moriz Hard Email: hard+ee7c@berkeley.edu Graduae Insrucor: Max Simchowiz Email: msimchow+ee7c@berkeley.edu Ocober 15, 018 3
More informationInequality measures for intersecting Lorenz curves: an alternative weak ordering
h Inernaional Scienific Conference Financial managemen of Firms and Financial Insiuions Osrava VŠB-TU of Osrava, Faculy of Economics, Deparmen of Finance 7 h 8 h Sepember 25 Absrac Inequaliy measures for
More informationInternational Journal of Scientific & Engineering Research, Volume 4, Issue 10, October ISSN
Inernaional Journal of Scienific & Engineering Research, Volume 4, Issue 10, Ocober-2013 900 FUZZY MEAN RESIDUAL LIFE ORDERING OF FUZZY RANDOM VARIABLES J. EARNEST LAZARUS PIRIYAKUMAR 1, A. YAMUNA 2 1.
More informationTwo Popular Bayesian Estimators: Particle and Kalman Filters. McGill COMP 765 Sept 14 th, 2017
Two Popular Bayesian Esimaors: Paricle and Kalman Filers McGill COMP 765 Sep 14 h, 2017 1 1 1, dx x Bel x u x P x z P Recall: Bayes Filers,,,,,,, 1 1 1 1 u z u x P u z u x z P Bayes z = observaion u =
More information18 Biological models with discrete time
8 Biological models wih discree ime The mos imporan applicaions, however, may be pedagogical. The elegan body of mahemaical heory peraining o linear sysems (Fourier analysis, orhogonal funcions, and so
More informationChapter 14 Wiener Processes and Itô s Lemma. Options, Futures, and Other Derivatives, 9th Edition, Copyright John C. Hull
Chaper 14 Wiener Processes and Iô s Lemma Copyrigh John C. Hull 014 1 Sochasic Processes! Describes he way in which a variable such as a sock price, exchange rae or ineres rae changes hrough ime! Incorporaes
More informationSparse Stabilization of Dynamical Systems Driven by Attraction and Avoidance Forces
Sparse Sabilizaion of Dynamical Sysems Driven by Aracion an Avoiance Forces Maia Bongini Massimo Fornasier Fabian Fröhlich Laleh Haghveri Technische Universiä München (e-mail: maia.bongini@ma.um.e). Technische
More informationLinear Response Theory: The connection between QFT and experiments
Phys540.nb 39 3 Linear Response Theory: The connecion beween QFT and experimens 3.1. Basic conceps and ideas Q: How do we measure he conduciviy of a meal? A: we firs inroduce a weak elecric field E, and
More informationarxiv: v1 [math.fa] 9 Dec 2018
AN INVERSE FUNCTION THEOREM CONVERSE arxiv:1812.03561v1 [mah.fa] 9 Dec 2018 JIMMIE LAWSON Absrac. We esablish he following converse of he well-known inverse funcion heorem. Le g : U V and f : V U be inverse
More informationVehicle Arrival Models : Headway
Chaper 12 Vehicle Arrival Models : Headway 12.1 Inroducion Modelling arrival of vehicle a secion of road is an imporan sep in raffic flow modelling. I has imporan applicaion in raffic flow simulaion where
More informationFinal Spring 2007
.615 Final Spring 7 Overview The purpose of he final exam is o calculae he MHD β limi in a high-bea oroidal okamak agains he dangerous n = 1 exernal ballooning-kink mode. Effecively, his corresponds o
More informationSingle and Double Pendulum Models
Single and Double Pendulum Models Mah 596 Projec Summary Spring 2016 Jarod Har 1 Overview Differen ypes of pendulums are used o model many phenomena in various disciplines. In paricular, single and double
More informationUNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS
UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS Exam: ECON4325 Moneary Policy Dae of exam: Tuesday, May 24, 206 Grades are given: June 4, 206 Time for exam: 2.30 p.m. 5.30 p.m. The problem se covers 5 pages
More informationModule II, Part C. More Insight into Fiber Dispersion
Moule II Par C More Insigh ino Fiber Dispersion . Polariaion Moe Dispersion Fiber Birefringence: Imperfec cylinrical symmery leas o wha is known as birefringence. Recall he HE moe an is E x componen which
More informationEmpirical Process Theory
Empirical Process heory 4.384 ime Series Analysis, Fall 27 Reciaion by Paul Schrimpf Supplemenary o lecures given by Anna Mikusheva Ocober 7, 28 Reciaion 7 Empirical Process heory Le x be a real-valued
More informationAN OPTIMAL CONTROL PROBLEM FOR SPLINES ASSOCIATED TO LINEAR DIFFERENTIAL OPERATORS
CONTROLO 6 7h Poruguese Conference on Auomaic Conrol Insiuo Superior Técnico, Lisboa, Porugal Sepember -3, 6 AN OPTIMAL CONTROL PROBLEM FOR SPLINES ASSOCIATED TO LINEAR DIFFERENTIAL OPERATORS Rui C. Rodrigues,
More information11!Hí MATHEMATICS : ERDŐS AND ULAM PROC. N. A. S. of decomposiion, properly speaking) conradics he possibiliy of defining a counably addiive real-valu
ON EQUATIONS WITH SETS AS UNKNOWNS BY PAUL ERDŐS AND S. ULAM DEPARTMENT OF MATHEMATICS, UNIVERSITY OF COLORADO, BOULDER Communicaed May 27, 1968 We shall presen here a number of resuls in se heory concerning
More informationBoundedness and Exponential Asymptotic Stability in Dynamical Systems with Applications to Nonlinear Differential Equations with Unbounded Terms
Advances in Dynamical Sysems and Applicaions. ISSN 0973-531 Volume Number 1 007, pp. 107 11 Research India Publicaions hp://www.ripublicaion.com/adsa.hm Boundedness and Exponenial Asympoic Sabiliy in Dynamical
More informationf(s)dw Solution 1. Approximate f by piece-wise constant left-continuous non-random functions f n such that (f(s) f n (s)) 2 ds 0.
Advanced Financial Models Example shee 3 - Michaelmas 217 Michael Tehranchi Problem 1. Le f : [, R be a coninuous (non-random funcion and W a Brownian moion, and le σ 2 = f(s 2 ds and assume σ 2
More information2.3 SCHRÖDINGER AND HEISENBERG REPRESENTATIONS
Andrei Tokmakoff, MIT Deparmen of Chemisry, 2/22/2007 2-17 2.3 SCHRÖDINGER AND HEISENBERG REPRESENTATIONS The mahemaical formulaion of he dynamics of a quanum sysem is no unique. So far we have described
More informationSZG Macro 2011 Lecture 3: Dynamic Programming. SZG macro 2011 lecture 3 1
SZG Macro 2011 Lecure 3: Dynamic Programming SZG macro 2011 lecure 3 1 Background Our previous discussion of opimal consumpion over ime and of opimal capial accumulaion sugges sudying he general decision
More informationUnit Root Time Series. Univariate random walk
Uni Roo ime Series Univariae random walk Consider he regression y y where ~ iid N 0, he leas squares esimae of is: ˆ yy y y yy Now wha if = If y y hen le y 0 =0 so ha y j j If ~ iid N 0, hen y ~ N 0, he
More informationEXERCISES FOR SECTION 1.5
1.5 Exisence and Uniqueness of Soluions 43 20. 1 v c 21. 1 v c 1 2 4 6 8 10 1 2 2 4 6 8 10 Graph of approximae soluion obained using Euler s mehod wih = 0.1. Graph of approximae soluion obained using Euler
More informationIntroduction to continuum mechanics-ii
Ioan R. IONESCU LSPM, Universiy Paris 3 (Sorbonne-Paris-Cié) July 3, 27 Coninuum kinemaics B uneforme/reference configuraion, B eforme/acual configuraion Moion: x(, X ) = X + u(, X ) wih x(, B ) = B. Maerial/Lagrangian
More informationarxiv: v1 [math.pr] 27 Dec 2018
Job Allocaion in Large-Scale Service Sysems wih Affiniy Relaions Ellen Carinaels, Sem C. Bors,2 an Johan S.H. van Leeuwaaren Einhoven Universiy of Technology, The eherlans 2 okia Bell Labs, Murray Hill,
More informationIntroduction D P. r = constant discount rate, g = Gordon Model (1962): constant dividend growth rate.
Inroducion Gordon Model (1962): D P = r g r = consan discoun rae, g = consan dividend growh rae. If raional expecaions of fuure discoun raes and dividend growh vary over ime, so should he D/P raio. Since
More information2. Nonlinear Conservation Law Equations
. Nonlinear Conservaion Law Equaions One of he clear lessons learned over recen years in sudying nonlinear parial differenial equaions is ha i is generally no wise o ry o aack a general class of nonlinear
More information