Multilevel ensemble Kalman filtering
|
|
- Eustacia Chase
- 6 years ago
- Views:
Transcription
1 Multilevel esemble Kalma filterig Håko Hoel 1 Kody Law 2 Raúl Tempoe 3 1 Departmet of Mathematics, Uiversity of Oslo, Norway 2 Oak Ridge Natioal Laboratory, TN, USA 3 Applied Mathematics ad Computatioal Scieces, KAUST uiversity, Saudi Arabia UQAW 2016, Thuwal 1 / 27
2 Overview 1 Problem descriptio 2 Kalma filterig 3 Esemble Kalma filterig 4 Multilevel esemble Kalma filterig 5 Extesio of MLEKF ad Coclusio 2 / 27
3 Problem descriptio Cosider the uderlyig ad uobservable dyamics u +1 = u + a(u t ) dt + b(u t ) dw (t) } 1 {{ 1 } =:Ψ(u ) with u R d, ad Lipschitz cotiuous a : R d R d ad b : R d Rd ˆd. Ad oisy observatios y = Hv + γ, with i.i.d. γ N(0, Γ) ad H R k d. Objective: Let Y := (y 1, y 2,..., y ) ad let Y obs be a sequece of fixed observatios. Costruct a efficiet method for trackig u (Y = Y obs ). That is, approximate [ ] E φ(u ) Y = Y obs for a observable φ : R d R. Abuse of otatio: will write u Y obs to represet u (Y = Y obs ). 3 / 27
4 Problem descriptio Cosider the uderlyig ad uobservable dyamics u +1 = u + a(u t ) dt + b(u t ) dw (t) } 1 {{ 1 } =:Ψ(u ) with u R d, ad Lipschitz cotiuous a : R d R d ad b : R d Rd ˆd. Ad oisy observatios y = Hv + γ, with i.i.d. γ N(0, Γ) ad H R k d. Objective: Let Y := (y 1, y 2,..., y ) ad let Y obs be a sequece of fixed observatios. Costruct a efficiet method for trackig u (Y = Y obs ). That is, approximate [ ] E φ(u ) Y = Y obs for a observable φ : R d R. Abuse of otatio: will write u Y obs to represet u (Y = Y obs ). 3 / 27
5 Problem descriptio Cosider the uderlyig ad uobservable dyamics u +1 = u + a(u t ) dt + b(u t ) dw (t) } 1 {{ 1 } =:Ψ(u ) with u R d, ad Lipschitz cotiuous a : R d R d ad b : R d Rd ˆd. Ad oisy observatios y = Hv + γ, with i.i.d. γ N(0, Γ) ad H R k d. Objective: Let Y := (y 1, y 2,..., y ) ad let Y obs be a sequece of fixed observatios. Costruct a efficiet method for trackig u (Y = Y obs ). That is, approximate [ ] E φ(u ) Y = Y obs for a observable φ : R d R. Abuse of otatio: will write u Y obs to represet u (Y = Y obs ). 3 / 27
6 Overview 1 Problem descriptio 2 Kalma filterig 3 Esemble Kalma filterig 4 Multilevel esemble Kalma filterig 5 Extesio of MLEKF ad Coclusio 4 / 27
7 Kalma filterig Cosider the liear settig u +1 = Au + ξ +1, y +1 = Hu +1 + γ +1, ξ +1 N(0, Σ), γ +1 N(0, Γ). (1) Gaussiaity of the filterig distributio If u Y obs N(m, C ), the uder (1) both u +1 Y obs will also be Gaussias. ad u +1 Y obs +1 u +1 Y obs = (Au +ξ +1 ) Y obs = A(u Y obs )+ξ +1 N( Am }{{}, AC A T + Σ), }{{} =: m +1 =:Ĉ+1 Ca use Bayesia iferece to show u +1 Y obs +1 N(m +1, C +1 ), where m +1 = (I K +1 H) m +1 + K +1 y obs +1, C +1 = (I K +1 H)Ĉ+1, K +1 = Ĉ+1H T (Γ + HĈ+1H T ) 1. 5 / 27
8 Kalma filterig Cosider the liear settig u +1 = Au + ξ +1, y +1 = Hu +1 + γ +1, ξ +1 N(0, Σ), γ +1 N(0, Γ). (1) Gaussiaity of the filterig distributio If u Y obs N(m, C ), the uder (1) both u +1 Y obs will also be Gaussias. ad u +1 Y obs +1 u +1 Y obs = (Au +ξ +1 ) Y obs = A(u Y obs )+ξ +1 N( Am }{{}, AC A T + Σ), }{{} =: m +1 =:Ĉ+1 Ca use Bayesia iferece to show u +1 Y obs +1 N(m +1, C +1 ), where m +1 = (I K +1 H) m +1 + K +1 y obs +1, C +1 = (I K +1 H)Ĉ+1, K +1 = Ĉ+1H T (Γ + HĈ+1H T ) 1. 5 / 27
9 Kalma filterig Cosider the liear settig u +1 = Au + ξ +1, y +1 = Hu +1 + γ +1, ξ +1 N(0, Σ), γ +1 N(0, Γ). (1) Gaussiaity of the filterig distributio If u Y obs N(m, C ), the uder (1) both u +1 Y obs will also be Gaussias. ad u +1 Y obs +1 u +1 Y obs = (Au +ξ +1 ) Y obs = A(u Y obs )+ξ +1 N( Am }{{}, AC A T + Σ), }{{} =: m +1 =:Ĉ+1 Ca use Bayesia iferece to show u +1 Y obs +1 N(m +1, C +1 ), where m +1 = (I K +1 H) m +1 + K +1 y obs +1, C +1 = (I K +1 H)Ĉ+1, K +1 = Ĉ+1H T (Γ + HĈ+1H T ) 1. 5 / 27
10 Kalma filterig formulas 1 The predictio step for u +1 Y obs Predictio N( m +1, Ĉ+1): m +1 = Am Ĉ +1 = AC A T + Σ. 2 The update step. Update the predictio with the latest observatio y +1 ito u +1 Y +1 N(m +1, C +1 ): Update m +1 = (I K +1 H) m +1 + K +1 y obs +1, C +1 = (I K +1 H)Ĉ+1, K +1 = Ĉ+1H T (Γ + HĈ+1H T ) 1. 6 / 27
11 Overview 1 Problem descriptio 2 Kalma filterig 3 Esemble Kalma filterig 4 Multilevel esemble Kalma filterig 5 Extesio of MLEKF ad Coclusio 7 / 27
12 Esemble Kalma filterig (Evese 94) I more complex settigs, Kalma filterig has major drawbacks: I high dimesios, d 1, storage ad evolutio of the full d d covariace matrix C is very costly. Kalma filterig is ot desiged for oliear dyamics u +1 = Ψ(u ); liearizatio is the eeded, ad it is hard to estimate the errors from liearizatio. Esemble Kalma filterig (EKF) may overcome these drawbacks by propagatig a esemble of particles {v (ω i )} M i=1 {v +1(ω i )} M i=1 ad usig their sample momets i the predict ad update steps. 8 / 27
13 Esemble Kalma Filterig II Predict 1 Compute (umerical solutios of) M particle paths oe step forward v +1,i = Ψ(v,i, ω i ) for i = 1, 2,..., M. 2 Compute sample mea ad covariace m MC +1 = E M [ v +1 ] Ĉ MC +1 = Cov M [ v +1 ] where E M [ v +1 ] := 1 M M i=1 v +1,i ad Cov M [ v +1 ] := E M [ v +1 v T +1] E M [ v +1 ](E M [ v +1 ]) T. 9 / 27
14 Esemble Kalma Filterig III Update 1 Geerate sigal observatios for the esemble of particles ỹ +1,i = y obs +1 + γ +1,i for i = 1, 2..., M, with i.i.d. γ +1,1 N(0, Γ). 2 Use sigal observatios to update particle paths where v +1,i = (I K MC +1H) v +1,i + K MC +1ỹ +1,i, K MC +1 = Ĉ MC +1H T (HĈ MC +1H T + Γ) 1. Note: After the first step, all particles are correlated due to K MC / 27
15 From EKF to mea field EKF For studyig covergece properties of EKF it is useful to itroduce the mea field EKF (MFEKF) v +1,i MF = Ψ(v,i MF, ω i ) ] K+1 Pr m +1 MF MF = E [ v MF = Ĉ +1 MFHT (HĈ +1 MFHT + Γ) 1 +1,i Up ỹ +1,i = y +1 + γ +1,i Ĉ+1 MF = Cov[ v +1,i MF ], v+1,i MF = (I K+1 MF MF H)v+1,i + K +1ỹ+1,i. MF ad i compariso, EKF v +1,i = Ψ(v,i, ω i ) Pr m +1 MC = E M [ v +1 ] Up Ĉ+1 MC = Cov M [ v +1 ] K MC ỹ +1,i v +1,i +1 = Ĉ MC +1 HT (HĈ MC +1 HT + Γ) 1 = y +1 + γ +1,i = (I K+1 MCH) v +1,i + K+1ỹ+1,i. MC Whe uderlyig dyamics is liear with Gaussia additive oise ad u 0 Gaussia, it holds that µ MF (dx) = P ( u dx Y obs ), where µ MF = Law(v,i MF ). I oliear settigs, we use as approximatio goal φ(x)µ MF R d [ (dx)( E φ(u ) Y obs ] ) 11 / 27
16 From EKF to mea field EKF For studyig covergece properties of EKF it is useful to itroduce the mea field EKF (MFEKF) v +1,i MF = Ψ(v,i MF, ω i ) ] K+1 Pr m +1 MF MF = E [ v MF = Ĉ +1 MFHT (HĈ +1 MFHT + Γ) 1 +1,i Up ỹ +1,i = y +1 + γ +1,i Ĉ+1 MF = Cov[ v +1,i MF ], v+1,i MF = (I K+1 MF MF H)v+1,i + K +1ỹ+1,i. MF ad i compariso, EKF v +1,i = Ψ(v,i, ω i ) Pr m +1 MC = E M [ v +1 ] Up Ĉ+1 MC = Cov M [ v +1 ] K MC ỹ +1,i v +1,i +1 = Ĉ MC +1 HT (HĈ MC +1 HT + Γ) 1 = y +1 + γ +1,i = (I K+1 MCH) v +1,i + K+1ỹ+1,i. MC Whe uderlyig dyamics is liear with Gaussia additive oise ad u 0 Gaussia, it holds that µ MF (dx) = P ( u dx Y obs ), where µ MF = Law(v,i MF ). I oliear settigs, we use as approximatio goal φ(x)µ MF R d [ (dx)( E φ(u ) Y obs ] ) 11 / 27
17 Covergece of EKF Theorem 1 (Le Glad et al. (2009)) Cosider the dyamics ad observatios, u +1 = f (u ) + ξ +1, y +1 = Hu +1 + γ +1, ξ +1 N(0, Σ), γ +1 N(0, Γ), ad assume u 0 L p (Ω) for ay p 1, ad that max( f (x) f (x ), φ(x) φ(x ) ) C x x (1+ x s + x s ), for a s 0. The, for the EKF update esemble {v,i } M i=1, ( sup M E[ M 1 M i=1 φ(v,i ) M for ay order p 1 ad fiite. φ(x)µ MF R d p]) 1/p (dx) <. Extesio to further oliear settigs i [Law et al. (2014)]. 12 / 27
18 Cetral step i proof: M φ(v,i ) M φ(x)µ MF M (dx) i=1 R d p i=1 M + i=1 φ(v,i ) M φ(v,i MF ) M M φ(v,i MF ) M i=1 p φ(x)µ MF R d = O( v,i v MF,i ˆp + M 1/2 ) (dx) p 13 / 27
19 Computatioal cost of EKF To meet the costrait ( M E[ i=1 φ(v,i ) M φ(x)µ MF R d oe thus eeds esemble of size M = O(ɛ 2 ). p]) 1/p (dx) = O(ɛ), How does the computatioal cost icrease if the EKF dyamics has to be sampled usig a umerical solver for which E [ Ψ Ψ ] = O( t α )? Short aswer (uder additioal assumptios): the cost icreases to O(ɛ (2+1/α) ). 14 / 27
20 Overview 1 Problem descriptio 2 Kalma filterig 3 Esemble Kalma filterig 4 Multilevel esemble Kalma filterig 5 Extesio of MLEKF ad Coclusio 15 / 27
21 Multilevel EKF (MLEKF) Predictio Compute a esemble of particle paths o a hierarchy of accuracy levels v l 1 +1,i = Ψ l 1 (v l 1,i, ω l,i ), v l +1,i = Ψ l (v l,i, ω l,i ), for the levels l = 0, 1,..., L ad i = 1, 2,..., M l. Multilevel approximatio of mea ad covariace matrices: m ML +1 = Ĉ ML +1 = L l=0 L l=0 E Ml [ v l +1 v l 1 +1 ], Cov Ml [ v l +1] Cov Ml [ v l 1 +1 ] Notice the telescopig properties E [ m +1] ML ] = E [ v L ] +1 ad = Cov( v +1 L ) + O(1/M L). E[Ĉ ML / 27
22 MLEKF update step Update For l = 0, 1,..., L ad i = 1, 2,..., M l, ỹ l +1,i = y obs +1 + γ l +1,i, i.i.d. γ l +1,i N(0, Γ) v+1 l 1 ML = (I K+1H) v l 1 +1,i + K +1ỹ ML +1,i, l v+1,i l = (I K+1H) v ML +1,i l + K+1ỹ ML +1,i, l where K ML +1 = Ĉ ML +1H T (HĈ ML +1H T + Γ) / 27
23 Covergece of MLEKF For observables φ : R d R, itroduce otatio µ ML (φ) := L 1 M l M l l=0 i=1 φ(v l,i) φ(v l 1,i ). ad µ MF (φ) := φ(x)µ MF (dx). R d Questio: Uder what assumptios ad at what cost ca oe achieve µ ML (φ) µ MF (φ) L p (Ω) = O(ɛ)? 18 / 27
24 Assumptio 1 Cosider the dyamics u +1 = Ψ(u ) = u + +1 a(u t )dt + +1 b(u t )dw (t), = 0, 1,... with u 0 L p (Ω) for all p 1 ad a hierarchy of umerical solvers {Ψ l } L l=0. For ay p 2, l N, ad u, v L p (Ω), we assume that Ψ l (u) Ψ l (v) p C u v p, Ψ l (u) p C(1 + u p ). 19 / 27
25 Assumptio 2 Assume the observable φ : R d R satisfies φ(x) φ(x ) C x x (1 + x s + x s ), for a s 0. ad there exists costats α, β > 0 such that for u, v L p (Ω), (i) [ E φ(ψ l (u)) φ(ψ(v)) ] N α l, provided that E[u v] N α l, (ii) φ(ψ l (v)) φ(ψ l 1 (v)) p N β/2 l, for all p 2, (iii) Cost ( Ψ l (v) ) N l. Assume further (i) ad (ii) hold for that all moomials φ of degree / 27
26 Theorem 2 (MLEKF accuracy vs. cost) Suppose Assumptios 1 ad 2 hold. The, for ay ɛ > 0 ad p 2, there exists a L > 0 ad {M l } L l=0 such that µ ML (φ; (M l )) µ MF (φ) p ɛ. Ad ( log(ɛ) 1 ɛ) 2, if β > 1, Cost (MLEKF) ( log(ɛ) 1 ɛ) 2 log(ɛ) 3, if β = 1, (2) ( log(ɛ) 1 1 β (2+ ɛ) α ), if β < 1. I compariso, is achieved at cost O µ EKF ( ɛ (2+ 1 α) ). (φ) µ MF (φ) p ɛ, 21 / 27
27 Theorem 2 (MLEKF accuracy vs. cost) Suppose Assumptios 1 ad 2 hold. The, for ay ɛ > 0 ad p 2, there exists a L > 0 ad {M l } L l=0 such that µ ML (φ; (M l )) µ MF (φ) p ɛ. Ad ( log(ɛ) 1 ɛ) 2, if β > 1, Cost (MLEKF) ( log(ɛ) 1 ɛ) 2 log(ɛ) 3, if β = 1, (2) ( log(ɛ) 1 1 β (2+ ɛ) α ), if β < 1. I compariso, is achieved at cost O µ EKF ( ɛ (2+ 1 α) ). (φ) µ MF (φ) p ɛ, 21 / 27
28 Cetral idea i the proof Itroduce µ MLMF (φ) := µ MF,L (φ) := E L 1 M l M l l=0 i=1 [ φ(v MF,L ad boud MLEKF error by µ ML φ(v MF,l (ω i,l )) φ(v MF,l 1 (ω i,l )) ) Y obs ], (φ) µ MF (φ) p µ ML (φ) µ MLMF (φ) p + µ MLMF (φ) µ MF,L [ L c v l v MF,l ˆp + c l=0 ( ɛ + L l=0 (φ) p + µ MF,L v MF,l M 1/2 l N β/2 l + N α L v MF,l 1 M 1/2 l ) (φ) µ MF (φ) p ] ˆp + E [ φ(v MF,L ) φ(v MF ) Y obs ] 22 / 27
29 Numerical example Uderlyig dyamics Orstei Uhlebeck SDE with a set of observatios du = udt + 0.5dW (t), y = u + γ, i.i.d. γ N(0, 0.04) Solvers: Hierarchy of Milstei solutio operators {Ψ l } L l=0 with t l = O ( 2 l). Compare the approximatio errors for the observable φ(x) = x i terms of the RMSE 100 µ ML (φ) µ MF (φ) 2. =1 23 / 27
30 Numerical example Uderlyig dyamics Orstei Uhlebeck SDE du = udt + 0.5dW (t), with a set of observatios y = u + γ, i.i.d. γ N(0, 0.04) RMSE EKF MLEKF cs 1/3 cs 1/ Rutime [s] 23 / 27
31 Overview 1 Problem descriptio 2 Kalma filterig 3 Esemble Kalma filterig 4 Multilevel esemble Kalma filterig 5 Extesio of MLEKF ad Coclusio 24 / 27
32 Extesio of MLEKF to ifiite dimesioal state spaces Work i progress, together with Alexey Cherov, Law, Nobile ad Tempoe. Ifiite dimesioal stochastic dyamics: u +1 = Ψ(u ) where u L p (Ω; H) with H = Spa({ν i } i=1 ), ad Ψ : L p (Ω; H) L p (Ω; H). Ad fiite dimesioal observatios y = Hu + γ, with liear H : H R m Itroduce ested hierarchy of Hilbert spaces H 0 H 1... H = H, where H l = Spa({ν i } N l i=1 ) ad work with a hierarchy of solvers Ψ l : L p (Ω; H l ) L p (Ω; H l ). 25 / 27
33 Coclusio Exteded EKF to multilevel EKF. Verified asymptotic efficiecy gai for approximatios of expectatio of observables. We hope to improve result further! Further extesio of MLEKF to ifiite dimesioal state space is work i progress. Preprit available o Arxiv 26 / 27
34 Refereces Thak you! 1 Hoel, Håko, Kody JH Law, ad Raul Tempoe, Multilevel esemble Kalma filterig, arxiv preprit arxiv: (2015). 2 Fraçois Le Glad, Valérie Mobet, Vu-Duc Tra, et al., Large sample asymptotics for the esemble kalma filter, The Oxford Hadbook of Noliear Filterig, (2011), pp Kody JH Law, Hamidou Tembie, ad Raul Tempoe, Determiistic methods for oliear filterig, part i: Mea-field esemble kalma filterig, arxiv preprit arxiv: , (2014). 27 / 27
Nonlinear Stability of Ensemble Kalman filter
Noliear Stability of Esemble Kalma filter Xi T Tog Joit work with Adrew J, Majda ad David, Kelly CIMS Wedesday 30 th September, 2015 Xi Tog Stability of EKF 1 / 34 Roadmap 1 What are esemble Kalma filters
More information3/8/2016. Contents in latter part PATTERN RECOGNITION AND MACHINE LEARNING. Dynamical Systems. Dynamical Systems. Linear Dynamical Systems
Cotets i latter part PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 13: SEQUENTIAL DATA Liear Dyamical Systems What is differet from HMM? Kalma filter Its stregth ad limitatio Particle Filter Its simple
More informationAppendix to: Hypothesis Testing for Multiple Mean and Correlation Curves with Functional Data
Appedix to: Hypothesis Testig for Multiple Mea ad Correlatio Curves with Fuctioal Data Ao Yua 1, Hog-Bi Fag 1, Haiou Li 1, Coli O. Wu, Mig T. Ta 1, 1 Departmet of Biostatistics, Bioiformatics ad Biomathematics,
More informationSequential Monte Carlo Methods - A Review. Arnaud Doucet. Engineering Department, Cambridge University, UK
Sequetial Mote Carlo Methods - A Review Araud Doucet Egieerig Departmet, Cambridge Uiversity, UK http://www-sigproc.eg.cam.ac.uk/ ad2/araud doucet.html ad2@eg.cam.ac.uk Istitut Heri Poicaré - Paris - 2
More informationTMA4205 Numerical Linear Algebra. The Poisson problem in R 2 : diagonalization methods
TMA4205 Numerical Liear Algebra The Poisso problem i R 2 : diagoalizatio methods September 3, 2007 c Eiar M Røquist Departmet of Mathematical Scieces NTNU, N-749 Trodheim, Norway All rights reserved A
More informationIt should be unbiased, or approximately unbiased. Variance of the variance estimator should be small. That is, the variance estimator is stable.
Chapter 10 Variace Estimatio 10.1 Itroductio Variace estimatio is a importat practical problem i survey samplig. Variace estimates are used i two purposes. Oe is the aalytic purpose such as costructig
More informationMA Advanced Econometrics: Properties of Least Squares Estimators
MA Advaced Ecoometrics: Properties of Least Squares Estimators Karl Whela School of Ecoomics, UCD February 5, 20 Karl Whela UCD Least Squares Estimators February 5, 20 / 5 Part I Least Squares: Some Fiite-Sample
More informationSTA Object Data Analysis - A List of Projects. January 18, 2018
STA 6557 Jauary 8, 208 Object Data Aalysis - A List of Projects. Schoeberg Mea glaucomatous shape chages of the Optic Nerve Head regio i aimal models 2. Aalysis of VW- Kedall ati-mea shapes with a applicatio
More informationData Assimilation. Alan O Neill University of Reading, UK
Data Assimilatio Ala O Neill Uiversity of Readig, UK he Kalma Filter Kalma Filter (expesive Use model equatios to propagate B forward i time. B B(t Aalysis step as i OI Evolutio of Covariace Matrices (
More informationKolmogorov-Smirnov type Tests for Local Gaussianity in High-Frequency Data
Proceedigs 59th ISI World Statistics Cogress, 5-30 August 013, Hog Kog (Sessio STS046) p.09 Kolmogorov-Smirov type Tests for Local Gaussiaity i High-Frequecy Data George Tauche, Duke Uiversity Viktor Todorov,
More informationECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors
ECONOMETRIC THEORY MODULE XIII Lecture - 34 Asymptotic Theory ad Stochastic Regressors Dr. Shalabh Departmet of Mathematics ad Statistics Idia Istitute of Techology Kapur Asymptotic theory The asymptotic
More informationLecture 20: Multivariate convergence and the Central Limit Theorem
Lecture 20: Multivariate covergece ad the Cetral Limit Theorem Covergece i distributio for radom vectors Let Z,Z 1,Z 2,... be radom vectors o R k. If the cdf of Z is cotiuous, the we ca defie covergece
More informationGamma Distribution and Gamma Approximation
Gamma Distributio ad Gamma Approimatio Xiaomig Zeg a Fuhua (Frak Cheg b a Xiame Uiversity, Xiame 365, Chia mzeg@jigia.mu.edu.c b Uiversity of Ketucky, Leigto, Ketucky 456-46, USA cheg@cs.uky.edu Abstract
More informationSieve Estimators: Consistency and Rates of Convergence
EECS 598: Statistical Learig Theory, Witer 2014 Topic 6 Sieve Estimators: Cosistecy ad Rates of Covergece Lecturer: Clayto Scott Scribe: Julia Katz-Samuels, Brado Oselio, Pi-Yu Che Disclaimer: These otes
More informationTHE KALMAN FILTER RAUL ROJAS
THE KALMAN FILTER RAUL ROJAS Abstract. This paper provides a getle itroductio to the Kalma filter, a umerical method that ca be used for sesor fusio or for calculatio of trajectories. First, we cosider
More informationLecture 33: Bootstrap
Lecture 33: ootstrap Motivatio To evaluate ad compare differet estimators, we eed cosistet estimators of variaces or asymptotic variaces of estimators. This is also importat for hypothesis testig ad cofidece
More informationChapter 10: Power Series
Chapter : Power Series 57 Chapter Overview: Power Series The reaso series are part of a Calculus course is that there are fuctios which caot be itegrated. All power series, though, ca be itegrated because
More informationNon-Gaussian Estimation and Observer-Based Feedback using the Gaussian Mixture Kalman and Extended Kalman Filters
No-Gaussia Estimatio ad Observer-Based Feedback usig the Gaussia Mixture Kalma ad Exteded Kalma Filters Debdipta Goswami 1 ad Derek A. Paley 2 Abstract This paper cosiders the problem of o-gaussia estimatio
More informationLecture 19: Convergence
Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may
More informationExponential Families and Bayesian Inference
Computer Visio Expoetial Families ad Bayesia Iferece Lecture Expoetial Families A expoetial family of distributios is a d-parameter family f(x; havig the followig form: f(x; = h(xe g(t T (x B(, (. where
More informationRandom Variables, Sampling and Estimation
Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig
More informationNotes 19 : Martingale CLT
Notes 9 : Martigale CLT Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces: [Bil95, Chapter 35], [Roc, Chapter 3]. Sice we have ot ecoutered weak covergece i some time, we first recall
More informationECE 901 Lecture 12: Complexity Regularization and the Squared Loss
ECE 90 Lecture : Complexity Regularizatio ad the Squared Loss R. Nowak 5/7/009 I the previous lectures we made use of the Cheroff/Hoeffdig bouds for our aalysis of classifier errors. Hoeffdig s iequality
More informationA Simplified Derivation of Scalar Kalman Filter using Bayesian Probability Theory
6th Iteratioal Workshop o Aalysis of Dyamic Measuremets Jue -3 0 Göteorg Swede A Simplified Derivatio of Scalar Kalma Filter usig Bayesia Proaility Theory Gregory Kyriazis Imetro - Electrical Metrology
More informationFirst Year Quantitative Comp Exam Spring, Part I - 203A. f X (x) = 0 otherwise
First Year Quatitative Comp Exam Sprig, 2012 Istructio: There are three parts. Aswer every questio i every part. Questio I-1 Part I - 203A A radom variable X is distributed with the margial desity: >
More informationAsymptotic Properties of MLE in Stochastic. Differential Equations with Random Effects in. the Diffusion Coefficient
Iteratioal Joural of Cotemporary Mathematical Scieces Vol. 1, 215, o. 6, 275-286 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/1.12988/ijcms.215.563 Asymptotic Properties of MLE i Stochastic Differetial
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY Department of Electrical Engineering and Computer Science. BACKGROUND EXAM September 30, 2004.
MASSACHUSETTS INSTITUTE OF TECHNOLOGY Departmet of Electrical Egieerig ad Computer Sciece 6.34 Discrete Time Sigal Processig Fall 24 BACKGROUND EXAM September 3, 24. Full Name: Note: This exam is closed
More informationResearch Article A New Second-Order Iteration Method for Solving Nonlinear Equations
Abstract ad Applied Aalysis Volume 2013, Article ID 487062, 4 pages http://dx.doi.org/10.1155/2013/487062 Research Article A New Secod-Order Iteratio Method for Solvig Noliear Equatios Shi Mi Kag, 1 Arif
More informationMonte Carlo Integration
Mote Carlo Itegratio I these otes we first review basic umerical itegratio methods (usig Riema approximatio ad the trapezoidal rule) ad their limitatios for evaluatig multidimesioal itegrals. Next we itroduce
More informationEntropy Rates and Asymptotic Equipartition
Chapter 29 Etropy Rates ad Asymptotic Equipartitio Sectio 29. itroduces the etropy rate the asymptotic etropy per time-step of a stochastic process ad shows that it is well-defied; ad similarly for iformatio,
More informationA Risk Comparison of Ordinary Least Squares vs Ridge Regression
Joural of Machie Learig Research 14 (2013) 1505-1511 Submitted 5/12; Revised 3/13; Published 6/13 A Risk Compariso of Ordiary Least Squares vs Ridge Regressio Paramveer S. Dhillo Departmet of Computer
More informationEconomics 241B Relation to Method of Moments and Maximum Likelihood OLSE as a Maximum Likelihood Estimator
Ecoomics 24B Relatio to Method of Momets ad Maximum Likelihood OLSE as a Maximum Likelihood Estimator Uder Assumptio 5 we have speci ed the distributio of the error, so we ca estimate the model parameters
More informationSlide Set 13 Linear Model with Endogenous Regressors and the GMM estimator
Slide Set 13 Liear Model with Edogeous Regressors ad the GMM estimator Pietro Coretto pcoretto@uisa.it Ecoometrics Master i Ecoomics ad Fiace (MEF) Uiversità degli Studi di Napoli Federico II Versio: Friday
More informationStochastic Simulation
Stochastic Simulatio 1 Itroductio Readig Assigmet: Read Chapter 1 of text. We shall itroduce may of the key issues to be discussed i this course via a couple of model problems. Model Problem 1 (Jackso
More informationStatistical Inference Based on Extremum Estimators
T. Rotheberg Fall, 2007 Statistical Iferece Based o Extremum Estimators Itroductio Suppose 0, the true value of a p-dimesioal parameter, is kow to lie i some subset S R p : Ofte we choose to estimate 0
More informationBerry-Esseen bounds for self-normalized martingales
Berry-Essee bouds for self-ormalized martigales Xiequa Fa a, Qi-Ma Shao b a Ceter for Applied Mathematics, Tiaji Uiversity, Tiaji 30007, Chia b Departmet of Statistics, The Chiese Uiversity of Hog Kog,
More informationRegression and generalization
Regressio ad geeralizatio CE-717: Machie Learig Sharif Uiversity of Techology M. Soleymai Fall 2016 Curve fittig: probabilistic perspective Describig ucertaity over value of target variable as a probability
More informationPrecise Rates in Complete Moment Convergence for Negatively Associated Sequences
Commuicatios of the Korea Statistical Society 29, Vol. 16, No. 5, 841 849 Precise Rates i Complete Momet Covergece for Negatively Associated Sequeces Dae-Hee Ryu 1,a a Departmet of Computer Sciece, ChugWoo
More informationA RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS
J. Japa Statist. Soc. Vol. 41 No. 1 2011 67 73 A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS Yoichi Nishiyama* We cosider k-sample ad chage poit problems for idepedet data i a
More informationLecture 3. Properties of Summary Statistics: Sampling Distribution
Lecture 3 Properties of Summary Statistics: Samplig Distributio Mai Theme How ca we use math to justify that our umerical summaries from the sample are good summaries of the populatio? Lecture Summary
More information6.3 Testing Series With Positive Terms
6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial
More informationLinear Regression Models
Liear Regressio Models Dr. Joh Mellor-Crummey Departmet of Computer Sciece Rice Uiversity johmc@cs.rice.edu COMP 528 Lecture 9 15 February 2005 Goals for Today Uderstad how to Use scatter diagrams to ispect
More informationLecture 22: Review for Exam 2. 1 Basic Model Assumptions (without Gaussian Noise)
Lecture 22: Review for Exam 2 Basic Model Assumptios (without Gaussia Noise) We model oe cotiuous respose variable Y, as a liear fuctio of p umerical predictors, plus oise: Y = β 0 + β X +... β p X p +
More information1 = δ2 (0, ), Y Y n nδ. , T n = Y Y n n. ( U n,k + X ) ( f U n,k + Y ) n 2n f U n,k + θ Y ) 2 E X1 2 X1
8. The cetral limit theorems 8.1. The cetral limit theorem for i.i.d. sequeces. ecall that C ( is N -separatig. Theorem 8.1. Let X 1, X,... be i.i.d. radom variables with EX 1 = ad EX 1 = σ (,. Suppose
More informationMath 312 Lecture Notes One Dimensional Maps
Math 312 Lecture Notes Oe Dimesioal Maps Warre Weckesser Departmet of Mathematics Colgate Uiversity 21-23 February 25 A Example We begi with the simplest model of populatio growth. Suppose, for example,
More informationSolutions to HW Assignment 1
Solutios to HW: 1 Course: Theory of Probability II Page: 1 of 6 Uiversity of Texas at Austi Solutios to HW Assigmet 1 Problem 1.1. Let Ω, F, {F } 0, P) be a filtered probability space ad T a stoppig time.
More informationFilter banks. Separately, the lowpass and highpass filters are not invertible. removes the highest frequency 1/ 2and
Filter bas Separately, the lowpass ad highpass filters are ot ivertible T removes the highest frequecy / ad removes the lowest frequecy Together these filters separate the sigal ito low-frequecy ad high-frequecy
More information3. Z Transform. Recall that the Fourier transform (FT) of a DT signal xn [ ] is ( ) [ ] = In order for the FT to exist in the finite magnitude sense,
3. Z Trasform Referece: Etire Chapter 3 of text. Recall that the Fourier trasform (FT) of a DT sigal x [ ] is ω ( ) [ ] X e = j jω k = xe I order for the FT to exist i the fiite magitude sese, S = x [
More informationESTIMATION AND PREDICTION BASED ON K-RECORD VALUES FROM NORMAL DISTRIBUTION
STATISTICA, ao LXXIII,. 4, 013 ESTIMATION AND PREDICTION BASED ON K-RECORD VALUES FROM NORMAL DISTRIBUTION Maoj Chacko Departmet of Statistics, Uiversity of Kerala, Trivadrum- 695581, Kerala, Idia M. Shy
More informationLaw of the sum of Bernoulli random variables
Law of the sum of Beroulli radom variables Nicolas Chevallier Uiversité de Haute Alsace, 4, rue des frères Lumière 68093 Mulhouse icolas.chevallier@uha.fr December 006 Abstract Let be the set of all possible
More informationAn Introduction to Asymptotic Theory
A Itroductio to Asymptotic Theory Pig Yu School of Ecoomics ad Fiace The Uiversity of Hog Kog Pig Yu (HKU) Asymptotic Theory 1 / 20 Five Weapos i Asymptotic Theory Five Weapos i Asymptotic Theory Pig Yu
More information1 Review and Overview
DRAFT a fial versio will be posted shortly CS229T/STATS231: Statistical Learig Theory Lecturer: Tegyu Ma Lecture #3 Scribe: Migda Qiao October 1, 2013 1 Review ad Overview I the first half of this course,
More informationLecture 27: Optimal Estimators and Functional Delta Method
Stat210B: Theoretical Statistics Lecture Date: April 19, 2007 Lecture 27: Optimal Estimators ad Fuctioal Delta Method Lecturer: Michael I. Jorda Scribe: Guilherme V. Rocha 1 Achievig Optimal Estimators
More informationRegression with an Evaporating Logarithmic Trend
Regressio with a Evaporatig Logarithmic Tred Peter C. B. Phillips Cowles Foudatio, Yale Uiversity, Uiversity of Aucklad & Uiversity of York ad Yixiao Su Departmet of Ecoomics Yale Uiversity October 5,
More informationLECTURE 11 LINEAR PROCESSES III: ASYMPTOTIC RESULTS
PRIL 7, 9 where LECTURE LINER PROCESSES III: SYMPTOTIC RESULTS (Phillips ad Solo (99) ad Phillips Lecture Notes o Statioary ad Nostatioary Time Series) I this lecture, we discuss the LLN ad CLT for a liear
More informationG. R. Pasha Department of Statistics Bahauddin Zakariya University Multan, Pakistan
Deviatio of the Variaces of Classical Estimators ad Negative Iteger Momet Estimator from Miimum Variace Boud with Referece to Maxwell Distributio G. R. Pasha Departmet of Statistics Bahauddi Zakariya Uiversity
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 6 9/23/2013. Brownian motion. Introduction
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/5.070J Fall 203 Lecture 6 9/23/203 Browia motio. Itroductio Cotet.. A heuristic costructio of a Browia motio from a radom walk. 2. Defiitio ad basic properties
More informationLectures on Stochastic System Analysis and Bayesian Updating
Lectures o Stochastic System Aalysis ad Bayesia Updatig Jue 29-July 13 2005 James L. Beck, Califoria Istitute of Techology Jiaye Chig, Natioal Taiwa Uiversity of Sciece & Techology Siu-Kui (Iva) Au, Nayag
More informationOn forward improvement iteration for stopping problems
O forward improvemet iteratio for stoppig problems Mathematical Istitute, Uiversity of Kiel, Ludewig-Mey-Str. 4, D-24098 Kiel, Germay irle@math.ui-iel.de Albrecht Irle Abstract. We cosider the optimal
More informationLecture 3 The Lebesgue Integral
Lecture 3: The Lebesgue Itegral 1 of 14 Course: Theory of Probability I Term: Fall 2013 Istructor: Gorda Zitkovic Lecture 3 The Lebesgue Itegral The costructio of the itegral Uless expressly specified
More informationA Note on Effi cient Conditional Simulation of Gaussian Distributions. April 2010
A Note o Effi ciet Coditioal Simulatio of Gaussia Distributios A D D C S S, U B C, V, BC, C April 2010 A Cosider a multivariate Gaussia radom vector which ca be partitioed ito observed ad uobserved compoetswe
More informationLainiotis filter implementation. via Chandrasekhar type algorithm
Joural of Computatios & Modellig, vol.1, o.1, 2011, 115-130 ISSN: 1792-7625 prit, 1792-8850 olie Iteratioal Scietific Press, 2011 Laiiotis filter implemetatio via Chadrasehar type algorithm Nicholas Assimais
More informationSummary and Discussion on Simultaneous Analysis of Lasso and Dantzig Selector
Summary ad Discussio o Simultaeous Aalysis of Lasso ad Datzig Selector STAT732, Sprig 28 Duzhe Wag May 4, 28 Abstract This is a discussio o the work i Bickel, Ritov ad Tsybakov (29). We begi with a short
More informationON BLEIMANN, BUTZER AND HAHN TYPE GENERALIZATION OF BALÁZS OPERATORS
STUDIA UNIV. BABEŞ BOLYAI, MATHEMATICA, Volume XLVII, Number 4, December 2002 ON BLEIMANN, BUTZER AND HAHN TYPE GENERALIZATION OF BALÁZS OPERATORS OGÜN DOĞRU Dedicated to Professor D.D. Stacu o his 75
More informationStatistical Pattern Recognition
Statistical Patter Recogitio Classificatio: No-Parametric Modelig Hamid R. Rabiee Jafar Muhammadi Sprig 2014 http://ce.sharif.edu/courses/92-93/2/ce725-2/ Ageda Parametric Modelig No-Parametric Modelig
More informationLarge Sample Theory. Convergence. Central Limit Theorems Asymptotic Distribution Delta Method. Convergence in Probability Convergence in Distribution
Large Sample Theory Covergece Covergece i Probability Covergece i Distributio Cetral Limit Theorems Asymptotic Distributio Delta Method Covergece i Probability A sequece of radom scalars {z } = (z 1,z,
More informationConvergence of random variables. (telegram style notes) P.J.C. Spreij
Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space
More informationCS537. Numerical Analysis and Computing
CS57 Numerical Aalysis ad Computig Lecture Locatig Roots o Equatios Proessor Ju Zhag Departmet o Computer Sciece Uiversity o Ketucky Leigto KY 456-6 Jauary 9 9 What is the Root May physical system ca be
More informationAsymptotic Coupling and Its Applications in Information Theory
Asymptotic Couplig ad Its Applicatios i Iformatio Theory Vicet Y. F. Ta Joit Work with Lei Yu Departmet of Electrical ad Computer Egieerig, Departmet of Mathematics, Natioal Uiversity of Sigapore IMS-APRM
More informationBasics of Probability Theory (for Theory of Computation courses)
Basics of Probability Theory (for Theory of Computatio courses) Oded Goldreich Departmet of Computer Sciece Weizma Istitute of Sciece Rehovot, Israel. oded.goldreich@weizma.ac.il November 24, 2008 Preface.
More informationAdvanced Stochastic Processes.
Advaced Stochastic Processes. David Gamarik LECTURE 2 Radom variables ad measurable fuctios. Strog Law of Large Numbers (SLLN). Scary stuff cotiued... Outlie of Lecture Radom variables ad measurable fuctios.
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More informationLecture 01: the Central Limit Theorem. 1 Central Limit Theorem for i.i.d. random variables
CSCI-B609: A Theorist s Toolkit, Fall 06 Aug 3 Lecture 0: the Cetral Limit Theorem Lecturer: Yua Zhou Scribe: Yua Xie & Yua Zhou Cetral Limit Theorem for iid radom variables Let us say that we wat to aalyze
More informationLecture Chapter 6: Convergence of Random Sequences
ECE5: Aalysis of Radom Sigals Fall 6 Lecture Chapter 6: Covergece of Radom Sequeces Dr Salim El Rouayheb Scribe: Abhay Ashutosh Doel, Qibo Zhag, Peiwe Tia, Pegzhe Wag, Lu Liu Radom sequece Defiitio A ifiite
More informationSummary. Recap ... Last Lecture. Summary. Theorem
Last Lecture Biostatistics 602 - Statistical Iferece Lecture 23 Hyu Mi Kag April 11th, 2013 What is p-value? What is the advatage of p-value compared to hypothesis testig procedure with size α? How ca
More informationMODEL CHANGE DETECTION WITH APPLICATION TO MACHINE LEARNING. University of Illinois at Urbana-Champaign
MODEL CHANGE DETECTION WITH APPLICATION TO MACHINE LEARNING Yuheg Bu Jiaxu Lu Veugopal V. Veeravalli Uiversity of Illiois at Urbaa-Champaig Tsighua Uiversity Email: bu3@illiois.edu, lujx4@mails.tsighua.edu.c,
More informationSupplementary Material for Fast Stochastic AUC Maximization with O(1/n)-Convergence Rate
Supplemetary Material for Fast Stochastic AUC Maximizatio with O/-Covergece Rate Migrui Liu Xiaoxua Zhag Zaiyi Che Xiaoyu Wag 3 iabao Yag echical Lemmas ized versio of Hoeffdig s iequality, ote that We
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit theorems Throughout this sectio we will assume a probability space (Ω, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More informationQuantile regression with multilayer perceptrons.
Quatile regressio with multilayer perceptros. S.-F. Dimby ad J. Rykiewicz Uiversite Paris 1 - SAMM 90 Rue de Tolbiac, 75013 Paris - Frace Abstract. We cosider oliear quatile regressio ivolvig multilayer
More informationRandom Signals and Noise Winter Semester 2017 Problem Set 12 Wiener Filter Continuation
Radom Sigals ad Noise Witer Semester 7 Problem Set Wieer Filter Cotiuatio Problem (Sprig, Exam A) Give is the sigal W t, which is a Gaussia white oise with expectatio zero ad power spectral desity fuctio
More informationA REMARK ON A PROBLEM OF KLEE
C O L L O Q U I U M M A T H E M A T I C U M VOL. 71 1996 NO. 1 A REMARK ON A PROBLEM OF KLEE BY N. J. K A L T O N (COLUMBIA, MISSOURI) AND N. T. P E C K (URBANA, ILLINOIS) This paper treats a property
More informationQuick Review of Probability
Quick Review of Probability Berli Che Departmet of Computer Sciece & Iformatio Egieerig Natioal Taiwa Normal Uiversity Refereces: 1. W. Navidi. Statistics for Egieerig ad Scietists. Chapter & Teachig Material.
More informationChandrasekhar Type Algorithms. for the Riccati Equation of Lainiotis Filter
Cotemporary Egieerig Scieces, Vol. 3, 00, o. 4, 9-00 Chadrasekhar ype Algorithms for the Riccati Equatio of Laiiotis Filter Nicholas Assimakis Departmet of Electroics echological Educatioal Istitute of
More informationADVANCED DIGITAL SIGNAL PROCESSING
ADVANCED DIGITAL SIGNAL PROCESSING PROF. S. C. CHAN (email : sccha@eee.hku.hk, Rm. CYC-702) DISCRETE-TIME SIGNALS AND SYSTEMS MULTI-DIMENSIONAL SIGNALS AND SYSTEMS RANDOM PROCESSES AND APPLICATIONS ADAPTIVE
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013. Large Deviations for i.i.d. Random Variables
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013 Large Deviatios for i.i.d. Radom Variables Cotet. Cheroff boud usig expoetial momet geeratig fuctios. Properties of a momet
More informationLECTURE 8: ASYMPTOTICS I
LECTURE 8: ASYMPTOTICS I We are iterested i the properties of estimators as. Cosider a sequece of radom variables {, X 1}. N. M. Kiefer, Corell Uiversity, Ecoomics 60 1 Defiitio: (Weak covergece) A sequece
More informationThe Numerical Solution of Singular Fredholm Integral Equations of the Second Kind
WDS' Proceedigs of Cotributed Papers, Part I, 57 64, 2. ISBN 978-8-7378-39-2 MATFYZPRESS The Numerical Solutio of Sigular Fredholm Itegral Equatios of the Secod Kid J. Rak Charles Uiversity, Faculty of
More informationOn Equivalence of Martingale Tail Bounds and Deterministic Regret Inequalities
O Equivalece of Martigale Tail Bouds ad Determiistic Regret Iequalities Sasha Rakhli Departmet of Statistics, The Wharto School Uiversity of Pesylvaia Dec 16, 2015 Joit work with K. Sridhara arxiv:1510.03925
More informationIt is often useful to approximate complicated functions using simpler ones. We consider the task of approximating a function by a polynomial.
Taylor Polyomials ad Taylor Series It is ofte useful to approximate complicated fuctios usig simpler oes We cosider the task of approximatig a fuctio by a polyomial If f is at least -times differetiable
More informationApproximations and more PMFs and PDFs
Approximatios ad more PMFs ad PDFs Saad Meimeh 1 Approximatio of biomial with Poisso Cosider the biomial distributio ( b(k,,p = p k (1 p k, k λ: k Assume that is large, ad p is small, but p λ at the limit.
More informationEstimation of the Mean and the ACVF
Chapter 5 Estimatio of the Mea ad the ACVF A statioary process {X t } is characterized by its mea ad its autocovariace fuctio γ ), ad so by the autocorrelatio fuctio ρ ) I this chapter we preset the estimators
More informationA Hilbert Space Central Limit Theorem for Geometrically Ergodic Markov Chains
A Hilbert Space Cetral Limit Theorem for Geometrically Ergodic Marov Chais Joh Stachursi Research School of Ecoomics, Australia Natioal Uiversity Abstract This ote proves a simple but useful cetral limit
More informationModified Decomposition Method by Adomian and. Rach for Solving Nonlinear Volterra Integro- Differential Equations
Noliear Aalysis ad Differetial Equatios, Vol. 5, 27, o. 4, 57-7 HIKARI Ltd, www.m-hikari.com https://doi.org/.2988/ade.27.62 Modified Decompositio Method by Adomia ad Rach for Solvig Noliear Volterra Itegro-
More informationMaximum likelihood estimation from record-breaking data for the generalized Pareto distribution
METRON - Iteratioal Joural of Statistics 004, vol. LXII,. 3, pp. 377-389 NAGI S. ABD-EL-HAKIM KHALAF S. SULTAN Maximum likelihood estimatio from record-breakig data for the geeralized Pareto distributio
More informationStochastic Nerve Axon Equations
Stochastic Nerve Axo Equatios Wilhelm Staat Istitut fu r Mathematik, Fakulta t II TU Berli Berstei Ceter for Computatioal Neurosciece Berli Liz, December 13, 216 Stochastic processes i Neurosciece Modellig
More informationA NOTE ON BOUNDARY BLOW-UP PROBLEM OF u = u p
A NOTE ON BOUNDARY BLOW-UP PROBLEM OF u = u p SEICK KIM Abstract. Assume that Ω is a bouded domai i R with 2. We study positive solutios to the problem, u = u p i Ω, u(x) as x Ω, where p > 1. Such solutios
More informationChapter 7 Isoperimetric problem
Chapter 7 Isoperimetric problem Recall that the isoperimetric problem (see the itroductio its coectio with ido s proble) is oe of the most classical problem of a shape optimizatio. It ca be formulated
More information1 Lecture 2: Sequence, Series and power series (8/14/2012)
Summer Jump-Start Program for Aalysis, 202 Sog-Yig Li Lecture 2: Sequece, Series ad power series (8/4/202). More o sequeces Example.. Let {x } ad {y } be two bouded sequeces. Show lim sup (x + y ) lim
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013 Fuctioal Law of Large Numbers. Costructio of the Wieer Measure Cotet. 1. Additioal techical results o weak covergece
More informationCS321. Numerical Analysis and Computing
CS Numerical Aalysis ad Computig Lecture Locatig Roots o Equatios Proessor Ju Zhag Departmet o Computer Sciece Uiversity o Ketucky Leigto KY 456-6 September 8 5 What is the Root May physical system ca
More information