Financial Econometrics Kalman Filter: some applications to Finance University of Evry - Master 2
|
|
- Ralph Paul
- 5 years ago
- Views:
Transcription
1 Financial Economerics Kalman Filer: some applicaions o Finance Universiy of Evry - Maser 2 Eric Bouyé January 27, 2009 Conens 1 Sae-space models 2 2 The Scalar Kalman Filer 2 21 Presenaion 2 22 Summary of he dieren seps 5 23 Is i an opimal linear esimae? 5 24 Predicion, lering and smoohing 6 3 The Kalman Filer 6 4 Generalized Vasicek Term Srucure Models 9 41 The Model 9 42 Empirical applicaion 10 5 Invesmen Sraegies Tracking problems Innovaion represenaion Empirical applicaion 11 6 Appendix: The condiional gaussian disribuion 13 Universiy of Evry and Sociéé Générale Conac: ericbouye@sgamcom 1
2 1 Sae-space models A general specicaion for he Kalman ler - Kalman 1960, [6] - is provided below The represenaion of Harvey 1991 [5] is used For an excellen presenaion abou lering - and elegan proofs-, we refer o Le Gland 2007 Measuremen equaion y = X β + d + ε = 1,, T 1 Transiion equaion β = T β 1 + c + R η = 1,, T wih β he m 1 sae vecor unobserved ha represens he developmen over ime of he sysem y is he N 1 vecor of he observed variables d and ε are N 1 vecors and X is a N m marix T is an m m marix, R a m g marix, c a m 1 vecor and η a g 1 vecor The disurbances are such ha { ε N 0, H η N 0, Q and ε and η are uncorrelaed Specically, { E ε η s = 0 s, = 1,, T E ε β 0 = 0 for = 1,, T 2 The Scalar Kalman Filer 21 Presenaion For he sake of simpliciy, he scalar model is rs sudied Measuremen equaion y = X β + ε = 1,, T Transiion equaion β = T β 1 + c + η = 1,, T η c β T β 1 Time Can we ler β such ha he eecs of η are minimized? 2
3 η ɛ c β X y T β 1 Time Can we ler y and esimae β such ha he eecs of ε and η are minimized? η ɛ c β X y T β 1 Time β X ŷ T Time K β 1 β In order o predic an esimae of he oupu y, he KF uses an a priori esimae of β noed β such ha β = T β 1 + c Then he dierence beween he esimaed oupu ŷ and acual oupu can be compued y ŷ = y X β and his residual is used o rene he a priori esimae: he a poseriori esimae β is calculaed β = β + K y ŷ = β + K y X β 3
4 Quesion: wha is he appropriae K such ha an opimal esimaor is compued? The errors are dened { e = β β a priori e = β β a poseriori wih respecive variances { p e 2 = E p = E e 2 A Kalman Filer minimizes he a poseriori error variance p Then, le us compue he value of K ha minimizes p ie K = arg min p K [ = arg min E β β ] 2 [ = arg min E β β ] 2 K y X β Then p K K = 0 K = From his resul, one can remark ha if he a priori error is large, hen X p X 2 p + H K 1 X and he condence in he a priori esimae is quie low, if he a priori error is small, hen he correcion by he KF will be small In oher words, if our rs esimaes have been quie good, here is lile need o correc i, if H is large, he condence in he measuremen is quie low The KF has more condence in he previous esimaes 4
5 22 Summary of he dieren seps 1 Model specicaion Measuremen equaion y = X β + ε = 1,, T 2 Predicion sep Transiion equaion β = T β 1 + c + η = 1,, T and he a priori covariance is β = T β 1 + c p = T 2 p 1 + Q 3 Correcion sep Given he addiional informaion on he oupu, one can correc he esimaor wih K he gain: K = and he a poseriori covariance is β = β + K y X β X 2 p X p + H p = p 1 X K 23 Is i an opimal linear esimae? Is he Kalman Filer an opimal linear esimae? ˆβ = a 1ˆβ 1 + a 2 y min p [ min E β β ] 2 { p a 1 = 0 p a 2 = 0 E [β β ] β 1 = 0 E [β β ] y = 0 ha corresponds o he orhogonaliy condiions discussed above Then we obain a 1 = T 1 a 2 X 5
6 Then, by subsiuing in he above equaion ˆβ = a 1ˆβ 1 + a 2 y = T 1 a 2 X ˆβ 1 + a 2 y = T ˆβ 1 + a 2 y T X ˆβ 1 ˆβ = ˆβ + a 2 y X β 24 Predicion, lering and smoohing One disinguishes hree ypes of use of he Kalman ler 1 Predicion 2 Filering 3 Smoohing 3 The Kalman Filer For he sake of simpliciy, le denoe E x = E x y 0,, y 1 and E x = E x y 0,, y The sae-space model is: Measuremen equaion y = X β + d + ε = 1,, T Transiion equaion β = T β 1 + c + R η = 1,, T Theorem The Kalman-Buci ler The Kalman-Buci ler is dened as follows E β = T E β 1 + c 2 and P = T P 1 T + R Q R 3 E β = E β [ + K y X E β ] + d 4 wih K he Kalman gain: P = [I K X ] P 5 K = P X [ X P X + Q ] 1 6 6
7 The iniial sae of he sysem is as follows { E β 0 = E β0 P 0 = Var β 0 = P 0 Proof for 2 E β E β = T E β 1 + c + R E η = T E β 1 + c Proof for 3 P = E [ β E β β E β ] = E {[ T β 1 E β 1 + R E η ] [ T β 1 E β 1 + R E η ] } = T E { β 1 E β 1 β 1 E } β 1 T + R E η η R +T E { β 1 E β 1 η } T + R E { η β 1 E } β 1 T By noing ha E { β 1 E β 1 η } = 0, we ge P = T P 1 T + R Q R Proof for 4 and 5 Le us noe ν he innovaion vecor ν = y E y y 0,, y 1 = y E y We have E β y 0,, y = E β = E β E β = E β + E β β y 0,, y + E β β y 0,, y 1, ν + E β β ν From above, β E β = v E β E β = β E β E β β ν hen, we can calculae P : P = E [β E β β E β ] = E [ β E β E β β ν β E β E β β ν ] 7
8 We need o compue he condiial mean and variance of β E β Firs, we need o compue he variance of ν and is covariance wih β E β We have E ν ν = E [ y E y y E y ] = E [ X β E β + ε X β E β ] + ε = X E [ β E β β E β ] X + E [ ε β E β ] X +X E [ β E β ε ] + E ε ε E ν ν = X P X + H Also he covariance is such as E β E β ν = E β E β X β E β + ε = E [ β E β β E β E ν ν = P X ] X + E [ β E β Then, he join disribuion of β E β and ν is β E β P N 0, P X ν X P X P X + H hen if Q is inverible, hen X P X + H is also inverible, and from a propery of he gaussian condiional disribuion see Appendix 2, ε ] E β = E β + P X [ X P X + H ] 1 ν and P = P P X [ X P X + H ] 1 X P Se of equaions for he Kalman Filer: alernaive noaion E β = T E β 1 + c P = T P 1 T + R Q R E y = X E β + d ν = y E y E V = X P X + Q E β = E β + P X [E V ] 1 ν P = P P X [E V ] 1 X P ˆβ 1 = T ˆβ c ˆP 1 = T ˆP 1 1 T + R Q R ŷ 1 = X ˆβ 1 + d ˆν = y ŷ 1 ˆV = X ˆP 1 X + Q ˆβ = ˆβ 1 + ˆP 1 X 1 ˆV P = ˆP 1 ˆP 1 X ˆV 1 ν X ˆP 1 8
9 4 Generalized Vasicek Term Srucure Models 41 The Model From Babbs and Ben Nowman 1999 Their model is a subclass of Langeieg's linear Gaussian models of he erm srucure: J B M, = exp τ R w τ u ξ j τ X j τ wih R = µ + Q J θ q q=1 j=1 κ jq ξ j 1 2 j=1 Q J q=1 j=1 κ jq ξ j 2 W τ = J j= u ξ j τ J i=1 j=1 Q q=1 θ q κ jq ξ j Q J q=1 i=1 J H Q ξ i + ξ j τ q=1 κ iq κ jq ξ i ξ j κ iq κ jq ξ i ξ j wih τ = M and u x = 1 e x x The heoreical yield curve is such ha R + τ i, = log B + τ i, τ = A 0 τ i A 1 τ i X for i = 1,, N wih A 0 τ i = R w τ i and A 1 τ i = u ξ j τ i a J 1 vecor The ime invarian sae-space model is specied as follows: Measuremen equaion R = Z ψ X + d ψ + ε = 1,, T Transiion equaion X = T ψ X 1 + η = 1,, T wih ε N 0, H ψ and η N 0, V ψ, A 0 τ 1, ψ A 0 τ 2, ψ d ψ =, A 0 τ N, ψ 9
10 Z ψ = A 1 τ 1, ψ A 1 τ 2, ψ A 1 τ N, ψ = u ξ 1 τ 1 u ξ 2 τ 1 u ξ J τ 1 u ξ 1 τ 2 u ξ 2 τ 2 u ξ J τ 2 u ξ 1 τ N u ξ 2 τ N u ξ J τ N and T ψ = e ξ 1 e ξ 2 e ξ J, In pracice, H ψ is assumed o be diagonal wih specic variances h h 2 0 H ψ = 0 0 h N 42 Empirical applicaion 5 Invesmen Sraegies Tracking problems For his applicaion we refer o Roncalli and Weisang 2008 Le assume we wan o replicae he performance of a fund or an index r F for example no invesable wih some liquid insrumens eg fuures ha are called facors Le assume ha we have m facors wih respecive reurns r i for i = 1,, m I is assumed ha he performance of he fund can be linearly explained by he reurns of he facor One can dene he following racking problem: { r F = r w + η 7 w = w 1 + ε In he above TP, he predicion par of he KF algorihm is used in pracice 51 Innovaion represenaion Le us dene he innovaion represenaion of he sae-space model We noe ha ˆβ +1 = T +1 K X ˆβ 1 + K y + c +1 K d = T +1ˆβ 1 + c +1 + K y X ˆβ 1 d 10
11 wih K = T +1 ˆP 1 X 1 ˆV Then, y = d + X ˆβ 1 + ν ˆβ +1 = c +1 + T +1ˆβ 1 + K ν = 1,, T = 1,, T wih Appliying his represenaion o our TP problem above, we ge { r F = r ŵ 1 + ˆν ŵ +1 = ŵ 1 + ˆP 1 r ˆν 8 ˆV ˆν ˆV Commens he normalized racking-error The i h facor is hen ajused as follows 52 Empirical applicaion ŵ+1 i = ŵ+1 i ŵi 1 9 ŵ+1 i ˆν m = ˆP 1 ˆV i,j rj k 10 j=1 11
12 References [1] Babbs Simon H and K Ben Nowman 1999, Kalman Filering of Generalized Vasicek Term Srucure Models, Journal of Financial and Quaniaive Analysis, 34, No 1, March [2] Cheever Erik, Kalman Filer Tuorial, Swarhmore College [3] Davidson Russell and James G MacKinnon 1993, Esimaion and Inference in Economerics, Oxford Universiy Press New York [4] Davidson Russell and James G MacKinnon 2003, Economeric Theory and Mehods, Oxford Universiy Press New York [5] Harvey A C 1991, Forecasing, Srucural Time Series and he Kalman Filer, Cambridge: Cambridge Universiy [6] Kalman RE 1960, A new approach o linear lering and predicion problems, J Basic Eng, 82, 35-45, March [7] Le Gland François 2007, Filre de Kalman e modèles de Markov cachés, Noes de cours [8] Roncalli Thierry 2005, Economérie Financière II, Lecure Noes , Maser Ingénierie Economique e Saisique Appliquée, Universié d'evry [9] Roncalli Thierry and Guillaume Weisang 2008, Tracking Problems, Hedge Fund Replicaion and Alernaive Bea, Working Paper [10] Welch Greg and Gary Bishop 2006, An Inroducion o he Kalman Filer, Working Paper 12
13 6 Appendix: The condiional gaussian disribuion Le assume a gaussian vecor X 1, X 2 such as X 1, X 2 N µ1 µ 2 Σ1 Σ, 12 Σ 21 Σ 2 If Σ 2 is inverible, he condiional densiy of he random vecor X 1 given X 2 = x 2, is gaussian wih mean µ 1 2 and covariance Σ 1 2 such ha µ 1 2 = µ 1 + Σ 12 Σ 1 2 x 2 µ 2 and Σ 1 2 = Σ 1 Σ 12 Σ 1 2 Σ 21 13
Testing for a Single Factor Model in the Multivariate State Space Framework
esing for a Single Facor Model in he Mulivariae Sae Space Framework Chen C.-Y. M. Chiba and M. Kobayashi Inernaional Graduae School of Social Sciences Yokohama Naional Universiy Japan Faculy of Economics
More informationAugmented Reality II - Kalman Filters - Gudrun Klinker May 25, 2004
Augmened Realiy II Kalman Filers Gudrun Klinker May 25, 2004 Ouline Moivaion Discree Kalman Filer Modeled Process Compuing Model Parameers Algorihm Exended Kalman Filer Kalman Filer for Sensor Fusion Lieraure
More informationState-Space Models. Initialization, Estimation and Smoothing of the Kalman Filter
Sae-Space Models Iniializaion, Esimaion and Smoohing of he Kalman Filer Iniializaion of he Kalman Filer The Kalman filer shows how o updae pas predicors and he corresponding predicion error variances when
More informationRecursive Least-Squares Fixed-Interval Smoother Using Covariance Information based on Innovation Approach in Linear Continuous Stochastic Systems
8 Froniers in Signal Processing, Vol. 1, No. 1, July 217 hps://dx.doi.org/1.2266/fsp.217.112 Recursive Leas-Squares Fixed-Inerval Smooher Using Covariance Informaion based on Innovaion Approach in Linear
More informationNotes on Kalman Filtering
Noes on Kalman Filering Brian Borchers and Rick Aser November 7, Inroducion Daa Assimilaion is he problem of merging model predicions wih acual measuremens of a sysem o produce an opimal esimae of he curren
More informationLinear Gaussian State Space Models
Linear Gaussian Sae Space Models Srucural Time Series Models Level and Trend Models Basic Srucural Model (BSM Dynamic Linear Models Sae Space Model Represenaion Level, Trend, and Seasonal Models Time Varying
More informationL07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS. NA568 Mobile Robotics: Methods & Algorithms
L07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS NA568 Mobile Roboics: Mehods & Algorihms Today s Topic Quick review on (Linear) Kalman Filer Kalman Filering for Non-Linear Sysems Exended Kalman Filer (EKF)
More informationGeorey E. Hinton. University oftoronto. Technical Report CRG-TR February 22, Abstract
Parameer Esimaion for Linear Dynamical Sysems Zoubin Ghahramani Georey E. Hinon Deparmen of Compuer Science Universiy oftorono 6 King's College Road Torono, Canada M5S A4 Email: zoubin@cs.orono.edu Technical
More informationTwo Popular Bayesian Estimators: Particle and Kalman Filters. McGill COMP 765 Sept 14 th, 2017
Two Popular Bayesian Esimaors: Paricle and Kalman Filers McGill COMP 765 Sep 14 h, 2017 1 1 1, dx x Bel x u x P x z P Recall: Bayes Filers,,,,,,, 1 1 1 1 u z u x P u z u x z P Bayes z = observaion u =
More informationGMM - Generalized Method of Moments
GMM - Generalized Mehod of Momens Conens GMM esimaion, shor inroducion 2 GMM inuiion: Maching momens 2 3 General overview of GMM esimaion. 3 3. Weighing marix...........................................
More informationInstitute for Mathematical Methods in Economics. University of Technology Vienna. Singapore, May Manfred Deistler
MULTIVARIATE TIME SERIES ANALYSIS AND FORECASTING Manfred Deisler E O S Economerics and Sysems Theory Insiue for Mahemaical Mehods in Economics Universiy of Technology Vienna Singapore, May 2004 Inroducion
More informationZürich. ETH Master Course: L Autonomous Mobile Robots Localization II
Roland Siegwar Margaria Chli Paul Furgale Marco Huer Marin Rufli Davide Scaramuzza ETH Maser Course: 151-0854-00L Auonomous Mobile Robos Localizaion II ACT and SEE For all do, (predicion updae / ACT),
More informationBook Corrections for Optimal Estimation of Dynamic Systems, 2 nd Edition
Boo Correcions for Opimal Esimaion of Dynamic Sysems, nd Ediion John L. Crassidis and John L. Junins November 17, 017 Chaper 1 This documen provides correcions for he boo: Crassidis, J.L., and Junins,
More informationApplications in Industry (Extended) Kalman Filter. Week Date Lecture Title
hp://elec34.com Applicaions in Indusry (Eended) Kalman Filer 26 School of Informaion echnology and Elecrical Engineering a he Universiy of Queensland Lecure Schedule: Week Dae Lecure ile 29-Feb Inroducion
More informationProbabilistic Robotics
Probabilisic Roboics Bayes Filer Implemenaions Gaussian filers Bayes Filer Reminder Predicion bel p u bel d Correcion bel η p z bel Gaussians : ~ π e p N p - Univariae / / : ~ μ μ μ e p Ν p d π Mulivariae
More informationLecture 10 Estimating Nonlinear Regression Models
Lecure 0 Esimaing Nonlinear Regression Models References: Greene, Economeric Analysis, Chaper 0 Consider he following regression model: y = f(x, β) + ε =,, x is kx for each, β is an rxconsan vecor, ε is
More informationIntroduction to Mobile Robotics
Inroducion o Mobile Roboics Bayes Filer Kalman Filer Wolfram Burgard Cyrill Sachniss Giorgio Grisei Maren Bennewiz Chrisian Plagemann Bayes Filer Reminder Predicion bel p u bel d Correcion bel η p z bel
More informationReferences are appeared in the last slide. Last update: (1393/08/19)
SYSEM IDEIFICAIO Ali Karimpour Associae Professor Ferdowsi Universi of Mashhad References are appeared in he las slide. Las updae: 0..204 393/08/9 Lecure 5 lecure 5 Parameer Esimaion Mehods opics o be
More informationSEIF, EnKF, EKF SLAM. Pieter Abbeel UC Berkeley EECS
SEIF, EnKF, EKF SLAM Pieer Abbeel UC Berkeley EECS Informaion Filer From an analyical poin of view == Kalman filer Difference: keep rack of he inverse covariance raher han he covariance marix [maer of
More informationDiebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles
Diebold, Chaper 7 Francis X. Diebold, Elemens of Forecasing, 4h Ediion (Mason, Ohio: Cengage Learning, 006). Chaper 7. Characerizing Cycles Afer compleing his reading you should be able o: Define covariance
More informationModeling Economic Time Series with Stochastic Linear Difference Equations
A. Thiemer, SLDG.mcd, 6..6 FH-Kiel Universiy of Applied Sciences Prof. Dr. Andreas Thiemer e-mail: andreas.hiemer@fh-kiel.de Modeling Economic Time Series wih Sochasic Linear Difference Equaions Summary:
More information2.160 System Identification, Estimation, and Learning. Lecture Notes No. 8. March 6, 2006
2.160 Sysem Idenificaion, Esimaion, and Learning Lecure Noes No. 8 March 6, 2006 4.9 Eended Kalman Filer In many pracical problems, he process dynamics are nonlinear. w Process Dynamics v y u Model (Linearized)
More informationAffine term structure models
Affine erm srucure models A. Inro o Gaussian affine erm srucure models B. Esimaion by minimum chi square (Hamilon and Wu) C. Esimaion by OLS (Adrian, Moench, and Crump) D. Dynamic Nelson-Siegel model (Chrisensen,
More informationEMS SCM joint meeting. On stochastic partial differential equations of parabolic type
EMS SCM join meeing Barcelona, May 28-30, 2015 On sochasic parial differenial equaions of parabolic ype Isván Gyöngy School of Mahemaics and Maxwell Insiue Edinburgh Universiy 1 I. Filering problem II.
More information(10) (a) Derive and plot the spectrum of y. Discuss how the seasonality in the process is evident in spectrum.
January 01 Final Exam Quesions: Mark W. Wason (Poins/Minues are given in Parenheses) (15) 1. Suppose ha y follows he saionary AR(1) process y = y 1 +, where = 0.5 and ~ iid(0,1). Le x = (y + y 1 )/. (11)
More informationTesting the Random Walk Model. i.i.d. ( ) r
he random walk heory saes: esing he Random Walk Model µ ε () np = + np + Momen Condiions where where ε ~ i.i.d he idea here is o es direcly he resricions imposed by momen condiions. lnp lnp µ ( lnp lnp
More informationFINM 6900 Finance Theory
FINM 6900 Finance Theory Universiy of Queensland Lecure Noe 4 The Lucas Model 1. Inroducion In his lecure we consider a simple endowmen economy in which an unspecified number of raional invesors rade asses
More informationKalman filtering for maximum likelihood estimation given corrupted observations.
alman filering maimum likelihood esimaion given corruped observaions... Holmes Naional Marine isheries Service Inroducion he alman filer is used o eend likelihood esimaion o cases wih hidden saes such
More informationAn recursive analytical technique to estimate time dependent physical parameters in the presence of noise processes
WHAT IS A KALMAN FILTER An recursive analyical echnique o esimae ime dependen physical parameers in he presence of noise processes Example of a ime and frequency applicaion: Offse beween wo clocks PREDICTORS,
More informationAn EM algorithm for maximum likelihood estimation given corrupted observations. E. E. Holmes, National Marine Fisheries Service
An M algorihm maimum likelihood esimaion given corruped observaions... Holmes Naional Marine Fisheries Service Inroducion M algorihms e likelihood esimaion o cases wih hidden saes such as when observaions
More informationUsing the Kalman filter Extended Kalman filter
Using he Kalman filer Eended Kalman filer Doz. G. Bleser Prof. Sricker Compuer Vision: Objec and People Tracking SA- Ouline Recap: Kalman filer algorihm Using Kalman filers Eended Kalman filer algorihm
More informationHow to Deal with Structural Breaks in Practical Cointegration Analysis
How o Deal wih Srucural Breaks in Pracical Coinegraion Analysis Roselyne Joyeux * School of Economic and Financial Sudies Macquarie Universiy December 00 ABSTRACT In his noe we consider he reamen of srucural
More information12: AUTOREGRESSIVE AND MOVING AVERAGE PROCESSES IN DISCRETE TIME. Σ j =
1: AUTOREGRESSIVE AND MOVING AVERAGE PROCESSES IN DISCRETE TIME Moving Averages Recall ha a whie noise process is a series { } = having variance σ. The whie noise process has specral densiy f (λ) = of
More informationKriging Models Predicting Atrazine Concentrations in Surface Water Draining Agricultural Watersheds
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 Kriging Models Predicing Arazine Concenraions in Surface Waer Draining Agriculural Waersheds Paul L. Mosquin, Jeremy Aldworh, Wenlin Chen Supplemenal Maerial Number
More informationAnnouncements. Recap: Filtering. Recap: Reasoning Over Time. Example: State Representations for Robot Localization. Particle Filtering
Inroducion o Arificial Inelligence V22.0472-001 Fall 2009 Lecure 18: aricle & Kalman Filering Announcemens Final exam will be a 7pm on Wednesday December 14 h Dae of las class 1.5 hrs long I won ask anyhing
More informationApplication of a Stochastic-Fuzzy Approach to Modeling Optimal Discrete Time Dynamical Systems by Using Large Scale Data Processing
Applicaion of a Sochasic-Fuzzy Approach o Modeling Opimal Discree Time Dynamical Sysems by Using Large Scale Daa Processing AA WALASZE-BABISZEWSA Deparmen of Compuer Engineering Opole Universiy of Technology
More informationOBJECTIVES OF TIME SERIES ANALYSIS
OBJECTIVES OF TIME SERIES ANALYSIS Undersanding he dynamic or imedependen srucure of he observaions of a single series (univariae analysis) Forecasing of fuure observaions Asceraining he leading, lagging
More information0.1 MAXIMUM LIKELIHOOD ESTIMATION EXPLAINED
0.1 MAXIMUM LIKELIHOOD ESTIMATIO EXPLAIED Maximum likelihood esimaion is a bes-fi saisical mehod for he esimaion of he values of he parameers of a sysem, based on a se of observaions of a random variable
More informationData Assimilation. Alan O Neill National Centre for Earth Observation & University of Reading
Daa Assimilaion Alan O Neill Naional Cenre for Earh Observaion & Universiy of Reading Conens Moivaion Univariae scalar) daa assimilaion Mulivariae vecor) daa assimilaion Opimal Inerpoleion BLUE) 3d-Variaional
More informationOnline Convex Optimization Example And Follow-The-Leader
CSE599s, Spring 2014, Online Learning Lecure 2-04/03/2014 Online Convex Opimizaion Example And Follow-The-Leader Lecurer: Brendan McMahan Scribe: Sephen Joe Jonany 1 Review of Online Convex Opimizaion
More informationExcel-Based Solution Method For The Optimal Policy Of The Hadley And Whittin s Exact Model With Arma Demand
Excel-Based Soluion Mehod For The Opimal Policy Of The Hadley And Whiin s Exac Model Wih Arma Demand Kal Nami School of Business and Economics Winson Salem Sae Universiy Winson Salem, NC 27110 Phone: (336)750-2338
More informationWhat Ties Return Volatilities to Price Valuations and Fundamentals? On-Line Appendix
Wha Ties Reurn Volailiies o Price Valuaions and Fundamenals? On-Line Appendix Alexander David Haskayne School of Business, Universiy of Calgary Piero Veronesi Universiy of Chicago Booh School of Business,
More informationSequential Importance Resampling (SIR) Particle Filter
Paricle Filers++ Pieer Abbeel UC Berkeley EECS Many slides adaped from Thrun, Burgard and Fox, Probabilisic Roboics 1. Algorihm paricle_filer( S -1, u, z ): 2. Sequenial Imporance Resampling (SIR) Paricle
More informationCS 4495 Computer Vision Tracking 1- Kalman,Gaussian
CS 4495 Compuer Vision A. Bobick CS 4495 Compuer Vision - KalmanGaussian Aaron Bobick School of Ineracive Compuing CS 4495 Compuer Vision A. Bobick Adminisrivia S5 will be ou his Thurs Due Sun Nov h :55pm
More informationTracking. Announcements
Tracking Tuesday, Nov 24 Krisen Grauman UT Ausin Announcemens Pse 5 ou onigh, due 12/4 Shorer assignmen Auo exension il 12/8 I will no hold office hours omorrow 5 6 pm due o Thanksgiving 1 Las ime: Moion
More informationCourse Notes for EE227C (Spring 2018): Convex Optimization and Approximation
Course Noes for EE7C Spring 018: Convex Opimizaion and Approximaion Insrucor: Moriz Hard Email: hard+ee7c@berkeley.edu Graduae Insrucor: Max Simchowiz Email: msimchow+ee7c@berkeley.edu Ocober 15, 018 3
More informationמקורות לחומר בשיעור ספר הלימוד: Forsyth & Ponce מאמרים שונים חומר באינטרנט! פרק פרק 18
עקיבה מקורות לחומר בשיעור ספר הלימוד: פרק 5..2 Forsh & once פרק 8 מאמרים שונים חומר באינטרנט! Toda Tracking wih Dnamics Deecion vs. Tracking Tracking as probabilisic inference redicion and Correcion Linear
More informationGeneralized Least Squares
Generalized Leas Squares Augus 006 1 Modified Model Original assumpions: 1 Specificaion: y = Xβ + ε (1) Eε =0 3 EX 0 ε =0 4 Eεε 0 = σ I In his secion, we consider relaxing assumpion (4) Insead, assume
More informationData Fusion using Kalman Filter. Ioannis Rekleitis
Daa Fusion using Kalman Filer Ioannis Rekleiis Eample of a arameerized Baesian Filer: Kalman Filer Kalman filers (KF represen poserior belief b a Gaussian (normal disribuion A -d Gaussian disribuion is
More informationBias in Conditional and Unconditional Fixed Effects Logit Estimation: a Correction * Tom Coupé
Bias in Condiional and Uncondiional Fixed Effecs Logi Esimaion: a Correcion * Tom Coupé Economics Educaion and Research Consorium, Naional Universiy of Kyiv Mohyla Academy Address: Vul Voloska 10, 04070
More informationPresentation Overview
Acion Refinemen in Reinforcemen Learning by Probabiliy Smoohing By Thomas G. Dieerich & Didac Busques Speaer: Kai Xu Presenaion Overview Bacground The Probabiliy Smoohing Mehod Experimenal Sudy of Acion
More informationModal identification of structures from roving input data by means of maximum likelihood estimation of the state space model
Modal idenificaion of srucures from roving inpu daa by means of maximum likelihood esimaion of he sae space model J. Cara, J. Juan, E. Alarcón Absrac The usual way o perform a forced vibraion es is o fix
More informationMANY FACET, COMMON LATENT TRAIT POLYTOMOUS IRT MODEL AND EM ALGORITHM. Dimitar Atanasov
Pliska Sud. Mah. Bulgar. 20 (2011), 5 12 STUDIA MATHEMATICA BULGARICA MANY FACET, COMMON LATENT TRAIT POLYTOMOUS IRT MODEL AND EM ALGORITHM Dimiar Aanasov There are many areas of assessmen where he level
More informationVectorautoregressive Model and Cointegration Analysis. Time Series Analysis Dr. Sevtap Kestel 1
Vecorauoregressive Model and Coinegraion Analysis Par V Time Series Analysis Dr. Sevap Kesel 1 Vecorauoregression Vecor auoregression (VAR) is an economeric model used o capure he evoluion and he inerdependencies
More informationSpeaker Adaptation Techniques For Continuous Speech Using Medium and Small Adaptation Data Sets. Constantinos Boulis
Speaker Adapaion Techniques For Coninuous Speech Using Medium and Small Adapaion Daa Ses Consaninos Boulis Ouline of he Presenaion Inroducion o he speaker adapaion problem Maximum Likelihood Sochasic Transformaions
More informationArticle from. Predictive Analytics and Futurism. July 2016 Issue 13
Aricle from Predicive Analyics and Fuurism July 6 Issue An Inroducion o Incremenal Learning By Qiang Wu and Dave Snell Machine learning provides useful ools for predicive analyics The ypical machine learning
More informationImpact of International Information Technology Transfer on National Productivity. Online Supplement
Impac of Inernaional Informaion Technology Transfer on Naional Prouciviy Online Supplemen Jungsoo Park Deparmen of Economics Sogang Universiy Seoul, Korea Email: jspark@sogang.ac.kr, Tel: 82-2-705-8697,
More informationRobust estimation based on the first- and third-moment restrictions of the power transformation model
h Inernaional Congress on Modelling and Simulaion, Adelaide, Ausralia, 6 December 3 www.mssanz.org.au/modsim3 Robus esimaion based on he firs- and hird-momen resricions of he power ransformaion Nawaa,
More informationm = 41 members n = 27 (nonfounders), f = 14 (founders) 8 markers from chromosome 19
Sequenial Imporance Sampling (SIS) AKA Paricle Filering, Sequenial Impuaion (Kong, Liu, Wong, 994) For many problems, sampling direcly from he arge disribuion is difficul or impossible. One reason possible
More informationTracking. Many slides adapted from Kristen Grauman, Deva Ramanan
Tracking Man slides adaped from Krisen Grauman Deva Ramanan Coures G. Hager Coures G. Hager J. Kosecka cs3b Adapive Human-Moion Tracking Acquisiion Decimaion b facor 5 Moion deecor Grascale convers. Image
More informationACE 562 Fall Lecture 4: Simple Linear Regression Model: Specification and Estimation. by Professor Scott H. Irwin
ACE 56 Fall 005 Lecure 4: Simple Linear Regression Model: Specificaion and Esimaion by Professor Sco H. Irwin Required Reading: Griffihs, Hill and Judge. "Simple Regression: Economic and Saisical Model
More informationA Specification Test for Linear Dynamic Stochastic General Equilibrium Models
Journal of Saisical and Economeric Mehods, vol.1, no.2, 2012, 65-70 ISSN: 2241-0384 (prin), 2241-0376 (online) Scienpress Ld, 2012 A Specificaion Tes for Linear Dynamic Sochasic General Equilibrium Models
More informationLecture 20: Riccati Equations and Least Squares Feedback Control
34-5 LINEAR SYSTEMS Lecure : Riccai Equaions and Leas Squares Feedback Conrol 5.6.4 Sae Feedback via Riccai Equaions A recursive approach in generaing he marix-valued funcion W ( ) equaion for i for he
More informationUNIVERSITY OF TRENTO MEASUREMENTS OF TRANSIENT PHENOMENA WITH DIGITAL OSCILLOSCOPES. Antonio Moschitta, Fabrizio Stefani, Dario Petri.
UNIVERSIY OF RENO DEPARMEN OF INFORMAION AND COMMUNICAION ECHNOLOGY 385 Povo reno Ialy Via Sommarive 4 hp://www.di.unin.i MEASUREMENS OF RANSIEN PHENOMENA WIH DIGIAL OSCILLOSCOPES Anonio Moschia Fabrizio
More information10. State Space Methods
. Sae Space Mehods. Inroducion Sae space modelling was briefly inroduced in chaper. Here more coverage is provided of sae space mehods before some of heir uses in conrol sysem design are covered in he
More informationKEY. Math 334 Midterm III Winter 2008 section 002 Instructor: Scott Glasgow
KEY Mah 334 Miderm III Winer 008 secion 00 Insrucor: Sco Glasgow Please do NOT wrie on his exam. No credi will be given for such work. Raher wrie in a blue book, or on your own paper, preferably engineering
More informationSolutions to the Exam Digital Communications I given on the 11th of June = 111 and g 2. c 2
Soluions o he Exam Digial Communicaions I given on he 11h of June 2007 Quesion 1 (14p) a) (2p) If X and Y are independen Gaussian variables, hen E [ XY ]=0 always. (Answer wih RUE or FALSE) ANSWER: False.
More informationOrdinary dierential equations
Chaper 5 Ordinary dierenial equaions Conens 5.1 Iniial value problem........................... 31 5. Forward Euler's mehod......................... 3 5.3 Runge-Kua mehods.......................... 36
More informationLecture 1 Overview. course mechanics. outline & topics. what is a linear dynamical system? why study linear systems? some examples
EE263 Auumn 27-8 Sephen Boyd Lecure 1 Overview course mechanics ouline & opics wha is a linear dynamical sysem? why sudy linear sysems? some examples 1 1 Course mechanics all class info, lecures, homeworks,
More informationSTATE-SPACE MODELLING. A mass balance across the tank gives:
B. Lennox and N.F. Thornhill, 9, Sae Space Modelling, IChemE Process Managemen and Conrol Subjec Group Newsleer STE-SPACE MODELLING Inroducion: Over he pas decade or so here has been an ever increasing
More informationBlock Diagram of a DCS in 411
Informaion source Forma A/D From oher sources Pulse modu. Muliplex Bandpass modu. X M h: channel impulse response m i g i s i Digial inpu Digial oupu iming and synchronizaion Digial baseband/ bandpass
More informationTracking. Many slides adapted from Kristen Grauman, Deva Ramanan
Tracking Man slides adaped from Krisen Grauman Deva Ramanan Coures G. Hager Coures G. Hager J. Kosecka cs3b Adapive Human-Moion Tracking Acquisiion Decimaion b facor 5 Moion deecor Grascale convers. Image
More informationCash Flow Valuation Mode Lin Discrete Time
IOSR Journal of Mahemaics (IOSR-JM) e-issn: 2278-5728,p-ISSN: 2319-765X, 6, Issue 6 (May. - Jun. 2013), PP 35-41 Cash Flow Valuaion Mode Lin Discree Time Olayiwola. M. A. and Oni, N. O. Deparmen of Mahemaics
More informationPhysics 127b: Statistical Mechanics. Fokker-Planck Equation. Time Evolution
Physics 7b: Saisical Mechanics Fokker-Planck Equaion The Langevin equaion approach o he evoluion of he velociy disribuion for he Brownian paricle migh leave you uncomforable. A more formal reamen of his
More informationWednesday, November 7 Handout: Heteroskedasticity
Amhers College Deparmen of Economics Economics 360 Fall 202 Wednesday, November 7 Handou: Heeroskedasiciy Preview Review o Regression Model o Sandard Ordinary Leas Squares (OLS) Premises o Esimaion Procedures
More informationψ(t) = V x (0)V x (t)
.93 Home Work Se No. (Professor Sow-Hsin Chen Spring Term 5. Due March 7, 5. This problem concerns calculaions of analyical expressions for he self-inermediae scaering funcion (ISF of he es paricle in
More informationStochastic Signals and Systems
Sochasic Signals and Sysems Conens 1. Probabiliy Theory. Sochasic Processes 3. Parameer Esimaion 4. Signal Deecion 5. Specrum Analysis 6. Opimal Filering Chaper 6 / Sochasic Signals and Sysems / Prof.
More informationFiltering Turbulent Signals Using Gaussian and non-gaussian Filters with Model Error
Filering Turbulen Signals Using Gaussian and non-gaussian Filers wih Model Error June 3, 3 Nan Chen Cener for Amosphere Ocean Science (CAOS) Couran Insiue of Sciences New York Universiy / I. Ouline Use
More informationhen found from Bayes rule. Specically, he prior disribuion is given by p( ) = N( ; ^ ; r ) (.3) where r is he prior variance (we add on he random drif
Chaper Kalman Filers. Inroducion We describe Bayesian Learning for sequenial esimaion of parameers (eg. means, AR coeciens). The updae procedures are known as Kalman Filers. We show how Dynamic Linear
More informationTime series model fitting via Kalman smoothing and EM estimation in TimeModels.jl
Time series model fiing via Kalman smoohing and EM esimaion in TimeModels.jl Gord Sephen Las updaed: January 206 Conens Inroducion 2. Moivaion and Acknowledgemens....................... 2.2 Noaion......................................
More informationAnno accademico 2006/2007. Davide Migliore
Roboica Anno accademico 2006/2007 Davide Migliore migliore@ele.polimi.i Today Eercise session: An Off-side roblem Robo Vision Task Measuring NBA layers erformance robabilisic Roboics Inroducion The Bayesian
More informationTemporal probability models
Temporal probabiliy models CS194-10 Fall 2011 Lecure 25 CS194-10 Fall 2011 Lecure 25 1 Ouline Hidden variables Inerence: ilering, predicion, smoohing Hidden Markov models Kalman ilers (a brie menion) Dynamic
More informationA unit root test based on smooth transitions and nonlinear adjustment
MPRA Munich Personal RePEc Archive A uni roo es based on smooh ransiions and nonlinear adjusmen Aycan Hepsag Isanbul Universiy 5 Ocober 2017 Online a hps://mpra.ub.uni-muenchen.de/81788/ MPRA Paper No.
More informationR t. C t P t. + u t. C t = αp t + βr t + v t. + β + w t
Exercise 7 C P = α + β R P + u C = αp + βr + v (a) (b) C R = α P R + β + w (c) Assumpions abou he disurbances u, v, w : Classical assumions on he disurbance of one of he equaions, eg. on (b): E(v v s P,
More informationSTAD57 Time Series Analysis. Lecture 14
STAD57 Time Series Analysis Lecure 14 1 Maximum Likelihood AR(p) Esimaion Insead of Yule-Walker (MM) for AR(p) model, can use Maximum Likelihood (ML) esimaion Likelihood is join densiy of daa {x 1,,x n
More informationY, where. 1 Estimate St.error
1 HG Feb 2014 ECON 5101 Exercises III - 24 Feb 2014 Exercise 1 In lecure noes 3 (LN3 page 11) we esimaed an ARMA(1,2) for daa) for he period, 1978q2-2013q2 Le Y ln BNP ln BNP (Norwegian Model: Y Y, where
More informationHidden Markov Models
Hidden Markov Models Probabilisic reasoning over ime So far, we ve mosly deal wih episodic environmens Excepions: games wih muliple moves, planning In paricular, he Bayesian neworks we ve seen so far describe
More information2016 Possible Examination Questions. Robotics CSCE 574
206 Possible Examinaion Quesions Roboics CSCE 574 ) Wha are he differences beween Hydraulic drive and Shape Memory Alloy drive? Name one applicaion in which each one of hem is appropriae. 2) Wha are he
More informationThe General Linear Test in the Ridge Regression
ommunicaions for Saisical Applicaions Mehods 2014, Vol. 21, No. 4, 297 307 DOI: hp://dx.doi.org/10.5351/sam.2014.21.4.297 Prin ISSN 2287-7843 / Online ISSN 2383-4757 The General Linear Tes in he Ridge
More informationBU Macro BU Macro Fall 2008, Lecture 4
Dynamic Programming BU Macro 2008 Lecure 4 1 Ouline 1. Cerainy opimizaion problem used o illusrae: a. Resricions on exogenous variables b. Value funcion c. Policy funcion d. The Bellman equaion and an
More informationOptimal Paired Choice Block Designs. Supplementary Material
Saisica Sinica: Supplemen Opimal Paired Choice Block Designs Rakhi Singh 1, Ashish Das 2 and Feng-Shun Chai 3 1 IITB-Monash Research Academy, Mumbai, India 2 Indian Insiue of Technology Bombay, Mumbai,
More informationNew effective moduli of isotropic viscoelastic composites. Part I. Theoretical justification
IOP Conference Series: Maerials Science and Engineering PAPE OPEN ACCESS New effecive moduli of isoropic viscoelasic composies. Par I. Theoreical jusificaion To cie his aricle: A A Sveashkov and A A akurov
More informationLinear Combinations of Volatility Forecasts for the WIG20 and Polish Exchange Rates
Eliza Buszkowska Universiy of Poznań, Poland Linear Combinaions of Volailiy Forecass for he WIG0 and Polish Exchange Raes Absrak. As is known forecas combinaions may be beer forecass hen forecass obained
More informationF2E5216/TS1002 Adaptive Filtering and Change Detection. Likelihood Ratio based Change Detection Tests. Gaussian Case. Recursive Formulation
Adapive Filering and Change Deecion Fredrik Gusafsson (LiTH and Bo Wahlberg (KTH Likelihood Raio based Change Deecion Tess Hypohesis es: H : no jump H 1 (k, ν : a jump of magniude ν a ime k. Lecure 8 Filer
More informationACE 562 Fall Lecture 8: The Simple Linear Regression Model: R 2, Reporting the Results and Prediction. by Professor Scott H.
ACE 56 Fall 5 Lecure 8: The Simple Linear Regression Model: R, Reporing he Resuls and Predicion by Professor Sco H. Irwin Required Readings: Griffihs, Hill and Judge. "Explaining Variaion in he Dependen
More informationLinear Dynamic Models
Linear Dnamic Models and Forecasing Reference aricle: Ineracions beween he muliplier analsis and he principle of acceleraion Ouline. The sae space ssem as an approach o working wih ssems of difference
More informationAnti-Disturbance Control for Multiple Disturbances
Workshop a 3 ACC Ani-Disurbance Conrol for Muliple Disurbances Lei Guo (lguo@buaa.edu.cn) Naional Key Laboraory on Science and Technology on Aircraf Conrol, Beihang Universiy, Beijing, 9, P.R. China. Presened
More informationRobert Kollmann. 6 September 2017
Appendix: Supplemenary maerial for Tracable Likelihood-Based Esimaion of Non- Linear DSGE Models Economics Leers (available online 6 Sepember 207) hp://dx.doi.org/0.06/j.econle.207.08.027 Rober Kollmann
More informationUNIVERSITY OF CALIFORNIA College of Engineering Department of Electrical Engineering and Computer Sciences EECS 121 FINAL EXAM
Name: UNIVERSIY OF CALIFORNIA College of Engineering Deparmen of Elecrical Engineering and Compuer Sciences Professor David se EECS 121 FINAL EXAM 21 May 1997, 5:00-8:00 p.m. Please wrie answers on blank
More informationLecture Notes 2. The Hilbert Space Approach to Time Series
Time Series Seven N. Durlauf Universiy of Wisconsin. Basic ideas Lecure Noes. The Hilber Space Approach o Time Series The Hilber space framework provides a very powerful language for discussing he relaionship
More information