Local ensemble Kalman filtering in the presence of model bias

Size: px
Start display at page:

Download "Local ensemble Kalman filtering in the presence of model bias"

Transcription

1 Tellus (2006), 58A, Copyright C Blackwell Muksgaard, 2006 Prited i Sigapore. All rights reserved TELLUS Local esemle Kalma filterig i the presece of model ias By SEUNG-JONG BAEK 1, BRIAN R. HUNT 2, EUGENIA KALNAY 3, EDWARD OTT 1,4 ad ISTVAN SZUNYOGH 3, 1 Istitute for Research i Electroics ad Applied Physics, ad Departmet of Electrical ad Computer Egieerig, Uiversity of Marylad, College Park, MD, USA; 2 Istitute for Physical Sciece ad Techology, ad Departmet of Mathematics, Uiversity of Marylad, College Park, MD, USA; 3 Istitute for Physical Sciece ad Techology, ad Departmet of Atmospheric ad Oceaic Sciece, Uiversity of Marylad, College Park, MD, USA; 4 Departmet of Physics, Uiversity of Marylad, College Park, MD, USA (Mauscript received 6 April 2005; i fial form 5 Decemer 2005) ABSTRACT We modify the local esemle Kalma filter (LEKF) to icorporate the effect of forecast model ias. The method is ased o augmetatio of the atmospheric state y estimates of the model ias, ad we cosider differet ways of modelig (i.e. parameterizig) the model ias. We evaluate the effectiveess of the proposed augmeted state esemle Kalma filter through umerical experimets icorporatig various model iases ito the model of Lorez ad Emauel. Our results highlight the critical role played y the selectio of a good parameterizatio model for represetig the form of the possile ias i the forecast model. I particular, we fid that forecasts ca e greatly improved provided that a good model parameterizig the model ias is used to augmet the state i the Kalma filter. 1. Itroductio I may situatios the dyamics of a real process may differ from those of the est availale model of that process. We refer to this differece as model error. Model error is thought to e a key issue i weather forecastig i that the presece of model error ca lead to cause large discrepacies etwee the forecasts ad the true atmospheric states. I this coectio, we ote (i) that Kalma filters have ee cosidered for estimatig atmospheric states to e used as iitial coditios i forecast models (Ghil et al., 1981), ad, (ii) that the geeral Kalma filter methodology has log ee adapted to accout for model error (Friedlad, 1969). Recetly, the esemle techique has ee proposed as a computatioally feasile meas of applyig Kalma filterig to the very high dimesioal states iheret i gloal atmospheric models (Evese, 1994; Houtekamer ad Mitchell, 1998, 2001; Aderso, 2001; Bishop et al., 2001; Hamill et al., 2001; Whitaker ad Hamill, 2002; Ott et al., 2004a). Oe of our goals i this paper is to ivestigate the icorporatio of model error correctio i a esemle Kalma filter. Here, we cosider oly the case where the evolutio of the model error is govered y a determiistic equatio, i.e. the model error has o radom com- Correspodig author. sjaek@glue.umd.edu DOI: /j x poet. We refer to this type of error as model ias, sice whe the state of the model is descried y a proailistic variale, as is the case i data assimilatio, such errors ecome equal to the expected error i the model forecast. We will restrict our cosideratios to the example of oe particular esemle Kalma filter, the Local Esemle Kalma Filter (LEKF) proposed y Ott et al. (2004a). [This scheme has ee successfully tested (Szuyogh et al., 2005) o a reduced resolutio versio of the operatioal Gloal Forecast System (GFS) of the Natioal Ceters for Evirometal Predictio (NCEP) for the perfect forecast model sceario.] We elieve that our results i the preset paper, usig the LEKF example, may also e more geerally applicale, providig a idicatio of what to expect if model ias correctio is attempted usig other related esemle Kalma filter methods. I additio, some of our ideas may also e useful i desigig weakly costraied 4DVAR schemes (e.g. Derer, 1989; Zupaski, 1997), which also allow for model errors. The techique we propose elogs to the family of schemes usually called state space augmetatio methods (Coh, 1997). I these techiques the state vector is augmeted with the ucertai model parameters, ad the augmeted state is estimated usig the forecast model i cojuctio with oservatios. I priciple, the ucertai parameters ca occur i otherwise completely kow forecast model equatios. I such a case, the augmeted state space approach may provide a accurate 293

2 294 S. J. BAEK ET AL. estimate of the parameters eve for a highly chaotic system, as recetly demostrated o a simple model y Aa ad Hargreaves (2004). I reality, the equatios goverig the motio of the atmospheric flow are ot kow exactly, thus ucertaities also arise due to our limited kowledge of the dyamics. Also, estimatig all parameters of the forecast model equatios would ot e computatioally feasile due to the large umer of parameters. A practical approach, first suggested y Derer (1989), is to assume that the ucertaities i the forecast model ca e approximately represeted i the form of a limited umer of ulk error terms. The the task is to estimate the parameters of the ulk error terms. We recall that sice the error terms are modeled as radom vectors, the parameters to e estimated are the mea errors (model iases). The iformatio ecapsulated i the ias ca e used either to modify the forecast model equatios or to modify the aalysis scheme. Here we follow the secod approach. That is, we treat the forecast model as a lack ox, that does ot yield the true time evolutio of the atmosphere, ad we attempt to use this lack ox i cojuctio with oservatios to accout for model ias i the state estimatio. The two key compoets of the aforemetioed strategy are the selectio of a ias model that efficietly represets the ias ad the desig of a computatioal strategy that ca efficietly estimate the parameters of the ias model. The most commo assumptio is that the ias is costat or has a simple evolutio i time. It is also frequetly assumed that the ucertaities i the forecast model state ad the ias are ucorrelated. These assumptios were used to derive the ias estimatio schemes of Dee ad Da Silva (1998), Dee ad Todlig (2000), Carto et al. (2000), Marti et al. (2002) ad Bell et al. (2004). The scheme we propose allows for correlatios etwee the ucertaities of the forecast model state ad the ias. This additioal flexiility is ecessitated y the structure of our techique (see Sectio 2.4), ad is affordale due to the high computatioal efficiecy of the LEKF approach. I Sectio 2, we itroduce three differet ias models. Bias Model I is a simple additive correctio to the model forecast. Bias Model II is motivated y evisioig a situatio i which the forecast model evolutio takes place o a attractor that is shifted from the attractor for the true system evolutio. Bias Model III is essetially a comiatio of Bias Models I ad II. Sectio 3 presets the results of umerical experimets with the Lorez- 96 model (e.g. Lorez ad Emauel, 1998) for several cases of the differece etwee the forecast model evolutio ad the evolutio of the true state. Coclusios ad discussio follow i Sectio 4. A mai result is the importace of selectig a ias model that effectively parameterizes the form of possile ias i the forecast model. I particular, if the ias model ca parameterize the possile ias of the forecast model, the our results suggest that sustatial improvemet i forecasts may result. O the other had, if the parameterizatio of the model ias through the ias model does ot sufficietly capture the form of the true iases i the forecast model, the sustatial forecast improvemets were ot otaied i our umerical experimets. 2. Bias modelig ad data assimilatio The discrepacy etwee the forecast model evolutio ad the evolutio of the real atmosphere has two sources: (i) due to umerical solutio o a grid of a fiite umer of poits, the forecast model state is a fiite dimesioal represetatio of the ifiite dimesioal atmospheric fields, ad (ii) the equatios that gover the true evolutio of the atmosphere are ot kow exactly. These two sources of forecast model errors are ot idepedet, sice the errors i the forecast model formulatio are maily associated with the iheret prolems of cosiderig oly a limited umer of iteractios etwee the fiite umer of compoets of the state vector ad the imperfect represetatio of the effects of the sugrid processes o the motios at the resolved scales. Deotig the true atmospheric state at t y x t, the true atmospheric evolutio is deoted x t +1 = Ft ( x t ), (1) where F t is the (ukow) true atmospheric evolutio operator ad x t +1 is the true atmospheric state at time t +1 = t + t. Deotig the forecast model state at time t y x m, the lack ox produces a forecast model state at time t +1, x m +1 = ( ) Fm x m, (2) where F m is the forecast model evolutio operator that mimics F t. Note that the dimesios of x t ad x m are, i geeral, differet; for example, i the case of real weather forecastig the true state is ifiite dimesioal ad the forecast model state is fiite dimesioal. I what follows we will treat a sceario i which x m ad x t have the same (fiite) dimesioality, ad we heceforth assume this circumstace. With respect to the situatio of atmospheric weather forecastig, this assumptio restricts the character of the errors ad their meas (iases) that ca e addressed y our ias models. I particular, we regard our treatmet to follow as addressig oly those types of forecast model iases that ca e represeted as dyamics i the state space of the forecast model variales. Thus, we igore dyamics that occur at smaller scales tha the forecast model resolves. O the other had, if we thik of the dyamics at the uresolved scales as radom perturatios to the forecast model dyamics, our methods may e ale to correct for the mea ias due to such perturatios. Meawhile, the ucertaity i the small-scale fluctuatios is modeled as represetativeess error i the oservatio error statistics. I this sectio, we defie three ways of modelig the ias that ca arise due to forecast model error. We refer to these as Bias Model I, Bias Model II ad Bias Model III.

3 LEKF FOR MODEL BIAS 295 Fig. 1. Illustratio of Bias Model I: x t is the true state evolvig accordig to F t from the previous true state, ad x m is the forecast model state evolvig accordig to F m from the previous true state Bias Model I I geeral, it is desired to have the forecast model state as close to the true state as possile so that, assumig that the forecast model ad the true evolutio operators are the same, the forecast model state stays ear the true state after its evolutio. I practice, however, the forecast model evolutio operator differs from the true evolutio operator. As a result, eve if we evolve the forecast model state from a iitial coditio correspodig to the true state at the iitial time (e.g. x m 1 = xt 1 ), it is likely that the forecast model state departs from the true state as it evolves. I Bias Model I, we attempt to estimate t = Ft ( x t 1) F m ( x t 1), (3) i.e. the departure of the forecast model state from the true state as illustrated i Fig. 1. I order to estimate t, we must use some model of how it is related to past values of the ias i t (i < ). For example, we ca assume that the ias is costat i time. If so, the true system evolutio ca e writte i terms of the model evolutio as follows: x t = Fm( ) x t 1 + t, (4) t = t 1. (5) Though we could write this system more cocisely as x t = F m (x t 1 ) +, where is a ukow parameter vector, we write the system i terms of the augmeted state vector (x t, t )iorder to facilitate the iterative estimatio of oth x t ad t y our data assimilatio procedure. More geerally, we ca replace eq. (5) with aother model for the ias of the form, t = G ( t 1, xt 1), (6) where G is the evolutio operator for the ias correctio term. Aother alterative is to assume that the model error evolutio is a Markov process. I that case, t is represeted as t 1 multiplied y a matrix that descries the temporal covariace e- Fig. 2. Illustratio of data assimilatio with Bias Model I: Data assimilatio produces a uiased aalysis for the true state, x a, ad a aalysis for the ias correctio term, a. twee the model errors at differet spatial locatio, ad the righthad side of eq. (6) also icludes a additive radom term (e.g. Jazwiski, 1970; Daley, 1992; Zupaski, 1997). The give a estimate (x a 1, a 1 ) of the augmeted state vector at time t 1 (the aalysis from the previous data assimilatio), we take the forecast (or ackgroud ) of this vector (x, ) at time t to e x = ( ) Fm x a 1 +, (7) = G ( a 1, xa 1), (8) where we have assumed ias evolutio y eq. (6). We the perform data assimilatio usig (x, ), ad the oservatios at time t to otai the aalysis (x a, a ). This way of takig forecast model error ito accout is illustrated i Fig. 2, ad is the geeral scheme used i several previous methods appearig i the literature (e.g. Dee ad Da Silva, 1998; Dee ad Todlig, 2000; Carto et al., 2000; Marti et al., 2002; Bell et al., 2004). The vector y i Fig. 2 is the oservatio of the true state at time t, which we assume to oey a model equatio of the form, y = H ( x t ) + ɛ, (9) where H is the oservatio operator mappig the true states to the oservatios. ad ɛ is the oservatioal oise. Basically, i Bias Model I it is supposed that the est forecast is produced whe the iput to the forecast model evolutio is as close to the truth as possile. Oe ca imagie prolems with this. For example, say that atmospheric alace for the forecast model is ot the same as that for the true atmosphere. The, if a very good estimate of the true state at time t is iserted ito the forecast model, the forecast model state at time t could ofte e out of alace, ad spurious gravity wave activity might e excited. I the practice of umerical weather predictio, such spurious gravity wave activity is preveted y a filterig process, called iitializatio, applied to the fields provided y the data assimilatio process (e.g. Machehauer, 1977; Baer ad Triia, 1977; Lych ad Huag, 1992; Lych, 1997). The geeral wisdom is that a well-desiged Kalma filter might elimiate the

4 296 S. J. BAEK ET AL. eed for iitializatio process. This cosideratio motivates Bias Model II Bias Model II A cosequece of the imperfect model is that the forecast model system has a differet attractor from the true system. I some cases, it might e desirale to let the forecast model state follow its ow attractor, sice pluggig a very good approximatio of the true state ito the forecast model system ca result i completely differet dyamics (like gravity wave excitatio). I additio, oe ca evisio a situatio i which forecast model dyamics ad true dyamics ecome more similar through a (a priori ukow) coordiate trasformatio. For istace, such trasformatios were rigorously derived to correct for trucatio errors i umerical solutio of the two-dimesioal Navier Stokes equatios (Margoli et al., 2003). Havig foud a similar trasformatio for the weather predictio model, we may otai a etter estimate of the true trajectory y applyig this trasformatio to a appropriate forecast model trajectory after it has ee computed tha y forcig the forecast model state to e close to the truth ad the computig its trajectory. For simplicity, we assume the trasformatio is just a shift of the forecast model state to the true state, ad we defie the ias c t at time t y c t = Ft( x 1) ( ) t F m x m 1 = F t( x 1) ( t F m x t 1 1) ct. (10) A schematic illustratio of this ias model is show i Fig. 3. The forecast model state is ot pushed to the true state. Istead, it mimics the true dyamics i a shifted locatio of the state space. Ulike the ias i Bias Model I, the ias i Bias Model II at time t depeds ot oly o F t, F m, ad x t 1, ut also o the previous ias c t 1. Noetheless, we may assume that for some choice of c t 1, the correctio term ct approximately oeys a simplified evolutio model such as c t = ct 1, or more geerally c t = G c (c t 1, xt 1 ). I terms of this model, we approximate the true system evolutio y the augmeted model system, x t = ( Fm x t 1 ) ct 1 + c t, (11) c t = G c ( c t 1, xt 1). (12) For this ias model (ad for Bias Model III to follow), our goal is ot that the aalysis state vector x a closely approximates the true state x t, ut rather that it approximates the est forecast model state x m = xt ct from which to make future forecasts. Thus, we rewrite eqs. (11) ad (12) as x m = Fm ( x m 1), (13) c t = Gc ( c t 1, xm 1), (14) where G(c, x) = G c (c, x + c). We ca the write the ackgroud augmeted state vector (x, c ) i terms of the previous aalysis (x a 1, ca 1 ) as follows: x = Fm ( x a 1), (15) c = Gc ( c a 1, xa 1), (16) I takig this approach, oe must keep i mid that the ias should e added to the forecast model state vector wheever makig comparisos to oservatios. Thus istead of eq. (9), we use the oservatio model, y = H ( x m + ct ) + ɛ (17) whe performig data assimilatio. The aalysis (x a, ca ) represets a approximatio to the augmeted state vector (x m, ct ), ad thus forecasts made usig x a as the iitial coditio should also e corrected y the approximated ias i order to etter predict the true system. Data assimilatio with Bias Model II is illustrated i Fig. 4. Fig. 3. Illustratio of Bias Model II: x t ad xm evolve accordig to their ow dyamics ut the ehavior of the forecast model is similar to the ehavior of the truth. Fig. 4. Illustratio of data assimilatio with Bias Model II i the case H(x) = x: Data assimilatio produces a aalysis of the est forecast model state, x m = xt ct, ad a aalysis for the correctio term, ct.

5 LEKF FOR MODEL BIAS 297 To the est of our kowledge, Bias Model II is a ovel approach to the effects of model errors o the accuracy of the state estimates. Hase (2002) also argued for the model attractor, ut he suggested the use of a multi-model approach as opposed to the state augmetatio we propose. Fig. 5. Illustratio of a local state cetered aout locatio m Bias Model III I Bias Model III, we comie Bias Model I ad Bias Model II. Formally, we comie the equatios descriig the previous two ias models i the followig maer. We evolve the aalysis augmeted state vector (x a 1, a 1, ca 1 ) to the ackgroud at the ext step usig the model x = ( ) Fm x a 1 + (18) = ( G x a 1, a 1, ) ca 1 (19) c = Gc ( x a 1, a 1, ca 1), (20) ad we compare the ackgroud state with oservatios accordig to eq. (17). Sice x ad c represet the est availale approximatios to x m ad ct prior to the data assimilatio at time t, the oservatio icremet we use is y H ( x + c ). (21) Notice that if G (x,, c) = 0, the this model reduces to Bias Model II, while if G c (x,, c) = 0, this model reduces to Bias Model I. I its simplest form, our model uses G (x,, c) = ad G c (x,, c) = c. However, we fid a slightly differet ias evolutio fuctio to e advatageous i some situatios (see Sectio 3.6) Augmeted local esemle Kalma filter For the purposes of all susequet discussio we heceforth take the system state at time t to e a scalar variale x,i defied o a discrete oe-dimesioal spatial domai, i = 1, 2,..., N. Thus we represet the system state as a vector x = [x,1, x,2,...,x,n ] T, where the superscript T deotes the traspose. Oce a suitale model for the ias is chose, it ca e icorporated ito the formulatio of the Kalma filter. For example, i the case of Bias Model III, the ew equatios ca e otaied y replacig the state x, y the augmeted state, v = [x,, c ] T, i the Kalma filter equatios. Here, the correctio terms, = [,1,,2,...,,N ] T, ad c = [c,1, c,2,...,c,n ] T,havethe same dimesio, N, which is typically equal to the umer of grid-poit variales i a umerical weather predictio model. By isertig the augmeted state ito the Kalma filter equatios, we assume that ψ (v ), the ackgroud proaility distriutio of the augmeted state, is Gaussia; that is, ψ ( [ ) v exp 1 ( v 2 ) T ( ) v P 1 ( v v ) ] v, (22) where v is the ackgroud mea of the augmeted state, ad P v is the ackgroud error covariace matrix for the augmeted state. The mai computatioal challege i desigig a augmeted Kalma filter is to fid a computatioally efficiet approach to estimate P v, whose dimesio icreases y N whe a ew parameter is added to the state. Oe frequetly applied approach to reduce the computatioal urde associated with the estimatio of P v is to assume that may etries of the matrix are zero, e.g. y assumig that the (o-augmeted) state ad the ias parameters are ucorrelated. We propose a differet approach, which ivolves estimatig the ackgroud mea ad the ackgroud error covariace matrix y a esemle, ad solvig the esemle Kalma filter equatios locally i grid space applyig the Local Esemle Kalma Filter (Ott et al., 2004a) to the augmeted state. The LEKF scheme estimates local states as illustrated i Fig. 5. I particular, cosiderig the LEKF procedure without model ias correctio (i.e. as i Ott et al., 2004a), for each poit m o the spatial grid, we cosider a eighorhood cosistig of the 2l + 1 poits cetered at m; these poits have locatios m l, m l + 1,..., m,..., m + l 1, m + l (e.g. l = 3 i Fig. 5). At time t = t, the LEKF does data assimilatio o local regios cetered at each grid poit usig the local state, x (m) = x,m l x,m l+1. x,m. x,m+l 1 x,m+l. (23) The gloal aalysis state (i.e. the aalysis state at t = t at each grid poit over the etire grid) is the take to e the state at the ceter of each local regio (see Ott et al., 2004a, for further discussio). I order to adapt the LEKF to correct for model ias, we augmet each local state to iclude the ias estimate of the ias model employed. For example, for Bias Model III, we form a augmeted local state, v (m) = [x (m), (m), c (m)] T, for the data assimilatio at locatio m. Similarly, for Bias Model I, v (m) = [x (m), (m)] T, ad, for Bias Model II, v (m) = [x (m), c (m)] T. Sice the augmeted local state is derived from the gloal state v, it ca e also assumed to have a Gaussia

6 298 S. J. BAEK ET AL. distriutio, ψ m ( v (m) ) exp { 1 [ v 2 (m) v (m)] T [ P (m)] 1 [ v (m) v (m)]}, (24) where v (m) is the ackgroud mea of the augmeted local state, ad P (m) is the ackgroud error covariace matrix for the augmeted local state. I this way, the dimesio of the space for data assimilatio is reduced to 2(2l + 1) for Bias Model I or II ad to 3(2l + 1) for Bias Model III. A importat property of this scheme is that it allows for (ad also requires) the estimatio of cross-correlatios etwee ucertaities i the state estimates ad ucertaities i the estimatio of the model ias terms. 3. Numerical experimets 3.1. Experimetal setup For testig our assimilatio scheme, we cosider the Lorez- 96 model (Lorez ad Emauel, 1998) which is defied y the system of differetial equatios, dx i = (x i+1 x i 2 )x i 1 x i +, i = 1,...,N, (25) where x 1 = x N 1, x 0 = x N, x N+1 = x 1 ad is a costat. The variales form a cyclic chai ad may e thought of as roughly aalogous to the values of some uspecified scalar meteorological quatity at N equally spaced sites alog a latitude circle. For compactess of otatio, we will also represet eq. (25) as dx = L(x), (26) where x = [x 1, x 2,...,x N ] T. We solve eq. (25) with a fourthorder Ruge Kutta method usig a time step of 0.05 dimesioless uits for which the system is computatioally stale. Lorez ad Emauel (1998) cosider this time step as roughly correspodig to 6 h of real atmospheric evolutio. With = 8.0 ad N = 40, Lorez ad Emauel demostrate that the system (25) results i a westward (i.e. i the directio of low idex of locatios) progressio of idividual maxima ad miima ad a eastward progressio of the ceter of activity with a domiat waveumer of 8. I additio, they also fid that the system is chaotic with 13 positive Lyapuov expoets ad a Lyapuov dimesio of Throughout our umerical experimets we use = 8.0 ad N = 40. I what follows we will assume that our forecast model dyamics is give y eq. (25) ut that the true dyamics of the system whose state we are cocered with oeys dyamics that may differ from those of our forecast model. We will cosider situatios i which the true dyamics differ from the forecast model i three ways, which we refer to as Type A truth ias, Type B truth ias, ad Type C truth ias. The dyamical ehaviors of the true system i these three cases are as follows: dx = L(x) + β (Type A), (27) dx = L(x + ζ) (Type B), (28) dx = L(x + ζ) + β (Type C), (29) where β = [β 1,β 2,...,β N ] T ad ζ = [ζ 1,ζ 2,...,ζ N ] T. Whe the true dyamics is descried y the same equatio [eq. (25)] as the forecast model, we say that the forecast model is perfect. Note that Bias Model I would e a atural choice if it were kow that the deviatio of the true dyamics from the model dyamics (26) was such that the true dyamics eloged to a family of systems of the form give y (27) (Type A truth ias). Similar statemets apply with regard to the relatio etwee Bias Model II ad Type B truth ias ad etwee Bias Model III ad Type C truth ias. With small values of β ad ζ, we cojecture that the systems (27) (29) exhiit ehaviors similar to those of system (25). I our umerical experimets, the elemets of β ad ζ vary i space (i) ad have the forms ( β i = A si 2π i 1 ), (30) N ( ζ i = B si 2π i 1 N ), i = 1,...,N, (31) where A ad B are scalar costats. The true states are geerated y itegratig oe of the three eqs. (27) (29), while the forecast model states are geerated y itegratig eq. (26). The evolutio operators, F t ad F m, are the itegratios of the aove eqs. (26) (29) from some time t to t + t where t = 0.05 ad the states are availale at every discrete time t = t 0 + t, where t 0 is the time at which a experimet egis ad is a positive iteger. We assume that the oservatios are availale at every time t for 0 ad the state variales themselves are directly oserved. Thus the oservatio operator i eqs. (9) ad (17) is the idetity operator [i.e. H (x) = x]. We also assume that the oservatioal oise ɛ has zero-expected value ad is ucorrelated, white ad Gaussia with variace σ 2. Thus the local oservatio error covariace matrix is a diagoal matrix whose compoets are σ 2. Correspodigly, we geerate our simulated oservatios (9) y addig ucorrelated Gaussia radom umers with variace σ 2 to the true state variales x t i ad form a local oservatio y (m) = [y,m l,...,y,m+l ] T. Throughout our umerical experimets, we take σ 2 = Data assimilatios are doe at every itegratio time t. The aalysis error is defied as e a = xa xt, (32) for Bias Model I, ad e a = xa + ca xt, (33)

7 LEKF FOR MODEL BIAS 299 for Bias Model II ad Bias Model III, where x a is the esemle mea of the aalysis ad where c a is the esemle mea of the estimate of the Type II ias. We use the root-mea-square (rms) of the aalysis error, RMS { } e a 1 = N N ( ) e a 2,,i (34) i=1 to assess the quality of the aalysis at a give time, ad the time mea of the rms error over a log time iterval T, e a = 1 T 0 +T = 0 +1 RMS { e a }, T 1, (35) to measure the overall performace of the assimilatio scheme. Here, 0 is the time we allow for the aalysis to coverge to the true state. To improve the aalyses i our umerical experimets, we employ variace iflatio, ˆP a (m) ˆP a (m) + μ k I k, (36) where ˆP a (m) is the local aalysis error covariace matrix defied i the iteral coordiate system (Ott et al., 2004a) whose asis is the set of eigevectors of the local ackgroud error covariace matrix P (m), μ is a iflatio coefficiet, ad = Trace{ ˆP a (m)}. This particular form of variace iflatio was proposed i Ott et al. (2004a) where it is referred to as ehaced variace iflatio. Ehaced variace iflatio has the effect of ehacig the estimated proaility of error i directios that formally show oly very small error proaility. [This modificatio of ˆP a (m) also modifies the esemle perturatios through the square root filter; see Ott et al. (2004a).] The geeral purpose of employig a variace iflatio is to correct for the loss of variace i the esemle due to o-liearities ad samplig errors. Most importatly, variace iflatio ca also stailize the Kalma filter i the presece of model errors, as it was show i Ott et al. (2004) for the Loraz-96 model ad i Whitaker et al. (2004) for the NCEP GFS model preparig a historical reaalysis data set. Sice variace iflatio schemes are computatioally less expesive tha the state augmetatio method, we hope to see that the techique we propose here lead to larger improvemets i the accuracy of the state estimates tha what ca e achieved y simply tuig the variace iflatio coefficiet μ. For the dimesio of local states used i the LEKF, we select 13 (i.e. l = 6) which is kow to e a good choice for the Lorez model (25) with = 8 ad N = 40 (Ott et al., 2004a). Hece, the augmeted local states have 26 dimesios for the states used i Bias Model I or Bias Model II, ad 39 dimesios for the states used i Bias Model III. I our umerical experimets, we choose the umer of esemle memers to e the same as the dimesio of the augmeted local states so that the local ackgroud error covariace matrix has full rak. This choice meas that the esemle size is 13 whe ias is ot estimated i the assimilatio, 26 whe Bias Model I or II is used, ad 39 whe Bias Model III is used. Thus we take ito accout the added dimesioality of the augmeted local states, aticipatig that this icreased dimesioality ecessitates correspodigly icreased esemle size i order to properly represet it. This icreased esemle size is part of the added computatioal cost that is paid i order to correct for model ias. I practice, for give computer resources, the eed for a large esemle may thus ecessitate cosideratio of eefit trade-offs amog esemle size, local domai size, model resolutio, etc. Fially, for ias evolutio [eqs. (8), (16), (19) ad (20)] we use G (x,, c) = ad G c (x,, c) = c, util Sectio 3.6 where we cosider differet evolutio Perfect forecast model We first test our ias models for the case of a perfect forecast model, i.e. for the case whe the true values of β ad ζ i eqs. (27) (29) are 0. I this case, the evolutio operators for the true state ad the forecast model state are idetical, F t = F m. I order to geerate the true states for this ru, we first itegrate eq. (25) for 10 4 time steps from a radom iitial coditio, allowig the system to approach its attractor. After this, we perform data assimilatio at every time step. The iitial esemle memers for the first data assimilatio are geerated y addig idepedet, zero mea, ormally distriuted radom umers of variace 1.3 to the true state at every spatial poit i. Before otaiig the rms time mea of the aalysis error (35), we ru data assimilatios to allow covergece. Past this time (deoted 0 ), it is foud that the rms aalysis error reaches a statistically steady state i which it fluctuates aout a temporally costat mea value which we deote e a. The data plotted i Fig. 6 show the time-averaged rms aalysis error (35) as a fuctio of the iflatio coefficiet μ (36). Here, the rms aalysis error is averaged over T = time steps. For the case i which o state augmetatio is employed i the assimilatio (data plotted as symols) the est performace is otaied ear μ = for which e a = The other three curves i Fig. 6 show the aalysis errors for the cases whe the same oservatios are assimilated with usig the three differet ias models of Sectio 2.4 i the state estimatio. I these cases, we try to estimate a ias that is zero i reality. The estimated ias terms ted to fluctuate aout zero, resultig i a slight ( 8%) icrease of the error. The aove results from examiig this case provide a stadard agaist which we ca compare results that we will susequetly otai for situatios with error i the forecast model. I Fig. 6, we see that the miima of e a appear at a lower iflatio coefficiet whe the states are augmeted y a estimate of the ias, (i.e. for Bias Models I ad III). I order to see why this occurs we cosider the local perturatios for the augmeted

8 300 S. J. BAEK ET AL Data assimilatio with Type A truth ias Fig. 6. Time-averaged rms aalysis error, e a, versus variace iflatio coefficiet, μ, for the perfect forecast model experimet: With a perfect forecast model, ay attempt to estimate ad correct for a ias results i slightly higher aalysis error. local ackgroud, δv (m) = v (m) v (m), (37) where {v (m)} are the esemle memers of the augmeted local ackgroud. These perturatios are used to estimate the local ackgroud error covariace matrix (Ott et al., 2004a) P (m) = V (m) [ V (m)] T, (38) where V (m) = k 1 2 [ δv (1) (m) δv (2) (m) δv (k+1) (m) ] (39) I this experimet, we perform data assimilatio usig the three augmeted local states as descried i Sectio 2.4 ad a uaugmeted state whe the true state is evolved usig eq. (27) with A = 0.2 = 1.6 i eq. (30) correspodig to Type A truth ias. Agai the forecast model state is evolved usig eq. (25). We ca approximate the ias t give y eq. (3) as follows. Recall that F t ad F m are the time t maps of the true dyamics [eq. (27)] ad the forecast model [eq. (26)] ad that eq. (3) is ased o the assumptio that x m (t 1 ) = x t (t 1 ). Takig the differece etwee the true equatio (27) ad the model equatio (26), d (xt x m ) = L(x t ) + β L(x m ) β, (41) the, itegratig eq. (41) for the time iterval t 1 t t with the iitial coditio x t (t 1 ) = x m (t 1 ) = x t 1, to otai t = x t (t ) x m (t ), yields t x t x m β = β t. (42) t 1 Usig eqs. (3) ad (42) we otai t β t. For the situatio i this sectio, t = 0.05, ad we have take β to e costat i time, β i ( = A si 2π i 1 ) N ( = 1.6 si 2π i 1 ). (43) N Time-averaged rms aalysis errors for each case are show i Fig. 7. I the case where the ias is ot estimated, the error is aroud at μ 0.7, which is still lower tha the rms error of the oisy oservatios. If we, however, augmet the state usig Bias Model I the error is reduced dramatically, ad slightly more if we augmet the state usig Bias Model III, yieldig e a = ad 0.061, respectively, at μ 10 5 [Fig. 7()]. If, however, we augmet the state usig Bias Model II, the the ad k + 1 is the umer of the local esemle memers. We rewrite eq. (37) usig eq. (7) as δv (m) = [ δx δ ] [ (m) = (m) δ x (m) + δ δ (m) ] (m), (40) where {δx (m)} are perturatios for the local ackgroud, x = Fm (x a j) 1 ), ad {δ( (m)} are perturatios for the local predictio for Bias Model I. I our experimets we oserve that {δ (m)} are oly weakly correlated with each other ad almost ucorrelated with {δ x (m)}. Effectively, therefore, ucorrelated radom vectors are added to the state perturatios {δ x (m)} i eq. (40). I cosequece, P (m) (38) is effectively iflated mostly o the diagoal compoets y the amout of the variace of {δ (m)}. (This effective iflatio created y usig eq. (7) to otai the ackgroud will also e oserved whe the forecast model is ot perfect as show i the followig susectios.) Fig. 7. Time-averaged rms aalysis error, e a, versus μ for the case of Type A truth ias: Note that () shows the same results as (a) for Bias Model I ad Bias Model III ut for a differet vertical scale.

9 LEKF FOR MODEL BIAS 301 Fig. 8. The average ias estimate of locatio i is show as. The approximate true ias β i t is show as the solid curve. rms error is aroud at μ 0.3, worse tha what is otaied whe o ias estimatio is employed. Here, we see agai that usig the uiased ackgroud (7) for data assimilatio effectively iflates the local ackgroud error covariace matrix, ad a smaller variace iflatio yields the lowest aalysis error, e a. The good results otaied whe the state is augmeted usig either Bias Model I or Bias Model III might reasoaly e ascried to the fact that estimatio of t ca e regarded as correctig for precisely the form of truth ias that is preset whe the truth evolves y eq. (27). I Fig. 8, we plot a, the time average of the esemle mea of the ias estimate, a = 1 T 0 +T = 0 +1 a, (44) a = 1 k+1 a( j), (45) k + 1 i=1 where T = 2000 ad 0 = , for the experimet with the state augmeted usig Bias Model I at μ = 10 5 (where the rms error is miimum i Fig. 7). We see that a agrees well with the approximatio to t give y (42) ad (43) (show as the solid curve). Also, although the shape is ot show here, for the case that the state is augmeted usig Bias Model III, a agai agrees well with (42) ad (43). We ow examie the aalysis errors usig Bias Model I ad III. I Fig. 9, we plot the aalysis error (32) averaged over 5000 time steps, e a = 1 T 0 +T = 0 +1 e a, (46) (here, T = 5000 ad 0 = ) for the case that o ias estimatio is performed i data assimilatio ( ), the case that the estimatio is performed usig Bias Model I i the assimilatio ( ), ad the case that the ias estimatio is performed usig Bias Model III ( ). The variace iflatio coefficiets are μ = 1.0, 10 5, ad 10 5, respectively, at which the errors, e a, are miimum for each case. I order to uderstad why Bias Model III does etter tha Bias Model I for this case, recall that oth models determie the ackgroud state x at time t y x = Fm (x a 1 ) + where Fig. 9. Time-average of the aalysis error as a fuctio of locatio: The Type A truth ias is corrected est whe we perform the assimilatio usig Bias Model III. is approximately costat i time [eqs. (7) ad (18)]. However, Bias Model I tries to make x close to xt, whereas Bias Model III tries to make x + c close to xt, where c is also approximately costat i time. Suppose that has coverged to the timeidepedet approximatio β t of t [see eq. (42)], that c has coverged to a costat vector c, ad that the aalysis at time t 1 is perfect: x a 1 + c = xt. Cosider the model trajectory x m (t) of eq. (26) with x m (t 1 ) = x a 1 ad the true trajectory x t (t) of eq. (27) with x t (t 1 ) = x t 1. The xt = xt (t ) ad x = xm (t ) +β t, ad the ackgroud is most accurate if x + c = xt. As i eq. (41), x t ( x + c) = x t (t ) ( x m (t ) + β t + c) = x t (t 1 ) ( x m (t 1 ) + β t + c ) t + [L(x t (t)) + β L(x m (t))] t 1 = x t 1 ( x a 1 + β t + c) = + t t t 1 [L(x t (t)) L(x m (t))] + β t t 1 [L(x t (t)) L(x m (t))]. (47) Thus, we desire that the average value of L (x t (t)) L(x m (t)) to e as small as possile over the iterval t 1 t t. Usig c = β t/2 makes this average zero to first order, ad is thus superior to usig c = 0, which correspods to Bias Model I. (see Fig. 10.) This is cofirmed i Fig. 11, from which oe oserves c a β t/2 i the experimet with Bias Model III.

10 302 S. J. BAEK ET AL. Fig. 10. Figure (a) depicts the case c = 0, correspodig Bias Model I, while figure () depicts the case c β/2 i Bias Model III. Fig. 11. The average ias estimate of locatio i is show as +. The the value of β i t/2 is show as the solid curve Data assimilatio with Type B truth ias I this experimet, we simulate a ias y evolvig the true state with eq. (28) with temporally costat ζ ad estimate it with three differet augmetatio methods as doe i Sectio 3.3. To otai the true value of c t, defied y (10), we use dc t = dxt dxm = L(x t + ζ) L(x m ) = L(x t + ζ) L(x t c t ). (48) A trivial solutio to eq. (48) is c t = ζ whose ith elemet is give y ( c t,i = B si 2π i 1 ) ( = 1.6 si 2π i 1 ), (49) N N where we take B = 0.2 = 1.6 i this experimet. The time-averaged rms aalysis errors for each case are show i Fig. 12. We see that, whe we augmet the state usig Bias Model II i the assimilatio, we ca correct for the ias. The miimum rms error for this assimilatio is aout ad occurs ear μ = The miimum rms error for the assimilatio with the augmeted state usig the Bias Model III is aout ad occurs at a lower μ value (as expected) of aout μ = Without ias correctio, the miimum rms error is ad occurs ear μ = 4.0, similar to what is otaied usig Bias Model I ( e a ear μ = 0.5). Also, due to the variace iflatio effect of Bias Model I, the est assimilatio result Fig. 12. Time-averaged rms aalysis error, e a, versus μ for the case of Type B truth ias. () has a differet vertical scale from (a) for trasparecy. with the augmeted state usig the Bias Model III occurs at a lower value of variace iflatio tha the assimilatio with the augmeted state usig Bias Model II. For the same reaso, the rms error, e a, for the case of assimilatio with the augmeted state usig Bias Model I has lower values i the regio of variace iflatio, 10 5 μ 1.0, tha for the case of assimilatio with o state augmetatio. We show c a i Fig. 13 for the case i which the state is augmeted usig Bias Model II at μ = It is see that the Fig. 13. Bias estimate for the Bias Model II is show as. The true ias (49) is show as the solid curve.

11 LEKF FOR MODEL BIAS Settlig time Fig. 14. Time-averaged rms aalysis error, e a, versus μ for the case i which the truth has Type C truth ias: I order to correct for the iases, the augmeted state used i the assimilatios must cotai oth the ad c ias estimates, Here, we agai use a differet vertical scale i () from (a) for trasparecy. result (plotted as ) agrees very well with eq. (49) (plotted as the solid lie). We otai the same result for c a whe the state is augmeted usig Bias Model III at μ = Data assimilatio with Type C truth ias Now, we comie the two iases i the truth [see eq. (29)], ad estimate them with three augmeted states as doe i previous sectios. I this case, we ca regard the Type A truth ias as added to a system that already has Type B truth ias. Hece, a differetial equatio for t ca e writte as Eve though the state augmeted LEKF ca correct for various iases i the true state, for the truth iases cosidered here it requires loger settlig time for the forecast model state to coverge toward the true state as compared to the LEKF without state augmetatio. We regard the time it takes for the rms aalysis error (34) to settle ear its time-averaged rms aalysis error (35) as the settlig time. With a perfect forecast model as i Sectio 3.2, the settlig time is aroud 50 time steps with the k + 1 = 13 esemle memers we are usig for the regular (i.e. without state augmetatio) LEKF assimilatio scheme. The settlig time, however, ecomes etwee 100 ad 200 time steps whe either Bias Model I or Bias Model II are used i the assimilatio to respectively correct for Type A or B truth ias. The logest settlig time, which is ear time steps, appears whe assimilatios are doe usig Bias Model III to correct for Type B ad Type C truth iases (whe usig Bias Model III to correct for Type A truth ias, we foud settlig times that were geerally elow 500). However, it turs out that we ca easily correct this prolem y usig a priori iformatio o the ias which could e otaied y lookig at the iovatio, the differece etwee the forecast ad the oservatio, d = H ( x ) y, (52) for the case whe o ias estimatio is performed. We plot the time-average of the iovatio i Fig. 15 for the case that o ias estimatios are performed eve though Type A, B or C truth ias is preset i the truth. Sice we take the oservatios to e uiased, we ca thik of the time averaged iovatio as the forecast ias. We see that these averages are large ad vary slowly i space. d t = L(x t + ζ) + β L(x t c t ), (50) where ζ ad β are costat i time i the preset experimet. A solutio to eq. (50) is d t = β if c t = ζ; (51) that is, the idividual true ias is the same as if the system has oly oe ias. The quatities β, ζ, are thus agai give y eqs. (43) ad (49). Figure 14 shows the resultig time-averaged rms aalysis error, e a, for each estimatio method. The est result is otaied usig Bias Model III. This might e aticipated sice augmetatio y oe ias estimate aloe caot satisfy the solutio (51). The miimum rms error is aroud ad occurs ear ; this is the same as i the previous experimets. The other assimilatio methods yields e a at μ 4.0 without state augmetatio, e a at μ 0.5 usig Bias Model I, ad e a at μ 0.3 usig Bias Model II. Fig. 15. Time-averaged iovatio for the case that o ias estimatio is performed with various iases i the truth.

12 304 S. J. BAEK ET AL. I the previous experimets, the iitial esemle variace for the ias estimate is 0.1. By icreasig the iitial variace to 1.0 (somewhat larger tha the spread i the time-averaged iovatios), we ca dramatically decrease the logest settlig time from time steps to 800 time steps, while for the case that the settlig time is already small (etwee 100 ad 200 time steps) o sigificat chage i the settlig time is oserved. We ca decrease the settlig time further if we exploit the fact that the iases vary slowly i space. To icorporate this added kowledge ito our data assimilatio scheme we ow use a diffusio process for the time evolutio, eqs. (8) ad (16), of the iases, +1,i = (1 2α ) a,i + α a,i 1 + α a,i+1, (53) c +1,i = (1 2α c )c a,i + α cc a,i 1 + α cc a,i+1, (54) where α ad α c are diffusio coefficiets. By itroducig diffusio i this way, rapid spatial variatio of the ias estimates is damped, leadig to smooth spatial variatio cosistet with the actual case, eqs. (30) ad (31), ad the evidece of Fig. 15. Our experimets show that there is a modest improvemet i the settlig time i the case that there is oe type of ias i the truth (truth ias A or B) ad that it is corrected usig the correspodig ias model (Bias Model I or II, respectively); the settlig time is decreased from etwee 100 ad 200 time steps to etwee 80 ad 130 time steps whe α (or α c ) is icreased from zero to α = 0.01 (or α c = 0.01). Whe we cosider the case of Type C truth ias ad augmet the state usig Bias Model III, o-zero α diffusio (with α c = 0) ca achieve a large decrease i the settlig time, from 800 time steps to 300 time steps. All of the decreases i settlig time we have descried come without sigificat icrease i the time-averaged rms aalysis error e a. We fid that usig diffusive evolutio o ias estimates actually decreases e a i some cases. Figure 16 shows the time asymptotic aalysis errors as a fuctio of α for the case of Type C truth ias ad Bias Model III assimilatio. We see that a small amout of diffusio, i additio to shorteig the settlig time, also improves the time asymptotic performace of the assimilatio. This improvemet is ot see i the experimets with Bias Model I ad II. Fially, we ote that if diffusio [eqs. (53) ad (54)] is added i the perfect forecast model case (Sectio 3.2), all three cases of augmetatio have the same values of rms aalysis error as that of the uaugmeted case. That is, curves correspodig to the four cases i Fig. 6 have the same miimum values with appropriate amouts of diffusio. Evidetly diffused evolutio of the ias estimate allows the estimate to coverge to the truth faster, ad also reduces the rms aalysis error of the state augmeted estimates A simple state-depedet model error I this sectio, we itroduce a simple model error, γ x 2 i, which is proportioal to the square of the state variale. That is, the Fig. 16. Time-averaged rms aalysis error, e a, versus μ with various α ad α c = 0 for the case of Type C truth ias corrected usig Bias Model III: Small diffusio improves the performace of the assimilatio up to α = dyamic equatio for the true system is as follows: dx i = (x i+1 x i 2 )x i 1 x i γ x 2 i +, i = 1,...,N, (55) where γ = 0.05 ad = Here, is icreased to maitai chaotic ehavior of the true dyamics (itroducig γ x i 2 without chagig from its previous value of = 8.0 results i domiace of time periodic ehavior of the true dyamics). For the forecast model, we use eq. (25) with = Through the umerical experimet, we otai the time average γ x i at each poit i while γ x i 2 itself has large temporal fluctuatios ragig from 0 to aroud 10. The task we udertake here is to successfully estimate the time mea effect of the model error, γ x i 2, with our ias estimatio schemes. Usig aalysis similar to that i eqs. (41) ad (42), we otai t t (x ) i γ (x t i )2 t 2 γ i t, (56) t 1 ad hece i t for each locatio i. I Fig. 17, we plot the rms aalysis errors of the umerical experimets. Without ias estimatio the miimum rms aalysis error e a is otaied at μ 1.0. Amog the three ias models, Bias Model I produces the est result, e a at μ I terms of the differece with the error i the perfect model case ( e a 0.057), this represets a 12% improvemet toward the perfect model performace. If we employ diffusive evolutio (with α = 0.05), we ca further decrease the rms error to otai e a at μ 0.09 ad 18% improvemet toward the perfect model performace. I oth cases (with ad without diffusio), we otai i a 0.05, which is a good

13 LEKF FOR MODEL BIAS 305 To evaluate the performace of the proposed ias models for use i augmeted esemle Kalma filterig, we carried out experimets with the Lorez-96 model. While we used the origial model equatio of Lorez ad Emauel (1998) to evolve the model state, we employed altered versios of Lorez ad Emauel s equatio to geerate sets of time-series of the true states. Each alteratio of the equatio correspoded to distictly differet types of model iases. The mai results of these umerical experimets are the followig. Fig. 17. Time-averaged rms aalysis error, e a, versus μ with the simple state-depedet model error: With Bias Model I ad diffusio process, we ca improve the performace i terms of the rms aalysis error. estimate of i t, with smaller spatial variatios whe we use diffusio. We also fid that the performace of the assimilatio with Bias Model I is ot sesitive to the selectio of i the model equatio while the performace of the assimilatio without ias estimatio is sesitive to the selectio of. We ca also achieve the same performace with Bias Model III with appropriate diffusio (α = 0.05, α c = 0.2), ut we caot achieve it with Bias Model II. We cojecture that the reaso is ecause the form of the ias i eq. (55) is closer to Type A truth ias tha Type B. 4. Coclusios ad discussio I this paper, we cosidered three ias models for use i state space augmetatio strategies to mitigate the effects of model iases o forecasts. (i) Bias Model I is ased o the assumptio that the est ackgroud iformatio is otaied whe the iitial coditio of the short-term forecast that provides the ackgroud (the aalysis at the previous assimilatio time) is as close to the truth as possile. (ii) Bias Model II is ased o the assumptio that there exists a trasformatio from orits o the attractor of the forecast model to orits o the attractor of the true system. (iii) Bias Model III comies Bias Model I ad Bias Model II. While Bias Model I was cosidered y others i earlier papers for schemes other tha the LEKF, Bias Model II ad Bias Model III are (to the est of our kowledge) first itroduced i the preset paper. (i) The effectiveess of the differet ias models strogly depeds o the actual form of the true model ias. I our umerical experimets it was foud that whe the ias model was suited to the ias of the forecast model i modelig the true dyamics, the good results were otaied. However, whe this was ot the case, the results were ot improved y the model ias correctio scheme. This suggests that serious cosideratio of the choice of the ias model may e crucial i otaiig a successful scheme for model ias mitigatio. (ii) For the ias models we cosidered, Bias Model III performed as well or etter tha the other ias models i terms of average aalysis error, at the expese of requirig a larger esemle ad i some cases icreasig the settlig time. I most cases, the iclusio of parameters that were ot preset i the model ias did ot yield improved performace. However, i the case of Type A truth ias, Bias Model III did outperform Bias Model I, due to the fact that the model ias was added to a cotiuous time forecast model, while the ias correctio was applied at discrete times (see Sectio 3.3). (iii) We foud (Sectio 3.6) that the model ias correctio scheme took may more iteratio steps to coverge tha i the case i which o model iases are preset. The settlig time strogly depeds o the actual model ias, ad o the ias model employed. As a result of the possiility of log settlig times, oe might aticipate that use of these model correctio schemes may ecome prolematic. We ca, however, dramatically reduce the settlig time y icrease of the iitial esemle spread of the ias estimates. Moreover, whe the model ias is slowly varyig i space, we demostrated that choosig a diffusive evolutio of the model ias ca also reduce the settlig time. (iv) I a case with state-depedet, ad thus time-varyig, additive model error (Sectio 3.7), Bias Model I estimated a model ias that was close to the time average of the model error. I this sese, it foud the est estimate of the model error withi our costat-i-time parameterizatio. The improvemet i performace compared to o ias estimatio was modest ut sigificat. Fially, we ote that state space augmetatio is ot the oly way to accout for the effect of model errors i the state estimatio process. As we metioed earlier, variace iflatio (oth additive ad multiplicative) ca improve the resiliece of Kalma filter schemes to the effects of model errors. Promisig results were achieved y employig additive variace iflatio schemes

A Simplified Derivation of Scalar Kalman Filter using Bayesian Probability Theory

A Simplified Derivation of Scalar Kalman Filter using Bayesian Probability Theory 6th Iteratioal Workshop o Aalysis of Dyamic Measuremets Jue -3 0 Göteorg Swede A Simplified Derivatio of Scalar Kalma Filter usig Bayesia Proaility Theory Gregory Kyriazis Imetro - Electrical Metrology

More information

6.3 Testing Series With Positive Terms

6.3 Testing Series With Positive Terms 6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial

More information

Random Variables, Sampling and Estimation

Random Variables, Sampling and Estimation Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig

More information

Discrete-Time Systems, LTI Systems, and Discrete-Time Convolution

Discrete-Time Systems, LTI Systems, and Discrete-Time Convolution EEL5: Discrete-Time Sigals ad Systems. Itroductio I this set of otes, we begi our mathematical treatmet of discrete-time s. As show i Figure, a discrete-time operates or trasforms some iput sequece x [

More information

Chapter 6 Sampling Distributions

Chapter 6 Sampling Distributions Chapter 6 Samplig Distributios 1 I most experimets, we have more tha oe measuremet for ay give variable, each measuremet beig associated with oe radomly selected a member of a populatio. Hece we eed to

More information

Chapter 10: Power Series

Chapter 10: Power Series Chapter : Power Series 57 Chapter Overview: Power Series The reaso series are part of a Calculus course is that there are fuctios which caot be itegrated. All power series, though, ca be itegrated because

More information

Infinite Sequences and Series

Infinite Sequences and Series Chapter 6 Ifiite Sequeces ad Series 6.1 Ifiite Sequeces 6.1.1 Elemetary Cocepts Simply speakig, a sequece is a ordered list of umbers writte: {a 1, a 2, a 3,...a, a +1,...} where the elemets a i represet

More information

Lecture 2: Monte Carlo Simulation

Lecture 2: Monte Carlo Simulation STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: Ye-Chi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?

More information

THE KALMAN FILTER RAUL ROJAS

THE KALMAN FILTER RAUL ROJAS THE KALMAN FILTER RAUL ROJAS Abstract. This paper provides a getle itroductio to the Kalma filter, a umerical method that ca be used for sesor fusio or for calculatio of trajectories. First, we cosider

More information

CEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering

CEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering CEE 5 Autum 005 Ucertaity Cocepts for Geotechical Egieerig Basic Termiology Set A set is a collectio of (mutually exclusive) objects or evets. The sample space is the (collectively exhaustive) collectio

More information

Statistics 511 Additional Materials

Statistics 511 Additional Materials Cofidece Itervals o mu Statistics 511 Additioal Materials This topic officially moves us from probability to statistics. We begi to discuss makig ifereces about the populatio. Oe way to differetiate probability

More information

A statistical method to determine sample size to estimate characteristic value of soil parameters

A statistical method to determine sample size to estimate characteristic value of soil parameters A statistical method to determie sample size to estimate characteristic value of soil parameters Y. Hojo, B. Setiawa 2 ad M. Suzuki 3 Abstract Sample size is a importat factor to be cosidered i determiig

More information

Properties and Hypothesis Testing

Properties and Hypothesis Testing Chapter 3 Properties ad Hypothesis Testig 3.1 Types of data The regressio techiques developed i previous chapters ca be applied to three differet kids of data. 1. Cross-sectioal data. 2. Time series data.

More information

CHAPTER 5. Theory and Solution Using Matrix Techniques

CHAPTER 5. Theory and Solution Using Matrix Techniques A SERIES OF CLASS NOTES FOR 2005-2006 TO INTRODUCE LINEAR AND NONLINEAR PROBLEMS TO ENGINEERS, SCIENTISTS, AND APPLIED MATHEMATICIANS DE CLASS NOTES 3 A COLLECTION OF HANDOUTS ON SYSTEMS OF ORDINARY DIFFERENTIAL

More information

Chapter 4. Fourier Series

Chapter 4. Fourier Series Chapter 4. Fourier Series At this poit we are ready to ow cosider the caoical equatios. Cosider, for eample the heat equatio u t = u, < (4.) subject to u(, ) = si, u(, t) = u(, t) =. (4.) Here,

More information

Information-based Feature Selection

Information-based Feature Selection Iformatio-based Feature Selectio Farza Faria, Abbas Kazeroui, Afshi Babveyh Email: {faria,abbask,afshib}@staford.edu 1 Itroductio Feature selectio is a topic of great iterest i applicatios dealig with

More information

Chapter 9: Numerical Differentiation

Chapter 9: Numerical Differentiation 178 Chapter 9: Numerical Differetiatio Numerical Differetiatio Formulatio of equatios for physical problems ofte ivolve derivatives (rate-of-chage quatities, such as velocity ad acceleratio). Numerical

More information

Lesson 10: Limits and Continuity

Lesson 10: Limits and Continuity www.scimsacademy.com Lesso 10: Limits ad Cotiuity SCIMS Academy 1 Limit of a fuctio The cocept of limit of a fuctio is cetral to all other cocepts i calculus (like cotiuity, derivative, defiite itegrals

More information

The z-transform. 7.1 Introduction. 7.2 The z-transform Derivation of the z-transform: x[n] = z n LTI system, h[n] z = re j

The z-transform. 7.1 Introduction. 7.2 The z-transform Derivation of the z-transform: x[n] = z n LTI system, h[n] z = re j The -Trasform 7. Itroductio Geeralie the complex siusoidal represetatio offered by DTFT to a represetatio of complex expoetial sigals. Obtai more geeral characteristics for discrete-time LTI systems. 7.

More information

Kinetics of Complex Reactions

Kinetics of Complex Reactions Kietics of Complex Reactios by Flick Colema Departmet of Chemistry Wellesley College Wellesley MA 28 wcolema@wellesley.edu Copyright Flick Colema 996. All rights reserved. You are welcome to use this documet

More information

Discrete Mathematics for CS Spring 2008 David Wagner Note 22

Discrete Mathematics for CS Spring 2008 David Wagner Note 22 CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 22 I.I.D. Radom Variables Estimatig the bias of a coi Questio: We wat to estimate the proportio p of Democrats i the US populatio, by takig

More information

ENGI 4421 Confidence Intervals (Two Samples) Page 12-01

ENGI 4421 Confidence Intervals (Two Samples) Page 12-01 ENGI 44 Cofidece Itervals (Two Samples) Page -0 Two Sample Cofidece Iterval for a Differece i Populatio Meas [Navidi sectios 5.4-5.7; Devore chapter 9] From the cetral limit theorem, we kow that, for sufficietly

More information

GRAPHING LINEAR EQUATIONS. Linear Equations ( 3,1 ) _x-axis. Origin ( 0, 0 ) Slope = change in y change in x. Equation for l 1.

GRAPHING LINEAR EQUATIONS. Linear Equations ( 3,1 ) _x-axis. Origin ( 0, 0 ) Slope = change in y change in x. Equation for l 1. GRAPHING LINEAR EQUATIONS Quadrat II Quadrat I ORDERED PAIR: The first umer i the ordered pair is the -coordiate ad the secod umer i the ordered pair is the y-coordiate. (,1 ) Origi ( 0, 0 ) _-ais Liear

More information

TR/46 OCTOBER THE ZEROS OF PARTIAL SUMS OF A MACLAURIN EXPANSION A. TALBOT

TR/46 OCTOBER THE ZEROS OF PARTIAL SUMS OF A MACLAURIN EXPANSION A. TALBOT TR/46 OCTOBER 974 THE ZEROS OF PARTIAL SUMS OF A MACLAURIN EXPANSION by A. TALBOT .. Itroductio. A problem i approximatio theory o which I have recetly worked [] required for its solutio a proof that the

More information

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 3 LOSSY IMAGE COMPRESSION SYSEMS Versio ECE II, Kharagpur Lesso 8 rasform Codig & K-L rasforms Versio ECE II, Kharagpur Istructioal Oectives At the ed of this lesso, the studets should e ale to:.

More information

x a x a Lecture 2 Series (See Chapter 1 in Boas)

x a x a Lecture 2 Series (See Chapter 1 in Boas) Lecture Series (See Chapter i Boas) A basic ad very powerful (if pedestria, recall we are lazy AD smart) way to solve ay differetial (or itegral) equatio is via a series expasio of the correspodig solutio

More information

Data Assimilation. Alan O Neill University of Reading, UK

Data Assimilation. Alan O Neill University of Reading, UK Data Assimilatio Ala O Neill Uiversity of Readig, UK he Kalma Filter Kalma Filter (expesive Use model equatios to propagate B forward i time. B B(t Aalysis step as i OI Evolutio of Covariace Matrices (

More information

Lecture 22: Review for Exam 2. 1 Basic Model Assumptions (without Gaussian Noise)

Lecture 22: Review for Exam 2. 1 Basic Model Assumptions (without Gaussian Noise) Lecture 22: Review for Exam 2 Basic Model Assumptios (without Gaussia Noise) We model oe cotiuous respose variable Y, as a liear fuctio of p umerical predictors, plus oise: Y = β 0 + β X +... β p X p +

More information

Statistical Pattern Recognition

Statistical Pattern Recognition Statistical Patter Recogitio Classificatio: No-Parametric Modelig Hamid R. Rabiee Jafar Muhammadi Sprig 2014 http://ce.sharif.edu/courses/92-93/2/ce725-2/ Ageda Parametric Modelig No-Parametric Modelig

More information

CHAPTER 10 INFINITE SEQUENCES AND SERIES

CHAPTER 10 INFINITE SEQUENCES AND SERIES CHAPTER 10 INFINITE SEQUENCES AND SERIES 10.1 Sequeces 10.2 Ifiite Series 10.3 The Itegral Tests 10.4 Compariso Tests 10.5 The Ratio ad Root Tests 10.6 Alteratig Series: Absolute ad Coditioal Covergece

More information

Physics 324, Fall Dirac Notation. These notes were produced by David Kaplan for Phys. 324 in Autumn 2001.

Physics 324, Fall Dirac Notation. These notes were produced by David Kaplan for Phys. 324 in Autumn 2001. Physics 324, Fall 2002 Dirac Notatio These otes were produced by David Kapla for Phys. 324 i Autum 2001. 1 Vectors 1.1 Ier product Recall from liear algebra: we ca represet a vector V as a colum vector;

More information

ANALYSIS OF EXPERIMENTAL ERRORS

ANALYSIS OF EXPERIMENTAL ERRORS ANALYSIS OF EXPERIMENTAL ERRORS All physical measuremets ecoutered i the verificatio of physics theories ad cocepts are subject to ucertaities that deped o the measurig istrumets used ad the coditios uder

More information

The Method of Least Squares. To understand least squares fitting of data.

The Method of Least Squares. To understand least squares fitting of data. The Method of Least Squares KEY WORDS Curve fittig, least square GOAL To uderstad least squares fittig of data To uderstad the least squares solutio of icosistet systems of liear equatios 1 Motivatio Curve

More information

U8L1: Sec Equations of Lines in R 2

U8L1: Sec Equations of Lines in R 2 MCVU U8L: Sec. 8.9. Equatios of Lies i R Review of Equatios of a Straight Lie (-D) Cosider the lie passig through A (-,) with slope, as show i the diagram below. I poit slope form, the equatio of the lie

More information

Stochastic Simulation

Stochastic Simulation Stochastic Simulatio 1 Itroductio Readig Assigmet: Read Chapter 1 of text. We shall itroduce may of the key issues to be discussed i this course via a couple of model problems. Model Problem 1 (Jackso

More information

Basics of Probability Theory (for Theory of Computation courses)

Basics of Probability Theory (for Theory of Computation courses) Basics of Probability Theory (for Theory of Computatio courses) Oded Goldreich Departmet of Computer Sciece Weizma Istitute of Sciece Rehovot, Israel. oded.goldreich@weizma.ac.il November 24, 2008 Preface.

More information

Linear Regression Demystified

Linear Regression Demystified Liear Regressio Demystified Liear regressio is a importat subject i statistics. I elemetary statistics courses, formulae related to liear regressio are ofte stated without derivatio. This ote iteds to

More information

OPTIMAL ALGORITHMS -- SUPPLEMENTAL NOTES

OPTIMAL ALGORITHMS -- SUPPLEMENTAL NOTES OPTIMAL ALGORITHMS -- SUPPLEMENTAL NOTES Peter M. Maurer Why Hashig is θ(). As i biary search, hashig assumes that keys are stored i a array which is idexed by a iteger. However, hashig attempts to bypass

More information

GUIDELINES ON REPRESENTATIVE SAMPLING

GUIDELINES ON REPRESENTATIVE SAMPLING DRUGS WORKING GROUP VALIDATION OF THE GUIDELINES ON REPRESENTATIVE SAMPLING DOCUMENT TYPE : REF. CODE: ISSUE NO: ISSUE DATE: VALIDATION REPORT DWG-SGL-001 002 08 DECEMBER 2012 Ref code: DWG-SGL-001 Issue

More information

Chapter 3. Strong convergence. 3.1 Definition of almost sure convergence

Chapter 3. Strong convergence. 3.1 Definition of almost sure convergence Chapter 3 Strog covergece As poited out i the Chapter 2, there are multiple ways to defie the otio of covergece of a sequece of radom variables. That chapter defied covergece i probability, covergece i

More information

Product measures, Tonelli s and Fubini s theorems For use in MAT3400/4400, autumn 2014 Nadia S. Larsen. Version of 13 October 2014.

Product measures, Tonelli s and Fubini s theorems For use in MAT3400/4400, autumn 2014 Nadia S. Larsen. Version of 13 October 2014. Product measures, Toelli s ad Fubii s theorems For use i MAT3400/4400, autum 2014 Nadia S. Larse Versio of 13 October 2014. 1. Costructio of the product measure The purpose of these otes is to preset the

More information

Sequences. Notation. Convergence of a Sequence

Sequences. Notation. Convergence of a Sequence Sequeces A sequece is essetially just a list. Defiitio (Sequece of Real Numbers). A sequece of real umbers is a fuctio Z (, ) R for some real umber. Do t let the descriptio of the domai cofuse you; it

More information

Math 113, Calculus II Winter 2007 Final Exam Solutions

Math 113, Calculus II Winter 2007 Final Exam Solutions Math, Calculus II Witer 7 Fial Exam Solutios (5 poits) Use the limit defiitio of the defiite itegral ad the sum formulas to compute x x + dx The check your aswer usig the Evaluatio Theorem Solutio: I this

More information

Streamfunction-Vorticity Formulation

Streamfunction-Vorticity Formulation Streamfuctio-Vorticity Formulatio A. Salih Departmet of Aerospace Egieerig Idia Istitute of Space Sciece ad Techology, Thiruvaathapuram March 2013 The streamfuctio-vorticity formulatio was amog the first

More information

PSYCHOLOGICAL RESEARCH (PYC 304-C) Lecture 9

PSYCHOLOGICAL RESEARCH (PYC 304-C) Lecture 9 Hypothesis testig PSYCHOLOGICAL RESEARCH (PYC 34-C Lecture 9 Statistical iferece is that brach of Statistics i which oe typically makes a statemet about a populatio based upo the results of a sample. I

More information

(A sequence also can be thought of as the list of function values attained for a function f :ℵ X, where f (n) = x n for n 1.) x 1 x N +k x N +4 x 3

(A sequence also can be thought of as the list of function values attained for a function f :ℵ X, where f (n) = x n for n 1.) x 1 x N +k x N +4 x 3 MATH 337 Sequeces Dr. Neal, WKU Let X be a metric space with distace fuctio d. We shall defie the geeral cocept of sequece ad limit i a metric space, the apply the results i particular to some special

More information

EECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1

EECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1 EECS564 Estimatio, Filterig, ad Detectio Hwk 2 Sols. Witer 25 4. Let Z be a sigle observatio havig desity fuctio where. p (z) = (2z + ), z (a) Assumig that is a oradom parameter, fid ad plot the maximum

More information

Vector Quantization: a Limiting Case of EM

Vector Quantization: a Limiting Case of EM . Itroductio & defiitios Assume that you are give a data set X = { x j }, j { 2,,, }, of d -dimesioal vectors. The vector quatizatio (VQ) problem requires that we fid a set of prototype vectors Z = { z

More information

Math 113 Exam 3 Practice

Math 113 Exam 3 Practice Math Exam Practice Exam will cover.-.9. This sheet has three sectios. The first sectio will remid you about techiques ad formulas that you should kow. The secod gives a umber of practice questios for you

More information

Math 2784 (or 2794W) University of Connecticut

Math 2784 (or 2794W) University of Connecticut ORDERS OF GROWTH PAT SMITH Math 2784 (or 2794W) Uiversity of Coecticut Date: Mar. 2, 22. ORDERS OF GROWTH. Itroductio Gaiig a ituitive feel for the relative growth of fuctios is importat if you really

More information

Problem Set 4 Due Oct, 12

Problem Set 4 Due Oct, 12 EE226: Radom Processes i Systems Lecturer: Jea C. Walrad Problem Set 4 Due Oct, 12 Fall 06 GSI: Assae Gueye This problem set essetially reviews detectio theory ad hypothesis testig ad some basic otios

More information

Beurling Integers: Part 2

Beurling Integers: Part 2 Beurlig Itegers: Part 2 Isomorphisms Devi Platt July 11, 2015 1 Prime Factorizatio Sequeces I the last article we itroduced the Beurlig geeralized itegers, which ca be represeted as a sequece of real umbers

More information

10. Comparative Tests among Spatial Regression Models. Here we revisit the example in Section 8.1 of estimating the mean of a normal random

10. Comparative Tests among Spatial Regression Models. Here we revisit the example in Section 8.1 of estimating the mean of a normal random Part III. Areal Data Aalysis 0. Comparative Tests amog Spatial Regressio Models While the otio of relative likelihood values for differet models is somewhat difficult to iterpret directly (as metioed above),

More information

September 2012 C1 Note. C1 Notes (Edexcel) Copyright - For AS, A2 notes and IGCSE / GCSE worksheets 1

September 2012 C1 Note. C1 Notes (Edexcel) Copyright   - For AS, A2 notes and IGCSE / GCSE worksheets 1 September 0 s (Edecel) Copyright www.pgmaths.co.uk - For AS, A otes ad IGCSE / GCSE worksheets September 0 Copyright www.pgmaths.co.uk - For AS, A otes ad IGCSE / GCSE worksheets September 0 Copyright

More information

Econ 325 Notes on Point Estimator and Confidence Interval 1 By Hiro Kasahara

Econ 325 Notes on Point Estimator and Confidence Interval 1 By Hiro Kasahara Poit Estimator Eco 325 Notes o Poit Estimator ad Cofidece Iterval 1 By Hiro Kasahara Parameter, Estimator, ad Estimate The ormal probability desity fuctio is fully characterized by two costats: populatio

More information

ECE 8527: Introduction to Machine Learning and Pattern Recognition Midterm # 1. Vaishali Amin Fall, 2015

ECE 8527: Introduction to Machine Learning and Pattern Recognition Midterm # 1. Vaishali Amin Fall, 2015 ECE 8527: Itroductio to Machie Learig ad Patter Recogitio Midterm # 1 Vaishali Ami Fall, 2015 tue39624@temple.edu Problem No. 1: Cosider a two-class discrete distributio problem: ω 1 :{[0,0], [2,0], [2,2],

More information

Chapter 6 Principles of Data Reduction

Chapter 6 Principles of Data Reduction Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a

More information

FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures

FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING Lectures MODULE 5 STATISTICS II. Mea ad stadard error of sample data. Biomial distributio. Normal distributio 4. Samplig 5. Cofidece itervals

More information

Analysis of Algorithms. Introduction. Contents

Analysis of Algorithms. Introduction. Contents Itroductio The focus of this module is mathematical aspects of algorithms. Our mai focus is aalysis of algorithms, which meas evaluatig efficiecy of algorithms by aalytical ad mathematical methods. We

More information

Similarity Solutions to Unsteady Pseudoplastic. Flow Near a Moving Wall

Similarity Solutions to Unsteady Pseudoplastic. Flow Near a Moving Wall Iteratioal Mathematical Forum, Vol. 9, 04, o. 3, 465-475 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/0.988/imf.04.48 Similarity Solutios to Usteady Pseudoplastic Flow Near a Movig Wall W. Robi Egieerig

More information

L 5 & 6: RelHydro/Basel. f(x)= ( ) f( ) ( ) ( ) ( ) n! 1! 2! 3! If the TE of f(x)= sin(x) around x 0 is: sin(x) = x - 3! 5!

L 5 & 6: RelHydro/Basel. f(x)= ( ) f( ) ( ) ( ) ( ) n! 1! 2! 3! If the TE of f(x)= sin(x) around x 0 is: sin(x) = x - 3! 5! aylor epasio: Let ƒ() be a ifiitely differetiable real fuctio. At ay poit i the eighbourhood of =0, the fuctio ca be represeted as a power series of the followig form: X 0 f(a) f() ƒ() f()= ( ) f( ) (

More information

Comparison Study of Series Approximation. and Convergence between Chebyshev. and Legendre Series

Comparison Study of Series Approximation. and Convergence between Chebyshev. and Legendre Series Applied Mathematical Scieces, Vol. 7, 03, o. 6, 3-337 HIKARI Ltd, www.m-hikari.com http://d.doi.org/0.988/ams.03.3430 Compariso Study of Series Approimatio ad Covergece betwee Chebyshev ad Legedre Series

More information

Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.

Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n. Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator

More information

Discrete Orthogonal Moment Features Using Chebyshev Polynomials

Discrete Orthogonal Moment Features Using Chebyshev Polynomials Discrete Orthogoal Momet Features Usig Chebyshev Polyomials R. Mukuda, 1 S.H.Og ad P.A. Lee 3 1 Faculty of Iformatio Sciece ad Techology, Multimedia Uiversity 75450 Malacca, Malaysia. Istitute of Mathematical

More information

Abstract Vector Spaces. Abstract Vector Spaces

Abstract Vector Spaces. Abstract Vector Spaces Astract Vector Spaces The process of astractio is critical i egieerig! Physical Device Data Storage Vector Space MRI machie Optical receiver 0 0 1 0 1 0 0 1 Icreasig astractio 6.1 Astract Vector Spaces

More information

TMA4205 Numerical Linear Algebra. The Poisson problem in R 2 : diagonalization methods

TMA4205 Numerical Linear Algebra. The Poisson problem in R 2 : diagonalization methods TMA4205 Numerical Liear Algebra The Poisso problem i R 2 : diagoalizatio methods September 3, 2007 c Eiar M Røquist Departmet of Mathematical Scieces NTNU, N-749 Trodheim, Norway All rights reserved A

More information

The standard deviation of the mean

The standard deviation of the mean Physics 6C Fall 20 The stadard deviatio of the mea These otes provide some clarificatio o the distictio betwee the stadard deviatio ad the stadard deviatio of the mea.. The sample mea ad variace Cosider

More information

Sequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence

Sequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece 1, 1, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet

More information

A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence

A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece,, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet as

More information

On Random Line Segments in the Unit Square

On Random Line Segments in the Unit Square O Radom Lie Segmets i the Uit Square Thomas A. Courtade Departmet of Electrical Egieerig Uiversity of Califoria Los Ageles, Califoria 90095 Email: tacourta@ee.ucla.edu I. INTRODUCTION Let Q = [0, 1] [0,

More information

3. Z Transform. Recall that the Fourier transform (FT) of a DT signal xn [ ] is ( ) [ ] = In order for the FT to exist in the finite magnitude sense,

3. Z Transform. Recall that the Fourier transform (FT) of a DT signal xn [ ] is ( ) [ ] = In order for the FT to exist in the finite magnitude sense, 3. Z Trasform Referece: Etire Chapter 3 of text. Recall that the Fourier trasform (FT) of a DT sigal x [ ] is ω ( ) [ ] X e = j jω k = xe I order for the FT to exist i the fiite magitude sese, S = x [

More information

Nonlinear regression

Nonlinear regression oliear regressio How to aalyse data? How to aalyse data? Plot! How to aalyse data? Plot! Huma brai is oe the most powerfull computatioall tools Works differetly tha a computer What if data have o liear

More information

1 Inferential Methods for Correlation and Regression Analysis

1 Inferential Methods for Correlation and Regression Analysis 1 Iferetial Methods for Correlatio ad Regressio Aalysis I the chapter o Correlatio ad Regressio Aalysis tools for describig bivariate cotiuous data were itroduced. The sample Pearso Correlatio Coefficiet

More information

If, for instance, we were required to test whether the population mean μ could be equal to a certain value μ

If, for instance, we were required to test whether the population mean μ could be equal to a certain value μ STATISTICAL INFERENCE INTRODUCTION Statistical iferece is that brach of Statistics i which oe typically makes a statemet about a populatio based upo the results of a sample. I oesample testig, we essetially

More information

Chapter 7: Numerical Series

Chapter 7: Numerical Series Chapter 7: Numerical Series Chapter 7 Overview: Sequeces ad Numerical Series I most texts, the topic of sequeces ad series appears, at first, to be a side topic. There are almost o derivatives or itegrals

More information

We are mainly going to be concerned with power series in x, such as. (x)} converges - that is, lims N n

We are mainly going to be concerned with power series in x, such as. (x)} converges - that is, lims N n Review of Power Series, Power Series Solutios A power series i x - a is a ifiite series of the form c (x a) =c +c (x a)+(x a) +... We also call this a power series cetered at a. Ex. (x+) is cetered at

More information

DS 100: Principles and Techniques of Data Science Date: April 13, Discussion #10

DS 100: Principles and Techniques of Data Science Date: April 13, Discussion #10 DS 00: Priciples ad Techiques of Data Sciece Date: April 3, 208 Name: Hypothesis Testig Discussio #0. Defie these terms below as they relate to hypothesis testig. a) Data Geeratio Model: Solutio: A set

More information

Kolmogorov-Smirnov type Tests for Local Gaussianity in High-Frequency Data

Kolmogorov-Smirnov type Tests for Local Gaussianity in High-Frequency Data Proceedigs 59th ISI World Statistics Cogress, 5-30 August 013, Hog Kog (Sessio STS046) p.09 Kolmogorov-Smirov type Tests for Local Gaussiaity i High-Frequecy Data George Tauche, Duke Uiversity Viktor Todorov,

More information

Chapter 6. Sampling and Estimation

Chapter 6. Sampling and Estimation Samplig ad Estimatio - 34 Chapter 6. Samplig ad Estimatio 6.. Itroductio Frequetly the egieer is uable to completely characterize the etire populatio. She/he must be satisfied with examiig some subset

More information

Probability, Expectation Value and Uncertainty

Probability, Expectation Value and Uncertainty Chapter 1 Probability, Expectatio Value ad Ucertaity We have see that the physically observable properties of a quatum system are represeted by Hermitea operators (also referred to as observables ) such

More information

Machine Learning for Data Science (CS 4786)

Machine Learning for Data Science (CS 4786) Machie Learig for Data Sciece CS 4786) Lecture & 3: Pricipal Compoet Aalysis The text i black outlies high level ideas. The text i blue provides simple mathematical details to derive or get to the algorithm

More information

Economics 241B Relation to Method of Moments and Maximum Likelihood OLSE as a Maximum Likelihood Estimator

Economics 241B Relation to Method of Moments and Maximum Likelihood OLSE as a Maximum Likelihood Estimator Ecoomics 24B Relatio to Method of Momets ad Maximum Likelihood OLSE as a Maximum Likelihood Estimator Uder Assumptio 5 we have speci ed the distributio of the error, so we ca estimate the model parameters

More information

CSE 527, Additional notes on MLE & EM

CSE 527, Additional notes on MLE & EM CSE 57 Lecture Notes: MLE & EM CSE 57, Additioal otes o MLE & EM Based o earlier otes by C. Grat & M. Narasimha Itroductio Last lecture we bega a examiatio of model based clusterig. This lecture will be

More information

Because it tests for differences between multiple pairs of means in one test, it is called an omnibus test.

Because it tests for differences between multiple pairs of means in one test, it is called an omnibus test. Math 308 Sprig 018 Classes 19 ad 0: Aalysis of Variace (ANOVA) Page 1 of 6 Itroductio ANOVA is a statistical procedure for determiig whether three or more sample meas were draw from populatios with equal

More information

Lecture 19: Convergence

Lecture 19: Convergence Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may

More information

Mechatronics. Time Response & Frequency Response 2 nd -Order Dynamic System 2-Pole, Low-Pass, Active Filter

Mechatronics. Time Response & Frequency Response 2 nd -Order Dynamic System 2-Pole, Low-Pass, Active Filter Time Respose & Frequecy Respose d -Order Dyamic System -Pole, Low-Pass, Active Filter R 4 R 7 C 5 e i R 1 C R 3 - + R 6 - + e out Assigmet: Perform a Complete Dyamic System Ivestigatio of the Two-Pole,

More information

Chandrasekhar Type Algorithms. for the Riccati Equation of Lainiotis Filter

Chandrasekhar Type Algorithms. for the Riccati Equation of Lainiotis Filter Cotemporary Egieerig Scieces, Vol. 3, 00, o. 4, 9-00 Chadrasekhar ype Algorithms for the Riccati Equatio of Laiiotis Filter Nicholas Assimakis Departmet of Electroics echological Educatioal Istitute of

More information

The Growth of Functions. Theoretical Supplement

The Growth of Functions. Theoretical Supplement The Growth of Fuctios Theoretical Supplemet The Triagle Iequality The triagle iequality is a algebraic tool that is ofte useful i maipulatig absolute values of fuctios. The triagle iequality says that

More information

Lecture 7: Density Estimation: k-nearest Neighbor and Basis Approach

Lecture 7: Density Estimation: k-nearest Neighbor and Basis Approach STAT 425: Itroductio to Noparametric Statistics Witer 28 Lecture 7: Desity Estimatio: k-nearest Neighbor ad Basis Approach Istructor: Ye-Chi Che Referece: Sectio 8.4 of All of Noparametric Statistics.

More information

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + 62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of

More information

Binomial Distribution

Binomial Distribution 0.0 0.5 1.0 1.5 2.0 2.5 3.0 0 1 2 3 4 5 6 7 0.0 0.5 1.0 1.5 2.0 2.5 3.0 Overview Example: coi tossed three times Defiitio Formula Recall that a r.v. is discrete if there are either a fiite umber of possible

More information

Numerical Methods in Fourier Series Applications

Numerical Methods in Fourier Series Applications Numerical Methods i Fourier Series Applicatios Recall that the basic relatios i usig the Trigoometric Fourier Series represetatio were give by f ( x) a o ( a x cos b x si ) () where the Fourier coefficiets

More information

Module 1 Fundamentals in statistics

Module 1 Fundamentals in statistics Normal Distributio Repeated observatios that differ because of experimetal error ofte vary about some cetral value i a roughly symmetrical distributio i which small deviatios occur much more frequetly

More information

A.1 Algebra Review: Polynomials/Rationals. Definitions:

A.1 Algebra Review: Polynomials/Rationals. Definitions: MATH 040 Notes: Uit 0 Page 1 A.1 Algera Review: Polyomials/Ratioals Defiitios: A polyomial is a sum of polyomial terms. Polyomial terms are epressios formed y products of costats ad variales with whole

More information

Introduction to Signals and Systems, Part V: Lecture Summary

Introduction to Signals and Systems, Part V: Lecture Summary EEL33: Discrete-Time Sigals ad Systems Itroductio to Sigals ad Systems, Part V: Lecture Summary Itroductio to Sigals ad Systems, Part V: Lecture Summary So far we have oly looked at examples of o-recursive

More information

Chapter 6 Infinite Series

Chapter 6 Infinite Series Chapter 6 Ifiite Series I the previous chapter we cosidered itegrals which were improper i the sese that the iterval of itegratio was ubouded. I this chapter we are goig to discuss a topic which is somewhat

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

Statistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.

Statistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample. Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized

More information

Jacob Hays Amit Pillay James DeFelice 4.1, 4.2, 4.3

Jacob Hays Amit Pillay James DeFelice 4.1, 4.2, 4.3 No-Parametric Techiques Jacob Hays Amit Pillay James DeFelice 4.1, 4.2, 4.3 Parametric vs. No-Parametric Parametric Based o Fuctios (e.g Normal Distributio) Uimodal Oly oe peak Ulikely real data cofies

More information

Chapter 6 Overview: Sequences and Numerical Series. For the purposes of AP, this topic is broken into four basic subtopics:

Chapter 6 Overview: Sequences and Numerical Series. For the purposes of AP, this topic is broken into four basic subtopics: Chapter 6 Overview: Sequeces ad Numerical Series I most texts, the topic of sequeces ad series appears, at first, to be a side topic. There are almost o derivatives or itegrals (which is what most studets

More information