Filtering of Nonlinear Systems with Sampled Noisy Data by Output Injection

Size: px
Start display at page:

Download "Filtering of Nonlinear Systems with Sampled Noisy Data by Output Injection"

Transcription

1 Filtering f Nnlinear Systems with Sampled Nisy Data by Output Injectin Filipp Cacace, Francesc Cnte, Alfred Germani, Givanni Palmb Abstract This paper cncerns with the state estimatin prblem f nnlinear systems with sampled nisy measurements. The main idea is t explit a result f the analysis f nnlinear systems, which cnsiders a class f state-space nnlinear mdels admitting the design f a deterministic bserver with linear errr dynamics. Such systems are suppsed t prvide sampled nisy measurements. A cnsistent filtering technique is then suitably develped, using the same apprach f the mentined classical result. I. INTRODUCTION During the last three decades, a part f the research n autmatic cntrl has been largely dedicated t the study f the state estimatin prblem fr nnlinear systems. In particular, significant results have been btained fr deterministic systems with the design f several nnlinear bservers. One f the pssible strategies uses a suitable change f crdinates by which the system is made linear except fr a nnlinear utput injectin. In this case, the errr dynamics f the bserver is exactly linearizable and the bserver design thery fr linear system can be applied. The use f utput injectin in rder t btain bservers with linear errr dynamics has been independently suggested by [1 and [2 fr single-utput systems. A cmplete analysis f the crrespnding prblem fr multi-utput systems can be fund in [. Further develpments have been presented in [4, [5, [6, [7, [8, [9, [1, and [11. All mentined literature cncerns with the cntinuus-time case. In [12 the effect f time-sampling n the design f nnlinear cntinuus-time based bservers with linear errr dynamics is investigated. A dual analysis n the feedbac linearizatin prblem can be fund in [1. A discrete-time cunterpart f the listed results has been parallely btained by [14 and then extended by [15 and [16. A great deal f attentin has been als devted t the state estimatin prblem fr nnlinear stchastic systems, als nwn as the nnlinear filtering prblem, bth in the cntinuus- and discrete-time cases (e.g. [17, [18, [19, [2, [21). In this framewr, the system is suppsed t be pssibly driven by a stchastic prcess and the measurements t be crrupted by a disturbing nise. In a real scenari, this F. Cacace is with Università Campus Bi-Medic di Rma, Via Álvar del Prtill 21, 128 Rma, Italy ( f.cacace@unicampus.it). F. Cnte is with Intelligent Electric Systems Labratry, Università degli studi di Genva, Via all Opera Pia 11A, Genva, Italy ( fr.cnte@unige.it). A. Germani and G. Palmb are with Dipartiment di Ingegneria e Scienze dell Infrmazine e Matematica, Università degli studi dell Aquila, Via Veti (Cppit 1), 671 Cppit (AQ), Italy ( {alfred.germani-givanni.palmb}@univaq.it. always is the case. Observers perfrmances are indeed ften cnsidered als in the presence f nise, in rder t analyze the rbustness f the methd and its significance fr real applicatins. In this sense, the principal difference amng deterministic and stchastic appraches cnsists in the explicit cnsideratin f nise used in the latter methdlgy. Hwever, strategies f nnlinear filtering maybe strngly different frm thse used by deterministic appraches. The idea f this paper, n the ther hand, is t explit the mentined results f the analysis f deterministic nnlinear systems in rder t derive a nnlinear filtering technique. Mre precisely, cntinuus-time systems which result t be lienarizable with (nnlinear) utput injectin (e.g. by ne f the cnditins prvided by [1, [2, r [) are cnsidered. Such systems are then suppsed t be measured with sampled nisy signals. The presence f nise is explicitly taen int accunt fr realizing a derivative-free filtering technique which fllws a strategy similar t the ne used in the design f nnlinear bservers with linear errr dynamics. The advantage f the prpsed technique is the cnsideratin f nise with respect t deterministic appraches and the avidance f linearizatin with respect t classical nnlinear filters. Even if designed fr cntinuus-time systems with sampled measurements, the prpsed methd can be als applied t discrete-time systems which admit linearizatin by utput injectin (e.g. satisfying ne f the cnditins in [14 r [15). The paper is rganized as fllws. Sectin II gives the prblem frmulatin. The prpsed apprach is described in Sectin III. A numerical example is illustrated in Sectin IV. Cnclusins are summarized in Sectin V. II. PROBLEM FORMULATION Cnsider a cntinuus-time stchastic autnmus system having the frm ẋ(t) = f(x(t)), x() = x (1) dr t = h(x(t))dt + σdw t (2) where x(t) R n is the system state prcess, x R n is the initial state, r t R is the stchastic integral frm f the measurement prcess y t R, w t is a Wiener prcess, σ R, and f : R n R n and h : R n R are analytic functins. The aim f this paper is the estimatin f the system state x(t) under the fllwing hypthesis: Hp. 1: The deterministic part f system (1)-(2) ẋ(t) = f(x(t)) () λ(t) = h(x(t)) (4)

2 is lcally state-equivalent t a linear system with nnlinear utput injectin, ([5, [12) i.e. there exist a crdinates transfrmatin z = Φ(x) defined in a neighbrhd U f the initial state x, a matrix Ā Rn n, a mapping β : h(u ) R n, and a rw vectr C R 1 n s.t. 1) ż(t) = ϕ(x) x f(x) x=φ 1 (z(t)) = Āz(t) + β (Cz(t)), 2) λ(t) = h ϕ 1 (z(t)) = Cz(t), C CĀ ) ran. = n, CĀn 1 fr all z(t) Φ(U ). Hp. 2: Fr a given sampling time R +, the sampled measurements y() := y, Z + are available. Hp. : The initial state x is a randm vectr independent f the measurement nise prcess w t. Ntice that [1 and [2 gives cnditins fr stating when a deterministic nnlinear system satisfies Hp. 1. In this case, the state bservatin can be carried ut by simply substituting the argument Cz f β( ) with the utput λ and design a Luemberger bserver with an exactly linear errr dynamics. It is wrth remaring that, when hypthesis Hp. 1 is satisfied, system (1)-(2) has the fllwing state-equivalent linear frm with nnlinear utput injectin: ż(t) = Āz(t) + β (Cz(t)), z() = Φ(x ), (5) dr t = Cz(t) + σdw t. (6) III. PROPOSED APPROACH The apprach here prpsed cnsists in designing a state estimatr fr the transfrmed system (5)-(6). Because f the availability f sampled measurements, such a system is firstly discretized. Then, a recursive filtering technique is intrduced fr carrying ut the estimatin f the sampled state. Finally, the estimate f the riginal state can be btained by using the inverse mapping Φ 1. A. System Discretizatin Despite the transfrmatin, system (5)-(6) is nnlinear. It is well nwn that the discretizatin f nnlinear systems cannt be exactly btained. Hwever, in the case f (5)-(6) the explicit presence f a linear part in the state dynamic can be used t btain a sufficient apprximatin f the crrespnding discrete-time system. Fr cnventin, the sampled values f x(t), z(t) and y(t) will be hereafter indicated with x() := x( ), z() := z( ), and y() := y, Z +, respectively. In rder t btain the discrete-time dynamic f the state vectr z, it is sufficient t get the slutin f the rdinary differential equatin (5) using and ( + 1) as initial and current times, respectively, and suppse the state z(t) t be cnstant within the sampling interval, i.e. z(t) = z( ) fr all t [, ( + 1) ): z( + 1) eā z() + where = eā z() + (+1) = Az() + B β(cz()). A := eā R n n, B := eā((+1) τ) β (Cz(τ)) dτ eāθ dθ β(cz()) eāθ dθ R n n. With the same assumptins, frm (6) fllws r +1 r (+1) Cz(t)dt + (+1) = Cz() + σ ( w (+1) w ) σdw t frm which, by suppsing that y t = y() within the sampling interval [, ( + 1) ), ne has y() r +1 r Cz() + σ w +1 w = Cz() + σ n = Cz() + n, where {n } := {σ/ n } results t be a zer-mean white Gaussian sequence with variance σ 2 /, as clearly fllws by the definitin prperties f the Wiener prcess. Mrever, frm Hp. 1 fllws that {n } is independent f the initial cnditin z(). The discretized system hence has the frm: z( + 1) = Az() + β(cz()) (7) y() = Cz() + n, (8) with β( ) := B β( ). Finally, the initial cnditin z() is suppsed here t be a randm vectr with nwn mean value z and cvariance matrix Ψ z. B. The Filtering Algrithm Despite the prblem frmulatin cnsiders cntinuustime systems with sampled scalar measurements, the filtering algrithm develped in this sectin can be generally applied t discrete-time systems having the frm (7)-(8), als with q- dimensinal utput. Fr example, such systems may belng t the class f multi-utput cntinuus-time systems cnsidered in [, r t the class f multi-utput discrete-time systems analyzed in [15. Then, the utput will be suppsed t be y R q, as well as n R q, which is suppsed t be a statinary zer-mean white Gaussian sequence with cvariance matrix R R q q. In the deterministic case, the utput injectin is classically explited in rder t btain an bserver with linear errr dynamics [1, [2, [5, just substituting the term Cz with the utput y. The aim f this paper is t prpse a slutin fr the stchastic discrete-time case fllwing the same fashin.

3 Therefre, (7) is rewritten by substituting the argument f β( ) frm (8): z( + 1) = Az() + β (y() n ). (9) This simple substitutin maes the system linear with respect t the state vectr z. The nnlinear map β( ) is indeed applied t the nwn nisy quantity y() and t the randm term n. The s btained vectr β (y() n ) can be tugh treated as a nngaussian state nise. The idea is similar t that used in [22 fr slving the planar tracing prblem: t transfrm nnlinearity in nngaussianity fr aviding linearizatin. Because f the particular frm f the randm term β (y() n ), it is nt bvius that applying a standard Kalman-lie filter t the transfrmed system will return any characterizable estimate (e.g. sub-ptimal, linear ptimal etc.). As a cnsequence, a prper filtering algrithm is here directly derived. This will be dne using a gemetrical apprach, as in [2. Fr cmpleteness and clarity, sme cncepts abut Hilber spaces and estimate thery are recalled in the next subsectin. 1) The Gemetrical Apprach fr Estimatin Prblems: Let (Ω, F, P ) be a prbability space. Fr any given sub σ- algebra G f F, dente by L 2 G the Hilbert space f the G- measurable, randm vectrs with finite secnd mment as { } L 2 G := x : Ω R n, G-meas., x(ω) 2 dp (ω) <, This space is endwed with the nrm x L 2:= x T (ω)x(ω)dp (ω) = E [ x 2. Ω It is imprtant t stress here that, when x is zer-mean, the squared L 2 nrm crrespnds t its variance. It is als pssible t define the rtgnality amng tw elements f this space as: x y E [ xy T = (1) which, in the case f zer-mean randm vectrs, crrespnds t uncrrelatin. Then, if M is a subspace f L 2 G, the symbl Π(x M) indicates the rthgnal prjectin f x L 2 G nt M, which is defined as the (unique) vectr in M such that the difference x Π(x M) is rthgnal t M, i.e. (x Π(x M)) y, y M. If N is anther sub-space, N M indicates that x y fr all x N and y M, whereas x M indicates that x y fr all y M. Mrever, when G is the σ-algebra generated by a randm vectr y : Ω R m, that is G = σ(y), the ntatin L 2 y indicates L 2 σ(y). Frm the Hilbert prjectin therem [24 fllws that the minimum variance estimate f a randm vectr x L 2 G with respect t a randm vectr y crrespnds t Π(x L 2 y). When x and y are nt Gaussian, such a prjectin cannt be cmputed with finite time. Therefre, subptimal Ω estimates are btained by prjecting x nt smaller subspaces. The mstly used (and usable) is L y := {x : Ω R n M R n (m+1) s.t. x = M[1 y } which is cmpsed by all affine transfrmatins f the randm vectr y : Ω R m. The prjectin Π(x L y ) is the linear minimum variance estimate f x w.r.t. y. It is pssible t shw that this prjectin can be cmputed as Π(x L y ) = E[x + E [ xȳ T E [ ȳȳ T 1 ȳ (11) where ȳ := y E[y [25. A secnd useful sub-space is L y := { x : Ω R n M R n m s.t. x = My } which is cmpsed by all linear transfrmatins f the randm vectr y : Ω R m. In this case, the prjectin is given by Π(x L y ) = E [ xȳ T E [ ȳȳ T 1 ȳ. (12) 2) Filtering Derivatin: The filtering prblem (frmulated fr system (7)-(8)), requires the recursive estimatin f the state z() frm the measurements sequence {y(τ), τ =, 1,..., }, which can be cllected in the ( + 1)q vectr Y := [ y T () y T (1) y T () T. Fllwing the intrduced gemetrical apprach, the ptimal minimum variance estimate is the prjectin Π(z() L 2 Y ). As mentined, because f nngaussianity, this cannt be cmputed. The aim here is t develp a filter able t return the linear 1 minimum variance estimate f z(), i.e. Π ( z() L y), where L y dentes the sub-space L Y. In rder t clearly present the derivatin f the filter, sme definitins fllw: state estimate: ẑ( ) := Π ( z() Ly) ; state predictin: ẑ( 1) := Π ( ) z() L 1 y ; estimate errr: ê( ) := z() ẑ( ); predictin errr: ê( 1) := z() ẑ( 1); utput innvatin: ν () := y() Π ( ) z() L 1 y. Mrever P ( ) and P ( 1) dente the estimate and predictin errr cvariance matrices, respectively. Let us fcus n the utput innvatin sequence {ν ()}. By definitin, it is easy t shw that E[ν () = and E[ν ()ν T (τ) = fr τ, i.e. it is a zer-mean white randm sequence. Mrever, ν () L 1 y, and, by denting L ν () with L ν, it results that L y = L 1 y L ν and L 1 y L ν. (1) Cnsider nw that frm (8), the whiteness f {n }, and the given definitins, fllws that ν () = y() Cẑ( 1) = Cz() + n Cẑ( 1). (14) 1 The term linear is usually used t indicate general affine estimates.

4 Nte that, frm (14) fllws that ν () = Cê( 1) + n, (15) The argument Cz f the nnlinear functin β( ) in (7) can be then substituted using (14) instead f directly use the utput equatin (8), btaining z( + 1) = Az() + β (Cẑ( 1) + ν () n ). (16) This substitutin eeps the linearity w.r.t. z but maes easier t statistically characterize the randm nngaussian term β (Cẑ( 1) + ν () n ), where Cẑ( 1) is a nwn quantity at time and {n } and {ν ()} and are white randm sequences. The cvariance matrix f {n } is R, whereas the cvariance matrix E [ ν ()ν T () is time varying and can be recursively cmputed as Ψ ν () := E [ ν ()ν T () = CP ( 1)C T + R. (17) The prf f (17) is left t end f the sectin. Nw, let us indicate the randm vectr β (Cẑ( 1) + ν () n ) with β() and define n s := β() Π ( β() L y), which is a is zer-mean nngaussian randm vectr. It is here assumed that the sequence {n s } is white with the cvariance matrix Q() := E [ n s n st. (18) Ntice that Q() is time-varying since it depends n the current value f the predicted state ẑ( 1). Finally, it is clear that the state and utput sequences are crrelated each ther, and therefre the crrelatin matrix J() must be defined as J() := E [ n s n T. (19) Fr clarity, the cmputatin f Π ( β() Ly), Q(), and J(), as well as a discussin abut the whiteness f n s are left t end f the sectin. Using the given definitins, the system equatins are rewritten as z( + 1)=Az() + Π ( β() L y) + n s, (2) y()=cz() + n, (21) where Π ( β() L y) plays the rle f the deterministic input. It is nw pssible t prvide the filter equatins: with ẑ( ) = ẑ( 1) + K() (y() Cẑ( 1)) (22) ẑ( + 1 ) = Az( ) + Π ( β() L y), (2) K() = P ( 1)C T ( CP ( 1)C T + R ) 1, (24) P ( ) = (I n K()C) P ( 1) (I n K()C) T +K()RK T (), (25) P ( + 1 ) = AP ( )A T + Q() AK()J T () J()K T ()A T, (26) and initial cnditins ẑ( 1) = z, P ( 1) = Ψ z. (27) The fllwing therem states the main result f this paper. Therem 1: Under the hypthesis that {n s } is a white sequence, the recursive cmputatin f equatins (22)-(27) returns the linear minimum variance estimate ẑ( ) = Π(z() L y) f the state z() f system (2)-(21). Prf. Frm prperty (1) it results that ẑ( ) = Π ( z() L 1 ) ( y + Π z() L ν ) = ẑ( 1) + Π ( z() L ) ν. (28) The term Π ( z() L ) ν can be cmputed using (12) and nting that Π ( ẑ( 1) L ) ν = : Π ( z() L ) ( ) ν = Π z() ẑ( 1) L ν = Π ( ê( 1) L ) ν where, by (15) and (17) = K()ν () K() = E [ ê( 1)ν T = K() (y() Cẑ( 1)) (29) E [ ν ()ν T () 1 = P ( 1)C T ( CP ( 1)C T + R ) 1, which is the well nwn expressin f the Kalman gain matrix K() prvided in (24). Equatin (22) is then btained by substituting (29) in (28). As far as the predictin term ẑ( + 1 ) is cncerned, expressin (2) trivially fllws by applying the prjectin Π( L y) t (2). It remains t prve (25) and (26). Fr this purpse, let us cnsider the recursive relatin amng the state and predictin errrs: ê( ) = z() ẑ( ) (by (22)) = z() ẑ( 1) K()ν () (by (14)) = (I n K()C) ê( 1) K()n, () ê( + 1 ) = z( + 1) ẑ( + 1 ) (by (2)) = Az() + Π ( β() L y) + n s ẑ( + 1 ) (by (2)) = Aê( ) + n s, (1) frm which it can be nted that, because f the whiteness f {n s } and {n }, E [ ê( 1)n st =, (2) E [ ê( 1)n T =. () Mrever, by (), and taing int accunt (19), E [ ê( )n st = (In K()C) E [ ê( 1)n st K()E [ n n st (by (2)) = K()J T (). (4) By taing int accunt (), (25) readily fllws frm (). Whereas, (26) fllws frm (1) by using (4) and recalling definitin (18).

5 It remains nw t prve (17) and discuss the cmputatin f Π ( β() Ly), Q(), and J(), and the whiteness f {n s }. Equatin (17) is readily prved by taing int accunt prperty (15): Ψ ν () = CE [ ê( 1)ê T ( 1) It is als interesting that + CE [ê( 1)n T +E [ n n T +E [ n ê T ( 1) C T = CP ( 1)C T + R. E [ ν ()n T = R. (5) As far as Π(β() L y) is cncerned, frm (1) fllws that Π ( β() L y ) ( ) ( ) = Π β() L 1 y + Π β() L ν. (6) In rder t cmpute these tw quantities, tw assumptins are required t be admitted: {ν ()} is apprximately a Gaussian distributed sequence with the cvariance matrix Ψ ν (); the term ẑ( 1) is available at time, i.e. it is a deterministic quantity. It can be remared that the first assumptin is true less then the nngaussianity f the system dynamic, nly due t the stchastic initial cnditin z(). As a cnsequence, when the evlutin f the system has the prperty f stability f frgetting the initial cnditin, it fllws that the innvatin prcess becmes asympttically Gaussian. Because f Gaussianity, ν () becmes independent f y(τ), τ =, 1,..., 1, and als f n τ and the same innvatin ν (τ) at a different time, τ. These tw last prperties imply that ν () is uncrrelated with β(τ), fr τ. Therefre, under the abve intrduced hypthesis, and taing int accunt the prjectin rules (11) and (12), the expressins in the next hld true: Π ( β() L 1 ) y = E [β() (7) Π ( β() L ) ν = M()ν () (8) with M() = [β()ν () Ψ 1 ν () (9) and where the mean values are cmputed ver the distributins f ν () and n s. As a cnsequence it results that: Π ( β() L y) = E [β() + M()ν (), (4) and E [n s n s τ = E [(β() E [β()) (β(τ) E [β(τ)) T E [ (β() E [β()) ν T (τ) M T (τ) M()E [ν () (β(τ) E [β(τ)) T [ +M()E ν ()ν T (τ) M T (). (41) When τ last expressin is equal t zer. Mrever the cvariance matrix Q() can be cmputed by (41) with = τ. Finally, matrix J() has the frm: J() = E [n s n = E [ β()n T E [ β()n T where prperty (5) has been used. IV. EXAMPLE [ M()E ν ()n T M()R, (42) In rder t validate the prpsed apprach, the filtering algrithm has been tested n the Van der Pl Oscillatr, as an example f system admitting linearizatin by utput injectin (see [9). The equatins are: ẋ 1 (t)= x 2 (t) ẋ 2 (t)= x 1 (t) + x 2 (t) x 2 1(t)x 2 (t) y(t)= x 1 (t) As shwn in [9, the mapping Φ(z) = applied t the system leads t [ x1 x 2 + x 1 ż 1 (t) = z 2 (t) z 1 (t) ż 2 (t) = z 2 (t) z 1 (t) z 1 (t) (4) which has the frm in (5), with the dynamic matrix and the nnlinear utput injectin: [ 1 Ā = 1 1 β(cz(t)) = 1 z 1(t) [ 1 1 Ging ahead by discretizatin, fllwing the prcedure described in Sectin III-A, the system assumes the frm (7)-(8) with the discrete-time utput injectin β(cz()) = 1 [ 1 (Cz()) B (44) 1 The nisy measurement prcess has been simulated based n mdel (2) using Euler-Maruyama integratin with σ =.28. The sampled utput sequence {y()} has been acquired with sampling time =. s. The filtering algrithm (22)-(27) has been implemented using (4), (41), and (42) fr cmputing Π(β() L y), Q() and J(), respectively. The initial estimate has been generated with a Gaussian distributin in the z crdinates with the real initial state as mean value and unitary cvariance matrix (Ψ z = I 2 ). Figure 1 shws the time evlutin f the measured state x 1 tgether with the crrespnding measurements and the estimatin result btained with the prpsed filtering technique. It can be nted that the estimatr succeeds in filtering the signals with a fast transient. It is wrth remaring that, in this example, the estimatr is required t face with the discretizatin errr als..

6 4 measurements estimated state bserved estimated state Time [s Time [s Fig. 1. Real, estimated and measured state cmpnent x 1. Fig. 2. Real, bserved and estimated state cmpnent x 2. Figure 2 cmpares the estimates f the state cmpnent x 2 btained with the prpsed technique and a discrete-time bserver based n the utput injectin [15. Because f the presence f nise, the bserver gain was difficult t be tuned in rder t btain a gd trade-ff between the transient interval and the estimatin precisin. In particular, nte that the bserver seems t start frm a different initial estimate. Actually, the filter and the bserver start frm the same initial cnditins, but, in the illustrated case, the bserver gain was set t a very lw value in rder t btain a sufficiently smth estimated signal. Therefre, while the first crrectin f the filter mves the estimate clse t the real state, this des nt happen in the bserver case. It is clear that the filter definitively have better perfrmances with respect t the bserver because f the explicit cnsideratin f nise. V. CONCLUSIONS The use f utput injectin in rder t btain bservers with linear errr dynamics in the deterministic framewr has been explited fr deriving a cnsistent filtering technique fr nnlinear systems with sampled nisy measurements. The utput injectin has been used t transfrm nnlinearity in nngaussianity. This allwed aviding linearizatin and getting a linear minimum variance filter. A numerical example cnfirmed the effectiveness f the prpsed apprach. REFERENCES [1 A. J. Krener and A. Isidri, Linearizatin by utput injectin and nnlinear bservers, Syst. & Cntr. Letters, vl., pp , June 198. [2 D. Bestle and M. Zeitz, Cannical frm bserver design fr nnlinear time variable systems, Int. J. f Cntr., vl. 1, pp. 7 81, 198. [ A. J. Krener and W. Respnde, Nnlinear bserver with linearizable errr dynamics, SIAM J. f Cntr. and Opt., vl. 2, n. 2, pp , [4 X. Xia and W. Ga, Nnlinear bserver design by bsever errr linearizatin, SIAM J. f Cntr. and Opt., vl. 27, pp , [5 A. Isidri, Nnlinear Cntrl Systems. Springer-Verlag, 2nd ed., [6 A. Banaszu and W. M. Sluis, On nnlinear bservers with apprximately linear errr dynamics, in IEEE ACC, vl. 2, pp , [7 A. J. Krener and M. Xia, A necessary and sufficient cnditin fr the existence f a nnlinear bserver with linearizable errr dynamics, in IEEE CDC, n. December, pp , 21. [8 A. F. Lynch and S. A. Brtff, Nnlinear bservers with apprximately linear errr dynamics: The multivariable case, IEEE Trans. n Autm. Cntr., vl. 46, n. 6, pp , 21. [9 A. J. Krener and M. Xia, Observers fr linearly unbservable nnlinear systems, Syst. & Cntr. Letters, vl. 46, pp , July 22. [1 J. Deutscher, Numerical design f nnlinear bservers with apprximately linear errr dynamics, 26 IEEE Cnference n Cmputer- Aided Cntrl Systems Design, pp , Oct. 26. [11 A. J. Krener and M. Xia, Nnlinear bserver design fr smth systems, in Chas in Autmatic Cntrl (W. Perruquetti and J. P. Barbt, eds.), ch. 1, pp , Taylr & Francis Grup, 26. [12 S. T. Chung and J. W. Grizzle, Sampled-data bserver errr linearizatin, Autmatica, vl. 26, n. 6, pp , 199. [1 A. Arapstathis, B. Jaubczy, H. G. Lee, S. I. Marcus, and E. D. Sntag, The effect f sampling n linear equivalence and feedbac linearizatin, Syst. & Cntr. Letters, vl. 1, n. 5, pp. 7 81, [14 H.-G. Lee and S. I. Marcus, Apprximate and lcal linearizability f nn-linear discrete-time systems, Int. J. f Cntr., vl. 44, pp , Oct [15 W. Lin and C. Byrnes, Remars n linearizatin f discrete-time autnmus systems and nnlinear bserver design, Syst. & Cntr. Letters, vl. 25, pp. 1 4, [16 N. Kazantzis, C. Kravaris, A. J. Krener, and M. Xia, Nnlinear discrete-time bserver design with linearizable errr dynamics, IEEE Trans. n Autm. Cntr., vl. 48, n. 4, pp , 2. [17 A. V. Balarishnan, Kalman filtering thery. New Yr: Optimizatin Sftware, Inc., [18 M. S. Arulampalam, S. Masell, N. Grdn, and T. Clapp, A tutrial n particle filters fr nline nnlinear/nn-gaussian bayesian tracing, IEEE Trans. n Sign. Prc., vl. 5, n. 2, 22. [19 S. J. Julier and J. K. Uhlmann, Unscented filtering and nnlinear estimatin, in Prceedings f the IEEE, vl. 92, 24. [2 A. Germani, C. Manes, and P. Palumb, Plynmial extended alman filter, IEEE Trans. n Autm. Cntr., vl. 5, n. 12, pp , 25. [21 F. E. Daum, Nnlinear filters: Beynd the alman filter, IEEE Aerspace and Electrnics Systems Magazine, vl. 2, n. 8, pp , 25. [22 F. Cnte, V. Cusiman, and A. Germani, Rbust planar tracing via a virtual measurement apprach, Eurp. J. f Cntr., vl. 19, n. 2, pp , 21. [2 F. Carravetta, A. Germani, and M. Raimndi, Plynmial filtering fr linear discrete time nn-gaussian systems, SIAM J. f Cntr. and Opt., vl. 4, n. 5, pp , [24 A. V. Balarishnan, Applied Functinal Analysis. Springer-Verlag: New Yr, [25 F. Carravetta, A. Germani, and M. Raimndi, Plynmial filtering f discrete-time stchastic linear systems with multiplicative state nise, IEEE Trans. n Autm. Cntr., vl. 42, n. 8, pp , 1997.

A Matrix Representation of Panel Data

A Matrix Representation of Panel Data web Extensin 6 Appendix 6.A A Matrix Representatin f Panel Data Panel data mdels cme in tw brad varieties, distinct intercept DGPs and errr cmpnent DGPs. his appendix presents matrix algebra representatins

More information

Lyapunov Stability Stability of Equilibrium Points

Lyapunov Stability Stability of Equilibrium Points Lyapunv Stability Stability f Equilibrium Pints 1. Stability f Equilibrium Pints - Definitins In this sectin we cnsider n-th rder nnlinear time varying cntinuus time (C) systems f the frm x = f ( t, x),

More information

Distributions, spatial statistics and a Bayesian perspective

Distributions, spatial statistics and a Bayesian perspective Distributins, spatial statistics and a Bayesian perspective Dug Nychka Natinal Center fr Atmspheric Research Distributins and densities Cnditinal distributins and Bayes Thm Bivariate nrmal Spatial statistics

More information

Least Squares Optimal Filtering with Multirate Observations

Least Squares Optimal Filtering with Multirate Observations Prc. 36th Asilmar Cnf. n Signals, Systems, and Cmputers, Pacific Grve, CA, Nvember 2002 Least Squares Optimal Filtering with Multirate Observatins Charles W. herrien and Anthny H. Hawes Department f Electrical

More information

Admissibility Conditions and Asymptotic Behavior of Strongly Regular Graphs

Admissibility Conditions and Asymptotic Behavior of Strongly Regular Graphs Admissibility Cnditins and Asympttic Behavir f Strngly Regular Graphs VASCO MOÇO MANO Department f Mathematics University f Prt Oprt PORTUGAL vascmcman@gmailcm LUÍS ANTÓNIO DE ALMEIDA VIEIRA Department

More information

Pattern Recognition 2014 Support Vector Machines

Pattern Recognition 2014 Support Vector Machines Pattern Recgnitin 2014 Supprt Vectr Machines Ad Feelders Universiteit Utrecht Ad Feelders ( Universiteit Utrecht ) Pattern Recgnitin 1 / 55 Overview 1 Separable Case 2 Kernel Functins 3 Allwing Errrs (Sft

More information

Computational modeling techniques

Computational modeling techniques Cmputatinal mdeling techniques Lecture 4: Mdel checing fr ODE mdels In Petre Department f IT, Åb Aademi http://www.users.ab.fi/ipetre/cmpmd/ Cntent Stichimetric matrix Calculating the mass cnservatin relatins

More information

Bootstrap Method > # Purpose: understand how bootstrap method works > obs=c(11.96, 5.03, 67.40, 16.07, 31.50, 7.73, 11.10, 22.38) > n=length(obs) >

Bootstrap Method > # Purpose: understand how bootstrap method works > obs=c(11.96, 5.03, 67.40, 16.07, 31.50, 7.73, 11.10, 22.38) > n=length(obs) > Btstrap Methd > # Purpse: understand hw btstrap methd wrks > bs=c(11.96, 5.03, 67.40, 16.07, 31.50, 7.73, 11.10, 22.38) > n=length(bs) > mean(bs) [1] 21.64625 > # estimate f lambda > lambda = 1/mean(bs);

More information

Modelling of Clock Behaviour. Don Percival. Applied Physics Laboratory University of Washington Seattle, Washington, USA

Modelling of Clock Behaviour. Don Percival. Applied Physics Laboratory University of Washington Seattle, Washington, USA Mdelling f Clck Behaviur Dn Percival Applied Physics Labratry University f Washingtn Seattle, Washingtn, USA verheads and paper fr talk available at http://faculty.washingtn.edu/dbp/talks.html 1 Overview

More information

IN a recent article, Geary [1972] discussed the merit of taking first differences

IN a recent article, Geary [1972] discussed the merit of taking first differences The Efficiency f Taking First Differences in Regressin Analysis: A Nte J. A. TILLMAN IN a recent article, Geary [1972] discussed the merit f taking first differences t deal with the prblems that trends

More information

The blessing of dimensionality for kernel methods

The blessing of dimensionality for kernel methods fr kernel methds Building classifiers in high dimensinal space Pierre Dupnt Pierre.Dupnt@ucluvain.be Classifiers define decisin surfaces in sme feature space where the data is either initially represented

More information

Dead-beat controller design

Dead-beat controller design J. Hetthéssy, A. Barta, R. Bars: Dead beat cntrller design Nvember, 4 Dead-beat cntrller design In sampled data cntrl systems the cntrller is realised by an intelligent device, typically by a PLC (Prgrammable

More information

SAMPLING DYNAMICAL SYSTEMS

SAMPLING DYNAMICAL SYSTEMS SAMPLING DYNAMICAL SYSTEMS Melvin J. Hinich Applied Research Labratries The University f Texas at Austin Austin, TX 78713-8029, USA (512) 835-3278 (Vice) 835-3259 (Fax) hinich@mail.la.utexas.edu ABSTRACT

More information

ENSC Discrete Time Systems. Project Outline. Semester

ENSC Discrete Time Systems. Project Outline. Semester ENSC 49 - iscrete Time Systems Prject Outline Semester 006-1. Objectives The gal f the prject is t design a channel fading simulatr. Upn successful cmpletin f the prject, yu will reinfrce yur understanding

More information

1996 Engineering Systems Design and Analysis Conference, Montpellier, France, July 1-4, 1996, Vol. 7, pp

1996 Engineering Systems Design and Analysis Conference, Montpellier, France, July 1-4, 1996, Vol. 7, pp THE POWER AND LIMIT OF NEURAL NETWORKS T. Y. Lin Department f Mathematics and Cmputer Science San Jse State University San Jse, Califrnia 959-003 tylin@cs.ssu.edu and Bereley Initiative in Sft Cmputing*

More information

initially lcated away frm the data set never win the cmpetitin, resulting in a nnptimal nal cdebk, [2] [3] [4] and [5]. Khnen's Self Organizing Featur

initially lcated away frm the data set never win the cmpetitin, resulting in a nnptimal nal cdebk, [2] [3] [4] and [5]. Khnen's Self Organizing Featur Cdewrd Distributin fr Frequency Sensitive Cmpetitive Learning with One Dimensinal Input Data Aristides S. Galanpuls and Stanley C. Ahalt Department f Electrical Engineering The Ohi State University Abstract

More information

, which yields. where z1. and z2

, which yields. where z1. and z2 The Gaussian r Nrmal PDF, Page 1 The Gaussian r Nrmal Prbability Density Functin Authr: Jhn M Cimbala, Penn State University Latest revisin: 11 September 13 The Gaussian r Nrmal Prbability Density Functin

More information

Internal vs. external validity. External validity. This section is based on Stock and Watson s Chapter 9.

Internal vs. external validity. External validity. This section is based on Stock and Watson s Chapter 9. Sectin 7 Mdel Assessment This sectin is based n Stck and Watsn s Chapter 9. Internal vs. external validity Internal validity refers t whether the analysis is valid fr the ppulatin and sample being studied.

More information

Part 3 Introduction to statistical classification techniques

Part 3 Introduction to statistical classification techniques Part 3 Intrductin t statistical classificatin techniques Machine Learning, Part 3, March 07 Fabi Rli Preamble ØIn Part we have seen that if we knw: Psterir prbabilities P(ω i / ) Or the equivalent terms

More information

4th Indian Institute of Astrophysics - PennState Astrostatistics School July, 2013 Vainu Bappu Observatory, Kavalur. Correlation and Regression

4th Indian Institute of Astrophysics - PennState Astrostatistics School July, 2013 Vainu Bappu Observatory, Kavalur. Correlation and Regression 4th Indian Institute f Astrphysics - PennState Astrstatistics Schl July, 2013 Vainu Bappu Observatry, Kavalur Crrelatin and Regressin Rahul Ry Indian Statistical Institute, Delhi. Crrelatin Cnsider a tw

More information

Homology groups of disks with holes

Homology groups of disks with holes Hmlgy grups f disks with hles THEOREM. Let p 1,, p k } be a sequence f distinct pints in the interir unit disk D n where n 2, and suppse that fr all j the sets E j Int D n are clsed, pairwise disjint subdisks.

More information

Perturbation approach applied to the asymptotic study of random operators.

Perturbation approach applied to the asymptotic study of random operators. Perturbatin apprach applied t the asympttic study f rm peratrs. André MAS, udvic MENNETEAU y Abstract We prve that, fr the main mdes f stchastic cnvergence (law f large numbers, CT, deviatins principles,

More information

Sequential Allocation with Minimal Switching

Sequential Allocation with Minimal Switching In Cmputing Science and Statistics 28 (1996), pp. 567 572 Sequential Allcatin with Minimal Switching Quentin F. Stut 1 Janis Hardwick 1 EECS Dept., University f Michigan Statistics Dept., Purdue University

More information

Support-Vector Machines

Support-Vector Machines Supprt-Vectr Machines Intrductin Supprt vectr machine is a linear machine with sme very nice prperties. Haykin chapter 6. See Alpaydin chapter 13 fr similar cntent. Nte: Part f this lecture drew material

More information

Determining the Accuracy of Modal Parameter Estimation Methods

Determining the Accuracy of Modal Parameter Estimation Methods Determining the Accuracy f Mdal Parameter Estimatin Methds by Michael Lee Ph.D., P.E. & Mar Richardsn Ph.D. Structural Measurement Systems Milpitas, CA Abstract The mst cmmn type f mdal testing system

More information

Modeling the Nonlinear Rheological Behavior of Materials with a Hyper-Exponential Type Function

Modeling the Nonlinear Rheological Behavior of Materials with a Hyper-Exponential Type Function www.ccsenet.rg/mer Mechanical Engineering Research Vl. 1, N. 1; December 011 Mdeling the Nnlinear Rhelgical Behavir f Materials with a Hyper-Expnential Type Functin Marc Delphin Mnsia Département de Physique,

More information

22.54 Neutron Interactions and Applications (Spring 2004) Chapter 11 (3/11/04) Neutron Diffusion

22.54 Neutron Interactions and Applications (Spring 2004) Chapter 11 (3/11/04) Neutron Diffusion .54 Neutrn Interactins and Applicatins (Spring 004) Chapter (3//04) Neutrn Diffusin References -- J. R. Lamarsh, Intrductin t Nuclear Reactr Thery (Addisn-Wesley, Reading, 966) T study neutrn diffusin

More information

COMP 551 Applied Machine Learning Lecture 5: Generative models for linear classification

COMP 551 Applied Machine Learning Lecture 5: Generative models for linear classification COMP 551 Applied Machine Learning Lecture 5: Generative mdels fr linear classificatin Instructr: Herke van Hf (herke.vanhf@mail.mcgill.ca) Slides mstly by: Jelle Pineau Class web page: www.cs.mcgill.ca/~hvanh2/cmp551

More information

MODULAR DECOMPOSITION OF THE NOR-TSUM MULTIPLE-VALUED PLA

MODULAR DECOMPOSITION OF THE NOR-TSUM MULTIPLE-VALUED PLA MODUAR DECOMPOSITION OF THE NOR-TSUM MUTIPE-AUED PA T. KAGANOA, N. IPNITSKAYA, G. HOOWINSKI k Belarusian State University f Infrmatics and Radielectrnics, abratry f Image Prcessing and Pattern Recgnitin.

More information

Kinematic transformation of mechanical behavior Neville Hogan

Kinematic transformation of mechanical behavior Neville Hogan inematic transfrmatin f mechanical behavir Neville Hgan Generalized crdinates are fundamental If we assume that a linkage may accurately be described as a cllectin f linked rigid bdies, their generalized

More information

COMP 551 Applied Machine Learning Lecture 11: Support Vector Machines

COMP 551 Applied Machine Learning Lecture 11: Support Vector Machines COMP 551 Applied Machine Learning Lecture 11: Supprt Vectr Machines Instructr: (jpineau@cs.mcgill.ca) Class web page: www.cs.mcgill.ca/~jpineau/cmp551 Unless therwise nted, all material psted fr this curse

More information

CS 477/677 Analysis of Algorithms Fall 2007 Dr. George Bebis Course Project Due Date: 11/29/2007

CS 477/677 Analysis of Algorithms Fall 2007 Dr. George Bebis Course Project Due Date: 11/29/2007 CS 477/677 Analysis f Algrithms Fall 2007 Dr. Gerge Bebis Curse Prject Due Date: 11/29/2007 Part1: Cmparisn f Srting Algrithms (70% f the prject grade) The bjective f the first part f the assignment is

More information

Resampling Methods. Chapter 5. Chapter 5 1 / 52

Resampling Methods. Chapter 5. Chapter 5 1 / 52 Resampling Methds Chapter 5 Chapter 5 1 / 52 1 51 Validatin set apprach 2 52 Crss validatin 3 53 Btstrap Chapter 5 2 / 52 Abut Resampling An imprtant statistical tl Pretending the data as ppulatin and

More information

Methods for Determination of Mean Speckle Size in Simulated Speckle Pattern

Methods for Determination of Mean Speckle Size in Simulated Speckle Pattern 0.478/msr-04-004 MEASUREMENT SCENCE REVEW, Vlume 4, N. 3, 04 Methds fr Determinatin f Mean Speckle Size in Simulated Speckle Pattern. Hamarvá, P. Šmíd, P. Hrváth, M. Hrabvský nstitute f Physics f the Academy

More information

Kinetic Model Completeness

Kinetic Model Completeness 5.68J/10.652J Spring 2003 Lecture Ntes Tuesday April 15, 2003 Kinetic Mdel Cmpleteness We say a chemical kinetic mdel is cmplete fr a particular reactin cnditin when it cntains all the species and reactins

More information

Lecture 10, Principal Component Analysis

Lecture 10, Principal Component Analysis Principal Cmpnent Analysis Lecture 10, Principal Cmpnent Analysis Ha Helen Zhang Fall 2017 Ha Helen Zhang Lecture 10, Principal Cmpnent Analysis 1 / 16 Principal Cmpnent Analysis Lecture 10, Principal

More information

MATCHING TECHNIQUES. Technical Track Session VI. Emanuela Galasso. The World Bank

MATCHING TECHNIQUES. Technical Track Session VI. Emanuela Galasso. The World Bank MATCHING TECHNIQUES Technical Track Sessin VI Emanuela Galass The Wrld Bank These slides were develped by Christel Vermeersch and mdified by Emanuela Galass fr the purpse f this wrkshp When can we use

More information

Equilibrium of Stress

Equilibrium of Stress Equilibrium f Stress Cnsider tw perpendicular planes passing thrugh a pint p. The stress cmpnents acting n these planes are as shwn in ig. 3.4.1a. These stresses are usuall shwn tgether acting n a small

More information

On Huntsberger Type Shrinkage Estimator for the Mean of Normal Distribution ABSTRACT INTRODUCTION

On Huntsberger Type Shrinkage Estimator for the Mean of Normal Distribution ABSTRACT INTRODUCTION Malaysian Jurnal f Mathematical Sciences 4(): 7-4 () On Huntsberger Type Shrinkage Estimatr fr the Mean f Nrmal Distributin Department f Mathematical and Physical Sciences, University f Nizwa, Sultanate

More information

Introduction: A Generalized approach for computing the trajectories associated with the Newtonian N Body Problem

Introduction: A Generalized approach for computing the trajectories associated with the Newtonian N Body Problem A Generalized apprach fr cmputing the trajectries assciated with the Newtnian N Bdy Prblem AbuBar Mehmd, Syed Umer Abbas Shah and Ghulam Shabbir Faculty f Engineering Sciences, GIK Institute f Engineering

More information

Building to Transformations on Coordinate Axis Grade 5: Geometry Graph points on the coordinate plane to solve real-world and mathematical problems.

Building to Transformations on Coordinate Axis Grade 5: Geometry Graph points on the coordinate plane to solve real-world and mathematical problems. Building t Transfrmatins n Crdinate Axis Grade 5: Gemetry Graph pints n the crdinate plane t slve real-wrld and mathematical prblems. 5.G.1. Use a pair f perpendicular number lines, called axes, t define

More information

3.4 Shrinkage Methods Prostate Cancer Data Example (Continued) Ridge Regression

3.4 Shrinkage Methods Prostate Cancer Data Example (Continued) Ridge Regression 3.3.4 Prstate Cancer Data Example (Cntinued) 3.4 Shrinkage Methds 61 Table 3.3 shws the cefficients frm a number f different selectin and shrinkage methds. They are best-subset selectin using an all-subsets

More information

MODULE FOUR. This module addresses functions. SC Academic Elementary Algebra Standards:

MODULE FOUR. This module addresses functions. SC Academic Elementary Algebra Standards: MODULE FOUR This mdule addresses functins SC Academic Standards: EA-3.1 Classify a relatinship as being either a functin r nt a functin when given data as a table, set f rdered pairs, r graph. EA-3.2 Use

More information

CAUSAL INFERENCE. Technical Track Session I. Phillippe Leite. The World Bank

CAUSAL INFERENCE. Technical Track Session I. Phillippe Leite. The World Bank CAUSAL INFERENCE Technical Track Sessin I Phillippe Leite The Wrld Bank These slides were develped by Christel Vermeersch and mdified by Phillippe Leite fr the purpse f this wrkshp Plicy questins are causal

More information

A PLETHORA OF MULTI-PULSED SOLUTIONS FOR A BOUSSINESQ SYSTEM. Department of Mathematics, Penn State University University Park, PA16802, USA.

A PLETHORA OF MULTI-PULSED SOLUTIONS FOR A BOUSSINESQ SYSTEM. Department of Mathematics, Penn State University University Park, PA16802, USA. A PLETHORA OF MULTI-PULSED SOLUTIONS FOR A BOUSSINESQ SYSTEM MIN CHEN Department f Mathematics, Penn State University University Park, PA68, USA. Abstract. This paper studies traveling-wave slutins f the

More information

Observability-based Rules for Designing Consistent EKF SLAM Estimators

Observability-based Rules for Designing Consistent EKF SLAM Estimators 1 Observability-based Rules fr Designing Cnsistent EKF SLAM Estimatrs Guquan P Huang, Anastasis I Murikis, and Stergis I Rumelitis Dept f Cmputer Science and Engineering, University f Minnesta, Minneaplis,

More information

We can see from the graph above that the intersection is, i.e., [ ).

We can see from the graph above that the intersection is, i.e., [ ). MTH 111 Cllege Algebra Lecture Ntes July 2, 2014 Functin Arithmetic: With nt t much difficulty, we ntice that inputs f functins are numbers, and utputs f functins are numbers. S whatever we can d with

More information

Sections 15.1 to 15.12, 16.1 and 16.2 of the textbook (Robbins-Miller) cover the materials required for this topic.

Sections 15.1 to 15.12, 16.1 and 16.2 of the textbook (Robbins-Miller) cover the materials required for this topic. Tpic : AC Fundamentals, Sinusidal Wavefrm, and Phasrs Sectins 5. t 5., 6. and 6. f the textbk (Rbbins-Miller) cver the materials required fr this tpic.. Wavefrms in electrical systems are current r vltage

More information

SUPPLEMENTARY MATERIAL GaGa: a simple and flexible hierarchical model for microarray data analysis

SUPPLEMENTARY MATERIAL GaGa: a simple and flexible hierarchical model for microarray data analysis SUPPLEMENTARY MATERIAL GaGa: a simple and flexible hierarchical mdel fr micrarray data analysis David Rssell Department f Bistatistics M.D. Andersn Cancer Center, Hustn, TX 77030, USA rsselldavid@gmail.cm

More information

FIELD QUALITY IN ACCELERATOR MAGNETS

FIELD QUALITY IN ACCELERATOR MAGNETS FIELD QUALITY IN ACCELERATOR MAGNETS S. Russenschuck CERN, 1211 Geneva 23, Switzerland Abstract The field quality in the supercnducting magnets is expressed in terms f the cefficients f the Furier series

More information

T Algorithmic methods for data mining. Slide set 6: dimensionality reduction

T Algorithmic methods for data mining. Slide set 6: dimensionality reduction T-61.5060 Algrithmic methds fr data mining Slide set 6: dimensinality reductin reading assignment LRU bk: 11.1 11.3 PCA tutrial in mycurses (ptinal) ptinal: An Elementary Prf f a Therem f Jhnsn and Lindenstrauss,

More information

NOTE ON APPELL POLYNOMIALS

NOTE ON APPELL POLYNOMIALS NOTE ON APPELL POLYNOMIALS I. M. SHEFFER An interesting characterizatin f Appell plynmials by means f a Stieltjes integral has recently been given by Thrne. 1 We prpse t give a secnd such representatin,

More information

Pressure And Entropy Variations Across The Weak Shock Wave Due To Viscosity Effects

Pressure And Entropy Variations Across The Weak Shock Wave Due To Viscosity Effects Pressure And Entrpy Variatins Acrss The Weak Shck Wave Due T Viscsity Effects OSTAFA A. A. AHOUD Department f athematics Faculty f Science Benha University 13518 Benha EGYPT Abstract:-The nnlinear differential

More information

Computational modeling techniques

Computational modeling techniques Cmputatinal mdeling techniques Lecture 2: Mdeling change. In Petre Department f IT, Åb Akademi http://users.ab.fi/ipetre/cmpmd/ Cntent f the lecture Basic paradigm f mdeling change Examples Linear dynamical

More information

How do we solve it and what does the solution look like?

How do we solve it and what does the solution look like? Hw d we slve it and what des the slutin l lie? KF/PFs ffer slutins t dynamical systems, nnlinear in general, using predictin and update as data becmes available. Tracing in time r space ffers an ideal

More information

February 28, 2013 COMMENTS ON DIFFUSION, DIFFUSIVITY AND DERIVATION OF HYPERBOLIC EQUATIONS DESCRIBING THE DIFFUSION PHENOMENA

February 28, 2013 COMMENTS ON DIFFUSION, DIFFUSIVITY AND DERIVATION OF HYPERBOLIC EQUATIONS DESCRIBING THE DIFFUSION PHENOMENA February 28, 2013 COMMENTS ON DIFFUSION, DIFFUSIVITY AND DERIVATION OF HYPERBOLIC EQUATIONS DESCRIBING THE DIFFUSION PHENOMENA Mental Experiment regarding 1D randm walk Cnsider a cntainer f gas in thermal

More information

Smoothing, penalized least squares and splines

Smoothing, penalized least squares and splines Smthing, penalized least squares and splines Duglas Nychka, www.image.ucar.edu/~nychka Lcally weighted averages Penalized least squares smthers Prperties f smthers Splines and Reprducing Kernels The interplatin

More information

Revision: August 19, E Main Suite D Pullman, WA (509) Voice and Fax

Revision: August 19, E Main Suite D Pullman, WA (509) Voice and Fax .7.4: Direct frequency dmain circuit analysis Revisin: August 9, 00 5 E Main Suite D Pullman, WA 9963 (509) 334 6306 ice and Fax Overview n chapter.7., we determined the steadystate respnse f electrical

More information

1 The limitations of Hartree Fock approximation

1 The limitations of Hartree Fock approximation Chapter: Pst-Hartree Fck Methds - I The limitatins f Hartree Fck apprximatin The n electrn single determinant Hartree Fck wave functin is the variatinal best amng all pssible n electrn single determinants

More information

Lecture 2: Supervised vs. unsupervised learning, bias-variance tradeoff

Lecture 2: Supervised vs. unsupervised learning, bias-variance tradeoff Lecture 2: Supervised vs. unsupervised learning, bias-variance tradeff Reading: Chapter 2 STATS 202: Data mining and analysis September 27, 2017 1 / 20 Supervised vs. unsupervised learning In unsupervised

More information

Simple Linear Regression (single variable)

Simple Linear Regression (single variable) Simple Linear Regressin (single variable) Intrductin t Machine Learning Marek Petrik January 31, 2017 Sme f the figures in this presentatin are taken frm An Intrductin t Statistical Learning, with applicatins

More information

GRAPH EFFECTIVE RESISTANCE AND DISTRIBUTED CONTROL: SPECTRAL PROPERTIES AND APPLICATIONS

GRAPH EFFECTIVE RESISTANCE AND DISTRIBUTED CONTROL: SPECTRAL PROPERTIES AND APPLICATIONS GRAPH EFFECTIVE RESISTANCE AND DISTRIBUTED CONTROL: SPECTRAL PROPERTIES AND APPLICATIONS Prabir Barah Jã P. Hespanha Abstract We intrduce the cncept f matrix-valued effective resistance fr undirected matrix-weighted

More information

Lecture 2: Supervised vs. unsupervised learning, bias-variance tradeoff

Lecture 2: Supervised vs. unsupervised learning, bias-variance tradeoff Lecture 2: Supervised vs. unsupervised learning, bias-variance tradeff Reading: Chapter 2 STATS 202: Data mining and analysis September 27, 2017 1 / 20 Supervised vs. unsupervised learning In unsupervised

More information

Enhancing Performance of MLP/RBF Neural Classifiers via an Multivariate Data Distribution Scheme

Enhancing Performance of MLP/RBF Neural Classifiers via an Multivariate Data Distribution Scheme Enhancing Perfrmance f / Neural Classifiers via an Multivariate Data Distributin Scheme Halis Altun, Gökhan Gelen Nigde University, Electrical and Electrnics Engineering Department Nigde, Turkey haltun@nigde.edu.tr

More information

Chapter 3: Cluster Analysis

Chapter 3: Cluster Analysis Chapter 3: Cluster Analysis } 3.1 Basic Cncepts f Clustering 3.1.1 Cluster Analysis 3.1. Clustering Categries } 3. Partitining Methds 3..1 The principle 3.. K-Means Methd 3..3 K-Medids Methd 3..4 CLARA

More information

Source Coding and Compression

Source Coding and Compression Surce Cding and Cmpressin Heik Schwarz Cntact: Dr.-Ing. Heik Schwarz heik.schwarz@hhi.fraunhfer.de Heik Schwarz Surce Cding and Cmpressin September 22, 2013 1 / 60 PartI: Surce Cding Fundamentals Heik

More information

A Few Basic Facts About Isothermal Mass Transfer in a Binary Mixture

A Few Basic Facts About Isothermal Mass Transfer in a Binary Mixture Few asic Facts but Isthermal Mass Transfer in a inary Miture David Keffer Department f Chemical Engineering University f Tennessee first begun: pril 22, 2004 last updated: January 13, 2006 dkeffer@utk.edu

More information

Chapter 3 Kinematics in Two Dimensions; Vectors

Chapter 3 Kinematics in Two Dimensions; Vectors Chapter 3 Kinematics in Tw Dimensins; Vectrs Vectrs and Scalars Additin f Vectrs Graphical Methds (One and Tw- Dimensin) Multiplicatin f a Vectr b a Scalar Subtractin f Vectrs Graphical Methds Adding Vectrs

More information

Slide04 (supplemental) Haykin Chapter 4 (both 2nd and 3rd ed): Multi-Layer Perceptrons

Slide04 (supplemental) Haykin Chapter 4 (both 2nd and 3rd ed): Multi-Layer Perceptrons Slide04 supplemental) Haykin Chapter 4 bth 2nd and 3rd ed): Multi-Layer Perceptrns CPSC 636-600 Instructr: Ynsuck Che Heuristic fr Making Backprp Perfrm Better 1. Sequential vs. batch update: fr large

More information

Chapter Summary. Mathematical Induction Strong Induction Recursive Definitions Structural Induction Recursive Algorithms

Chapter Summary. Mathematical Induction Strong Induction Recursive Definitions Structural Induction Recursive Algorithms Chapter 5 1 Chapter Summary Mathematical Inductin Strng Inductin Recursive Definitins Structural Inductin Recursive Algrithms Sectin 5.1 3 Sectin Summary Mathematical Inductin Examples f Prf by Mathematical

More information

COMP 551 Applied Machine Learning Lecture 9: Support Vector Machines (cont d)

COMP 551 Applied Machine Learning Lecture 9: Support Vector Machines (cont d) COMP 551 Applied Machine Learning Lecture 9: Supprt Vectr Machines (cnt d) Instructr: Herke van Hf (herke.vanhf@mail.mcgill.ca) Slides mstly by: Class web page: www.cs.mcgill.ca/~hvanh2/cmp551 Unless therwise

More information

Interference is when two (or more) sets of waves meet and combine to produce a new pattern.

Interference is when two (or more) sets of waves meet and combine to produce a new pattern. Interference Interference is when tw (r mre) sets f waves meet and cmbine t prduce a new pattern. This pattern can vary depending n the riginal wave directin, wavelength, amplitude, etc. The tw mst extreme

More information

k-nearest Neighbor How to choose k Average of k points more reliable when: Large k: noise in attributes +o o noise in class labels

k-nearest Neighbor How to choose k Average of k points more reliable when: Large k: noise in attributes +o o noise in class labels Mtivating Example Memry-Based Learning Instance-Based Learning K-earest eighbr Inductive Assumptin Similar inputs map t similar utputs If nt true => learning is impssible If true => learning reduces t

More information

Marginal Conceptual Predictive Statistic for Mixed Model Selection

Marginal Conceptual Predictive Statistic for Mixed Model Selection Open Jurnal f Statistics, 06, 6, 39-53 Published Online April 06 in Sci http://wwwscirprg/jurnal/js http://dxdirg/0436/js0660 Marginal Cnceptual Predictive Statistic fr Mixed Mdel Selectin Cheng Wenren,

More information

V. Balakrishnan and S. Boyd. (To Appear in Systems and Control Letters, 1992) Abstract

V. Balakrishnan and S. Boyd. (To Appear in Systems and Control Letters, 1992) Abstract On Cmputing the WrstCase Peak Gain f Linear Systems V Balakrishnan and S Byd (T Appear in Systems and Cntrl Letters, 99) Abstract Based n the bunds due t Dyle and Byd, we present simple upper and lwer

More information

ROUNDING ERRORS IN BEAM-TRACKING CALCULATIONS

ROUNDING ERRORS IN BEAM-TRACKING CALCULATIONS Particle Acceleratrs, 1986, Vl. 19, pp. 99-105 0031-2460/86/1904-0099/$15.00/0 1986 Grdn and Breach, Science Publishers, S.A. Printed in the United States f America ROUNDING ERRORS IN BEAM-TRACKING CALCULATIONS

More information

Performance Bounds for Detect and Avoid Signal Sensing

Performance Bounds for Detect and Avoid Signal Sensing Perfrmance unds fr Detect and Avid Signal Sensing Sam Reisenfeld Real-ime Infrmatin etwrks, University f echnlgy, Sydney, radway, SW 007, Australia samr@uts.edu.au Abstract Detect and Avid (DAA) is a Cgnitive

More information

Differentiation Applications 1: Related Rates

Differentiation Applications 1: Related Rates Differentiatin Applicatins 1: Related Rates 151 Differentiatin Applicatins 1: Related Rates Mdel 1: Sliding Ladder 10 ladder y 10 ladder 10 ladder A 10 ft ladder is leaning against a wall when the bttm

More information

MATCHING TECHNIQUES Technical Track Session VI Céline Ferré The World Bank

MATCHING TECHNIQUES Technical Track Session VI Céline Ferré The World Bank MATCHING TECHNIQUES Technical Track Sessin VI Céline Ferré The Wrld Bank When can we use matching? What if the assignment t the treatment is nt dne randmly r based n an eligibility index, but n the basis

More information

Optimization Programming Problems For Control And Management Of Bacterial Disease With Two Stage Growth/Spread Among Plants

Optimization Programming Problems For Control And Management Of Bacterial Disease With Two Stage Growth/Spread Among Plants Internatinal Jurnal f Engineering Science Inventin ISSN (Online): 9 67, ISSN (Print): 9 676 www.ijesi.rg Vlume 5 Issue 8 ugust 06 PP.0-07 Optimizatin Prgramming Prblems Fr Cntrl nd Management Of Bacterial

More information

MATHEMATICS SYLLABUS SECONDARY 5th YEAR

MATHEMATICS SYLLABUS SECONDARY 5th YEAR Eurpean Schls Office f the Secretary-General Pedaggical Develpment Unit Ref. : 011-01-D-8-en- Orig. : EN MATHEMATICS SYLLABUS SECONDARY 5th YEAR 6 perid/week curse APPROVED BY THE JOINT TEACHING COMMITTEE

More information

SIZE BIAS IN LINE TRANSECT SAMPLING: A FIELD TEST. Mark C. Otto Statistics Research Division, Bureau of the Census Washington, D.C , U.S.A.

SIZE BIAS IN LINE TRANSECT SAMPLING: A FIELD TEST. Mark C. Otto Statistics Research Division, Bureau of the Census Washington, D.C , U.S.A. SIZE BIAS IN LINE TRANSECT SAMPLING: A FIELD TEST Mark C. Ott Statistics Research Divisin, Bureau f the Census Washingtn, D.C. 20233, U.S.A. and Kenneth H. Pllck Department f Statistics, Nrth Carlina State

More information

A New Approach to Increase Parallelism for Dependent Loops

A New Approach to Increase Parallelism for Dependent Loops A New Apprach t Increase Parallelism fr Dependent Lps Yeng-Sheng Chen, Department f Electrical Engineering, Natinal Taiwan University, Taipei 06, Taiwan, Tsang-Ming Jiang, Arctic Regin Supercmputing Center,

More information

A mathematical model for complete stress-strain curve prediction of permeable concrete

A mathematical model for complete stress-strain curve prediction of permeable concrete A mathematical mdel fr cmplete stress-strain curve predictin f permeable cncrete M. K. Hussin Y. Zhuge F. Bullen W. P. Lkuge Faculty f Engineering and Surveying, University f Suthern Queensland, Twmba,

More information

Computational modeling techniques

Computational modeling techniques Cmputatinal mdeling techniques Lecture 11: Mdeling with systems f ODEs In Petre Department f IT, Ab Akademi http://www.users.ab.fi/ipetre/cmpmd/ Mdeling with differential equatins Mdeling strategy Fcus

More information

COMP 551 Applied Machine Learning Lecture 4: Linear classification

COMP 551 Applied Machine Learning Lecture 4: Linear classification COMP 551 Applied Machine Learning Lecture 4: Linear classificatin Instructr: Jelle Pineau (jpineau@cs.mcgill.ca) Class web page: www.cs.mcgill.ca/~jpineau/cmp551 Unless therwise nted, all material psted

More information

Collocation Map for Overcoming Data Sparseness

Collocation Map for Overcoming Data Sparseness Cllcatin Map fr Overcming Data Sparseness Mnj Kim, Yung S. Han, and Key-Sun Chi Department f Cmputer Science Krea Advanced Institute f Science and Technlgy Taejn, 305-701, Krea mj0712~eve.kaist.ac.kr,

More information

Midwest Big Data Summer School: Machine Learning I: Introduction. Kris De Brabanter

Midwest Big Data Summer School: Machine Learning I: Introduction. Kris De Brabanter Midwest Big Data Summer Schl: Machine Learning I: Intrductin Kris De Brabanter kbrabant@iastate.edu Iwa State University Department f Statistics Department f Cmputer Science June 24, 2016 1/24 Outline

More information

Margin Distribution and Learning Algorithms

Margin Distribution and Learning Algorithms ICML 03 Margin Distributin and Learning Algrithms Ashutsh Garg IBM Almaden Research Center, San Jse, CA 9513 USA Dan Rth Department f Cmputer Science, University f Illinis, Urbana, IL 61801 USA ASHUTOSH@US.IBM.COM

More information

7.0 Heat Transfer in an External Laminar Boundary Layer

7.0 Heat Transfer in an External Laminar Boundary Layer 7.0 Heat ransfer in an Eternal Laminar Bundary Layer 7. Intrductin In this chapter, we will assume: ) hat the fluid prperties are cnstant and unaffected by temperature variatins. ) he thermal & mmentum

More information

NOTE ON THE ANALYSIS OF A RANDOMIZED BLOCK DESIGN. Junjiro Ogawa University of North Carolina

NOTE ON THE ANALYSIS OF A RANDOMIZED BLOCK DESIGN. Junjiro Ogawa University of North Carolina NOTE ON THE ANALYSIS OF A RANDOMIZED BLOCK DESIGN by Junjir Ogawa University f Nrth Carlina This research was supprted by the Office f Naval Research under Cntract N. Nnr-855(06) fr research in prbability

More information

CHAPTER 3 INEQUALITIES. Copyright -The Institute of Chartered Accountants of India

CHAPTER 3 INEQUALITIES. Copyright -The Institute of Chartered Accountants of India CHAPTER 3 INEQUALITIES Cpyright -The Institute f Chartered Accuntants f India INEQUALITIES LEARNING OBJECTIVES One f the widely used decisin making prblems, nwadays, is t decide n the ptimal mix f scarce

More information

Probability, Random Variables, and Processes. Probability

Probability, Random Variables, and Processes. Probability Prbability, Randm Variables, and Prcesses Prbability Prbability Prbability thery: branch f mathematics fr descriptin and mdelling f randm events Mdern prbability thery - the aximatic definitin f prbability

More information

CHAPTER 4 DIAGNOSTICS FOR INFLUENTIAL OBSERVATIONS

CHAPTER 4 DIAGNOSTICS FOR INFLUENTIAL OBSERVATIONS CHAPTER 4 DIAGNOSTICS FOR INFLUENTIAL OBSERVATIONS 1 Influential bservatins are bservatins whse presence in the data can have a distrting effect n the parameter estimates and pssibly the entire analysis,

More information

A Simple Set of Test Matrices for Eigenvalue Programs*

A Simple Set of Test Matrices for Eigenvalue Programs* Simple Set f Test Matrices fr Eigenvalue Prgrams* By C. W. Gear** bstract. Sets f simple matrices f rder N are given, tgether with all f their eigenvalues and right eigenvectrs, and simple rules fr generating

More information

Localized Model Selection for Regression

Localized Model Selection for Regression Lcalized Mdel Selectin fr Regressin Yuhng Yang Schl f Statistics University f Minnesta Church Street S.E. Minneaplis, MN 5555 May 7, 007 Abstract Research n mdel/prcedure selectin has fcused n selecting

More information

Automatic control teaching can be fragmented, comprising

Automatic control teaching can be fragmented, comprising LECURE NOES Frm Classical t State-Feedback-Based Cntrllers By Juan I Yuz and Mari E Salgad Autmatic cntrl teaching can be fragmented, cmprising different streams that seem t be discnnec t ed r even cmpeting

More information

Neural Networks with Wavelet Based Denoising Layers for Time Series Prediction

Neural Networks with Wavelet Based Denoising Layers for Time Series Prediction Neural Netwrks with Wavelet Based Denising Layers fr Time Series Predictin UROS LOTRIC 1 AND ANDREJ DOBNIKAR University f Lublana, Faculty f Cmputer and Infrmatin Science, Slvenia, e-mail: {urs.ltric,

More information

Comparison of two variable parameter Muskingum methods

Comparison of two variable parameter Muskingum methods Extreme Hydrlgical Events: Precipitatin, Flds and Drughts (Prceedings f the Ykhama Sympsium, July 1993). IAHS Publ. n. 213, 1993. 129 Cmparisn f tw variable parameter Muskingum methds M. PERUMAL Department

More information

a(k) received through m channels of length N and coefficients v(k) is an additive independent white Gaussian noise with

a(k) received through m channels of length N and coefficients v(k) is an additive independent white Gaussian noise with urst Mde Nn-Causal Decisin-Feedback Equalizer based n Sft Decisins Elisabeth de Carvalh and Dirk T.M. Slck Institut EURECOM, 2229 rute des Crêtes,.P. 93, 694 Sphia ntiplis Cedex, FRNCE Tel: +33 493263

More information