Application of Bayesian Filters to Heat Conduction Problems
|
|
- Ethelbert Fletcher
- 5 years ago
- Views:
Transcription
1 EngOpt 28 - Internatonal Conference on Engneerng Optmzaton Ro de Janero, Brazl, - 5 June 28. Applcaton of Bayesan Flters to Heat Conducton Problems Helco R. B. Orlande, George S. Dulkravch 2 and Marcelo J. Colaço 3 Department of Mechancal Engneerng, COPPE, Federal Unversty of Ro de Janero, Brazl, helco@mecanca.coppe.ufrj.br Department of Mechancal and Materals Engneerng, Florda Internatonal Unversty, Mam, U.S.A., dulkrav@fu.edu Department of Mechancal and Materals Engneerng, Mltary Insttute of Engneerng, Ro de Janero, RJ, Brazl, colaco@asme.org. Abstract In ths paper we present a general descrpton of state estmaton problems wthn the Bayesan framework. State estmaton problems are addressed n whch evoluton and measurement stochastc models are used to predct the dynamc behavor of physcal systems. Specfcally, the applcaton of two Bayesan flters to lnear and non-lnear unsteady heat conducton problems s demonstrated; a) the use of Kalman flter, and b) the use of Partcle Flter wth the samplng mportance resamplng algorthm. 2. Keywords: Kalman flter, Partcle flter, state estmaton 3. Introducton State estmaton problems, also desgnated as nonstatonary nverse problems [], are of great nterest n nnumerable practcal applcatons. In such knds of problems, the avalable measured data s used together wth pror knowledge about the physcal phenomena and the measurng devces, n order to sequentally produce estmates of the desred dynamc varables. Ths s accomplshed n such a manner that the error s mnmzed statstcally [2]. For example, the poston of an arcraft can be estmated through the tme-ntegraton of ts velocty components snce departure. However, t may also be measured wth a GPS system and an altmeter. State estmaton problems deal wth the combnaton of the model predcton (ntegraton of the velocty components that contan errors due to the velocty measurements) and the GPS and altmeter measurements that are also uncertan, n order to obtan more accurate estmatons of the system varables (arcraft poston). State estmaton problems are solved wth the so-called Bayesan flters [,2]. In the Bayesan approach to statstcs, an attempt s made to utlze all avalable nformaton n order to reduce the amount of uncertanty present n an nferental or decson-makng problem. As new nformaton s obtaned, t s combned wth prevous nformaton to form the bass for statstcal procedures. The formal mechansm used to combne the new nformaton wth the prevously avalable nformaton s known as Bayes theorem [,3]. The most wdely known Bayesan flter method s the Kalman flter [,2,4-9]. However, the applcaton of the Kalman flter s lmted to lnear models wth addtve Gaussan noses. Extensons of the Kalman flter were developed n the past for less restrctve cases by usng lnearzaton technques [,3,6,7,8]. Smlarly, Monte Carlo methods have been developed n order to represent the posteror densty n terms of random samples and assocated weghts. Such Monte Carlo methods, usually denoted as partcle flters among other desgnatons found n the lterature, do not requre the restrctve hypotheses of the Kalman flter. Hence, partcle flters can be appled to non-lnear models wth non-gaussan errors [,4,8-7]. In ths paper we apply the Kalman flter and the partcle flter to heat conducton problems. These Bayesan flters are used to predct the temperature n a medum where the heat conducton model and temperature measurements contan errors. Lnear and nonlnear heat conducton problems are examned, as well as Gaussan and non-gaussan nose. Before focusng on the heat conducton applcatons of nterest, the state estmaton problem s defned and the Kalman and partcle flters are descrbed. 4. State Estmaton Problem In order to defne the state estmaton problem, consder a model for the evoluton of the vector x n the form xk = fk( xk, v k ) (.a) n where the subscrpt k =, 2,, denotes a tme nstant t k n a dynamc problem. The vector x R x s called the state vector and contans the varables to be dynamcally estmated. Ths vector advances n accordance wth the state evoluton model gven by n equaton (.a), where f s, n the general case, a non-lnear functon of the state varables x and of the state nose vector v R v. n Consder also that measurements z z k R are avalable at t k, k =, 2,. The measurements are related to the state varables x through the general, possbly non-lnear, functon h n the form zk = hk( xk, n k) (.b) n where n R n s the measurement nose. Equaton (.b) s referred to as the observaton (measurement) model. The state estmaton problem ams at obtanng nformaton about x k based on the state evoluton model (.a) and on the measurements z: k = { z, =, K, k} gven by the observaton model (.b) [-7]. The evoluton-observaton model gven by equatons (.a,b) are based on the followng assumptons [,4]: () The sequence xk for k =, 2,, s a Markovan process, that s, π( xk x, x, K, xk ) = π( xk xk ) (2.a) () The sequence zk for k =, 2,, s a Markovan process wth respect to the hstory of x k, that s, π( zk x, x, K, xk) = π( zk xk) (2.b)
2 () The sequence x k depends on the past observatons only through ts own hstory, that s, π( k k, : k ) = π( k k ) where π ( ab ) denotes the condtonal probablty of a when b s gven. x x z x x (2.c) In addton, for the evoluton-observaton model gven by equatons (.a,b) t s assumed that for j the nose vectors v and v j, as well as n and n j, are mutually ndependent and also mutually ndependent of the ntal state x. The vectors v and n j are also mutually ndependent for all and j []. Dfferent problems can be consdered wth the above evoluton-observaton model, namely []: () The predcton problem, concerned wth the determnaton of π ( xk z : k ) ; () The flterng problem, concerned wth the determnaton of π ( xk z : k) ; () The fxed-lag smoothng problem, concerned the determnaton of π ( xk z : k+ p), where p s the fxed lag; (v) The whole-doman smoothng problem, concerned wth the determnaton of π ( xk z : K), where z: K = { z, =, K, K} s the complete sequence of measurements. Ths paper deals only wth the flterng problem. By assumng that π( x z) = π( x ) s avalable, the posteror probablty densty π ( xk z : k) s then obtaned wth Bayesan flters n two steps [-7]: predcton and update, as llustrated n fgure. The Kalman flter and the partcle flter used n ths work are dscussed below. π(x ) π(x x ) Predcton π(x ) Update π(z x ) π(x z ) π(x 2 x ) Predcton π(x 2 z ) Update π(z 2 x 2 ) π(x 2 z :2 ) M Fgure. Predcton and update steps for the Bayesan flter [] 5. The Kalman Flter For the applcaton of the Kalman flter t s assumed that the evoluton and observaton models gven by equatons (.a,b) are lnear. Also, t s assumed that the noses n such models are Gaussan, wth known means and covarances, and that they are addtve. Therefore, the posteror densty π ( xk z : k) at t k, k =, 2, s Gaussan and the Kalman flter results n the optmal soluton to the state estmaton problem, that s, the posteror densty s calculated exactly [,2,4-9]. Wth the foregong hypotheses, the evoluton and observaton models can be wrtten respectvely as: xk = Fkxk + v k (3.a) zk = Hkxk + n k (3.b) where F and H are known matrces for the lnear evolutons of the state x and of the observaton z, respectvely. By assumng that the noses v and n have zero means and covarance matrces Q and R, respectvely, the predcton and update steps of the Kalman flter are gven by [,2,4-9]:
3 Predcton: Update: xk = Fkx k (4.a) Pk = FkPk Fk T + Q k (4.b) T ( ) T Kk = PkHk HkPkHk + R k (5.a) k x = xk + Kk( zk Hkx k) (5.b) ( ) Pk = I-KkHk P k (5.c) The matrx K s called Kalman s gan matrx. Notce above that after predctng the state varable x and ts covarance matrx P wth equatons (4.a,b), a posteror estmates for such quanttes are obtaned n the update step wth the utlzaton of the measurements z. For other cases for whch the hypotheses of lnear Gaussan evoluton-observaton models are not vald, the use of the Kalman flter does not result n optmal solutons because the posteror densty s not analytc. The applcaton of Monte Carlo technques then appears as the most general and robust approach to non-lnear and/or non-gaussan dstrbutons [,4,8-7]. Ths s the case despte the avalablty of the so-called extended Kalman flter and ts varatons, whch generally nvolves a lnearzaton of the problem. A Monte Carlo flter s descrbed below. 6. The Partcle Flter The Partcle Flter Method [,4,8-7] s a Monte Carlo technque for the soluton of the state estmaton problem. The partcle flter s also known as the bootstrap flter, condensaton algorthm, nteractng partcle approxmatons and survval of the fttest [8]. The key dea s to represent the requred posteror densty functon by a set of random samples (partcles) wth assocated weghts, and to compute the estmates based on these samples and weghts. As the number of samples becomes very large, ths Monte Carlo characterzaton becomes an equvalent representaton of the posteror probablty functon, and the soluton approaches the optmal Bayesan estmate. We present below the so-called Sequental Importance Samplng (SIS) algorthm for the partcle flter, whch ncludes a resamplng step at each nstant, as descrbed n detal n references [8,9]. The SIS algorthm makes use of an mportance densty, whch s a densty proposed to represent another one that cannot be exactly computed, that s, the sought posteror densty n the present case. Then, samples are drawn from the mportance densty nstead of the actual densty. Let { x:, = k, K, N } be the partcles wth assocated weghts { w k, =, K, N} and x: k = { xj, j =, K, k} be the set of all states N up to t k, where N s the number of partcles. The weghts are normalzed so that wk =. Then, the posteror densty at t k can be = dscretely approxmated by: N π( x: k z: k) wkδ( x: k x : k) (6.a) = where δ(.) s the Drac delta functon. By takng hypotheses (2.a-c) nto account, the posteror densty (6.a) can be wrtten as [9]: N π( xk z: k) wkδ( xk x k) (6.b) = A common problem wth the SIS partcle flter s the degeneracy phenomenon, where after a few states all but one partcle wll have neglgble weght [,4,8-7]. Ths degeneracy mples that a large computatonal effort s devoted to updatng partcles whose contrbuton to the approxmaton of the posteror densty functon s almost zero. Ths problem can be overcome by ncreasng the number of partcles, or more effcently by approprately selectng the mportance densty as the pror densty π ( xk x k ). In addton, the use of the resamplng technque s recommended to avod the degeneracy of the partcles. Resamplng nvolves a mappng of the random measure { * x k, wk} nto a random measure { x k, N } wth unform weghts. It can be performed f the number of effectve partcles wth large weghts falls below a certan threshold number. Alternatvely, resamplng can also be appled ndstnctvely at every nstant t k, as n the Samplng Importance Resamplng (SIR) algorthm descrbed n [8,9]. Such algorthm can be summarzed n the followng steps, as appled to the system evoluton from t k- to t k [8,9]: Step. For =,, N draw new partcles x k from the pror densty π ( xk x k ) and then use the lkelhood densty to calculate the correspondent weghts w k = π ( zk x k). Step 2. Calculate the total weght w = T w. k w k T w N = w and then normalze the partcle weghts, that s, for =,, N let = k
4 Step 3. Resample the partcles as follows: Step 3.. Construct the cumulatve sum of weghts (CSW) by computng c = c + wk for =,, N, wth c =. Step 3.2. Let = and draw a startng pont u from the unform dstrbuton U[, N ]. Step 3.3. For j =,, N Move along the CSW by makng uj = u + N ( j ). Whle uj > c make = +. j Assgn sample x k = x k. j Assgn weght wk = N. Although the resamplng step reduces the effects of the degeneracy problem, t may lead to a loss of dversty and the resultant sample can contan many repeated partcles. Ths problem, known as sample mpovershment, can be severe n the case of small process nose. In ths stuaton, all partcles collapse to a sngle partcle wthn few nstants t k [,8,9]. Another drawback of the partcle flter s related to the large computatonal cost due to the Monte Carlo method, whch may lmt ts applcaton to complcated physcal problems. 7. Results and Dscussons In ths sesson we apply the Bayesan flters descrbed above to the estmaton of the transent temperature feld n heat conductng meda. Lnear and non-lnear heat conducton problems are addressed, as well as dfferent models for the noses. The problems under study are descrbed below and the results obtaned wth the Kalman and partcle flters are dscussed. 7.. Lnear Heat Conducton Problem Consder heat conducton n a sem-nfnte one-dmensonal medum, ntally at the unform temperature T*. The temperature at boundary x = s kept at T = o C. Physcal propertes are constant and there s no heat generaton n the medum. The formulaton for ths problem s gven by: 2 T T = 2 α t x n x >, for t > (7.a) T = at x=, for t > (7.b) T = T* for t=, n x > (7.c) The analytcal soluton for ths problem s gven by [8]: x T( x, t) = T * erf 4αt (8) The dscretzaton of equaton (7.a) by usng explct fnte-dfferences results n: k+ k k k T = rt + ( 2 r) T + rt+ (9) where the superscrpt k denotes the tme step, the subscrpt denotes the fnte-dfference node and α t r = 2 ( x) () For the soluton of problem (7.a-c) wth fnte-dfferences we have to mpose a boundary condton at some fcttous surface at x=l. We assume L suffcently large for the tme range of nterest, so that the fnte doman behaves as a sem-nfnte medum. Temperature at the surface x=l was assumed to be T*. The fnte-dfference soluton for problem (7.a-c) can be wrtten as: k k T = FT + S () where ( 2 r) r T r ( 2 r) r Τ = M F = O O O M S = T N r ( 2 r) r r ( 2 r) rt * (2.a-c) In the equatons above N s the number of nternal nodes n the fnte-dfference dscretzaton. Matrx F s NxN and vectors T and S s Nx. Equaton () s n approprate form for the applcaton of the Kalman flter (see equaton 3.a). In the present example t s assumed that state and measured varables are the transent temperatures nsde the medum at the equdstant fnte dfference nodes. Therefore, matrx H for the observaton model (see equaton 3.b) s the dentty matrx. The medum s consdered to be concrete, wth thermal dffusvty α = 4.9x -7 m 2 /s. The standard devaton for the measurement errors s consdered constant and equal to 2 o C. The effects of the standard devaton of the errors n the state model are examned below. Fgures 2.a and 2.b present the exact temperatures and the measured temperatures n the regon, respectvely. The fnal tme s taken as 25 seconds and measurements are supposed avalable n the regon every second. The thckness of the medum s consdered to be L =. m and the regon s dscretzed wth N = 5 nternal nodes.
5 Temperature Temperature T, C 4 2 T, C x, m Fgure 2.a temperatures x, m 5 Fgure 2.b temperatures contanng Gaussan errors wth standard devaton of 2 o C Fgures 3.a,b present a comparson of exact, measured and predcted temperatures at postons x =.2 m and x =. m, respectvely. The predcted temperatures were obtaned wth the Kalman flter. The 99% confdence ntervals for the predcted temperatures are also presented n ths fgure. The results presented n fgures 3.a-d were obtaned wth a standard devaton for the evoluton model errors of o C. These fgures clearly show a great mprovement n the predcted temperatures as compared to the measured temperatures at dfferent postons nsde the medum. Note that predcted temperatures are much closer to the exact ones than the measurements. In fact, f the model errors are reduced, the predcted temperatures tend to follow the model more closely. Ths s exemplfed n fgures 4.a,b, where the standard devaton of the evoluton model errors was reduced to.5 o C. On the other hand, f such errors are large, the predctons of the Kalman flter tend to follow the measurements nstead of the model. Such a fact s clear from the analyss of fgures 5.a,b, whch present the results for a standard devaton for the evoluton model errors of 2 o C. The applcaton of the partcle flter wth the samplng mportance resamplng algorthm descrbed above s presented n fgures 6.a,b. These fgures present the exact, measured and predcted temperatures at postons x =.2 m and x =. m, respectvely. Ffty partcles were used n ths case. A comparson of fgures 3.a,b and 6.a,b show that the partcle flter, smlarly to the Kalman flter, provded accurate predctons for the temperature n the regon. However, as expected, the computatonal cost of the partcle flter was substantally larger than that of the Kalman flter. For ths example, the predctons obtaned wth the Kalman flter took.5 seconds and those obtaned wth the partcle flter took 6.9 seconds on a.8 GHz Centrno Duo computer wth Mbyte of RAM memory. We note that for ths case the computatonal cost of the partcle flter could be reduced to 2.3 seconds by decreasng the number of partcles to, wthout sgnfcant loss of accuracy n the predcted temperatures T(x=.2 m), C 2 T(x=. m), C (a) (b) Fgure 3 Temperature at (a) x =.2 m and (b) x =. m standard devaton for the evoluton model errors of o C Kalman flter
6 T(x=.2 m), C 3 2 T(x=. m), C (a) (b) Fgure 4 Temperature at (a) x =.2 m and (b) x =. m standard devaton for the evoluton model errors of.5 o C Kalman flter T(x=.2 m), C 3 2 T(x=. m), C (a) (b) Fgure 5 Temperature at (a) x =.2 m and (b) x =. m standard devaton for the evoluton model errors of 5 o C Kalman flter 5 4 Partcle Flter wth Re-samplng - Number of Partcles = Partcle Flter wth Re-samplng - Number of Partcles = T(x=.2 m), C 2 T(x=. m), C (a) (b) Fgure 6 Temperature at (a) x =.2 m and (b) x =. m standard devaton for the evoluton model errors of o C Partcle flter wth resamplng Fgures 7.a,b present results smlar to those of fgures 6.a,b, but wthout usng the resamplng technque. These fgures show that the predctons obtaned wthout resamplng were qute uncertan, that s, wth large confdence ntervals. On the other hand, sample mpovershment can be observed when resamplng was used, whch s characterzed by the very narrow confdence ntervals for the predcted temperatures shown n fgures 6.a,b.
7 We now examne a case nvolvng unformly dstrbuted errors n the evoluton model, nstead of Gaussan errors. For such case, the applcaton of the Kalman flter does not result n optmal solutons. Consequently, only the partcle flter was consdered for the predcton of the temperatures n the regon. The results obtaned wth errors n the evoluton model unformly dstrbuted n the nterval [-,] o C are presented n fgures 8.a,b for x =.2 m and x =. m, respectvely. These fgures show that the partcle flter was not affected by the dstrbuton of the errors and results smlar to those obtaned for the Gaussan dstrbuton (see fgures 6.a,b) were obtaned. 5 4 Partcle Flter - Number of Partcles = 5 - CPU Tme = sec 6 5 Partcle Flter - Number of Partcles = 5 - CPU Tme = sec 3 4 T(x=.2 m), C 2 T(x=. m), C (a) (b) Fgure 7 Temperature at (a) x =.2 m and (b) x =. m standard devaton for the evoluton model errors of o C Partcle flter wthout resamplng 5 4 Partcle Flter wth Re-samplng - Number of Partcles = Partcle Flter wth Re-samplng - Number of Partcles = T(x=.2 m), C 2 T(x=. m), C (a) (b) Fgure 8 Temperature at (a) x =.2 m and (b) x =. m evoluton model errors havng unform dstrbuton n [-,] o C Partcle flter wth resamplng 7.2. Non-lnear Heat Conducton Problem Consder heat conducton n a one-dmensonal medum wth thckness L, ntally at the unform temperature T*. The boundary at x = s kept nsulated and a constant heat flux q* s mposed at x = L. Thermophyscal propertes are temperature dependent and there s no heat generaton n the medum. The formulaton for ths problem s gven by: T T CT ( ) = kt ( ) t x x n < x < L, for t > (3.a) T = x at x=, for t > (3.b) T kt ( ) = q* x at x=l, for t > (3.c) T = T * for t=, n x > (3.d) We examne here a physcal problem smlar to those examned n references [9,2] nvolvng the heatng of a graphte sample wth an oxy-acetylene torch. The temperature dependence of the thermal conductvty, k(t), and volumetrc heat capacty, C(T), of the graphte, measured for dfferent temperatures, were curve-ftted (see fgure 9) wth exponentals of the form:
8 ( ) 3 CT = A+ Ae T A (4.a) 2 ( ) 3 k T = B + B e T B (4.b) 2 wth the adjusted parameters A, A 2, A 3, B, B 2 and B 3 gven n table. Table. Parameters of the curve-ftted thermophyscal propertes Parameter Mean A (Jm -3 ºC - ) 5,68,6 A 2 (Jm -3 ºC - ) 4,83,57 A 3 (ºC) 547. B (Wm - ºC - ) B 2 (Wm - ºC - ) 83.5 B 3 (ºC) 277. Capacdade Volumetrc Térmca Heat Capacty Volumetrca (Jm (J/m -3o C 3. C) - ) 6x 6 5x 6 4x 6 3x 6 2x 6 x 6 Thermal Condutvdade conductvty térmca Heat Capacdade capacty térmca Temperature Temperatura ( o ( C) Fgure 9. Temperature-dependent thermophyscal propertes Thermal Condutvdade Conductvty térmca (W/m. C) (Wm -o C - ) The sample was supposed to be ntally at the room temperature of T* = 2 o C and the mposed heat flux was q* = 5 W/m 2. The thckness of the slab was taken as L =. m. Fnte volumes were used for the soluton of ths nonlnear heat conducton problem, wth the regon dscretzed wth 5 equal volumes. The fnal tme was supposed to be 9 seconds and the tme step was taken as second. The errors n the state evoluton and observaton models were supposed to be addtve, Gaussan, uncorrelated, wth zero mean and constant standard devatons. In order to examne a very strct case, the standard devaton for the state evoluton model was set to 5 o C and for the observaton model as o C. Fgures.a and.b present the exact and measured temperatures, respectvely, for such non lnear heat conducton problem. It s apparent from the analyss of these fgures that extremely large measurement errors were consdered for ths case. State evoluton and measurement models were used for the predcton of the temperature varaton n the regon. Due to the nonlnear character of the problem under consderaton, only the partcle flter, n the form of the samplng mportance resamplng algorthm descrbed above, was used for the predctons. Ffty partcles were used n such flterng algorthm. Fgures.a-d present a comparson of exact, measured and predcted temperatures at the postons x =.2 m,. m,.2 m and.4 m, respectvely. An analyss of these fgures reveals the robustness of the partcle flter. Despte the very large errors n the evoluton and observaton models, the predcted average temperatures are n excellent agreement wth the exact values. Furthermore, the 99% confdence ntervals for the predcted temperatures are sgnfcantly smaller than the dsperson of the measurements. Dfferently from the case analyzed above nvolvng lnear heat conducton, sample mpovershment s not observed n fgures.a-d. Ths s probably due to the large nose n the state model used for the nonlnear case. The computatonal tme for ths case was 6.3 seconds.
9 Temperature T, C x, m Fgure.a temperatures Temperature T, C x, m Fgure.b temperatures contanng Gaussan errors wth standard devaton
10 6 Partcle Flter wth Re-samplng - Number of Partcles = T(x=.2 m), C Fgure.a Temperature at x =.2 m for the nonlnear heat conducton problem Partcle flter 6 Partcle Flter wth Re-samplng - Number of Partcles = T(x=. m), C Fgure.b Temperature at x =. m for the nonlnear heat conducton problem Partcle flter
11 7 Partcle Flter wth Re-samplng - Number of Partcles = T(x=.2 m), C Fgure.c Temperature at x =.2 m for the nonlnear heat conducton problem Partcle flter 6 Partcle Flter wth Re-samplng - Number of Partcles = T(x=.4 m), C Fgure.d Temperature at x =.4 m for the nonlnear heat conducton problem Partcle flter 8. Conclusons Ths paper dealt wth the applcaton of the Kalman flter and of the partcle flter to the estmaton of the transent temperature feld n lnear and non-lnear heat conducton problems. The partcle flter was coded n the form of the samplng mportance resamplng algorthm. State estmaton problems wth lnear evoluton-observaton models, contanng addtve Gaussan noses, were solved wth these Bayesan flter technques. For lnear-gaussan models, the Kalman flter and the partcle flter provded results of smlar accuracy. However, the computatonal cost of the partcle flter was sgnfcantly larger than that of the Kalman flter. On the other hand, n non-lnear and/or non-gaussan models the basc hypotheses requred for the applcaton of the Kalman flter are not vald. The partcle flter appears n the lterature as an accurate estmaton technque of general use, ncludng for non-lnear and/or non- Gaussan models. In ths paper, the partcle flter was successfully appled to a non-lnear heat conducton problem. Such Monte Carlo technque provded accurate estmaton results, even for a strct test-case nvolvng very large errors n the evoluton and observaton models.
12 9. Acknowledgements The vsts of Prof. Helco Orlande and Prof. Marcelo Colaço to Florda Internatonal Unversty, n January-February 28, were sponsored by CAPES and CNPq, agences for the fosterng of scence from the Brazlan government. The hosptalty of Prof. George S. Dulkravch and hs famly, as well as of the Department of Mechancal and Materals Engneerng of FIU, s greatly apprecated. Prof. Helco Orlande would lke to acknowledge the course on Statstcal and Computatonal Inverse Problems gven at the Federal Unversty of Ro de Janero by Prof. Jar Kapo and Prof. Vlle Kolehmanen, from the Unversty of Kuopo n Fnland. The authors are grateful for the fnancal support provded for ths work by the US Ar Force Offce of Scentfc Research under grant FA montored by Dr. Todd E. Combs, Dr. Farba Fahroo and Dr. Donald Hearn and by the US Army Research Offce/Materals Dvson under the contract number W9NF montored by Dr. Wllam M. Mullns. The vews and conclusons contaned heren are those of the authors and should not be nterpreted as necessarly representng the offcal polces or endorsements, ether expressed or mpled, of the US Ar Force Offce of Scentfc Research, the US Army Research Offce or the U.S. Government. The U.S. Government s authorzed to reproduce and dstrbute reprnts for government purposes notwthstandng any copyrght notaton thereon.. References. Kapo, J. and Somersalo, E., 24, Statstcal and Computatonal Inverse Problems, Appled Mathematcal Scences 6, Sprnger-Verlag. 2. Maybeck, P., 979, Stochastc models, estmaton and control, Academc Press, New York. 3. Wnkler, R., 23, An Introducton to Bayesan Inference and Decson, Probablstc Publshng, Gansvlle. 4. Kapo, J., Duncan S., Seppanen, A., Somersalo, E., Voutlanen, A., 25, State Estmaton for Process Imagng, Chapter n Handbook of Process Imagng for Automatc Control, edtors: Davd Scott and Hugh McCann, CRC Press. 5. Kalman, R., 96, A New Approach to Lnear Flterng and Predcton Problems, ASME J. Basc Engneerng, vol. 82, pp Sorenson, H., 97, Least-squares estmaton: from Gauss to Kalman, IEEE Spectrum, vol. 7, pp Welch, G. and Bshop, G., 26, An Introducton to the Kalman Flter, UNC-Chapel Hll, TR Arulampalam, S., Maskell, S., Gordon, N., Clapp, T., 2, A Tutoral on Partcle Flters for on-lne Non-lnear/Non- Gaussan Bayesan Trackng, IEEE Trans. Sgnal Processng, vol. 5, pp Rstc, B., Arulampalam, S., Gordon, N., 24, Beyond the Kalman Flter, Artech House, Boston.. Doucet, A., Godsll, S., Andreu, C., 2, On sequental Monte Carlo samplng methods for Bayesan flterng, Statstcs and Computng, vol., pp Lu, J and Chen, R., 998, Sequental Monte Carlo methods for dynamcal systems, J. Amercan Statstcal Assocaton, vol. 93, pp Andreu, C., Doucet, A., Robert, C., 24, Computatonal advances for and from Bayesan analyss, Statstcal Scence, vol. 9, pp Johansen, A. Doucet, A., 28, A note on auxlary partcle flters, Statstcs and Probablty Letters, to appear. 4. Carpenter, J., Clfford, P., Fearnhead, P, 999, An mproved partcle flter for non-lnear problems, IEEE Proc. Part F: Radar and Sonar Navgaton, vol. 46, pp Del Moral, P., Doucet, A., Jasra, A., 27, Sequental Monte Carlo for Bayesan Computaton, Bayesan Statstcs, vol. 8, pp Del Moral, P., Doucet, A., Jasra, A., 26, Sequental Monte Carlo samplers, J. R. Statstcal Socety, vol. 68, pp Andreu, C., Doucet, Sumeetpal, S., Tadc, V., 24, Partcle methods for charge detecton, system dentfcaton and control, Proceedngs of IEEE, vol. 92, pp Ozsk, M., 993, Heat Conducton, Wley, New York. 9. Mota, C. A. A., Mkhalov, M. D., Orlande, H. R. B. and Cotta, R. M., 24, Identfcaton of Heat Flux Imposed by an Oxyacetylene Torch, th AIAA/ISSMO Multdscplnary Analyss and Optmzaton Conference, Albany, New York, August 29 September Mota, C. A. A., Orlande, H. R. B., Wellele, O., Kolehmanen, V. and Kapo, J., 27, Inverse Problem of Smultaneous Identfcaton of Thermophyscal Propertes and Boundary Heat Flux, 9th COBEM -Internatonal Congress of Mechancal Engneerng, November 5-9, 27, Brasla, Brazl.
Appendix B: Resampling Algorithms
407 Appendx B: Resamplng Algorthms A common problem of all partcle flters s the degeneracy of weghts, whch conssts of the unbounded ncrease of the varance of the mportance weghts ω [ ] of the partcles
More informationQuantifying Uncertainty
Partcle Flters Quantfyng Uncertanty Sa Ravela M. I. T Last Updated: Sprng 2013 1 Quantfyng Uncertanty Partcle Flters Partcle Flters Appled to Sequental flterng problems Can also be appled to smoothng problems
More informationTEMPERATURE FIELD PREDICTION OF A MULTILAYERED COMPOSITE PIPELINE BASED ON THE PARTICLE FILTER METHOD
Proceedngs of the 4 th Internatonal Heat Transfer Conference IHTC-4 August 8-3, 2, Washngton D.C., USA DRAFT IHTC4-22462 TEMPERATURE FIELD PREDICTION OF A MULTILAYERED COMPOSITE PIPELINE BASED ON THE PARTICLE
More informationChapter 11: Simple Linear Regression and Correlation
Chapter 11: Smple Lnear Regresson and Correlaton 11-1 Emprcal Models 11-2 Smple Lnear Regresson 11-3 Propertes of the Least Squares Estmators 11-4 Hypothess Test n Smple Lnear Regresson 11-4.1 Use of t-tests
More informationComposite Hypotheses testing
Composte ypotheses testng In many hypothess testng problems there are many possble dstrbutons that can occur under each of the hypotheses. The output of the source s a set of parameters (ponts n a parameter
More informationA Hybrid Variational Iteration Method for Blasius Equation
Avalable at http://pvamu.edu/aam Appl. Appl. Math. ISSN: 1932-9466 Vol. 10, Issue 1 (June 2015), pp. 223-229 Applcatons and Appled Mathematcs: An Internatonal Journal (AAM) A Hybrd Varatonal Iteraton Method
More informationNumerical Heat and Mass Transfer
Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and
More informationTracking with Kalman Filter
Trackng wth Kalman Flter Scott T. Acton Vrgna Image and Vdeo Analyss (VIVA), Charles L. Brown Department of Electrcal and Computer Engneerng Department of Bomedcal Engneerng Unversty of Vrgna, Charlottesvlle,
More informationDETERMINATION OF TEMPERATURE DISTRIBUTION FOR ANNULAR FINS WITH TEMPERATURE DEPENDENT THERMAL CONDUCTIVITY BY HPM
Ganj, Z. Z., et al.: Determnaton of Temperature Dstrbuton for S111 DETERMINATION OF TEMPERATURE DISTRIBUTION FOR ANNULAR FINS WITH TEMPERATURE DEPENDENT THERMAL CONDUCTIVITY BY HPM by Davood Domr GANJI
More informationEcon107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)
I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes
More information1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands
Content. Inference on Regresson Parameters a. Fndng Mean, s.d and covarance amongst estmates.. Confdence Intervals and Workng Hotellng Bands 3. Cochran s Theorem 4. General Lnear Testng 5. Measures of
More informationGlobal Sensitivity. Tuesday 20 th February, 2018
Global Senstvty Tuesday 2 th February, 28 ) Local Senstvty Most senstvty analyses [] are based on local estmates of senstvty, typcally by expandng the response n a Taylor seres about some specfc values
More informationAn Application of Fuzzy Hypotheses Testing in Radar Detection
Proceedngs of the th WSES Internatonal Conference on FUZZY SYSEMS n pplcaton of Fuy Hypotheses estng n Radar Detecton.K.ELSHERIF, F.M.BBDY, G.M.BDELHMID Department of Mathematcs Mltary echncal Collage
More informationBOOTSTRAP METHOD FOR TESTING OF EQUALITY OF SEVERAL MEANS. M. Krishna Reddy, B. Naveen Kumar and Y. Ramu
BOOTSTRAP METHOD FOR TESTING OF EQUALITY OF SEVERAL MEANS M. Krshna Reddy, B. Naveen Kumar and Y. Ramu Department of Statstcs, Osmana Unversty, Hyderabad -500 007, Inda. nanbyrozu@gmal.com, ramu0@gmal.com
More informationFeature Selection & Dynamic Tracking F&P Textbook New: Ch 11, Old: Ch 17 Guido Gerig CS 6320, Spring 2013
Feature Selecton & Dynamc Trackng F&P Textbook New: Ch 11, Old: Ch 17 Gudo Gerg CS 6320, Sprng 2013 Credts: Materal Greg Welch & Gary Bshop, UNC Chapel Hll, some sldes modfed from J.M. Frahm/ M. Pollefeys,
More informationSTATS 306B: Unsupervised Learning Spring Lecture 10 April 30
STATS 306B: Unsupervsed Learnng Sprng 2014 Lecture 10 Aprl 30 Lecturer: Lester Mackey Scrbe: Joey Arthur, Rakesh Achanta 10.1 Factor Analyss 10.1.1 Recap Recall the factor analyss (FA) model for lnear
More informationInternational Journal of Pure and Applied Sciences and Technology
Int. J. Pure Appl. Sc. Technol., 4() (03), pp. 5-30 Internatonal Journal of Pure and Appled Scences and Technology ISSN 9-607 Avalable onlne at www.jopaasat.n Research Paper Schrödnger State Space Matrx
More informationChapter 13: Multiple Regression
Chapter 13: Multple Regresson 13.1 Developng the multple-regresson Model The general model can be descrbed as: It smplfes for two ndependent varables: The sample ft parameter b 0, b 1, and b are used to
More informationA PROCEDURE FOR SIMULATING THE NONLINEAR CONDUCTION HEAT TRANSFER IN A BODY WITH TEMPERATURE DEPENDENT THERMAL CONDUCTIVITY.
Proceedngs of the th Brazlan Congress of Thermal Scences and Engneerng -- ENCIT 006 Braz. Soc. of Mechancal Scences and Engneerng -- ABCM, Curtba, Brazl,- Dec. 5-8, 006 A PROCEDURE FOR SIMULATING THE NONLINEAR
More informationModule 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur
Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:
More informationCHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE
CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE Analytcal soluton s usually not possble when exctaton vares arbtrarly wth tme or f the system s nonlnear. Such problems can be solved by numercal tmesteppng
More informationA Particle Filter Algorithm based on Mixing of Prior probability density and UKF as Generate Importance Function
Advanced Scence and Technology Letters, pp.83-87 http://dx.do.org/10.14257/astl.2014.53.20 A Partcle Flter Algorthm based on Mxng of Pror probablty densty and UKF as Generate Importance Functon Lu Lu 1,1,
More informationUsing T.O.M to Estimate Parameter of distributions that have not Single Exponential Family
IOSR Journal of Mathematcs IOSR-JM) ISSN: 2278-5728. Volume 3, Issue 3 Sep-Oct. 202), PP 44-48 www.osrjournals.org Usng T.O.M to Estmate Parameter of dstrbutons that have not Sngle Exponental Famly Jubran
More information4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA
4 Analyss of Varance (ANOVA) 5 ANOVA 51 Introducton ANOVA ANOVA s a way to estmate and test the means of multple populatons We wll start wth one-way ANOVA If the populatons ncluded n the study are selected
More informationUncertainty as the Overlap of Alternate Conditional Distributions
Uncertanty as the Overlap of Alternate Condtonal Dstrbutons Olena Babak and Clayton V. Deutsch Centre for Computatonal Geostatstcs Department of Cvl & Envronmental Engneerng Unversty of Alberta An mportant
More informationA Robust Method for Calculating the Correlation Coefficient
A Robust Method for Calculatng the Correlaton Coeffcent E.B. Nven and C. V. Deutsch Relatonshps between prmary and secondary data are frequently quantfed usng the correlaton coeffcent; however, the tradtonal
More informationParametric fractional imputation for missing data analysis. Jae Kwang Kim Survey Working Group Seminar March 29, 2010
Parametrc fractonal mputaton for mssng data analyss Jae Kwang Km Survey Workng Group Semnar March 29, 2010 1 Outlne Introducton Proposed method Fractonal mputaton Approxmaton Varance estmaton Multple mputaton
More informationStatistics for Economics & Business
Statstcs for Economcs & Busness Smple Lnear Regresson Learnng Objectves In ths chapter, you learn: How to use regresson analyss to predct the value of a dependent varable based on an ndependent varable
More informationHidden Markov Models
Hdden Markov Models Namrata Vaswan, Iowa State Unversty Aprl 24, 204 Hdden Markov Model Defntons and Examples Defntons:. A hdden Markov model (HMM) refers to a set of hdden states X 0, X,..., X t,...,
More informationNumerical Transient Heat Conduction Experiment
Numercal ransent Heat Conducton Experment OBJECIVE 1. o demonstrate the basc prncples of conducton heat transfer.. o show how the thermal conductvty of a sold can be measured. 3. o demonstrate the use
More informationMarkov Chain Monte Carlo (MCMC), Gibbs Sampling, Metropolis Algorithms, and Simulated Annealing Bioinformatics Course Supplement
Markov Chan Monte Carlo MCMC, Gbbs Samplng, Metropols Algorthms, and Smulated Annealng 2001 Bonformatcs Course Supplement SNU Bontellgence Lab http://bsnuackr/ Outlne! Markov Chan Monte Carlo MCMC! Metropols-Hastngs
More informationStatistical analysis using matlab. HY 439 Presented by: George Fortetsanakis
Statstcal analyss usng matlab HY 439 Presented by: George Fortetsanaks Roadmap Probablty dstrbutons Statstcal estmaton Fttng data to probablty dstrbutons Contnuous dstrbutons Contnuous random varable X
More informationResearch Article Green s Theorem for Sign Data
Internatonal Scholarly Research Network ISRN Appled Mathematcs Volume 2012, Artcle ID 539359, 10 pages do:10.5402/2012/539359 Research Artcle Green s Theorem for Sgn Data Lous M. Houston The Unversty of
More informationAN IMPROVED PARTICLE FILTER ALGORITHM BASED ON NEURAL NETWORK FOR TARGET TRACKING
AN IMPROVED PARTICLE FILTER ALGORITHM BASED ON NEURAL NETWORK FOR TARGET TRACKING Qn Wen, Peng Qcong 40 Lab, Insttuton of Communcaton and Informaton Engneerng,Unversty of Electronc Scence and Technology
More informationLecture Notes on Linear Regression
Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume
More informationComparison of the Population Variance Estimators. of 2-Parameter Exponential Distribution Based on. Multiple Criteria Decision Making Method
Appled Mathematcal Scences, Vol. 7, 0, no. 47, 07-0 HIARI Ltd, www.m-hkar.com Comparson of the Populaton Varance Estmators of -Parameter Exponental Dstrbuton Based on Multple Crtera Decson Makng Method
More informationAn adaptive SMC scheme for ABC. Bayesian Computation (ABC)
An adaptve SMC scheme for Approxmate Bayesan Computaton (ABC) (ont work wth Prof. Mke West) Department of Statstcal Scence - Duke Unversty Aprl/2011 Approxmate Bayesan Computaton (ABC) Problems n whch
More informationGeneralized Linear Methods
Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set
More informationTransfer Functions. Convenient representation of a linear, dynamic model. A transfer function (TF) relates one input and one output: ( ) system
Transfer Functons Convenent representaton of a lnear, dynamc model. A transfer functon (TF) relates one nput and one output: x t X s y t system Y s The followng termnology s used: x y nput output forcng
More informationStatistics Chapter 4
Statstcs Chapter 4 "There are three knds of les: les, damned les, and statstcs." Benjamn Dsrael, 1895 (Brtsh statesman) Gaussan Dstrbuton, 4-1 If a measurement s repeated many tmes a statstcal treatment
More information2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification
E395 - Pattern Recognton Solutons to Introducton to Pattern Recognton, Chapter : Bayesan pattern classfcaton Preface Ths document s a soluton manual for selected exercses from Introducton to Pattern Recognton
More information4DVAR, according to the name, is a four-dimensional variational method.
4D-Varatonal Data Assmlaton (4D-Var) 4DVAR, accordng to the name, s a four-dmensonal varatonal method. 4D-Var s actually a drect generalzaton of 3D-Var to handle observatons that are dstrbuted n tme. The
More informationLinear Approximation with Regularization and Moving Least Squares
Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...
More informationConvergence of random processes
DS-GA 12 Lecture notes 6 Fall 216 Convergence of random processes 1 Introducton In these notes we study convergence of dscrete random processes. Ths allows to characterze phenomena such as the law of large
More informationConjugacy and the Exponential Family
CS281B/Stat241B: Advanced Topcs n Learnng & Decson Makng Conjugacy and the Exponental Famly Lecturer: Mchael I. Jordan Scrbes: Bran Mlch 1 Conjugacy In the prevous lecture, we saw conjugate prors for the
More informationComputation of Higher Order Moments from Two Multinomial Overdispersion Likelihood Models
Computaton of Hgher Order Moments from Two Multnomal Overdsperson Lkelhood Models BY J. T. NEWCOMER, N. K. NEERCHAL Department of Mathematcs and Statstcs, Unversty of Maryland, Baltmore County, Baltmore,
More informationThe Gaussian classifier. Nuno Vasconcelos ECE Department, UCSD
he Gaussan classfer Nuno Vasconcelos ECE Department, UCSD Bayesan decson theory recall that we have state of the world X observatons g decson functon L[g,y] loss of predctng y wth g Bayes decson rule s
More informationParameter Estimation for Dynamic System using Unscented Kalman filter
Parameter Estmaton for Dynamc System usng Unscented Kalman flter Jhoon Seung 1,a, Amr Atya F. 2,b, Alexander G.Parlos 3,c, and Klto Chong 1,4,d* 1 Dvson of Electroncs Engneerng, Chonbuk Natonal Unversty,
More informationComparison of Regression Lines
STATGRAPHICS Rev. 9/13/2013 Comparson of Regresson Lnes Summary... 1 Data Input... 3 Analyss Summary... 4 Plot of Ftted Model... 6 Condtonal Sums of Squares... 6 Analyss Optons... 7 Forecasts... 8 Confdence
More informationAppendix B. The Finite Difference Scheme
140 APPENDIXES Appendx B. The Fnte Dfference Scheme In ths appendx we present numercal technques whch are used to approxmate solutons of system 3.1 3.3. A comprehensve treatment of theoretcal and mplementaton
More informationBayesian predictive Configural Frequency Analysis
Psychologcal Test and Assessment Modelng, Volume 54, 2012 (3), 285-292 Bayesan predctve Confgural Frequency Analyss Eduardo Gutérrez-Peña 1 Abstract Confgural Frequency Analyss s a method for cell-wse
More informationInductance Calculation for Conductors of Arbitrary Shape
CRYO/02/028 Aprl 5, 2002 Inductance Calculaton for Conductors of Arbtrary Shape L. Bottura Dstrbuton: Internal Summary In ths note we descrbe a method for the numercal calculaton of nductances among conductors
More informationChapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems
Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons
More informationDETERMINATION OF UNCERTAINTY ASSOCIATED WITH QUANTIZATION ERRORS USING THE BAYESIAN APPROACH
Proceedngs, XVII IMEKO World Congress, June 7, 3, Dubrovn, Croata Proceedngs, XVII IMEKO World Congress, June 7, 3, Dubrovn, Croata TC XVII IMEKO World Congress Metrology n the 3rd Mllennum June 7, 3,
More informationDiscussion of Extensions of the Gauss-Markov Theorem to the Case of Stochastic Regression Coefficients Ed Stanek
Dscusson of Extensons of the Gauss-arkov Theorem to the Case of Stochastc Regresson Coeffcents Ed Stanek Introducton Pfeffermann (984 dscusses extensons to the Gauss-arkov Theorem n settngs where regresson
More informationSTAT 511 FINAL EXAM NAME Spring 2001
STAT 5 FINAL EXAM NAME Sprng Instructons: Ths s a closed book exam. No notes or books are allowed. ou may use a calculator but you are not allowed to store notes or formulas n the calculator. Please wrte
More informationSimulated Power of the Discrete Cramér-von Mises Goodness-of-Fit Tests
Smulated of the Cramér-von Mses Goodness-of-Ft Tests Steele, M., Chaselng, J. and 3 Hurst, C. School of Mathematcal and Physcal Scences, James Cook Unversty, Australan School of Envronmental Studes, Grffth
More informationAn identification algorithm of model kinetic parameters of the interfacial layer growth in fiber composites
IOP Conference Seres: Materals Scence and Engneerng PAPER OPE ACCESS An dentfcaton algorthm of model knetc parameters of the nterfacal layer growth n fber compostes o cte ths artcle: V Zubov et al 216
More informationIdentification of Linear Partial Difference Equations with Constant Coefficients
J. Basc. Appl. Sc. Res., 3(1)6-66, 213 213, TextRoad Publcaton ISSN 29-434 Journal of Basc and Appled Scentfc Research www.textroad.com Identfcaton of Lnear Partal Dfference Equatons wth Constant Coeffcents
More informationParticle Filter Approach to Fault Detection andisolation in Nonlinear Systems
Amercan Journal of Sgnal Processng 22,2(3): 46-5 DOI:.5923/j.ajsp.2223.2 Partcle Flter Approach to Fault Detecton andisolaton n Nonlnear Systems F. Soubgu *, F. BenHmda, A. Chaar Department of Electrcal
More informationTime-Varying Systems and Computations Lecture 6
Tme-Varyng Systems and Computatons Lecture 6 Klaus Depold 14. Januar 2014 The Kalman Flter The Kalman estmaton flter attempts to estmate the actual state of an unknown dscrete dynamcal system, gven nosy
More informationSTAT 3008 Applied Regression Analysis
STAT 3008 Appled Regresson Analyss Tutoral : Smple Lnear Regresson LAI Chun He Department of Statstcs, The Chnese Unversty of Hong Kong 1 Model Assumpton To quantfy the relatonshp between two factors,
More informationClassification as a Regression Problem
Target varable y C C, C,, ; Classfcaton as a Regresson Problem { }, 3 L C K To treat classfcaton as a regresson problem we should transform the target y nto numercal values; The choce of numercal class
More information2016 Wiley. Study Session 2: Ethical and Professional Standards Application
6 Wley Study Sesson : Ethcal and Professonal Standards Applcaton LESSON : CORRECTION ANALYSIS Readng 9: Correlaton and Regresson LOS 9a: Calculate and nterpret a sample covarance and a sample correlaton
More informationThe Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction
ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also
More informationAnalytic Local Linearization Particle Filter for Bayesian State Estimation in Nonlinear Continuous Process
D. Jayaprasanth, Jovtha Jerome Analytc Local Lnearzaton Partcle Flter for Bayesan State Estmaton n onlnear Contnuous Process D. JAYAPRASATH, JOVITHA JEROME Department of Instrumentaton and Control Systems
More informationChapter 9: Statistical Inference and the Relationship between Two Variables
Chapter 9: Statstcal Inference and the Relatonshp between Two Varables Key Words The Regresson Model The Sample Regresson Equaton The Pearson Correlaton Coeffcent Learnng Outcomes After studyng ths chapter,
More informationONE DIMENSIONAL TRIANGULAR FIN EXPERIMENT. Technical Advisor: Dr. D.C. Look, Jr. Version: 11/03/00
ONE IMENSIONAL TRIANGULAR FIN EXPERIMENT Techncal Advsor: r..c. Look, Jr. Verson: /3/ 7. GENERAL OJECTIVES a) To understand a one-dmensonal epermental appromaton. b) To understand the art of epermental
More informationCOMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS
Avalable onlne at http://sck.org J. Math. Comput. Sc. 3 (3), No., 6-3 ISSN: 97-537 COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS
More informationHidden Markov Models & The Multivariate Gaussian (10/26/04)
CS281A/Stat241A: Statstcal Learnng Theory Hdden Markov Models & The Multvarate Gaussan (10/26/04) Lecturer: Mchael I. Jordan Scrbes: Jonathan W. Hu 1 Hdden Markov Models As a bref revew, hdden Markov models
More informationDepartment of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6
Department of Quanttatve Methods & Informaton Systems Tme Seres and Ther Components QMIS 30 Chapter 6 Fall 00 Dr. Mohammad Zanal These sldes were modfed from ther orgnal source for educatonal purpose only.
More informationEstimation of Markov Jump Systems with Mode Observation One-Step Lagged to State Measurement
Estmaton of Marov Jump Systems wth Mode Observaton One-Step Lagged to State Measurement Yan Lang, Zengfu Wang, Ll We, Yongme Cheng, Quan Pan College of Automaton Northwestern Polytechncal Unversty X an,
More informationA LINEAR PROGRAM TO COMPARE MULTIPLE GROSS CREDIT LOSS FORECASTS. Dr. Derald E. Wentzien, Wesley College, (302) ,
A LINEAR PROGRAM TO COMPARE MULTIPLE GROSS CREDIT LOSS FORECASTS Dr. Derald E. Wentzen, Wesley College, (302) 736-2574, wentzde@wesley.edu ABSTRACT A lnear programmng model s developed and used to compare
More informationPsychology 282 Lecture #24 Outline Regression Diagnostics: Outliers
Psychology 282 Lecture #24 Outlne Regresson Dagnostcs: Outlers In an earler lecture we studed the statstcal assumptons underlyng the regresson model, ncludng the followng ponts: Formal statement of assumptons.
More informationDepartment of Statistics University of Toronto STA305H1S / 1004 HS Design and Analysis of Experiments Term Test - Winter Solution
Department of Statstcs Unversty of Toronto STA35HS / HS Desgn and Analyss of Experments Term Test - Wnter - Soluton February, Last Name: Frst Name: Student Number: Instructons: Tme: hours. Ads: a non-programmable
More informationDUE: WEDS FEB 21ST 2018
HOMEWORK # 1: FINITE DIFFERENCES IN ONE DIMENSION DUE: WEDS FEB 21ST 2018 1. Theory Beam bendng s a classcal engneerng analyss. The tradtonal soluton technque makes smplfyng assumptons such as a constant
More informationDigital Modems. Lecture 2
Dgtal Modems Lecture Revew We have shown that both Bayes and eyman/pearson crtera are based on the Lkelhood Rato Test (LRT) Λ ( r ) < > η Λ r s called observaton transformaton or suffcent statstc The crtera
More informationCIS526: Machine Learning Lecture 3 (Sept 16, 2003) Linear Regression. Preparation help: Xiaoying Huang. x 1 θ 1 output... θ M x M
CIS56: achne Learnng Lecture 3 (Sept 6, 003) Preparaton help: Xaoyng Huang Lnear Regresson Lnear regresson can be represented by a functonal form: f(; θ) = θ 0 0 +θ + + θ = θ = 0 ote: 0 s a dummy attrbute
More informationIrregular vibrations in multi-mass discrete-continuous systems torsionally deformed
(2) 4 48 Irregular vbratons n mult-mass dscrete-contnuous systems torsonally deformed Abstract In the paper rregular vbratons of dscrete-contnuous systems consstng of an arbtrary number rgd bodes connected
More informationMarkov Chain Monte Carlo Lecture 6
where (x 1,..., x N ) X N, N s called the populaton sze, f(x) f (x) for at least one {1, 2,..., N}, and those dfferent from f(x) are called the tral dstrbutons n terms of mportance samplng. Dfferent ways
More informationNON-CENTRAL 7-POINT FORMULA IN THE METHOD OF LINES FOR PARABOLIC AND BURGERS' EQUATIONS
IJRRAS 8 (3 September 011 www.arpapress.com/volumes/vol8issue3/ijrras_8_3_08.pdf NON-CENTRAL 7-POINT FORMULA IN THE METHOD OF LINES FOR PARABOLIC AND BURGERS' EQUATIONS H.O. Bakodah Dept. of Mathematc
More information( ) ( ) ( ) ( ) STOCHASTIC SIMULATION FOR BLOCKED DATA. Monte Carlo simulation Rejection sampling Importance sampling Markov chain Monte Carlo
SOCHASIC SIMULAIO FOR BLOCKED DAA Stochastc System Analyss and Bayesan Model Updatng Monte Carlo smulaton Rejecton samplng Importance samplng Markov chan Monte Carlo Monte Carlo smulaton Introducton: If
More informationA PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS
HCMC Unversty of Pedagogy Thong Nguyen Huu et al. A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS Thong Nguyen Huu and Hao Tran Van Department of mathematcs-nformaton,
More informationOn an Extension of Stochastic Approximation EM Algorithm for Incomplete Data Problems. Vahid Tadayon 1
On an Extenson of Stochastc Approxmaton EM Algorthm for Incomplete Data Problems Vahd Tadayon Abstract: The Stochastc Approxmaton EM (SAEM algorthm, a varant stochastc approxmaton of EM, s a versatle tool
More informationarxiv:cs.cv/ Jun 2000
Correlaton over Decomposed Sgnals: A Non-Lnear Approach to Fast and Effectve Sequences Comparson Lucano da Fontoura Costa arxv:cs.cv/0006040 28 Jun 2000 Cybernetc Vson Research Group IFSC Unversty of São
More informationRelevance Vector Machines Explained
October 19, 2010 Relevance Vector Machnes Explaned Trstan Fletcher www.cs.ucl.ac.uk/staff/t.fletcher/ Introducton Ths document has been wrtten n an attempt to make Tppng s [1] Relevance Vector Machnes
More informationj) = 1 (note sigma notation) ii. Continuous random variable (e.g. Normal distribution) 1. density function: f ( x) 0 and f ( x) dx = 1
Random varables Measure of central tendences and varablty (means and varances) Jont densty functons and ndependence Measures of assocaton (covarance and correlaton) Interestng result Condtonal dstrbutons
More informationMIMA Group. Chapter 2 Bayesian Decision Theory. School of Computer Science and Technology, Shandong University. Xin-Shun SDU
Group M D L M Chapter Bayesan Decson heory Xn-Shun Xu @ SDU School of Computer Scence and echnology, Shandong Unversty Bayesan Decson heory Bayesan decson theory s a statstcal approach to data mnng/pattern
More informationSuppose that there s a measured wndow of data fff k () ; :::; ff k g of a sze w, measured dscretely wth varable dscretzaton step. It s convenent to pl
RECURSIVE SPLINE INTERPOLATION METHOD FOR REAL TIME ENGINE CONTROL APPLICATIONS A. Stotsky Volvo Car Corporaton Engne Desgn and Development Dept. 97542, HA1N, SE- 405 31 Gothenburg Sweden. Emal: astotsky@volvocars.com
More informationStatistics for Business and Economics
Statstcs for Busness and Economcs Chapter 11 Smple Regresson Copyrght 010 Pearson Educaton, Inc. Publshng as Prentce Hall Ch. 11-1 11.1 Overvew of Lnear Models n An equaton can be ft to show the best lnear
More informationCombined Parameter and State Estimation Problem in a Complex Domain: RF Hyperthermia Treatment Using Nanoparticles
Journal of Physcs: Conference Seres PAPER OPEN ACCESS Combned Parameter and State Estmaton Problem n a Complex Doman: RF Hypertherma Treatment Usng Nanopartcles To cte ths artcle: L A Bermeo Varon et al
More informationx i1 =1 for all i (the constant ).
Chapter 5 The Multple Regresson Model Consder an economc model where the dependent varable s a functon of K explanatory varables. The economc model has the form: y = f ( x,x,..., ) xk Approxmate ths by
More informationPROPERTIES I. INTRODUCTION. Finite element (FE) models are widely used to predict the dynamic characteristics of aerospace
FINITE ELEMENT MODEL UPDATING USING BAYESIAN FRAMEWORK AND MODAL PROPERTIES Tshldz Marwala 1 and Sbusso Sbs I. INTRODUCTION Fnte element (FE) models are wdely used to predct the dynamc characterstcs of
More informationP R. Lecture 4. Theory and Applications of Pattern Recognition. Dept. of Electrical and Computer Engineering /
Theory and Applcatons of Pattern Recognton 003, Rob Polkar, Rowan Unversty, Glassboro, NJ Lecture 4 Bayes Classfcaton Rule Dept. of Electrcal and Computer Engneerng 0909.40.0 / 0909.504.04 Theory & Applcatons
More informationFUZZY FINITE ELEMENT METHOD
FUZZY FINITE ELEMENT METHOD RELIABILITY TRUCTURE ANALYI UING PROBABILITY 3.. Maxmum Normal tress Internal force s the shear force, V has a magntude equal to the load P and bendng moment, M. Bendng moments
More informationStructure and Drive Paul A. Jensen Copyright July 20, 2003
Structure and Drve Paul A. Jensen Copyrght July 20, 2003 A system s made up of several operatons wth flow passng between them. The structure of the system descrbes the flow paths from nputs to outputs.
More informationEstimation: Part 2. Chapter GREG estimation
Chapter 9 Estmaton: Part 2 9. GREG estmaton In Chapter 8, we have seen that the regresson estmator s an effcent estmator when there s a lnear relatonshp between y and x. In ths chapter, we generalzed the
More informationKernel Methods and SVMs Extension
Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general
More informationLossy Compression. Compromise accuracy of reconstruction for increased compression.
Lossy Compresson Compromse accuracy of reconstructon for ncreased compresson. The reconstructon s usually vsbly ndstngushable from the orgnal mage. Typcally, one can get up to 0:1 compresson wth almost
More information2 Finite difference basics
Numersche Methoden 1, WS 11/12 B.J.P. Kaus 2 Fnte dfference bascs Consder the one- The bascs of the fnte dfference method are best understood wth an example. dmensonal transent heat conducton equaton T
More information