Application of Bayesian Filters to Heat Conduction Problems

Size: px
Start display at page:

Download "Application of Bayesian Filters to Heat Conduction Problems"

Transcription

1 EngOpt 28 - Internatonal Conference on Engneerng Optmzaton Ro de Janero, Brazl, - 5 June 28. Applcaton of Bayesan Flters to Heat Conducton Problems Helco R. B. Orlande, George S. Dulkravch 2 and Marcelo J. Colaço 3 Department of Mechancal Engneerng, COPPE, Federal Unversty of Ro de Janero, Brazl, helco@mecanca.coppe.ufrj.br Department of Mechancal and Materals Engneerng, Florda Internatonal Unversty, Mam, U.S.A., dulkrav@fu.edu Department of Mechancal and Materals Engneerng, Mltary Insttute of Engneerng, Ro de Janero, RJ, Brazl, colaco@asme.org. Abstract In ths paper we present a general descrpton of state estmaton problems wthn the Bayesan framework. State estmaton problems are addressed n whch evoluton and measurement stochastc models are used to predct the dynamc behavor of physcal systems. Specfcally, the applcaton of two Bayesan flters to lnear and non-lnear unsteady heat conducton problems s demonstrated; a) the use of Kalman flter, and b) the use of Partcle Flter wth the samplng mportance resamplng algorthm. 2. Keywords: Kalman flter, Partcle flter, state estmaton 3. Introducton State estmaton problems, also desgnated as nonstatonary nverse problems [], are of great nterest n nnumerable practcal applcatons. In such knds of problems, the avalable measured data s used together wth pror knowledge about the physcal phenomena and the measurng devces, n order to sequentally produce estmates of the desred dynamc varables. Ths s accomplshed n such a manner that the error s mnmzed statstcally [2]. For example, the poston of an arcraft can be estmated through the tme-ntegraton of ts velocty components snce departure. However, t may also be measured wth a GPS system and an altmeter. State estmaton problems deal wth the combnaton of the model predcton (ntegraton of the velocty components that contan errors due to the velocty measurements) and the GPS and altmeter measurements that are also uncertan, n order to obtan more accurate estmatons of the system varables (arcraft poston). State estmaton problems are solved wth the so-called Bayesan flters [,2]. In the Bayesan approach to statstcs, an attempt s made to utlze all avalable nformaton n order to reduce the amount of uncertanty present n an nferental or decson-makng problem. As new nformaton s obtaned, t s combned wth prevous nformaton to form the bass for statstcal procedures. The formal mechansm used to combne the new nformaton wth the prevously avalable nformaton s known as Bayes theorem [,3]. The most wdely known Bayesan flter method s the Kalman flter [,2,4-9]. However, the applcaton of the Kalman flter s lmted to lnear models wth addtve Gaussan noses. Extensons of the Kalman flter were developed n the past for less restrctve cases by usng lnearzaton technques [,3,6,7,8]. Smlarly, Monte Carlo methods have been developed n order to represent the posteror densty n terms of random samples and assocated weghts. Such Monte Carlo methods, usually denoted as partcle flters among other desgnatons found n the lterature, do not requre the restrctve hypotheses of the Kalman flter. Hence, partcle flters can be appled to non-lnear models wth non-gaussan errors [,4,8-7]. In ths paper we apply the Kalman flter and the partcle flter to heat conducton problems. These Bayesan flters are used to predct the temperature n a medum where the heat conducton model and temperature measurements contan errors. Lnear and nonlnear heat conducton problems are examned, as well as Gaussan and non-gaussan nose. Before focusng on the heat conducton applcatons of nterest, the state estmaton problem s defned and the Kalman and partcle flters are descrbed. 4. State Estmaton Problem In order to defne the state estmaton problem, consder a model for the evoluton of the vector x n the form xk = fk( xk, v k ) (.a) n where the subscrpt k =, 2,, denotes a tme nstant t k n a dynamc problem. The vector x R x s called the state vector and contans the varables to be dynamcally estmated. Ths vector advances n accordance wth the state evoluton model gven by n equaton (.a), where f s, n the general case, a non-lnear functon of the state varables x and of the state nose vector v R v. n Consder also that measurements z z k R are avalable at t k, k =, 2,. The measurements are related to the state varables x through the general, possbly non-lnear, functon h n the form zk = hk( xk, n k) (.b) n where n R n s the measurement nose. Equaton (.b) s referred to as the observaton (measurement) model. The state estmaton problem ams at obtanng nformaton about x k based on the state evoluton model (.a) and on the measurements z: k = { z, =, K, k} gven by the observaton model (.b) [-7]. The evoluton-observaton model gven by equatons (.a,b) are based on the followng assumptons [,4]: () The sequence xk for k =, 2,, s a Markovan process, that s, π( xk x, x, K, xk ) = π( xk xk ) (2.a) () The sequence zk for k =, 2,, s a Markovan process wth respect to the hstory of x k, that s, π( zk x, x, K, xk) = π( zk xk) (2.b)

2 () The sequence x k depends on the past observatons only through ts own hstory, that s, π( k k, : k ) = π( k k ) where π ( ab ) denotes the condtonal probablty of a when b s gven. x x z x x (2.c) In addton, for the evoluton-observaton model gven by equatons (.a,b) t s assumed that for j the nose vectors v and v j, as well as n and n j, are mutually ndependent and also mutually ndependent of the ntal state x. The vectors v and n j are also mutually ndependent for all and j []. Dfferent problems can be consdered wth the above evoluton-observaton model, namely []: () The predcton problem, concerned wth the determnaton of π ( xk z : k ) ; () The flterng problem, concerned wth the determnaton of π ( xk z : k) ; () The fxed-lag smoothng problem, concerned the determnaton of π ( xk z : k+ p), where p s the fxed lag; (v) The whole-doman smoothng problem, concerned wth the determnaton of π ( xk z : K), where z: K = { z, =, K, K} s the complete sequence of measurements. Ths paper deals only wth the flterng problem. By assumng that π( x z) = π( x ) s avalable, the posteror probablty densty π ( xk z : k) s then obtaned wth Bayesan flters n two steps [-7]: predcton and update, as llustrated n fgure. The Kalman flter and the partcle flter used n ths work are dscussed below. π(x ) π(x x ) Predcton π(x ) Update π(z x ) π(x z ) π(x 2 x ) Predcton π(x 2 z ) Update π(z 2 x 2 ) π(x 2 z :2 ) M Fgure. Predcton and update steps for the Bayesan flter [] 5. The Kalman Flter For the applcaton of the Kalman flter t s assumed that the evoluton and observaton models gven by equatons (.a,b) are lnear. Also, t s assumed that the noses n such models are Gaussan, wth known means and covarances, and that they are addtve. Therefore, the posteror densty π ( xk z : k) at t k, k =, 2, s Gaussan and the Kalman flter results n the optmal soluton to the state estmaton problem, that s, the posteror densty s calculated exactly [,2,4-9]. Wth the foregong hypotheses, the evoluton and observaton models can be wrtten respectvely as: xk = Fkxk + v k (3.a) zk = Hkxk + n k (3.b) where F and H are known matrces for the lnear evolutons of the state x and of the observaton z, respectvely. By assumng that the noses v and n have zero means and covarance matrces Q and R, respectvely, the predcton and update steps of the Kalman flter are gven by [,2,4-9]:

3 Predcton: Update: xk = Fkx k (4.a) Pk = FkPk Fk T + Q k (4.b) T ( ) T Kk = PkHk HkPkHk + R k (5.a) k x = xk + Kk( zk Hkx k) (5.b) ( ) Pk = I-KkHk P k (5.c) The matrx K s called Kalman s gan matrx. Notce above that after predctng the state varable x and ts covarance matrx P wth equatons (4.a,b), a posteror estmates for such quanttes are obtaned n the update step wth the utlzaton of the measurements z. For other cases for whch the hypotheses of lnear Gaussan evoluton-observaton models are not vald, the use of the Kalman flter does not result n optmal solutons because the posteror densty s not analytc. The applcaton of Monte Carlo technques then appears as the most general and robust approach to non-lnear and/or non-gaussan dstrbutons [,4,8-7]. Ths s the case despte the avalablty of the so-called extended Kalman flter and ts varatons, whch generally nvolves a lnearzaton of the problem. A Monte Carlo flter s descrbed below. 6. The Partcle Flter The Partcle Flter Method [,4,8-7] s a Monte Carlo technque for the soluton of the state estmaton problem. The partcle flter s also known as the bootstrap flter, condensaton algorthm, nteractng partcle approxmatons and survval of the fttest [8]. The key dea s to represent the requred posteror densty functon by a set of random samples (partcles) wth assocated weghts, and to compute the estmates based on these samples and weghts. As the number of samples becomes very large, ths Monte Carlo characterzaton becomes an equvalent representaton of the posteror probablty functon, and the soluton approaches the optmal Bayesan estmate. We present below the so-called Sequental Importance Samplng (SIS) algorthm for the partcle flter, whch ncludes a resamplng step at each nstant, as descrbed n detal n references [8,9]. The SIS algorthm makes use of an mportance densty, whch s a densty proposed to represent another one that cannot be exactly computed, that s, the sought posteror densty n the present case. Then, samples are drawn from the mportance densty nstead of the actual densty. Let { x:, = k, K, N } be the partcles wth assocated weghts { w k, =, K, N} and x: k = { xj, j =, K, k} be the set of all states N up to t k, where N s the number of partcles. The weghts are normalzed so that wk =. Then, the posteror densty at t k can be = dscretely approxmated by: N π( x: k z: k) wkδ( x: k x : k) (6.a) = where δ(.) s the Drac delta functon. By takng hypotheses (2.a-c) nto account, the posteror densty (6.a) can be wrtten as [9]: N π( xk z: k) wkδ( xk x k) (6.b) = A common problem wth the SIS partcle flter s the degeneracy phenomenon, where after a few states all but one partcle wll have neglgble weght [,4,8-7]. Ths degeneracy mples that a large computatonal effort s devoted to updatng partcles whose contrbuton to the approxmaton of the posteror densty functon s almost zero. Ths problem can be overcome by ncreasng the number of partcles, or more effcently by approprately selectng the mportance densty as the pror densty π ( xk x k ). In addton, the use of the resamplng technque s recommended to avod the degeneracy of the partcles. Resamplng nvolves a mappng of the random measure { * x k, wk} nto a random measure { x k, N } wth unform weghts. It can be performed f the number of effectve partcles wth large weghts falls below a certan threshold number. Alternatvely, resamplng can also be appled ndstnctvely at every nstant t k, as n the Samplng Importance Resamplng (SIR) algorthm descrbed n [8,9]. Such algorthm can be summarzed n the followng steps, as appled to the system evoluton from t k- to t k [8,9]: Step. For =,, N draw new partcles x k from the pror densty π ( xk x k ) and then use the lkelhood densty to calculate the correspondent weghts w k = π ( zk x k). Step 2. Calculate the total weght w = T w. k w k T w N = w and then normalze the partcle weghts, that s, for =,, N let = k

4 Step 3. Resample the partcles as follows: Step 3.. Construct the cumulatve sum of weghts (CSW) by computng c = c + wk for =,, N, wth c =. Step 3.2. Let = and draw a startng pont u from the unform dstrbuton U[, N ]. Step 3.3. For j =,, N Move along the CSW by makng uj = u + N ( j ). Whle uj > c make = +. j Assgn sample x k = x k. j Assgn weght wk = N. Although the resamplng step reduces the effects of the degeneracy problem, t may lead to a loss of dversty and the resultant sample can contan many repeated partcles. Ths problem, known as sample mpovershment, can be severe n the case of small process nose. In ths stuaton, all partcles collapse to a sngle partcle wthn few nstants t k [,8,9]. Another drawback of the partcle flter s related to the large computatonal cost due to the Monte Carlo method, whch may lmt ts applcaton to complcated physcal problems. 7. Results and Dscussons In ths sesson we apply the Bayesan flters descrbed above to the estmaton of the transent temperature feld n heat conductng meda. Lnear and non-lnear heat conducton problems are addressed, as well as dfferent models for the noses. The problems under study are descrbed below and the results obtaned wth the Kalman and partcle flters are dscussed. 7.. Lnear Heat Conducton Problem Consder heat conducton n a sem-nfnte one-dmensonal medum, ntally at the unform temperature T*. The temperature at boundary x = s kept at T = o C. Physcal propertes are constant and there s no heat generaton n the medum. The formulaton for ths problem s gven by: 2 T T = 2 α t x n x >, for t > (7.a) T = at x=, for t > (7.b) T = T* for t=, n x > (7.c) The analytcal soluton for ths problem s gven by [8]: x T( x, t) = T * erf 4αt (8) The dscretzaton of equaton (7.a) by usng explct fnte-dfferences results n: k+ k k k T = rt + ( 2 r) T + rt+ (9) where the superscrpt k denotes the tme step, the subscrpt denotes the fnte-dfference node and α t r = 2 ( x) () For the soluton of problem (7.a-c) wth fnte-dfferences we have to mpose a boundary condton at some fcttous surface at x=l. We assume L suffcently large for the tme range of nterest, so that the fnte doman behaves as a sem-nfnte medum. Temperature at the surface x=l was assumed to be T*. The fnte-dfference soluton for problem (7.a-c) can be wrtten as: k k T = FT + S () where ( 2 r) r T r ( 2 r) r Τ = M F = O O O M S = T N r ( 2 r) r r ( 2 r) rt * (2.a-c) In the equatons above N s the number of nternal nodes n the fnte-dfference dscretzaton. Matrx F s NxN and vectors T and S s Nx. Equaton () s n approprate form for the applcaton of the Kalman flter (see equaton 3.a). In the present example t s assumed that state and measured varables are the transent temperatures nsde the medum at the equdstant fnte dfference nodes. Therefore, matrx H for the observaton model (see equaton 3.b) s the dentty matrx. The medum s consdered to be concrete, wth thermal dffusvty α = 4.9x -7 m 2 /s. The standard devaton for the measurement errors s consdered constant and equal to 2 o C. The effects of the standard devaton of the errors n the state model are examned below. Fgures 2.a and 2.b present the exact temperatures and the measured temperatures n the regon, respectvely. The fnal tme s taken as 25 seconds and measurements are supposed avalable n the regon every second. The thckness of the medum s consdered to be L =. m and the regon s dscretzed wth N = 5 nternal nodes.

5 Temperature Temperature T, C 4 2 T, C x, m Fgure 2.a temperatures x, m 5 Fgure 2.b temperatures contanng Gaussan errors wth standard devaton of 2 o C Fgures 3.a,b present a comparson of exact, measured and predcted temperatures at postons x =.2 m and x =. m, respectvely. The predcted temperatures were obtaned wth the Kalman flter. The 99% confdence ntervals for the predcted temperatures are also presented n ths fgure. The results presented n fgures 3.a-d were obtaned wth a standard devaton for the evoluton model errors of o C. These fgures clearly show a great mprovement n the predcted temperatures as compared to the measured temperatures at dfferent postons nsde the medum. Note that predcted temperatures are much closer to the exact ones than the measurements. In fact, f the model errors are reduced, the predcted temperatures tend to follow the model more closely. Ths s exemplfed n fgures 4.a,b, where the standard devaton of the evoluton model errors was reduced to.5 o C. On the other hand, f such errors are large, the predctons of the Kalman flter tend to follow the measurements nstead of the model. Such a fact s clear from the analyss of fgures 5.a,b, whch present the results for a standard devaton for the evoluton model errors of 2 o C. The applcaton of the partcle flter wth the samplng mportance resamplng algorthm descrbed above s presented n fgures 6.a,b. These fgures present the exact, measured and predcted temperatures at postons x =.2 m and x =. m, respectvely. Ffty partcles were used n ths case. A comparson of fgures 3.a,b and 6.a,b show that the partcle flter, smlarly to the Kalman flter, provded accurate predctons for the temperature n the regon. However, as expected, the computatonal cost of the partcle flter was substantally larger than that of the Kalman flter. For ths example, the predctons obtaned wth the Kalman flter took.5 seconds and those obtaned wth the partcle flter took 6.9 seconds on a.8 GHz Centrno Duo computer wth Mbyte of RAM memory. We note that for ths case the computatonal cost of the partcle flter could be reduced to 2.3 seconds by decreasng the number of partcles to, wthout sgnfcant loss of accuracy n the predcted temperatures T(x=.2 m), C 2 T(x=. m), C (a) (b) Fgure 3 Temperature at (a) x =.2 m and (b) x =. m standard devaton for the evoluton model errors of o C Kalman flter

6 T(x=.2 m), C 3 2 T(x=. m), C (a) (b) Fgure 4 Temperature at (a) x =.2 m and (b) x =. m standard devaton for the evoluton model errors of.5 o C Kalman flter T(x=.2 m), C 3 2 T(x=. m), C (a) (b) Fgure 5 Temperature at (a) x =.2 m and (b) x =. m standard devaton for the evoluton model errors of 5 o C Kalman flter 5 4 Partcle Flter wth Re-samplng - Number of Partcles = Partcle Flter wth Re-samplng - Number of Partcles = T(x=.2 m), C 2 T(x=. m), C (a) (b) Fgure 6 Temperature at (a) x =.2 m and (b) x =. m standard devaton for the evoluton model errors of o C Partcle flter wth resamplng Fgures 7.a,b present results smlar to those of fgures 6.a,b, but wthout usng the resamplng technque. These fgures show that the predctons obtaned wthout resamplng were qute uncertan, that s, wth large confdence ntervals. On the other hand, sample mpovershment can be observed when resamplng was used, whch s characterzed by the very narrow confdence ntervals for the predcted temperatures shown n fgures 6.a,b.

7 We now examne a case nvolvng unformly dstrbuted errors n the evoluton model, nstead of Gaussan errors. For such case, the applcaton of the Kalman flter does not result n optmal solutons. Consequently, only the partcle flter was consdered for the predcton of the temperatures n the regon. The results obtaned wth errors n the evoluton model unformly dstrbuted n the nterval [-,] o C are presented n fgures 8.a,b for x =.2 m and x =. m, respectvely. These fgures show that the partcle flter was not affected by the dstrbuton of the errors and results smlar to those obtaned for the Gaussan dstrbuton (see fgures 6.a,b) were obtaned. 5 4 Partcle Flter - Number of Partcles = 5 - CPU Tme = sec 6 5 Partcle Flter - Number of Partcles = 5 - CPU Tme = sec 3 4 T(x=.2 m), C 2 T(x=. m), C (a) (b) Fgure 7 Temperature at (a) x =.2 m and (b) x =. m standard devaton for the evoluton model errors of o C Partcle flter wthout resamplng 5 4 Partcle Flter wth Re-samplng - Number of Partcles = Partcle Flter wth Re-samplng - Number of Partcles = T(x=.2 m), C 2 T(x=. m), C (a) (b) Fgure 8 Temperature at (a) x =.2 m and (b) x =. m evoluton model errors havng unform dstrbuton n [-,] o C Partcle flter wth resamplng 7.2. Non-lnear Heat Conducton Problem Consder heat conducton n a one-dmensonal medum wth thckness L, ntally at the unform temperature T*. The boundary at x = s kept nsulated and a constant heat flux q* s mposed at x = L. Thermophyscal propertes are temperature dependent and there s no heat generaton n the medum. The formulaton for ths problem s gven by: T T CT ( ) = kt ( ) t x x n < x < L, for t > (3.a) T = x at x=, for t > (3.b) T kt ( ) = q* x at x=l, for t > (3.c) T = T * for t=, n x > (3.d) We examne here a physcal problem smlar to those examned n references [9,2] nvolvng the heatng of a graphte sample wth an oxy-acetylene torch. The temperature dependence of the thermal conductvty, k(t), and volumetrc heat capacty, C(T), of the graphte, measured for dfferent temperatures, were curve-ftted (see fgure 9) wth exponentals of the form:

8 ( ) 3 CT = A+ Ae T A (4.a) 2 ( ) 3 k T = B + B e T B (4.b) 2 wth the adjusted parameters A, A 2, A 3, B, B 2 and B 3 gven n table. Table. Parameters of the curve-ftted thermophyscal propertes Parameter Mean A (Jm -3 ºC - ) 5,68,6 A 2 (Jm -3 ºC - ) 4,83,57 A 3 (ºC) 547. B (Wm - ºC - ) B 2 (Wm - ºC - ) 83.5 B 3 (ºC) 277. Capacdade Volumetrc Térmca Heat Capacty Volumetrca (Jm (J/m -3o C 3. C) - ) 6x 6 5x 6 4x 6 3x 6 2x 6 x 6 Thermal Condutvdade conductvty térmca Heat Capacdade capacty térmca Temperature Temperatura ( o ( C) Fgure 9. Temperature-dependent thermophyscal propertes Thermal Condutvdade Conductvty térmca (W/m. C) (Wm -o C - ) The sample was supposed to be ntally at the room temperature of T* = 2 o C and the mposed heat flux was q* = 5 W/m 2. The thckness of the slab was taken as L =. m. Fnte volumes were used for the soluton of ths nonlnear heat conducton problem, wth the regon dscretzed wth 5 equal volumes. The fnal tme was supposed to be 9 seconds and the tme step was taken as second. The errors n the state evoluton and observaton models were supposed to be addtve, Gaussan, uncorrelated, wth zero mean and constant standard devatons. In order to examne a very strct case, the standard devaton for the state evoluton model was set to 5 o C and for the observaton model as o C. Fgures.a and.b present the exact and measured temperatures, respectvely, for such non lnear heat conducton problem. It s apparent from the analyss of these fgures that extremely large measurement errors were consdered for ths case. State evoluton and measurement models were used for the predcton of the temperature varaton n the regon. Due to the nonlnear character of the problem under consderaton, only the partcle flter, n the form of the samplng mportance resamplng algorthm descrbed above, was used for the predctons. Ffty partcles were used n such flterng algorthm. Fgures.a-d present a comparson of exact, measured and predcted temperatures at the postons x =.2 m,. m,.2 m and.4 m, respectvely. An analyss of these fgures reveals the robustness of the partcle flter. Despte the very large errors n the evoluton and observaton models, the predcted average temperatures are n excellent agreement wth the exact values. Furthermore, the 99% confdence ntervals for the predcted temperatures are sgnfcantly smaller than the dsperson of the measurements. Dfferently from the case analyzed above nvolvng lnear heat conducton, sample mpovershment s not observed n fgures.a-d. Ths s probably due to the large nose n the state model used for the nonlnear case. The computatonal tme for ths case was 6.3 seconds.

9 Temperature T, C x, m Fgure.a temperatures Temperature T, C x, m Fgure.b temperatures contanng Gaussan errors wth standard devaton

10 6 Partcle Flter wth Re-samplng - Number of Partcles = T(x=.2 m), C Fgure.a Temperature at x =.2 m for the nonlnear heat conducton problem Partcle flter 6 Partcle Flter wth Re-samplng - Number of Partcles = T(x=. m), C Fgure.b Temperature at x =. m for the nonlnear heat conducton problem Partcle flter

11 7 Partcle Flter wth Re-samplng - Number of Partcles = T(x=.2 m), C Fgure.c Temperature at x =.2 m for the nonlnear heat conducton problem Partcle flter 6 Partcle Flter wth Re-samplng - Number of Partcles = T(x=.4 m), C Fgure.d Temperature at x =.4 m for the nonlnear heat conducton problem Partcle flter 8. Conclusons Ths paper dealt wth the applcaton of the Kalman flter and of the partcle flter to the estmaton of the transent temperature feld n lnear and non-lnear heat conducton problems. The partcle flter was coded n the form of the samplng mportance resamplng algorthm. State estmaton problems wth lnear evoluton-observaton models, contanng addtve Gaussan noses, were solved wth these Bayesan flter technques. For lnear-gaussan models, the Kalman flter and the partcle flter provded results of smlar accuracy. However, the computatonal cost of the partcle flter was sgnfcantly larger than that of the Kalman flter. On the other hand, n non-lnear and/or non-gaussan models the basc hypotheses requred for the applcaton of the Kalman flter are not vald. The partcle flter appears n the lterature as an accurate estmaton technque of general use, ncludng for non-lnear and/or non- Gaussan models. In ths paper, the partcle flter was successfully appled to a non-lnear heat conducton problem. Such Monte Carlo technque provded accurate estmaton results, even for a strct test-case nvolvng very large errors n the evoluton and observaton models.

12 9. Acknowledgements The vsts of Prof. Helco Orlande and Prof. Marcelo Colaço to Florda Internatonal Unversty, n January-February 28, were sponsored by CAPES and CNPq, agences for the fosterng of scence from the Brazlan government. The hosptalty of Prof. George S. Dulkravch and hs famly, as well as of the Department of Mechancal and Materals Engneerng of FIU, s greatly apprecated. Prof. Helco Orlande would lke to acknowledge the course on Statstcal and Computatonal Inverse Problems gven at the Federal Unversty of Ro de Janero by Prof. Jar Kapo and Prof. Vlle Kolehmanen, from the Unversty of Kuopo n Fnland. The authors are grateful for the fnancal support provded for ths work by the US Ar Force Offce of Scentfc Research under grant FA montored by Dr. Todd E. Combs, Dr. Farba Fahroo and Dr. Donald Hearn and by the US Army Research Offce/Materals Dvson under the contract number W9NF montored by Dr. Wllam M. Mullns. The vews and conclusons contaned heren are those of the authors and should not be nterpreted as necessarly representng the offcal polces or endorsements, ether expressed or mpled, of the US Ar Force Offce of Scentfc Research, the US Army Research Offce or the U.S. Government. The U.S. Government s authorzed to reproduce and dstrbute reprnts for government purposes notwthstandng any copyrght notaton thereon.. References. Kapo, J. and Somersalo, E., 24, Statstcal and Computatonal Inverse Problems, Appled Mathematcal Scences 6, Sprnger-Verlag. 2. Maybeck, P., 979, Stochastc models, estmaton and control, Academc Press, New York. 3. Wnkler, R., 23, An Introducton to Bayesan Inference and Decson, Probablstc Publshng, Gansvlle. 4. Kapo, J., Duncan S., Seppanen, A., Somersalo, E., Voutlanen, A., 25, State Estmaton for Process Imagng, Chapter n Handbook of Process Imagng for Automatc Control, edtors: Davd Scott and Hugh McCann, CRC Press. 5. Kalman, R., 96, A New Approach to Lnear Flterng and Predcton Problems, ASME J. Basc Engneerng, vol. 82, pp Sorenson, H., 97, Least-squares estmaton: from Gauss to Kalman, IEEE Spectrum, vol. 7, pp Welch, G. and Bshop, G., 26, An Introducton to the Kalman Flter, UNC-Chapel Hll, TR Arulampalam, S., Maskell, S., Gordon, N., Clapp, T., 2, A Tutoral on Partcle Flters for on-lne Non-lnear/Non- Gaussan Bayesan Trackng, IEEE Trans. Sgnal Processng, vol. 5, pp Rstc, B., Arulampalam, S., Gordon, N., 24, Beyond the Kalman Flter, Artech House, Boston.. Doucet, A., Godsll, S., Andreu, C., 2, On sequental Monte Carlo samplng methods for Bayesan flterng, Statstcs and Computng, vol., pp Lu, J and Chen, R., 998, Sequental Monte Carlo methods for dynamcal systems, J. Amercan Statstcal Assocaton, vol. 93, pp Andreu, C., Doucet, A., Robert, C., 24, Computatonal advances for and from Bayesan analyss, Statstcal Scence, vol. 9, pp Johansen, A. Doucet, A., 28, A note on auxlary partcle flters, Statstcs and Probablty Letters, to appear. 4. Carpenter, J., Clfford, P., Fearnhead, P, 999, An mproved partcle flter for non-lnear problems, IEEE Proc. Part F: Radar and Sonar Navgaton, vol. 46, pp Del Moral, P., Doucet, A., Jasra, A., 27, Sequental Monte Carlo for Bayesan Computaton, Bayesan Statstcs, vol. 8, pp Del Moral, P., Doucet, A., Jasra, A., 26, Sequental Monte Carlo samplers, J. R. Statstcal Socety, vol. 68, pp Andreu, C., Doucet, Sumeetpal, S., Tadc, V., 24, Partcle methods for charge detecton, system dentfcaton and control, Proceedngs of IEEE, vol. 92, pp Ozsk, M., 993, Heat Conducton, Wley, New York. 9. Mota, C. A. A., Mkhalov, M. D., Orlande, H. R. B. and Cotta, R. M., 24, Identfcaton of Heat Flux Imposed by an Oxyacetylene Torch, th AIAA/ISSMO Multdscplnary Analyss and Optmzaton Conference, Albany, New York, August 29 September Mota, C. A. A., Orlande, H. R. B., Wellele, O., Kolehmanen, V. and Kapo, J., 27, Inverse Problem of Smultaneous Identfcaton of Thermophyscal Propertes and Boundary Heat Flux, 9th COBEM -Internatonal Congress of Mechancal Engneerng, November 5-9, 27, Brasla, Brazl.

Appendix B: Resampling Algorithms

Appendix B: Resampling Algorithms 407 Appendx B: Resamplng Algorthms A common problem of all partcle flters s the degeneracy of weghts, whch conssts of the unbounded ncrease of the varance of the mportance weghts ω [ ] of the partcles

More information

Quantifying Uncertainty

Quantifying Uncertainty Partcle Flters Quantfyng Uncertanty Sa Ravela M. I. T Last Updated: Sprng 2013 1 Quantfyng Uncertanty Partcle Flters Partcle Flters Appled to Sequental flterng problems Can also be appled to smoothng problems

More information

TEMPERATURE FIELD PREDICTION OF A MULTILAYERED COMPOSITE PIPELINE BASED ON THE PARTICLE FILTER METHOD

TEMPERATURE FIELD PREDICTION OF A MULTILAYERED COMPOSITE PIPELINE BASED ON THE PARTICLE FILTER METHOD Proceedngs of the 4 th Internatonal Heat Transfer Conference IHTC-4 August 8-3, 2, Washngton D.C., USA DRAFT IHTC4-22462 TEMPERATURE FIELD PREDICTION OF A MULTILAYERED COMPOSITE PIPELINE BASED ON THE PARTICLE

More information

Chapter 11: Simple Linear Regression and Correlation

Chapter 11: Simple Linear Regression and Correlation Chapter 11: Smple Lnear Regresson and Correlaton 11-1 Emprcal Models 11-2 Smple Lnear Regresson 11-3 Propertes of the Least Squares Estmators 11-4 Hypothess Test n Smple Lnear Regresson 11-4.1 Use of t-tests

More information

Composite Hypotheses testing

Composite Hypotheses testing Composte ypotheses testng In many hypothess testng problems there are many possble dstrbutons that can occur under each of the hypotheses. The output of the source s a set of parameters (ponts n a parameter

More information

A Hybrid Variational Iteration Method for Blasius Equation

A Hybrid Variational Iteration Method for Blasius Equation Avalable at http://pvamu.edu/aam Appl. Appl. Math. ISSN: 1932-9466 Vol. 10, Issue 1 (June 2015), pp. 223-229 Applcatons and Appled Mathematcs: An Internatonal Journal (AAM) A Hybrd Varatonal Iteraton Method

More information

Numerical Heat and Mass Transfer

Numerical Heat and Mass Transfer Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and

More information

Tracking with Kalman Filter

Tracking with Kalman Filter Trackng wth Kalman Flter Scott T. Acton Vrgna Image and Vdeo Analyss (VIVA), Charles L. Brown Department of Electrcal and Computer Engneerng Department of Bomedcal Engneerng Unversty of Vrgna, Charlottesvlle,

More information

DETERMINATION OF TEMPERATURE DISTRIBUTION FOR ANNULAR FINS WITH TEMPERATURE DEPENDENT THERMAL CONDUCTIVITY BY HPM

DETERMINATION OF TEMPERATURE DISTRIBUTION FOR ANNULAR FINS WITH TEMPERATURE DEPENDENT THERMAL CONDUCTIVITY BY HPM Ganj, Z. Z., et al.: Determnaton of Temperature Dstrbuton for S111 DETERMINATION OF TEMPERATURE DISTRIBUTION FOR ANNULAR FINS WITH TEMPERATURE DEPENDENT THERMAL CONDUCTIVITY BY HPM by Davood Domr GANJI

More information

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4) I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes

More information

1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands

1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands Content. Inference on Regresson Parameters a. Fndng Mean, s.d and covarance amongst estmates.. Confdence Intervals and Workng Hotellng Bands 3. Cochran s Theorem 4. General Lnear Testng 5. Measures of

More information

Global Sensitivity. Tuesday 20 th February, 2018

Global Sensitivity. Tuesday 20 th February, 2018 Global Senstvty Tuesday 2 th February, 28 ) Local Senstvty Most senstvty analyses [] are based on local estmates of senstvty, typcally by expandng the response n a Taylor seres about some specfc values

More information

An Application of Fuzzy Hypotheses Testing in Radar Detection

An Application of Fuzzy Hypotheses Testing in Radar Detection Proceedngs of the th WSES Internatonal Conference on FUZZY SYSEMS n pplcaton of Fuy Hypotheses estng n Radar Detecton.K.ELSHERIF, F.M.BBDY, G.M.BDELHMID Department of Mathematcs Mltary echncal Collage

More information

BOOTSTRAP METHOD FOR TESTING OF EQUALITY OF SEVERAL MEANS. M. Krishna Reddy, B. Naveen Kumar and Y. Ramu

BOOTSTRAP METHOD FOR TESTING OF EQUALITY OF SEVERAL MEANS. M. Krishna Reddy, B. Naveen Kumar and Y. Ramu BOOTSTRAP METHOD FOR TESTING OF EQUALITY OF SEVERAL MEANS M. Krshna Reddy, B. Naveen Kumar and Y. Ramu Department of Statstcs, Osmana Unversty, Hyderabad -500 007, Inda. nanbyrozu@gmal.com, ramu0@gmal.com

More information

Feature Selection & Dynamic Tracking F&P Textbook New: Ch 11, Old: Ch 17 Guido Gerig CS 6320, Spring 2013

Feature Selection & Dynamic Tracking F&P Textbook New: Ch 11, Old: Ch 17 Guido Gerig CS 6320, Spring 2013 Feature Selecton & Dynamc Trackng F&P Textbook New: Ch 11, Old: Ch 17 Gudo Gerg CS 6320, Sprng 2013 Credts: Materal Greg Welch & Gary Bshop, UNC Chapel Hll, some sldes modfed from J.M. Frahm/ M. Pollefeys,

More information

STATS 306B: Unsupervised Learning Spring Lecture 10 April 30

STATS 306B: Unsupervised Learning Spring Lecture 10 April 30 STATS 306B: Unsupervsed Learnng Sprng 2014 Lecture 10 Aprl 30 Lecturer: Lester Mackey Scrbe: Joey Arthur, Rakesh Achanta 10.1 Factor Analyss 10.1.1 Recap Recall the factor analyss (FA) model for lnear

More information

International Journal of Pure and Applied Sciences and Technology

International Journal of Pure and Applied Sciences and Technology Int. J. Pure Appl. Sc. Technol., 4() (03), pp. 5-30 Internatonal Journal of Pure and Appled Scences and Technology ISSN 9-607 Avalable onlne at www.jopaasat.n Research Paper Schrödnger State Space Matrx

More information

Chapter 13: Multiple Regression

Chapter 13: Multiple Regression Chapter 13: Multple Regresson 13.1 Developng the multple-regresson Model The general model can be descrbed as: It smplfes for two ndependent varables: The sample ft parameter b 0, b 1, and b are used to

More information

A PROCEDURE FOR SIMULATING THE NONLINEAR CONDUCTION HEAT TRANSFER IN A BODY WITH TEMPERATURE DEPENDENT THERMAL CONDUCTIVITY.

A PROCEDURE FOR SIMULATING THE NONLINEAR CONDUCTION HEAT TRANSFER IN A BODY WITH TEMPERATURE DEPENDENT THERMAL CONDUCTIVITY. Proceedngs of the th Brazlan Congress of Thermal Scences and Engneerng -- ENCIT 006 Braz. Soc. of Mechancal Scences and Engneerng -- ABCM, Curtba, Brazl,- Dec. 5-8, 006 A PROCEDURE FOR SIMULATING THE NONLINEAR

More information

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:

More information

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE Analytcal soluton s usually not possble when exctaton vares arbtrarly wth tme or f the system s nonlnear. Such problems can be solved by numercal tmesteppng

More information

A Particle Filter Algorithm based on Mixing of Prior probability density and UKF as Generate Importance Function

A Particle Filter Algorithm based on Mixing of Prior probability density and UKF as Generate Importance Function Advanced Scence and Technology Letters, pp.83-87 http://dx.do.org/10.14257/astl.2014.53.20 A Partcle Flter Algorthm based on Mxng of Pror probablty densty and UKF as Generate Importance Functon Lu Lu 1,1,

More information

Using T.O.M to Estimate Parameter of distributions that have not Single Exponential Family

Using T.O.M to Estimate Parameter of distributions that have not Single Exponential Family IOSR Journal of Mathematcs IOSR-JM) ISSN: 2278-5728. Volume 3, Issue 3 Sep-Oct. 202), PP 44-48 www.osrjournals.org Usng T.O.M to Estmate Parameter of dstrbutons that have not Sngle Exponental Famly Jubran

More information

4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA

4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA 4 Analyss of Varance (ANOVA) 5 ANOVA 51 Introducton ANOVA ANOVA s a way to estmate and test the means of multple populatons We wll start wth one-way ANOVA If the populatons ncluded n the study are selected

More information

Uncertainty as the Overlap of Alternate Conditional Distributions

Uncertainty as the Overlap of Alternate Conditional Distributions Uncertanty as the Overlap of Alternate Condtonal Dstrbutons Olena Babak and Clayton V. Deutsch Centre for Computatonal Geostatstcs Department of Cvl & Envronmental Engneerng Unversty of Alberta An mportant

More information

A Robust Method for Calculating the Correlation Coefficient

A Robust Method for Calculating the Correlation Coefficient A Robust Method for Calculatng the Correlaton Coeffcent E.B. Nven and C. V. Deutsch Relatonshps between prmary and secondary data are frequently quantfed usng the correlaton coeffcent; however, the tradtonal

More information

Parametric fractional imputation for missing data analysis. Jae Kwang Kim Survey Working Group Seminar March 29, 2010

Parametric fractional imputation for missing data analysis. Jae Kwang Kim Survey Working Group Seminar March 29, 2010 Parametrc fractonal mputaton for mssng data analyss Jae Kwang Km Survey Workng Group Semnar March 29, 2010 1 Outlne Introducton Proposed method Fractonal mputaton Approxmaton Varance estmaton Multple mputaton

More information

Statistics for Economics & Business

Statistics for Economics & Business Statstcs for Economcs & Busness Smple Lnear Regresson Learnng Objectves In ths chapter, you learn: How to use regresson analyss to predct the value of a dependent varable based on an ndependent varable

More information

Hidden Markov Models

Hidden Markov Models Hdden Markov Models Namrata Vaswan, Iowa State Unversty Aprl 24, 204 Hdden Markov Model Defntons and Examples Defntons:. A hdden Markov model (HMM) refers to a set of hdden states X 0, X,..., X t,...,

More information

Numerical Transient Heat Conduction Experiment

Numerical Transient Heat Conduction Experiment Numercal ransent Heat Conducton Experment OBJECIVE 1. o demonstrate the basc prncples of conducton heat transfer.. o show how the thermal conductvty of a sold can be measured. 3. o demonstrate the use

More information

Markov Chain Monte Carlo (MCMC), Gibbs Sampling, Metropolis Algorithms, and Simulated Annealing Bioinformatics Course Supplement

Markov Chain Monte Carlo (MCMC), Gibbs Sampling, Metropolis Algorithms, and Simulated Annealing Bioinformatics Course Supplement Markov Chan Monte Carlo MCMC, Gbbs Samplng, Metropols Algorthms, and Smulated Annealng 2001 Bonformatcs Course Supplement SNU Bontellgence Lab http://bsnuackr/ Outlne! Markov Chan Monte Carlo MCMC! Metropols-Hastngs

More information

Statistical analysis using matlab. HY 439 Presented by: George Fortetsanakis

Statistical analysis using matlab. HY 439 Presented by: George Fortetsanakis Statstcal analyss usng matlab HY 439 Presented by: George Fortetsanaks Roadmap Probablty dstrbutons Statstcal estmaton Fttng data to probablty dstrbutons Contnuous dstrbutons Contnuous random varable X

More information

Research Article Green s Theorem for Sign Data

Research Article Green s Theorem for Sign Data Internatonal Scholarly Research Network ISRN Appled Mathematcs Volume 2012, Artcle ID 539359, 10 pages do:10.5402/2012/539359 Research Artcle Green s Theorem for Sgn Data Lous M. Houston The Unversty of

More information

AN IMPROVED PARTICLE FILTER ALGORITHM BASED ON NEURAL NETWORK FOR TARGET TRACKING

AN IMPROVED PARTICLE FILTER ALGORITHM BASED ON NEURAL NETWORK FOR TARGET TRACKING AN IMPROVED PARTICLE FILTER ALGORITHM BASED ON NEURAL NETWORK FOR TARGET TRACKING Qn Wen, Peng Qcong 40 Lab, Insttuton of Communcaton and Informaton Engneerng,Unversty of Electronc Scence and Technology

More information

Lecture Notes on Linear Regression

Lecture Notes on Linear Regression Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume

More information

Comparison of the Population Variance Estimators. of 2-Parameter Exponential Distribution Based on. Multiple Criteria Decision Making Method

Comparison of the Population Variance Estimators. of 2-Parameter Exponential Distribution Based on. Multiple Criteria Decision Making Method Appled Mathematcal Scences, Vol. 7, 0, no. 47, 07-0 HIARI Ltd, www.m-hkar.com Comparson of the Populaton Varance Estmators of -Parameter Exponental Dstrbuton Based on Multple Crtera Decson Makng Method

More information

An adaptive SMC scheme for ABC. Bayesian Computation (ABC)

An adaptive SMC scheme for ABC. Bayesian Computation (ABC) An adaptve SMC scheme for Approxmate Bayesan Computaton (ABC) (ont work wth Prof. Mke West) Department of Statstcal Scence - Duke Unversty Aprl/2011 Approxmate Bayesan Computaton (ABC) Problems n whch

More information

Generalized Linear Methods

Generalized Linear Methods Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set

More information

Transfer Functions. Convenient representation of a linear, dynamic model. A transfer function (TF) relates one input and one output: ( ) system

Transfer Functions. Convenient representation of a linear, dynamic model. A transfer function (TF) relates one input and one output: ( ) system Transfer Functons Convenent representaton of a lnear, dynamc model. A transfer functon (TF) relates one nput and one output: x t X s y t system Y s The followng termnology s used: x y nput output forcng

More information

Statistics Chapter 4

Statistics Chapter 4 Statstcs Chapter 4 "There are three knds of les: les, damned les, and statstcs." Benjamn Dsrael, 1895 (Brtsh statesman) Gaussan Dstrbuton, 4-1 If a measurement s repeated many tmes a statstcal treatment

More information

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification E395 - Pattern Recognton Solutons to Introducton to Pattern Recognton, Chapter : Bayesan pattern classfcaton Preface Ths document s a soluton manual for selected exercses from Introducton to Pattern Recognton

More information

4DVAR, according to the name, is a four-dimensional variational method.

4DVAR, according to the name, is a four-dimensional variational method. 4D-Varatonal Data Assmlaton (4D-Var) 4DVAR, accordng to the name, s a four-dmensonal varatonal method. 4D-Var s actually a drect generalzaton of 3D-Var to handle observatons that are dstrbuted n tme. The

More information

Linear Approximation with Regularization and Moving Least Squares

Linear Approximation with Regularization and Moving Least Squares Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...

More information

Convergence of random processes

Convergence of random processes DS-GA 12 Lecture notes 6 Fall 216 Convergence of random processes 1 Introducton In these notes we study convergence of dscrete random processes. Ths allows to characterze phenomena such as the law of large

More information

Conjugacy and the Exponential Family

Conjugacy and the Exponential Family CS281B/Stat241B: Advanced Topcs n Learnng & Decson Makng Conjugacy and the Exponental Famly Lecturer: Mchael I. Jordan Scrbes: Bran Mlch 1 Conjugacy In the prevous lecture, we saw conjugate prors for the

More information

Computation of Higher Order Moments from Two Multinomial Overdispersion Likelihood Models

Computation of Higher Order Moments from Two Multinomial Overdispersion Likelihood Models Computaton of Hgher Order Moments from Two Multnomal Overdsperson Lkelhood Models BY J. T. NEWCOMER, N. K. NEERCHAL Department of Mathematcs and Statstcs, Unversty of Maryland, Baltmore County, Baltmore,

More information

The Gaussian classifier. Nuno Vasconcelos ECE Department, UCSD

The Gaussian classifier. Nuno Vasconcelos ECE Department, UCSD he Gaussan classfer Nuno Vasconcelos ECE Department, UCSD Bayesan decson theory recall that we have state of the world X observatons g decson functon L[g,y] loss of predctng y wth g Bayes decson rule s

More information

Parameter Estimation for Dynamic System using Unscented Kalman filter

Parameter Estimation for Dynamic System using Unscented Kalman filter Parameter Estmaton for Dynamc System usng Unscented Kalman flter Jhoon Seung 1,a, Amr Atya F. 2,b, Alexander G.Parlos 3,c, and Klto Chong 1,4,d* 1 Dvson of Electroncs Engneerng, Chonbuk Natonal Unversty,

More information

Comparison of Regression Lines

Comparison of Regression Lines STATGRAPHICS Rev. 9/13/2013 Comparson of Regresson Lnes Summary... 1 Data Input... 3 Analyss Summary... 4 Plot of Ftted Model... 6 Condtonal Sums of Squares... 6 Analyss Optons... 7 Forecasts... 8 Confdence

More information

Appendix B. The Finite Difference Scheme

Appendix B. The Finite Difference Scheme 140 APPENDIXES Appendx B. The Fnte Dfference Scheme In ths appendx we present numercal technques whch are used to approxmate solutons of system 3.1 3.3. A comprehensve treatment of theoretcal and mplementaton

More information

Bayesian predictive Configural Frequency Analysis

Bayesian predictive Configural Frequency Analysis Psychologcal Test and Assessment Modelng, Volume 54, 2012 (3), 285-292 Bayesan predctve Confgural Frequency Analyss Eduardo Gutérrez-Peña 1 Abstract Confgural Frequency Analyss s a method for cell-wse

More information

Inductance Calculation for Conductors of Arbitrary Shape

Inductance Calculation for Conductors of Arbitrary Shape CRYO/02/028 Aprl 5, 2002 Inductance Calculaton for Conductors of Arbtrary Shape L. Bottura Dstrbuton: Internal Summary In ths note we descrbe a method for the numercal calculaton of nductances among conductors

More information

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons

More information

DETERMINATION OF UNCERTAINTY ASSOCIATED WITH QUANTIZATION ERRORS USING THE BAYESIAN APPROACH

DETERMINATION OF UNCERTAINTY ASSOCIATED WITH QUANTIZATION ERRORS USING THE BAYESIAN APPROACH Proceedngs, XVII IMEKO World Congress, June 7, 3, Dubrovn, Croata Proceedngs, XVII IMEKO World Congress, June 7, 3, Dubrovn, Croata TC XVII IMEKO World Congress Metrology n the 3rd Mllennum June 7, 3,

More information

Discussion of Extensions of the Gauss-Markov Theorem to the Case of Stochastic Regression Coefficients Ed Stanek

Discussion of Extensions of the Gauss-Markov Theorem to the Case of Stochastic Regression Coefficients Ed Stanek Dscusson of Extensons of the Gauss-arkov Theorem to the Case of Stochastc Regresson Coeffcents Ed Stanek Introducton Pfeffermann (984 dscusses extensons to the Gauss-arkov Theorem n settngs where regresson

More information

STAT 511 FINAL EXAM NAME Spring 2001

STAT 511 FINAL EXAM NAME Spring 2001 STAT 5 FINAL EXAM NAME Sprng Instructons: Ths s a closed book exam. No notes or books are allowed. ou may use a calculator but you are not allowed to store notes or formulas n the calculator. Please wrte

More information

Simulated Power of the Discrete Cramér-von Mises Goodness-of-Fit Tests

Simulated Power of the Discrete Cramér-von Mises Goodness-of-Fit Tests Smulated of the Cramér-von Mses Goodness-of-Ft Tests Steele, M., Chaselng, J. and 3 Hurst, C. School of Mathematcal and Physcal Scences, James Cook Unversty, Australan School of Envronmental Studes, Grffth

More information

An identification algorithm of model kinetic parameters of the interfacial layer growth in fiber composites

An identification algorithm of model kinetic parameters of the interfacial layer growth in fiber composites IOP Conference Seres: Materals Scence and Engneerng PAPER OPE ACCESS An dentfcaton algorthm of model knetc parameters of the nterfacal layer growth n fber compostes o cte ths artcle: V Zubov et al 216

More information

Identification of Linear Partial Difference Equations with Constant Coefficients

Identification of Linear Partial Difference Equations with Constant Coefficients J. Basc. Appl. Sc. Res., 3(1)6-66, 213 213, TextRoad Publcaton ISSN 29-434 Journal of Basc and Appled Scentfc Research www.textroad.com Identfcaton of Lnear Partal Dfference Equatons wth Constant Coeffcents

More information

Particle Filter Approach to Fault Detection andisolation in Nonlinear Systems

Particle Filter Approach to Fault Detection andisolation in Nonlinear Systems Amercan Journal of Sgnal Processng 22,2(3): 46-5 DOI:.5923/j.ajsp.2223.2 Partcle Flter Approach to Fault Detecton andisolaton n Nonlnear Systems F. Soubgu *, F. BenHmda, A. Chaar Department of Electrcal

More information

Time-Varying Systems and Computations Lecture 6

Time-Varying Systems and Computations Lecture 6 Tme-Varyng Systems and Computatons Lecture 6 Klaus Depold 14. Januar 2014 The Kalman Flter The Kalman estmaton flter attempts to estmate the actual state of an unknown dscrete dynamcal system, gven nosy

More information

STAT 3008 Applied Regression Analysis

STAT 3008 Applied Regression Analysis STAT 3008 Appled Regresson Analyss Tutoral : Smple Lnear Regresson LAI Chun He Department of Statstcs, The Chnese Unversty of Hong Kong 1 Model Assumpton To quantfy the relatonshp between two factors,

More information

Classification as a Regression Problem

Classification as a Regression Problem Target varable y C C, C,, ; Classfcaton as a Regresson Problem { }, 3 L C K To treat classfcaton as a regresson problem we should transform the target y nto numercal values; The choce of numercal class

More information

2016 Wiley. Study Session 2: Ethical and Professional Standards Application

2016 Wiley. Study Session 2: Ethical and Professional Standards Application 6 Wley Study Sesson : Ethcal and Professonal Standards Applcaton LESSON : CORRECTION ANALYSIS Readng 9: Correlaton and Regresson LOS 9a: Calculate and nterpret a sample covarance and a sample correlaton

More information

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also

More information

Analytic Local Linearization Particle Filter for Bayesian State Estimation in Nonlinear Continuous Process

Analytic Local Linearization Particle Filter for Bayesian State Estimation in Nonlinear Continuous Process D. Jayaprasanth, Jovtha Jerome Analytc Local Lnearzaton Partcle Flter for Bayesan State Estmaton n onlnear Contnuous Process D. JAYAPRASATH, JOVITHA JEROME Department of Instrumentaton and Control Systems

More information

Chapter 9: Statistical Inference and the Relationship between Two Variables

Chapter 9: Statistical Inference and the Relationship between Two Variables Chapter 9: Statstcal Inference and the Relatonshp between Two Varables Key Words The Regresson Model The Sample Regresson Equaton The Pearson Correlaton Coeffcent Learnng Outcomes After studyng ths chapter,

More information

ONE DIMENSIONAL TRIANGULAR FIN EXPERIMENT. Technical Advisor: Dr. D.C. Look, Jr. Version: 11/03/00

ONE DIMENSIONAL TRIANGULAR FIN EXPERIMENT. Technical Advisor: Dr. D.C. Look, Jr. Version: 11/03/00 ONE IMENSIONAL TRIANGULAR FIN EXPERIMENT Techncal Advsor: r..c. Look, Jr. Verson: /3/ 7. GENERAL OJECTIVES a) To understand a one-dmensonal epermental appromaton. b) To understand the art of epermental

More information

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS Avalable onlne at http://sck.org J. Math. Comput. Sc. 3 (3), No., 6-3 ISSN: 97-537 COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

More information

Hidden Markov Models & The Multivariate Gaussian (10/26/04)

Hidden Markov Models & The Multivariate Gaussian (10/26/04) CS281A/Stat241A: Statstcal Learnng Theory Hdden Markov Models & The Multvarate Gaussan (10/26/04) Lecturer: Mchael I. Jordan Scrbes: Jonathan W. Hu 1 Hdden Markov Models As a bref revew, hdden Markov models

More information

Department of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6

Department of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6 Department of Quanttatve Methods & Informaton Systems Tme Seres and Ther Components QMIS 30 Chapter 6 Fall 00 Dr. Mohammad Zanal These sldes were modfed from ther orgnal source for educatonal purpose only.

More information

Estimation of Markov Jump Systems with Mode Observation One-Step Lagged to State Measurement

Estimation of Markov Jump Systems with Mode Observation One-Step Lagged to State Measurement Estmaton of Marov Jump Systems wth Mode Observaton One-Step Lagged to State Measurement Yan Lang, Zengfu Wang, Ll We, Yongme Cheng, Quan Pan College of Automaton Northwestern Polytechncal Unversty X an,

More information

A LINEAR PROGRAM TO COMPARE MULTIPLE GROSS CREDIT LOSS FORECASTS. Dr. Derald E. Wentzien, Wesley College, (302) ,

A LINEAR PROGRAM TO COMPARE MULTIPLE GROSS CREDIT LOSS FORECASTS. Dr. Derald E. Wentzien, Wesley College, (302) , A LINEAR PROGRAM TO COMPARE MULTIPLE GROSS CREDIT LOSS FORECASTS Dr. Derald E. Wentzen, Wesley College, (302) 736-2574, wentzde@wesley.edu ABSTRACT A lnear programmng model s developed and used to compare

More information

Psychology 282 Lecture #24 Outline Regression Diagnostics: Outliers

Psychology 282 Lecture #24 Outline Regression Diagnostics: Outliers Psychology 282 Lecture #24 Outlne Regresson Dagnostcs: Outlers In an earler lecture we studed the statstcal assumptons underlyng the regresson model, ncludng the followng ponts: Formal statement of assumptons.

More information

Department of Statistics University of Toronto STA305H1S / 1004 HS Design and Analysis of Experiments Term Test - Winter Solution

Department of Statistics University of Toronto STA305H1S / 1004 HS Design and Analysis of Experiments Term Test - Winter Solution Department of Statstcs Unversty of Toronto STA35HS / HS Desgn and Analyss of Experments Term Test - Wnter - Soluton February, Last Name: Frst Name: Student Number: Instructons: Tme: hours. Ads: a non-programmable

More information

DUE: WEDS FEB 21ST 2018

DUE: WEDS FEB 21ST 2018 HOMEWORK # 1: FINITE DIFFERENCES IN ONE DIMENSION DUE: WEDS FEB 21ST 2018 1. Theory Beam bendng s a classcal engneerng analyss. The tradtonal soluton technque makes smplfyng assumptons such as a constant

More information

Digital Modems. Lecture 2

Digital Modems. Lecture 2 Dgtal Modems Lecture Revew We have shown that both Bayes and eyman/pearson crtera are based on the Lkelhood Rato Test (LRT) Λ ( r ) < > η Λ r s called observaton transformaton or suffcent statstc The crtera

More information

CIS526: Machine Learning Lecture 3 (Sept 16, 2003) Linear Regression. Preparation help: Xiaoying Huang. x 1 θ 1 output... θ M x M

CIS526: Machine Learning Lecture 3 (Sept 16, 2003) Linear Regression. Preparation help: Xiaoying Huang. x 1 θ 1 output... θ M x M CIS56: achne Learnng Lecture 3 (Sept 6, 003) Preparaton help: Xaoyng Huang Lnear Regresson Lnear regresson can be represented by a functonal form: f(; θ) = θ 0 0 +θ + + θ = θ = 0 ote: 0 s a dummy attrbute

More information

Irregular vibrations in multi-mass discrete-continuous systems torsionally deformed

Irregular vibrations in multi-mass discrete-continuous systems torsionally deformed (2) 4 48 Irregular vbratons n mult-mass dscrete-contnuous systems torsonally deformed Abstract In the paper rregular vbratons of dscrete-contnuous systems consstng of an arbtrary number rgd bodes connected

More information

Markov Chain Monte Carlo Lecture 6

Markov Chain Monte Carlo Lecture 6 where (x 1,..., x N ) X N, N s called the populaton sze, f(x) f (x) for at least one {1, 2,..., N}, and those dfferent from f(x) are called the tral dstrbutons n terms of mportance samplng. Dfferent ways

More information

NON-CENTRAL 7-POINT FORMULA IN THE METHOD OF LINES FOR PARABOLIC AND BURGERS' EQUATIONS

NON-CENTRAL 7-POINT FORMULA IN THE METHOD OF LINES FOR PARABOLIC AND BURGERS' EQUATIONS IJRRAS 8 (3 September 011 www.arpapress.com/volumes/vol8issue3/ijrras_8_3_08.pdf NON-CENTRAL 7-POINT FORMULA IN THE METHOD OF LINES FOR PARABOLIC AND BURGERS' EQUATIONS H.O. Bakodah Dept. of Mathematc

More information

( ) ( ) ( ) ( ) STOCHASTIC SIMULATION FOR BLOCKED DATA. Monte Carlo simulation Rejection sampling Importance sampling Markov chain Monte Carlo

( ) ( ) ( ) ( ) STOCHASTIC SIMULATION FOR BLOCKED DATA. Monte Carlo simulation Rejection sampling Importance sampling Markov chain Monte Carlo SOCHASIC SIMULAIO FOR BLOCKED DAA Stochastc System Analyss and Bayesan Model Updatng Monte Carlo smulaton Rejecton samplng Importance samplng Markov chan Monte Carlo Monte Carlo smulaton Introducton: If

More information

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS HCMC Unversty of Pedagogy Thong Nguyen Huu et al. A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS Thong Nguyen Huu and Hao Tran Van Department of mathematcs-nformaton,

More information

On an Extension of Stochastic Approximation EM Algorithm for Incomplete Data Problems. Vahid Tadayon 1

On an Extension of Stochastic Approximation EM Algorithm for Incomplete Data Problems. Vahid Tadayon 1 On an Extenson of Stochastc Approxmaton EM Algorthm for Incomplete Data Problems Vahd Tadayon Abstract: The Stochastc Approxmaton EM (SAEM algorthm, a varant stochastc approxmaton of EM, s a versatle tool

More information

arxiv:cs.cv/ Jun 2000

arxiv:cs.cv/ Jun 2000 Correlaton over Decomposed Sgnals: A Non-Lnear Approach to Fast and Effectve Sequences Comparson Lucano da Fontoura Costa arxv:cs.cv/0006040 28 Jun 2000 Cybernetc Vson Research Group IFSC Unversty of São

More information

Relevance Vector Machines Explained

Relevance Vector Machines Explained October 19, 2010 Relevance Vector Machnes Explaned Trstan Fletcher www.cs.ucl.ac.uk/staff/t.fletcher/ Introducton Ths document has been wrtten n an attempt to make Tppng s [1] Relevance Vector Machnes

More information

j) = 1 (note sigma notation) ii. Continuous random variable (e.g. Normal distribution) 1. density function: f ( x) 0 and f ( x) dx = 1

j) = 1 (note sigma notation) ii. Continuous random variable (e.g. Normal distribution) 1. density function: f ( x) 0 and f ( x) dx = 1 Random varables Measure of central tendences and varablty (means and varances) Jont densty functons and ndependence Measures of assocaton (covarance and correlaton) Interestng result Condtonal dstrbutons

More information

MIMA Group. Chapter 2 Bayesian Decision Theory. School of Computer Science and Technology, Shandong University. Xin-Shun SDU

MIMA Group. Chapter 2 Bayesian Decision Theory. School of Computer Science and Technology, Shandong University. Xin-Shun SDU Group M D L M Chapter Bayesan Decson heory Xn-Shun Xu @ SDU School of Computer Scence and echnology, Shandong Unversty Bayesan Decson heory Bayesan decson theory s a statstcal approach to data mnng/pattern

More information

Suppose that there s a measured wndow of data fff k () ; :::; ff k g of a sze w, measured dscretely wth varable dscretzaton step. It s convenent to pl

Suppose that there s a measured wndow of data fff k () ; :::; ff k g of a sze w, measured dscretely wth varable dscretzaton step. It s convenent to pl RECURSIVE SPLINE INTERPOLATION METHOD FOR REAL TIME ENGINE CONTROL APPLICATIONS A. Stotsky Volvo Car Corporaton Engne Desgn and Development Dept. 97542, HA1N, SE- 405 31 Gothenburg Sweden. Emal: astotsky@volvocars.com

More information

Statistics for Business and Economics

Statistics for Business and Economics Statstcs for Busness and Economcs Chapter 11 Smple Regresson Copyrght 010 Pearson Educaton, Inc. Publshng as Prentce Hall Ch. 11-1 11.1 Overvew of Lnear Models n An equaton can be ft to show the best lnear

More information

Combined Parameter and State Estimation Problem in a Complex Domain: RF Hyperthermia Treatment Using Nanoparticles

Combined Parameter and State Estimation Problem in a Complex Domain: RF Hyperthermia Treatment Using Nanoparticles Journal of Physcs: Conference Seres PAPER OPEN ACCESS Combned Parameter and State Estmaton Problem n a Complex Doman: RF Hypertherma Treatment Usng Nanopartcles To cte ths artcle: L A Bermeo Varon et al

More information

x i1 =1 for all i (the constant ).

x i1 =1 for all i (the constant ). Chapter 5 The Multple Regresson Model Consder an economc model where the dependent varable s a functon of K explanatory varables. The economc model has the form: y = f ( x,x,..., ) xk Approxmate ths by

More information

PROPERTIES I. INTRODUCTION. Finite element (FE) models are widely used to predict the dynamic characteristics of aerospace

PROPERTIES I. INTRODUCTION. Finite element (FE) models are widely used to predict the dynamic characteristics of aerospace FINITE ELEMENT MODEL UPDATING USING BAYESIAN FRAMEWORK AND MODAL PROPERTIES Tshldz Marwala 1 and Sbusso Sbs I. INTRODUCTION Fnte element (FE) models are wdely used to predct the dynamc characterstcs of

More information

P R. Lecture 4. Theory and Applications of Pattern Recognition. Dept. of Electrical and Computer Engineering /

P R. Lecture 4. Theory and Applications of Pattern Recognition. Dept. of Electrical and Computer Engineering / Theory and Applcatons of Pattern Recognton 003, Rob Polkar, Rowan Unversty, Glassboro, NJ Lecture 4 Bayes Classfcaton Rule Dept. of Electrcal and Computer Engneerng 0909.40.0 / 0909.504.04 Theory & Applcatons

More information

FUZZY FINITE ELEMENT METHOD

FUZZY FINITE ELEMENT METHOD FUZZY FINITE ELEMENT METHOD RELIABILITY TRUCTURE ANALYI UING PROBABILITY 3.. Maxmum Normal tress Internal force s the shear force, V has a magntude equal to the load P and bendng moment, M. Bendng moments

More information

Structure and Drive Paul A. Jensen Copyright July 20, 2003

Structure and Drive Paul A. Jensen Copyright July 20, 2003 Structure and Drve Paul A. Jensen Copyrght July 20, 2003 A system s made up of several operatons wth flow passng between them. The structure of the system descrbes the flow paths from nputs to outputs.

More information

Estimation: Part 2. Chapter GREG estimation

Estimation: Part 2. Chapter GREG estimation Chapter 9 Estmaton: Part 2 9. GREG estmaton In Chapter 8, we have seen that the regresson estmator s an effcent estmator when there s a lnear relatonshp between y and x. In ths chapter, we generalzed the

More information

Kernel Methods and SVMs Extension

Kernel Methods and SVMs Extension Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general

More information

Lossy Compression. Compromise accuracy of reconstruction for increased compression.

Lossy Compression. Compromise accuracy of reconstruction for increased compression. Lossy Compresson Compromse accuracy of reconstructon for ncreased compresson. The reconstructon s usually vsbly ndstngushable from the orgnal mage. Typcally, one can get up to 0:1 compresson wth almost

More information

2 Finite difference basics

2 Finite difference basics Numersche Methoden 1, WS 11/12 B.J.P. Kaus 2 Fnte dfference bascs Consder the one- The bascs of the fnte dfference method are best understood wth an example. dmensonal transent heat conducton equaton T

More information