Model Updating Using Bayesian Estimation

Size: px
Start display at page:

Download "Model Updating Using Bayesian Estimation"

Transcription

1 Model Updatng Usng Bayesan Estmaton C. Mares, B. Dratz 1, J.E. Mottershead, M. I. Frswell 3 Brunel Unversty, School of Engneerng and Desgn, Uxbrdge, Mddlesex, UB8 3PH, UK 1 Ecole Centrale de Llle, Mechancal Engneerng, France Unversty of Lverpool, Dept. of Engneerng, Brownlow Hll, Lverpool L69 3GH, UK 3 Unversty of Brstol, Department of Aerospace Engneerng, Queen s Buldng, Unversty Walk,Brstol BS8 ITR, UK Abstract Varablty n real structures, whch could arse from manufacturng processes, and the modellng assumptons and lmtatons requre the creaton of a statstcal model of the relatonshp between expermental and model predctons and the quantfcaton of the uncertanty of ths estmate. In ths paper Markov-Chan Monte Carlo theory (MCMC) s dscussed and appled to model updatng n the case of multple sets of expermental results by usng frequency responses functons. The MCMC method allows the soluton of complex problems n a unfyng framework, by ntegratng over hgh dmensonal probablty dstrbutons n order to make nferences about the model parameters. A smulated three degree-of-freedom system s used to llustrate some aspects of the method, allowng for practcal assumptons to be tested on a smple example wthn the WINBUGS envronment (Bayesan nference Usng Gbbs Samplng). 1 Introducton Model updatng s usually performed by analysng the degree to whch a fnte element model adequately represents a sngle set of expermental data [1], []. The updated parameters should be justfed physcally and the qualty of the fnal model should be assessed wthn the operatng range. Robustness-touncertanty, fdelty-to-data and confdence-n-predcton are aspects whch gve a measure of credblty for the updated structural model [3], [4]. Varablty n real structures, whch could arse from manufacturng processes, and the modellng assumptons and lmtatons have an mportant effect when complcated jonts and nterfaces, such as welds and adhesvely connected surfaces, are present n the actual structure. For such complex structures, predctons based on a sngle calbraton of the model parameters cannot gve a clear measure of confdence n the capablty of an analytcal model to represent the actual structure. The possblty of correcton of a set of analytcal models wth randomzed parameters based on a set of expermental results from a collecton of nomnally dentcal test peces was presented n [5],[6] where a stochastc Monte-Carlo correlaton and nverse uncertanty propagaton was carred out on a smulated example and a benchmark structure wth spot-welds. The three goals presented above are antagonstc and an estmate of the uncertanty leads to the necessty of creatng a model of the relatonshp between expermental and model predctons. In ths paper the Markov-Chan Monte Carlo theory (MCMC) [7],[8], s dscussed and appled to model updatng n the case of multple sets of expermental results by usng frequency response functons. The MCMC method allows the soluton of complex problems n a unfyng framework, by ntegratng over hgh dmensonal probablty dstrbutons n order to make nference about the model parameters. A smulated three degree-of-freedom system s used to llustrate some aspects of the method, allowng for practcal assumptons to be tested on a smple example wthn the WINBUGS envronment (Bayesan nference Usng Gbbs Samplng) [10]. Ths software uses Gbbs samplng [11],[1],[13] and the Metropols algorthm [14] to generate a Markov chan by samplng from the full condtonal dstrbutons. Dfferent practcal assumptons are analysed and an assessment of the consequences of wrongly chosen 607

2 608 PROCEEDINGS OF ISMA006 updatng parameters, model structure errors, nose effects, observablty of the model errors through measurements locatons and optmal frequency measurement ponts for the mnmsaton of model errors s carred out. Theory.1 Bayesan Analyss Bayesan analyss provdes a ratonal approach for the soluton of complex problems, n partcular to parameter estmaton problems wth an assumed correct model or n model selecton problems. The learnng process, based on data, s performed usng Bayes theorem n a hypothess space, where probabltes are assgned to each competng hypothess regardng the problem under study. The parameter estmaton problem s then solved by estmatng the dstrbuton of a random parameter wthn an ensemble of data sets and the pror nformaton. The usual form of Bayes theorem s gven by: p( H p( D H, p( H D, = (1) p( D where H proposton assertng the truth of a hypothess of nterest I - proposton representng our pror nformaton D - proposton representng data p( D H, - probablty of obtanng data D, f H and I are true (called the lkelhood functon ) p( H - pror probablty hypothess p( H D, - posteror probablty of H p( D = p( H p( D H, - normalsaton factor ensurng that p( H D, = 1 Equaton (1) shows how the pror probablty of a hypothess H s updated to a posteror probablty p( H D, whch ncludes all the nformaton provded by the data D. The updatng factor s the rato of two terms and only the lkelhood functon (or samplng dstrbuton) p( D H, depends explctly on H, the denomnator p ( D, called the pror predctve probablty or the global lkelhood, beng ndependent of H.. Markov Chan Monte-Carlo Bayesan Inference Quantfcaton of the uncertanty n model parameters when expermental data and model predctons n some output varables of nterest, can be performed by usng the Bayesan nference. The Bayesan soluton requres ntegrals over the model parameter space and Markov Chan Monte Carlo (MCMC) algorthms form the bass of practcal computaton for probablty dstrbutons n several or many unknowns. The MCMC method estmates the requred posteror dstrbutons for hgh dmensonal models by usng sampler algorthms such as the Metropols Hastngs or Gbbs approaches, whch concentrate the samplng n regons wth sgnfcant probablty performng an effcent stochastc search n the model space. The models are constructed to assess the relatonshp between the response varables y and other characterstcs expressed n varables θ usually called covarates. The explanatory varables are lnked j

3 MODEL UPDATING AND CORRELATION 609 wth the response varables va a determnstc functon. For ndependent model responses followng a probablstc rule f ( θ ) the jont dstrbuton contans all the avalable nformaton provded by the sample: y f ( yθ ) = f ( y θ ) A Markov chan s a stochastc process { ( 1) (), ( t, θ θ ) } f ( θ θ () θ L such that (1) ( t+ 1) ( ), L θ ) = f ( θ θ ) the parameter dstrbuton θ at tme t + 1gven all the precedng θ ( t+ 1) ( t) t (t) ( t 1) ( t) depends only on θ and f ( θ + θ ) s ndependent of the tme step t. It can be shown that under (t) (0) certan condtons the dstrbuton θ tends to an equlbrum ndependent of the ntal estmates θ [8] convergng on a posteror dstrbuton called the statonary dstrbuton of the Markov chan. Assumng (0) that the equlbrum dstrbuton s the target dstrbuton f ( yθ ), after ntalzaton θ, the Gbbs sampler algorthm ntroduced by Geman and Geman [11] generates samples of θ wth a probablty densty whch converges on the desred posteror target. The Gbbs sampler algorthm s a specal case of a sngle component Metropols-Hastngs algorthm [1],[13],[14]..3 Stochastc Search Varable Selecton In buldng a model for the estmaton problem, a key aspect s that of the varables to be ncluded. The Bayesan model selecton usng MCMC technques explores the model space, tracng the best models and estmatng ther posteror probablty based on the observed data and the pror probabltes. A possble two-step soluton for a subset of predctors was developed by George and McCulloch [14]. The Stochastc Search Varable Selecton (SSVS) method assgns a probablty dstrbuton on a set of models such that the most approprate models are gven the hghest probablty dstrbuton and the approach s effectve even for a large number of predctors and small number of observatons [14]. The man feature of ths approach s the assgnment of a latent ncluson varable δ to every predctor. Suppose the adopted model * * * * s descrbed by a set of predctors θ1, θ, θ 3 K θ q from a larger set θ 1, θ, θ 3 Kθ n. The components θ are modelled as a normal mxture: π ( θ δ ) = (1 δ ) N(0, τ ) + δ N(0, cτ ) P( δ = 1) = 1 P( δ = 0) wth τ << cτ (3) If δ = 1 then θ s dstrbuted as a normal wth mean zero and varance cτ where c s a large constant pre-multplyng a small default varance τ. If the ncluson of θ s not supported by the data, then the pror wth the default varance N(0, τ ) wll be selected more often. The choce δ = 1 corresponds to retanng the predctor θ whle for δ = 0 the predctor s dstrbuted around zero wth a small varance, meanng that the data does not support the appearance of the predctor among the defnng varables for the model.

4 610 PROCEEDINGS OF ISMA006 3 Example If the model s descrbed by usng a fnte element model, the global matrces are expressed as lnear combnatons of constant element or substructure matrces multpled by the varable parameters and affectng all the terms n the substructure stffness or mass matrx. For example a general parametersaton for the stffness matrx may be wrtten as, e K ( x) = x K (4) j j wth smlar decompostons for the mass or dampng matrces. The choce of updatng parameters and ther type of varaton (bounds and probablty dstrbutons), must be justfed physcally and requres expermental data that are not always accessble. Dfferent measures for goodness-of-ft used n test-analyss correlaton can be used for Bayesan estmaton [15],[16]. In ths paper the lkelhood functon s bult usng a root mean square error (RMS) between expermental and predcted frequency response functons: { measurement pont set} { exctaton pont set} exp ( αβ ( ) ( )) Nfreq Nfreq Ly ( θ ) = ε k = h ωk h αβ ωk; θ k= 1 k= 1 α β (5) where the sum the measured FRFs for a chosen set Nfreq of the frequency lnes, at the exctaton and measurement locatons used n test. For varablty studes, the sum n equaton (5) s augmented to { measurement pont set} { exctaton pont set} exp ( αβ, j ( ), ( )) Nsamples Nfreq Nsamples Nfreq Ly ( θ ) = ε k = h ωk h αβ j ωk; θ j= 1 k= 1 j= 1 k= 1 α β (6) When the nformaton about the system s uncertan, the model predcton ncludes error components due to the measurement and statstcal uncertanty n the model, generally these beng uncorrelated. In the example dscussed n ths paper, only the errors due to the analytcal model are dscussed n order to assess dfferent possble aspects n model updatng. Each updatng varable n each sample, vares accordng to a Gaussan law, expressed by: k ~ N( k 1, τ ); τ = (7) σ The pror nformaton for each mean and varance parameter k, σ s encoded n a probablty dstrbuton to be used wth the lkelhood term, equaton (6) for Bayesan estmaton usng MCMC: k = Normal(0.0,1.0e 6); τ = Gamma(0.001,0.001) (8) The example consdered s the 3 degree-of-freedom system, shown n Fgure 1.

5 MODEL UPDATING AND CORRELATION 611 Fgure 1. Three Degree-of-Freedom Mass-Sprng Example. The nomnal values of the parameters for the expermental system are: m = 1. 0 kg ( = 1,, 3) k = 1. 0 N/m ( = 3,4, ) and k 6 = 3. 0 N/m. The analyss random parameters have Gaussan dstrbutons wth mean values, k 1 = k = k5 = 1. 0 and standard devatons, σ 1 = σ = σ 5 = 0. 0 N/m. For the analytcal model, the erroneous parameters have the ntal values k1 = k = k5 = 1. 5N/m. A set of 10 systems are used for statstcal nference. 10 Expermental Model Set A Set B Set C H 11 (m/n) Frequency(rad/s) Fgure. Frequency pont sets n Case 1. The followng cases are smulated: Case 1: Only the erroneous parameters are updated as n the deal case of perfectly localzed errors. Case : In the expermental model a sprng connecton: k 6 s not present, the analytcal model presentng a connectvty error. The updatng parameters reman the same as n Case 1. Case 3: The same as Case 1 except that all the sprngs are Gaussan random varables wth standard devatons σ = 0. 0 N/m for =1, K5 and σ 6 = 0. 6 N/m.

6 61 PROCEEDINGS OF ISMA006 Case 1: Ths s an deal case wth all the errors contaned n the analytcal model located correctly and t wll be used to evaluate the method s performance. In order to obtan the most accurate predcton, an optmum subset of frequency lnes should be determned wthn the acqured frequency range. The computatonal costs, and many factors nfluencng the relatve accuracy wth whch the response can be measured, precludes the use of all the frequency range n the updatng algorthm. In the case of real data, the nose mpacts upon the results and dfferent frequences can dramatcally alter the results, and each algorthm s affected by a combnaton of measurement and processng errors. Fgure 3. Mean parameter varaton and pdf n Case 1. Expermental Updated Model Parameter Mean Std Mean Std k (-0.36) 0.194(-7.77) k (-.17) 0.181(-.84) k (1.39) 0.57(-7.98) Table 1. Parameter Estmate n Case 1: h11 and h measured, frequency set A.

7 MODEL UPDATING AND CORRELATION 613 The fnte element model s updated usng the lkelhood functon, equaton (1): h1,1, h, evaluated for set A consstng of 5 equally spaced frequency lnes n the nterval rad [ 0.0,4.0] ( ) ; s h for set A; 1, 1 h1,1, h, evaluated for set B consstng of 14 frequency lnes avodng the areas close to the resonances or ant-resonances; h1,1, h, evaluated for set C wth 16 frequency lnes n the areas close to the resonances. The locaton for each frequency set s shown n Fg. for a nomnal expermental model. The results for the mean and standard devaton obtaned after updatng n each case after 6000 teratons, are presented n Tables 1-4. The convergence hstory for each updated parameter and the fnal probablty densty functons when usng set A and h 1,1, h, are presented n Fg. 3.In ths case, the estmated mean and standard devaton of the expermental sample are not exactly the same as the dstrbuton that was used to produce them. The updated parameters converge upon the statstcs of the expermental sample rather than the underlyng dstrbuton. The results are mproved when usng two frequency response functons due to ncreased nformaton contaned n the response functons. The errors for the mean values are reduced when usng frequency lnes avodng the resonances (set B) as opposed to a equally spaced selected frequences (set A) but both sets present standard devatons errors (ncreased for set B). Set C presents bg errors for all the estmates showng that n general t s better to avod frequences located n the resonance or ant-resonance areas. The expermental sample s small, as encountered usually n ndustral applcatons and t can be expected that f more expermental samples were avalable, the MCMC process would estmate better the model parameters. Expermental Updated Model Parameter ean Std Mean Std k (3.5) 0.07(-15.0) k (-5.54) 0.158(10.) k (.8) 0.59(-8.8) Table. Parameter Estmate n Case 1: h11 measured, frequency set A. Expermental Updated Model Parameter Mean Std Mean Std k (0.3) 0.197(-9.44) k (0.19) 0.187(-6.5) k (-0.10) 0.63(-10.50) Table 3. Parameter Estmate n Case 1: h11 and h measured, frequency set B. Expermental Updated Model Parameter Mean Std Mean Std k (-38.40) 0.398(-11.11) k (-1.55) 0.0(-14.77) k (1.63) 0.94(-3.5) Table 4. Parameter Estmate n Case 1: h11 and h measured, frequency set C.

8 614 PROCEEDINGS OF ISMA006 Case The model correcton s carred out n two phases, frst by analyzng the structure of the analytcal model and then by an estmaton phase smlar to that dscussed for Case 1. The possblty of havng a dfferent structure of the analytcal model s nvestgated by usng the model selecton procedure proposed by George and McCulloch [14]. In the Stochastc Search Varable Selecton (SSVS) method, the relatonshp between the output varables and a set of predctor varables s descrbed by a latent ncluson varable. Three dfferent models are consdered for comparson, each havng a dfferent structure by addng a sprng connecton k 5, k 6 or both, to a baselne system as shown n Table 5. The ntal sprng stffnesses are k = k = k 1. 5N/m. 1 5 = Model Elements 1 k1,k,k3,k4,k5 k1,k,k3,k4,k6 3 k1,k,k3,k4,k5, k6 Table 5. Models used n SSVS. As prevously, the frequency responses h11 and h are used n the lkelhood functon, equaton (4). The probablty of appearance for each model, named p, s defned as a categorcal dstrbuton, p = (1,...,3) 3 and P ( p) = 1. A pror dstrbuton for p s gven by the nverse of the number of models contanng k = 1 each k. A lnk s created between the models and varables as descrbed by (9): model model 0 1 model k5 k6 (9) The varable parameters are defned by equaton (3) as a normal mxture and the stochastc search wll determne a posteror dstrbuton for the ncluson varable whch wll defne the model wth the best structure. The results for a smulaton wth 5000 updates are presented n Fgure 4, where the probablty of occurrence for the frst model, ranks t as havng the most approprate for the analysed data. In ths case the connecton represented by the sprng k 6 should not exst n the fnal analytcal model ( model 1 s the most probable). Case 3 Table 6 shows the results n ths case. All of the stffnesses are randomsed and the estmated parameters ncorporate all the varablty presented by the expermental set. The two models come from dfferent famles wth dfferent statstcal propertes and both the mean and standard devatons are n error. The same type of result can be obtaned when a localsed error s not located pror to the updatng process and consequently not ncluded n the updatng loop.

9 MODEL UPDATING AND CORRELATION 615 a) b) c) Fgure 4. Probablty of appearance for each model: a) convergence of the latent varable; b) detal of the convergence process; c) fnal probabltes, model 1 beng the most probable one. Expermental Updated Model Parameter Mean Std Mean Std k (-.58) 0.67(-56.14) k (0.0) 0.166(-9.93) k (.31) 0.11(15.30) Table 6. Parameter Estmate n Case 3. 4 Conclusons In ths paper a non-lnear least squares analyss seen from a Bayesan perspectve s used for model updatng. The uncertanty about some model parameter or about the model structure s encoded based on pror nformaton and used n a Bayesan nference for the determnaton of a posteror probablty densty functon based on measured frequency response data. A smulated example s used to demonstrate the potental of the method for applcatons related to real lfe applcatons. It s accepted nowadays that the structure of the model (the parametersaton used to descrbe the model dynamcs) s the most mportant aspect related to the updatng process. A two-stage methodology for varable selecton and an analyss of measurement locatons and frequency lnes dstrbuton are presented together wth the effects on parameter estmaton.

10 616 PROCEEDINGS OF ISMA006 References [1] J. E. Mottershead and M. I. Frswell, Model updatng n structural dynamcs: a survey, Journal of Sound and Vbraton, 16(), (1993), pp [] M. I. Frswell, J. E. Mottershead, Fnte Element Model Updatng n Structural Dynamcs, Dordrecht, Kluwer Academc Press, (1995). [3] F. M. Hemez, S. W. Doeblng, M. C. Anderson, A bref tutoral on verfcaton and valdaton, Internatonal Modal Analyss Conference, Dearborn, USA, (003). [4] K. F. Alvn, W. L. Oberkampf, K. V. Degert, B. M. Rutherford, Uncertanty quantfcaton n structural dynamcs: a new paradgm for model valdaton, Internatonal Modal Analyss Conference, USA, (1998). [5] C. Mares, J. E. Mottershead and M. I. Frswell, Stochastc Model Updatng - Part 1: Theory and Smulated Examples, Mechancal Systems and Sgnal Processng, 0(7), (006), pp [6] J. E. Mottershead, C. Mares, S. James and M. I. Frswell, Stochastc Model Updatng: Part : Applcaton to a Set of Physcal Structures, Mechancal Systems and Sgnal Processng, n press. [7] D. Gamerman, Markov Chan Monte Carlo Stochastc Smulaton for Bayesan Inference, (1997). [8] W.R. Glks, S. Rchardson and D.J. Spegelhalter, Markov Chan Monte Carlo n Practce, Chapman &Hall, (1996). [9] D.J. Spegelhalter, A. Thomas, N. J. Best, D. Lunn, WnBUGS verson1.4 Users Manual, MRC Bostatcs Unt Cambrdge, URL:// (003). [10] N. Metropols, A. Rosenbluth, M. Rosenbluth, H. Teller, E. Teller, Equaton of State Calculatons by Fast Computng Machnes, Journal of Chemcal Physcs, 1, (1953), pp [11] S. Geman, D. Geman, Stochastc Relaxatons, Gbbs Dstrbutons and the Bayesan Restoraton of Images, IEEE Transactons of Pattern Analyss and machne Intellgence, 6, (1984), pp [1] A. E. Gelfand, A. F. M. Smth, Samplng-Based Approaches to Calculatng Margnal Denstes, Journal of the Amercan Statstcal Assocaton, 85, (1990), pp [13] G. Casella, E. George, Explanng the Gbbs Sampler, Amercan Statstcan, 46, (199), pp [14] E. I. George, R. E. McCulloch, Varable Selecton Va Gbbs Samplng, Journal of Amercan Statstcal Assocaton, 88, (1993), pp [15] G. Kerschen, J-C. Golnval, F. M. Hemez, Bayesan Model Screenng for the dentfcaton of Nonlnear Mechancal Structures, Journal of Vbraton and Acoustcs, 15, (003), pp [16] T. Marwala, S. Sbs, Fnte Element Model Updatng Usng Bayesan Framework and Modal Propertes, Journal of Arcraft, 4(1), (005), pp

Chapter 11: Simple Linear Regression and Correlation

Chapter 11: Simple Linear Regression and Correlation Chapter 11: Smple Lnear Regresson and Correlaton 11-1 Emprcal Models 11-2 Smple Lnear Regresson 11-3 Propertes of the Least Squares Estmators 11-4 Hypothess Test n Smple Lnear Regresson 11-4.1 Use of t-tests

More information

Markov Chain Monte Carlo (MCMC), Gibbs Sampling, Metropolis Algorithms, and Simulated Annealing Bioinformatics Course Supplement

Markov Chain Monte Carlo (MCMC), Gibbs Sampling, Metropolis Algorithms, and Simulated Annealing Bioinformatics Course Supplement Markov Chan Monte Carlo MCMC, Gbbs Samplng, Metropols Algorthms, and Smulated Annealng 2001 Bonformatcs Course Supplement SNU Bontellgence Lab http://bsnuackr/ Outlne! Markov Chan Monte Carlo MCMC! Metropols-Hastngs

More information

PROPERTIES I. INTRODUCTION. Finite element (FE) models are widely used to predict the dynamic characteristics of aerospace

PROPERTIES I. INTRODUCTION. Finite element (FE) models are widely used to predict the dynamic characteristics of aerospace FINITE ELEMENT MODEL UPDATING USING BAYESIAN FRAMEWORK AND MODAL PROPERTIES Tshldz Marwala 1 and Sbusso Sbs I. INTRODUCTION Fnte element (FE) models are wdely used to predct the dynamc characterstcs of

More information

Statistics for Economics & Business

Statistics for Economics & Business Statstcs for Economcs & Busness Smple Lnear Regresson Learnng Objectves In ths chapter, you learn: How to use regresson analyss to predct the value of a dependent varable based on an ndependent varable

More information

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4) I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes

More information

Parametric fractional imputation for missing data analysis. Jae Kwang Kim Survey Working Group Seminar March 29, 2010

Parametric fractional imputation for missing data analysis. Jae Kwang Kim Survey Working Group Seminar March 29, 2010 Parametrc fractonal mputaton for mssng data analyss Jae Kwang Km Survey Workng Group Semnar March 29, 2010 1 Outlne Introducton Proposed method Fractonal mputaton Approxmaton Varance estmaton Multple mputaton

More information

CIS526: Machine Learning Lecture 3 (Sept 16, 2003) Linear Regression. Preparation help: Xiaoying Huang. x 1 θ 1 output... θ M x M

CIS526: Machine Learning Lecture 3 (Sept 16, 2003) Linear Regression. Preparation help: Xiaoying Huang. x 1 θ 1 output... θ M x M CIS56: achne Learnng Lecture 3 (Sept 6, 003) Preparaton help: Xaoyng Huang Lnear Regresson Lnear regresson can be represented by a functonal form: f(; θ) = θ 0 0 +θ + + θ = θ = 0 ote: 0 s a dummy attrbute

More information

A Robust Method for Calculating the Correlation Coefficient

A Robust Method for Calculating the Correlation Coefficient A Robust Method for Calculatng the Correlaton Coeffcent E.B. Nven and C. V. Deutsch Relatonshps between prmary and secondary data are frequently quantfed usng the correlaton coeffcent; however, the tradtonal

More information

Information Geometry of Gibbs Sampler

Information Geometry of Gibbs Sampler Informaton Geometry of Gbbs Sampler Kazuya Takabatake Neuroscence Research Insttute AIST Central 2, Umezono 1-1-1, Tsukuba JAPAN 305-8568 k.takabatake@ast.go.jp Abstract: - Ths paper shows some nformaton

More information

Statistical Energy Analysis for High Frequency Acoustic Analysis with LS-DYNA

Statistical Energy Analysis for High Frequency Acoustic Analysis with LS-DYNA 14 th Internatonal Users Conference Sesson: ALE-FSI Statstcal Energy Analyss for Hgh Frequency Acoustc Analyss wth Zhe Cu 1, Yun Huang 1, Mhamed Soul 2, Tayeb Zeguar 3 1 Lvermore Software Technology Corporaton

More information

Comparison of Regression Lines

Comparison of Regression Lines STATGRAPHICS Rev. 9/13/2013 Comparson of Regresson Lnes Summary... 1 Data Input... 3 Analyss Summary... 4 Plot of Ftted Model... 6 Condtonal Sums of Squares... 6 Analyss Optons... 7 Forecasts... 8 Confdence

More information

Finite Element Model Updating Using Bayesian Approach

Finite Element Model Updating Using Bayesian Approach Fnte Element Model Updatng Usng Bayesan Approach Tshldz Marwala, Lungle Mdlaz and Sbusso Sbs School of Electrcal and Informaton Engneerng Unversty of the Wtwatersrand rvate Bag 3, WITS, 050 South Afrca

More information

Markov Chain Monte Carlo Lecture 6

Markov Chain Monte Carlo Lecture 6 where (x 1,..., x N ) X N, N s called the populaton sze, f(x) f (x) for at least one {1, 2,..., N}, and those dfferent from f(x) are called the tral dstrbutons n terms of mportance samplng. Dfferent ways

More information

1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands

1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands Content. Inference on Regresson Parameters a. Fndng Mean, s.d and covarance amongst estmates.. Confdence Intervals and Workng Hotellng Bands 3. Cochran s Theorem 4. General Lnear Testng 5. Measures of

More information

Composite Hypotheses testing

Composite Hypotheses testing Composte ypotheses testng In many hypothess testng problems there are many possble dstrbutons that can occur under each of the hypotheses. The output of the source s a set of parameters (ponts n a parameter

More information

Computation of Higher Order Moments from Two Multinomial Overdispersion Likelihood Models

Computation of Higher Order Moments from Two Multinomial Overdispersion Likelihood Models Computaton of Hgher Order Moments from Two Multnomal Overdsperson Lkelhood Models BY J. T. NEWCOMER, N. K. NEERCHAL Department of Mathematcs and Statstcs, Unversty of Maryland, Baltmore County, Baltmore,

More information

Chapter 13: Multiple Regression

Chapter 13: Multiple Regression Chapter 13: Multple Regresson 13.1 Developng the multple-regresson Model The general model can be descrbed as: It smplfes for two ndependent varables: The sample ft parameter b 0, b 1, and b are used to

More information

2016 Wiley. Study Session 2: Ethical and Professional Standards Application

2016 Wiley. Study Session 2: Ethical and Professional Standards Application 6 Wley Study Sesson : Ethcal and Professonal Standards Applcaton LESSON : CORRECTION ANALYSIS Readng 9: Correlaton and Regresson LOS 9a: Calculate and nterpret a sample covarance and a sample correlaton

More information

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:

More information

See Book Chapter 11 2 nd Edition (Chapter 10 1 st Edition)

See Book Chapter 11 2 nd Edition (Chapter 10 1 st Edition) Count Data Models See Book Chapter 11 2 nd Edton (Chapter 10 1 st Edton) Count data consst of non-negatve nteger values Examples: number of drver route changes per week, the number of trp departure changes

More information

Negative Binomial Regression

Negative Binomial Regression STATGRAPHICS Rev. 9/16/2013 Negatve Bnomal Regresson Summary... 1 Data Input... 3 Statstcal Model... 3 Analyss Summary... 4 Analyss Optons... 7 Plot of Ftted Model... 8 Observed Versus Predcted... 10 Predctons...

More information

Department of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6

Department of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6 Department of Quanttatve Methods & Informaton Systems Tme Seres and Ther Components QMIS 30 Chapter 6 Fall 00 Dr. Mohammad Zanal These sldes were modfed from ther orgnal source for educatonal purpose only.

More information

Basic Business Statistics, 10/e

Basic Business Statistics, 10/e Chapter 13 13-1 Basc Busness Statstcs 11 th Edton Chapter 13 Smple Lnear Regresson Basc Busness Statstcs, 11e 009 Prentce-Hall, Inc. Chap 13-1 Learnng Objectves In ths chapter, you learn: How to use regresson

More information

Uncertainty as the Overlap of Alternate Conditional Distributions

Uncertainty as the Overlap of Alternate Conditional Distributions Uncertanty as the Overlap of Alternate Condtonal Dstrbutons Olena Babak and Clayton V. Deutsch Centre for Computatonal Geostatstcs Department of Cvl & Envronmental Engneerng Unversty of Alberta An mportant

More information

x = , so that calculated

x = , so that calculated Stat 4, secton Sngle Factor ANOVA notes by Tm Plachowsk n chapter 8 we conducted hypothess tests n whch we compared a sngle sample s mean or proporton to some hypotheszed value Chapter 9 expanded ths to

More information

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also

More information

Chapter 9: Statistical Inference and the Relationship between Two Variables

Chapter 9: Statistical Inference and the Relationship between Two Variables Chapter 9: Statstcal Inference and the Relatonshp between Two Varables Key Words The Regresson Model The Sample Regresson Equaton The Pearson Correlaton Coeffcent Learnng Outcomes After studyng ths chapter,

More information

Classification as a Regression Problem

Classification as a Regression Problem Target varable y C C, C,, ; Classfcaton as a Regresson Problem { }, 3 L C K To treat classfcaton as a regresson problem we should transform the target y nto numercal values; The choce of numercal class

More information

Lecture Notes on Linear Regression

Lecture Notes on Linear Regression Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume

More information

Lecture 6: Introduction to Linear Regression

Lecture 6: Introduction to Linear Regression Lecture 6: Introducton to Lnear Regresson An Manchakul amancha@jhsph.edu 24 Aprl 27 Lnear regresson: man dea Lnear regresson can be used to study an outcome as a lnear functon of a predctor Example: 6

More information

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 30 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 2 Remedes for multcollnearty Varous technques have

More information

This column is a continuation of our previous column

This column is a continuation of our previous column Comparson of Goodness of Ft Statstcs for Lnear Regresson, Part II The authors contnue ther dscusson of the correlaton coeffcent n developng a calbraton for quanttatve analyss. Jerome Workman Jr. and Howard

More information

Predictive Analytics : QM901.1x Prof U Dinesh Kumar, IIMB. All Rights Reserved, Indian Institute of Management Bangalore

Predictive Analytics : QM901.1x Prof U Dinesh Kumar, IIMB. All Rights Reserved, Indian Institute of Management Bangalore Sesson Outlne Introducton to classfcaton problems and dscrete choce models. Introducton to Logstcs Regresson. Logstc functon and Logt functon. Maxmum Lkelhood Estmator (MLE) for estmaton of LR parameters.

More information

Credit Card Pricing and Impact of Adverse Selection

Credit Card Pricing and Impact of Adverse Selection Credt Card Prcng and Impact of Adverse Selecton Bo Huang and Lyn C. Thomas Unversty of Southampton Contents Background Aucton model of credt card solctaton - Errors n probablty of beng Good - Errors n

More information

Statistics Chapter 4

Statistics Chapter 4 Statstcs Chapter 4 "There are three knds of les: les, damned les, and statstcs." Benjamn Dsrael, 1895 (Brtsh statesman) Gaussan Dstrbuton, 4-1 If a measurement s repeated many tmes a statstcal treatment

More information

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE Analytcal soluton s usually not possble when exctaton vares arbtrarly wth tme or f the system s nonlnear. Such problems can be solved by numercal tmesteppng

More information

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur Analyss of Varance and Desgn of Experment-I MODULE VIII LECTURE - 34 ANALYSIS OF VARIANCE IN RANDOM-EFFECTS MODEL AND MIXED-EFFECTS EFFECTS MODEL Dr Shalabh Department of Mathematcs and Statstcs Indan

More information

MACHINE APPLIED MACHINE LEARNING LEARNING. Gaussian Mixture Regression

MACHINE APPLIED MACHINE LEARNING LEARNING. Gaussian Mixture Regression 11 MACHINE APPLIED MACHINE LEARNING LEARNING MACHINE LEARNING Gaussan Mture Regresson 22 MACHINE APPLIED MACHINE LEARNING LEARNING Bref summary of last week s lecture 33 MACHINE APPLIED MACHINE LEARNING

More information

Introduction to Regression

Introduction to Regression Introducton to Regresson Dr Tom Ilvento Department of Food and Resource Economcs Overvew The last part of the course wll focus on Regresson Analyss Ths s one of the more powerful statstcal technques Provdes

More information

and V is a p p positive definite matrix. A normal-inverse-gamma distribution.

and V is a p p positive definite matrix. A normal-inverse-gamma distribution. OSR Journal of athematcs (OSR-J) e-ssn: 78-578, p-ssn: 39-765X. Volume 3, ssue 3 Ver. V (ay - June 07), PP 68-7 www.osrjournals.org Comparng The Performance of Bayesan And Frequentst Analyss ethods of

More information

Conjugacy and the Exponential Family

Conjugacy and the Exponential Family CS281B/Stat241B: Advanced Topcs n Learnng & Decson Makng Conjugacy and the Exponental Famly Lecturer: Mchael I. Jordan Scrbes: Bran Mlch 1 Conjugacy In the prevous lecture, we saw conjugate prors for the

More information

International Journal of Industrial Engineering Computations

International Journal of Industrial Engineering Computations Internatonal Journal of Industral Engneerng Computatons 4 (03) 47 46 Contents lsts avalable at GrowngScence Internatonal Journal of Industral Engneerng Computatons homepage: www.growngscence.com/ec Modelng

More information

Appendix B: Resampling Algorithms

Appendix B: Resampling Algorithms 407 Appendx B: Resamplng Algorthms A common problem of all partcle flters s the degeneracy of weghts, whch conssts of the unbounded ncrease of the varance of the mportance weghts ω [ ] of the partcles

More information

PHYS 450 Spring semester Lecture 02: Dealing with Experimental Uncertainties. Ron Reifenberger Birck Nanotechnology Center Purdue University

PHYS 450 Spring semester Lecture 02: Dealing with Experimental Uncertainties. Ron Reifenberger Birck Nanotechnology Center Purdue University PHYS 45 Sprng semester 7 Lecture : Dealng wth Expermental Uncertantes Ron Refenberger Brck anotechnology Center Purdue Unversty Lecture Introductory Comments Expermental errors (really expermental uncertantes)

More information

STAT 511 FINAL EXAM NAME Spring 2001

STAT 511 FINAL EXAM NAME Spring 2001 STAT 5 FINAL EXAM NAME Sprng Instructons: Ths s a closed book exam. No notes or books are allowed. ou may use a calculator but you are not allowed to store notes or formulas n the calculator. Please wrte

More information

U-Pb Geochronology Practical: Background

U-Pb Geochronology Practical: Background U-Pb Geochronology Practcal: Background Basc Concepts: accuracy: measure of the dfference between an expermental measurement and the true value precson: measure of the reproducblty of the expermental result

More information

The Ordinary Least Squares (OLS) Estimator

The Ordinary Least Squares (OLS) Estimator The Ordnary Least Squares (OLS) Estmator 1 Regresson Analyss Regresson Analyss: a statstcal technque for nvestgatng and modelng the relatonshp between varables. Applcatons: Engneerng, the physcal and chemcal

More information

x i1 =1 for all i (the constant ).

x i1 =1 for all i (the constant ). Chapter 5 The Multple Regresson Model Consder an economc model where the dependent varable s a functon of K explanatory varables. The economc model has the form: y = f ( x,x,..., ) xk Approxmate ths by

More information

Modal Strain Energy Decomposition Method for Damage Detection of an Offshore Structure Using Modal Testing Information

Modal Strain Energy Decomposition Method for Damage Detection of an Offshore Structure Using Modal Testing Information Thrd Chnese-German Jont Symposum on Coastal and Ocean Engneerng Natonal Cheng Kung Unversty, Tanan November 8-16, 2006 Modal Stran Energy Decomposton Method for Damage Detecton of an Offshore Structure

More information

4DVAR, according to the name, is a four-dimensional variational method.

4DVAR, according to the name, is a four-dimensional variational method. 4D-Varatonal Data Assmlaton (4D-Var) 4DVAR, accordng to the name, s a four-dmensonal varatonal method. 4D-Var s actually a drect generalzaton of 3D-Var to handle observatons that are dstrbuted n tme. The

More information

Bayesian Planning of Hit-Miss Inspection Tests

Bayesian Planning of Hit-Miss Inspection Tests Bayesan Plannng of Ht-Mss Inspecton Tests Yew-Meng Koh a and Wllam Q Meeker a a Center for Nondestructve Evaluaton, Department of Statstcs, Iowa State Unversty, Ames, Iowa 5000 Abstract Although some useful

More information

Tracking with Kalman Filter

Tracking with Kalman Filter Trackng wth Kalman Flter Scott T. Acton Vrgna Image and Vdeo Analyss (VIVA), Charles L. Brown Department of Electrcal and Computer Engneerng Department of Bomedcal Engneerng Unversty of Vrgna, Charlottesvlle,

More information

Psychology 282 Lecture #24 Outline Regression Diagnostics: Outliers

Psychology 282 Lecture #24 Outline Regression Diagnostics: Outliers Psychology 282 Lecture #24 Outlne Regresson Dagnostcs: Outlers In an earler lecture we studed the statstcal assumptons underlyng the regresson model, ncludng the followng ponts: Formal statement of assumptons.

More information

Statistics for Managers Using Microsoft Excel/SPSS Chapter 13 The Simple Linear Regression Model and Correlation

Statistics for Managers Using Microsoft Excel/SPSS Chapter 13 The Simple Linear Regression Model and Correlation Statstcs for Managers Usng Mcrosoft Excel/SPSS Chapter 13 The Smple Lnear Regresson Model and Correlaton 1999 Prentce-Hall, Inc. Chap. 13-1 Chapter Topcs Types of Regresson Models Determnng the Smple Lnear

More information

Computing MLE Bias Empirically

Computing MLE Bias Empirically Computng MLE Bas Emprcally Kar Wa Lm Australan atonal Unversty January 3, 27 Abstract Ths note studes the bas arses from the MLE estmate of the rate parameter and the mean parameter of an exponental dstrbuton.

More information

Lecture 3 Stat102, Spring 2007

Lecture 3 Stat102, Spring 2007 Lecture 3 Stat0, Sprng 007 Chapter 3. 3.: Introducton to regresson analyss Lnear regresson as a descrptve technque The least-squares equatons Chapter 3.3 Samplng dstrbuton of b 0, b. Contnued n net lecture

More information

Linear Approximation with Regularization and Moving Least Squares

Linear Approximation with Regularization and Moving Least Squares Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...

More information

P R. Lecture 4. Theory and Applications of Pattern Recognition. Dept. of Electrical and Computer Engineering /

P R. Lecture 4. Theory and Applications of Pattern Recognition. Dept. of Electrical and Computer Engineering / Theory and Applcatons of Pattern Recognton 003, Rob Polkar, Rowan Unversty, Glassboro, NJ Lecture 4 Bayes Classfcaton Rule Dept. of Electrcal and Computer Engneerng 0909.40.0 / 0909.504.04 Theory & Applcatons

More information

An Application of Fuzzy Hypotheses Testing in Radar Detection

An Application of Fuzzy Hypotheses Testing in Radar Detection Proceedngs of the th WSES Internatonal Conference on FUZZY SYSEMS n pplcaton of Fuy Hypotheses estng n Radar Detecton.K.ELSHERIF, F.M.BBDY, G.M.BDELHMID Department of Mathematcs Mltary echncal Collage

More information

Statistics II Final Exam 26/6/18

Statistics II Final Exam 26/6/18 Statstcs II Fnal Exam 26/6/18 Academc Year 2017/18 Solutons Exam duraton: 2 h 30 mn 1. (3 ponts) A town hall s conductng a study to determne the amount of leftover food produced by the restaurants n the

More information

Chapter 15 - Multiple Regression

Chapter 15 - Multiple Regression Chapter - Multple Regresson Chapter - Multple Regresson Multple Regresson Model The equaton that descrbes how the dependent varable y s related to the ndependent varables x, x,... x p and an error term

More information

Lecture 16 Statistical Analysis in Biomaterials Research (Part II)

Lecture 16 Statistical Analysis in Biomaterials Research (Part II) 3.051J/0.340J 1 Lecture 16 Statstcal Analyss n Bomaterals Research (Part II) C. F Dstrbuton Allows comparson of varablty of behavor between populatons usng test of hypothess: σ x = σ x amed for Brtsh statstcan

More information

( ) ( ) ( ) ( ) STOCHASTIC SIMULATION FOR BLOCKED DATA. Monte Carlo simulation Rejection sampling Importance sampling Markov chain Monte Carlo

( ) ( ) ( ) ( ) STOCHASTIC SIMULATION FOR BLOCKED DATA. Monte Carlo simulation Rejection sampling Importance sampling Markov chain Monte Carlo SOCHASIC SIMULAIO FOR BLOCKED DAA Stochastc System Analyss and Bayesan Model Updatng Monte Carlo smulaton Rejecton samplng Importance samplng Markov chan Monte Carlo Monte Carlo smulaton Introducton: If

More information

Probability Theory (revisited)

Probability Theory (revisited) Probablty Theory (revsted) Summary Probablty v.s. plausblty Random varables Smulaton of Random Experments Challenge The alarm of a shop rang. Soon afterwards, a man was seen runnng n the street, persecuted

More information

Economics 130. Lecture 4 Simple Linear Regression Continued

Economics 130. Lecture 4 Simple Linear Regression Continued Economcs 130 Lecture 4 Contnued Readngs for Week 4 Text, Chapter and 3. We contnue wth addressng our second ssue + add n how we evaluate these relatonshps: Where do we get data to do ths analyss? How do

More information

Basically, if you have a dummy dependent variable you will be estimating a probability.

Basically, if you have a dummy dependent variable you will be estimating a probability. ECON 497: Lecture Notes 13 Page 1 of 1 Metropoltan State Unversty ECON 497: Research and Forecastng Lecture Notes 13 Dummy Dependent Varable Technques Studenmund Chapter 13 Bascally, f you have a dummy

More information

Hidden Markov Models

Hidden Markov Models CM229S: Machne Learnng for Bonformatcs Lecture 12-05/05/2016 Hdden Markov Models Lecturer: Srram Sankararaman Scrbe: Akshay Dattatray Shnde Edted by: TBD 1 Introducton For a drected graph G we can wrte

More information

Hidden Markov Models & The Multivariate Gaussian (10/26/04)

Hidden Markov Models & The Multivariate Gaussian (10/26/04) CS281A/Stat241A: Statstcal Learnng Theory Hdden Markov Models & The Multvarate Gaussan (10/26/04) Lecturer: Mchael I. Jordan Scrbes: Jonathan W. Hu 1 Hdden Markov Models As a bref revew, hdden Markov models

More information

Outline for today. Markov chain Monte Carlo. Example: spatial statistics (Christensen and Waagepetersen 2001)

Outline for today. Markov chain Monte Carlo. Example: spatial statistics (Christensen and Waagepetersen 2001) Markov chan Monte Carlo Rasmus Waagepetersen Department of Mathematcs Aalborg Unversty Denmark November, / Outlne for today MCMC / Condtonal smulaton for hgh-dmensonal U: Markov chan Monte Carlo Consder

More information

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number

More information

Chapter 2 - The Simple Linear Regression Model S =0. e i is a random error. S β2 β. This is a minimization problem. Solution is a calculus exercise.

Chapter 2 - The Simple Linear Regression Model S =0. e i is a random error. S β2 β. This is a minimization problem. Solution is a calculus exercise. Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where y + = β + β e for =,..., y and are observable varables e s a random error How can an estmaton rule be constructed for the

More information

/ n ) are compared. The logic is: if the two

/ n ) are compared. The logic is: if the two STAT C141, Sprng 2005 Lecture 13 Two sample tests One sample tests: examples of goodness of ft tests, where we are testng whether our data supports predctons. Two sample tests: called as tests of ndependence

More information

Lecture 9: Linear regression: centering, hypothesis testing, multiple covariates, and confounding

Lecture 9: Linear regression: centering, hypothesis testing, multiple covariates, and confounding Recall: man dea of lnear regresson Lecture 9: Lnear regresson: centerng, hypothess testng, multple covarates, and confoundng Sandy Eckel seckel@jhsph.edu 6 May 8 Lnear regresson can be used to study an

More information

Using T.O.M to Estimate Parameter of distributions that have not Single Exponential Family

Using T.O.M to Estimate Parameter of distributions that have not Single Exponential Family IOSR Journal of Mathematcs IOSR-JM) ISSN: 2278-5728. Volume 3, Issue 3 Sep-Oct. 202), PP 44-48 www.osrjournals.org Usng T.O.M to Estmate Parameter of dstrbutons that have not Sngle Exponental Famly Jubran

More information

Lecture 9: Linear regression: centering, hypothesis testing, multiple covariates, and confounding

Lecture 9: Linear regression: centering, hypothesis testing, multiple covariates, and confounding Lecture 9: Lnear regresson: centerng, hypothess testng, multple covarates, and confoundng Sandy Eckel seckel@jhsph.edu 6 May 008 Recall: man dea of lnear regresson Lnear regresson can be used to study

More information

Basic Statistical Analysis and Yield Calculations

Basic Statistical Analysis and Yield Calculations October 17, 007 Basc Statstcal Analyss and Yeld Calculatons Dr. José Ernesto Rayas Sánchez 1 Outlne Sources of desgn-performance uncertanty Desgn and development processes Desgn for manufacturablty A general

More information

Bayesian predictive Configural Frequency Analysis

Bayesian predictive Configural Frequency Analysis Psychologcal Test and Assessment Modelng, Volume 54, 2012 (3), 285-292 Bayesan predctve Confgural Frequency Analyss Eduardo Gutérrez-Peña 1 Abstract Confgural Frequency Analyss s a method for cell-wse

More information

Notes on Frequency Estimation in Data Streams

Notes on Frequency Estimation in Data Streams Notes on Frequency Estmaton n Data Streams In (one of) the data streamng model(s), the data s a sequence of arrvals a 1, a 2,..., a m of the form a j = (, v) where s the dentty of the tem and belongs to

More information

Global Sensitivity. Tuesday 20 th February, 2018

Global Sensitivity. Tuesday 20 th February, 2018 Global Senstvty Tuesday 2 th February, 28 ) Local Senstvty Most senstvty analyses [] are based on local estmates of senstvty, typcally by expandng the response n a Taylor seres about some specfc values

More information

Department of Statistics University of Toronto STA305H1S / 1004 HS Design and Analysis of Experiments Term Test - Winter Solution

Department of Statistics University of Toronto STA305H1S / 1004 HS Design and Analysis of Experiments Term Test - Winter Solution Department of Statstcs Unversty of Toronto STA35HS / HS Desgn and Analyss of Experments Term Test - Wnter - Soluton February, Last Name: Frst Name: Student Number: Instructons: Tme: hours. Ads: a non-programmable

More information

j) = 1 (note sigma notation) ii. Continuous random variable (e.g. Normal distribution) 1. density function: f ( x) 0 and f ( x) dx = 1

j) = 1 (note sigma notation) ii. Continuous random variable (e.g. Normal distribution) 1. density function: f ( x) 0 and f ( x) dx = 1 Random varables Measure of central tendences and varablty (means and varances) Jont densty functons and ndependence Measures of assocaton (covarance and correlaton) Interestng result Condtonal dstrbutons

More information

since [1-( 0+ 1x1i+ 2x2 i)] [ 0+ 1x1i+ assumed to be a reasonable approximation

since [1-( 0+ 1x1i+ 2x2 i)] [ 0+ 1x1i+ assumed to be a reasonable approximation Econ 388 R. Butler 204 revsons Lecture 4 Dummy Dependent Varables I. Lnear Probablty Model: the Regresson model wth a dummy varables as the dependent varable assumpton, mplcaton regular multple regresson

More information

Lecture 12: Classification

Lecture 12: Classification Lecture : Classfcaton g Dscrmnant functons g The optmal Bayes classfer g Quadratc classfers g Eucldean and Mahalanobs metrcs g K Nearest Neghbor Classfers Intellgent Sensor Systems Rcardo Guterrez-Osuna

More information

Degradation Data Analysis Using Wiener Process and MCMC Approach

Degradation Data Analysis Using Wiener Process and MCMC Approach Engneerng Letters 5:3 EL_5_3_0 Degradaton Data Analyss Usng Wener Process and MCMC Approach Chunpng L Hubng Hao Abstract Tradtonal relablty assessment methods are based on lfetme data. However the lfetme

More information

SPANC -- SPlitpole ANalysis Code User Manual

SPANC -- SPlitpole ANalysis Code User Manual Functonal Descrpton of Code SPANC -- SPltpole ANalyss Code User Manual Author: Dale Vsser Date: 14 January 00 Spanc s a code created by Dale Vsser for easer calbratons of poston spectra from magnetc spectrometer

More information

Chapter 14 Simple Linear Regression

Chapter 14 Simple Linear Regression Chapter 4 Smple Lnear Regresson Chapter 4 - Smple Lnear Regresson Manageral decsons often are based on the relatonshp between two or more varables. Regresson analss can be used to develop an equaton showng

More information

Finite Mixture Models and Expectation Maximization. Most slides are from: Dr. Mario Figueiredo, Dr. Anil Jain and Dr. Rong Jin

Finite Mixture Models and Expectation Maximization. Most slides are from: Dr. Mario Figueiredo, Dr. Anil Jain and Dr. Rong Jin Fnte Mxture Models and Expectaton Maxmzaton Most sldes are from: Dr. Maro Fgueredo, Dr. Anl Jan and Dr. Rong Jn Recall: The Supervsed Learnng Problem Gven a set of n samples X {(x, y )},,,n Chapter 3 of

More information

4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA

4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA 4 Analyss of Varance (ANOVA) 5 ANOVA 51 Introducton ANOVA ANOVA s a way to estmate and test the means of multple populatons We wll start wth one-way ANOVA If the populatons ncluded n the study are selected

More information

is the calculated value of the dependent variable at point i. The best parameters have values that minimize the squares of the errors

is the calculated value of the dependent variable at point i. The best parameters have values that minimize the squares of the errors Multple Lnear and Polynomal Regresson wth Statstcal Analyss Gven a set of data of measured (or observed) values of a dependent varable: y versus n ndependent varables x 1, x, x n, multple lnear regresson

More information

Answers Problem Set 2 Chem 314A Williamsen Spring 2000

Answers Problem Set 2 Chem 314A Williamsen Spring 2000 Answers Problem Set Chem 314A Wllamsen Sprng 000 1) Gve me the followng crtcal values from the statstcal tables. a) z-statstc,-sded test, 99.7% confdence lmt ±3 b) t-statstc (Case I), 1-sded test, 95%

More information

Open Systems: Chemical Potential and Partial Molar Quantities Chemical Potential

Open Systems: Chemical Potential and Partial Molar Quantities Chemical Potential Open Systems: Chemcal Potental and Partal Molar Quanttes Chemcal Potental For closed systems, we have derved the followng relatonshps: du = TdS pdv dh = TdS + Vdp da = SdT pdv dg = VdP SdT For open systems,

More information

RELIABILITY ASSESSMENT

RELIABILITY ASSESSMENT CHAPTER Rsk Analyss n Engneerng and Economcs RELIABILITY ASSESSMENT A. J. Clark School of Engneerng Department of Cvl and Envronmental Engneerng 4a CHAPMAN HALL/CRC Rsk Analyss for Engneerng Department

More information

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification E395 - Pattern Recognton Solutons to Introducton to Pattern Recognton, Chapter : Bayesan pattern classfcaton Preface Ths document s a soluton manual for selected exercses from Introducton to Pattern Recognton

More information

Gaussian Mixture Models

Gaussian Mixture Models Lab Gaussan Mxture Models Lab Objectve: Understand the formulaton of Gaussan Mxture Models (GMMs) and how to estmate GMM parameters. You ve already seen GMMs as the observaton dstrbuton n certan contnuous

More information

Numerical Heat and Mass Transfer

Numerical Heat and Mass Transfer Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and

More information

Generic Form of Bayesian Monte Carlo For Models With Partial Monotonicity

Generic Form of Bayesian Monte Carlo For Models With Partial Monotonicity Generc Form of Bayesan Monte Carlo For Models Wth Partal Monotoncty M. Raabalnead a*, C. Sptas b a,b Delft Unversty of Technology, Delft, the Netherlands Abstract: Ths paper presents a generc method for

More information

Lab 2e Thermal System Response and Effective Heat Transfer Coefficient

Lab 2e Thermal System Response and Effective Heat Transfer Coefficient 58:080 Expermental Engneerng 1 OBJECTIVE Lab 2e Thermal System Response and Effectve Heat Transfer Coeffcent Warnng: though the experment has educatonal objectves (to learn about bolng heat transfer, etc.),

More information

UNIVERSITY OF TORONTO Faculty of Arts and Science. December 2005 Examinations STA437H1F/STA1005HF. Duration - 3 hours

UNIVERSITY OF TORONTO Faculty of Arts and Science. December 2005 Examinations STA437H1F/STA1005HF. Duration - 3 hours UNIVERSITY OF TORONTO Faculty of Arts and Scence December 005 Examnatons STA47HF/STA005HF Duraton - hours AIDS ALLOWED: (to be suppled by the student) Non-programmable calculator One handwrtten 8.5'' x

More information

Discussion of Extensions of the Gauss-Markov Theorem to the Case of Stochastic Regression Coefficients Ed Stanek

Discussion of Extensions of the Gauss-Markov Theorem to the Case of Stochastic Regression Coefficients Ed Stanek Dscusson of Extensons of the Gauss-arkov Theorem to the Case of Stochastc Regresson Coeffcents Ed Stanek Introducton Pfeffermann (984 dscusses extensons to the Gauss-arkov Theorem n settngs where regresson

More information

MIMA Group. Chapter 2 Bayesian Decision Theory. School of Computer Science and Technology, Shandong University. Xin-Shun SDU

MIMA Group. Chapter 2 Bayesian Decision Theory. School of Computer Science and Technology, Shandong University. Xin-Shun SDU Group M D L M Chapter Bayesan Decson heory Xn-Shun Xu @ SDU School of Computer Scence and echnology, Shandong Unversty Bayesan Decson heory Bayesan decson theory s a statstcal approach to data mnng/pattern

More information