On incorporating time-lapse seismic survey data into automatic history matching of reservoir simulations

Size: px
Start display at page:

Download "On incorporating time-lapse seismic survey data into automatic history matching of reservoir simulations"

Transcription

1 ontents On ncorporatng tme-lapse sesmc survey data On ncorporatng tme-lapse sesmc survey data nto automatc hstory matchng of reservor smulatons Laurence R. Bentley BSTRT orosty, permeablty and other parameters must be specfed at every node wthn a petroleum reservor smulator. The parameters are developed from sparse and nosy data so that they are not known exactly. fter prelmnary assgnment of porosty and permeablty data, smulators are run n the forward mode, but they can seldom match the observed producton hstory adequately. onsequently, a hstory matchng step s requred n whch porosty, permeablty and other parameters are adjusted untl the model predctons match the producton hstory to a suffcent degree. In automatc hstory matchng, an objectve functon s formed by squarng and weghtng the dfference between observatons and the computed predctons. In addton, terms are often added to the objectve functon to penalze departures from orgnal parameter estmates. Ths objectve functon s then mnmzed wth respect to the parameters usng soluton technques such as the Marquardt method. Tme-lapse sesmc surveys produce mages at dfferent tmes n a reservor s hstory. The sesmc response of a reservor may change due to changes n pressure, flud saturaton and temperature. Gven approprate rock physcs models, the output of the reservor smulator can be used to predct the change n sesmc response. The dfference between the predcted change n sesmc response and the observed change n sesmc response forms another set of resduals. These resduals are squared, weghted and added to the objectve functon. INTRODUTION Reservor smulators are used to approxmately solve the mathematcal equatons that descrbe the physcs of flow of fluds wthn petroleum reservors. The smulators calculate changes n pressure and saturaton wthn reservors due to producton and the njecton of fluds durng secondary recovery operatons. Reservor smulators are used to forecast producton, assess rsk and test conceptual models. The mathematcal models used n reservor smulators requre the specfcaton of reservor parameters at all locatons wthn the reservor. In partcular, the ntrnsc permeablty and the porosty need to be specfed. The values of these attrbutes are extremely heterogeneous n geologc formatons, and they exert strong control on the flow and storage characterstcs of the reservor. In practce, these parameters are known approxmately, because hard data from wells are sparse, correlaton to densely spaced sesmc data s typcally weak and dfferences exst between measurement and modelng scales. In general, forward smulatons usng these values wll not adequately match the observed petroleum reservor producton hstory on the frst attempt, because of the uncertanty n the ntal estmates of the parameters. onsequently, the parameters REWES Research Report Volume 10 (1998) 33-1

2 ontents Bentley are teratvely adjusted untl an adequate match of the producton hstory s obtaned. Ths process s known as hstory matchng utomatc hstory matchng (M) s a process n whch hstory matchng s performed usng optmzaton technques. In ths approach, an objectve functon s formed whch s a functon of the msmatch between the calculated values of pressure and producton hstory and the observed pressure and producton hstory. The objectve functon s then mnmzed wth respect to the parameters to obtan an updated set of parameters for use n the smulator. DEVELOMENT Notaton vector of true producton hstory (pressure, water cut, gas ol rato, etc.) vector of measured producton hstory vector of computed producton hstory vector of computed producton hstory at the optmzaton pont N number of producton hstory vector entres e vector of errors assocated wth σ covarance of e covarance of e scaled by 1/σ σ common varance of e W producton hstory weght r producton hstory resdual vector X roducton hstory senstvty matrx vector of true sesmc attrbutes vector of measured sesmc attrbutes vector of computed sesmc attrbutes vector of computed sesmc attrbutes at the optmzaton pont N number of sesmc attrbute vector entres e vector of errors assocated wth 33- REWES Research Report Volume 10 (1998)

3 ontents On ncorporatng tme-lapse sesmc survey data σ covarance of e covarance of e scaled by 1/σ σ common varance of e W sesmc attrbute weght r sesmc attrbute resdual vector X sesmc attrbute senstvty matrx vector of true parameters values vector of measured parameter values (pror nformaton) vector of current parameter values derved from the optmzaton routne vector of parameter values at the optmzaton pont N number of pror nformaton vector entres e vector of errors assocated wth σ covarance of e covarance of e scaled by 1/σ σ common varance of e W pror nformaton weght r pror nformaton resdual vector X pror nformaton senstvty vector n number of decson varables, n N p reservor pressure S O ol saturaton S W water saturaton S G gas saturaton K objectve functon K objectve functon at soluton REWES Research Report Volume 10 (1998) 33-3

4 ontents Bentley X total senstvty (acoban) matrx X total senstvty matrx at soluton r augmented resdual vector r augmented resdual vector at soluton G gradent vector e approxmate essan matrx λ M Marquardt parameter λ R step sze relaxaton parameter s common varance Formulaton onsder three objectve functon terms assocated wth the producton hstory, sesmc attrbutes and pror knowledge of the parameter values. Typcally the decson parameters,, wll consst of the log-permeablty and the porosty. The producton values,, are calculated usng the smulator and the model parameters. set of rock physcs models, such as the Gassman equaton, are used wth the pressure and saturaton values computed by the flow smulator to calculate the sesmc attrbutes,. roducton story ssume that producton hstory measurements are related to the real producton hstory by, + Further, the form of e s assumed to be normal wth zero mean and covarance σ. The matrx has the form of the covarance of e, but t s scaled by the nverse of the common varance σ. The most common models for s that the producton measurement errors are uncorrelated n space but may be correlated by a one lag autocorrelaton functon n tme. Ths means that s a dagonal or block dagonal matrx. The dagonal terms of would vary f, for example, one set of pressure data was consdered less relable than another set of pressure data. e (1) 33-4 REWES Research Report Volume 10 (1998)

5 ontents The producton hstory objectve functon term s, On ncorporatng tme-lapse sesmc survey data t 1 ( ) ( ). 1 1 σ σ () 1 The weghtng terms σ and -1 : 1. Scale the equaton for varatons n unts (e.g. ps versus Kpa),. Weght more relable data more than less relable data, and 3. Flter the estmates based on the correlaton between errors. Sesmc ttrbutes In a manner analogous to the producton hstory match, the sesmc attrbute match leads to, t 1 ( ) ( ). 1 1 σ σ (3) In ths case, t s possble the e may be correlated and the optmal would be a non-dagonal matrx. ror Estmates of arameters Estmates of porosty have been developed usng well log nformaton or well log nformaton n conjuncton wth sesmc attrbutes. ermeablty estmates may be derved from upscalng core permeablty, DST analyss, and correlaton of porosty wth permeablty. The nformaton contaned n these pror estmates can be represented by the objectve functon term, t 1 ( ) ( ). 1 1 σ σ (4) In ths case, the form of the covarance of e Y may be determned from the estmaton errors generated n the nterpolaton step (e.g. krgng or cokrgng). Ths term s sometmes referred to as a regularzaton term and mproves the stablty of nverse procedures. In general, e wll be correlated, and usng the full correlaton structure whle developng the weghtng matrces has been shown to mprove estmates (Bentley, 1997). Optmzaton ssumng that the statstcal assumptons (normalty, etc.) are correct and that near the soluton the objectve functon s nearly lnear n the parameters, then the followng objectve functon s optmal n a least squares sense, REWES Research Report Volume 10 (1998) 33-5

6 ontents Bentley MIN 1... σ σ σ W R T 1 The correct weghtng s seen to be the nverse of the covarance of errors n the measurements and pror estmates. Usng ths form requres a pror knowledge of the covarance of the errors, whch are not known. In addton, we have neglected model error n the sense that the flow smulator may not be able to match the true system response due to nadequaces n the model equatons or dscretzaton. The assumpton of normally dstrbuted errors leads to problems f there are extremely large resduals. To date, mnmzaton of the equvalent of the full objectve functon 1 has not been reported. Researchers have optmzed the equvalent of σ σ (e.g. Gavalas et al. 1976, hu et al. 1995, havent et al. 1975), or the equvalent of (uang, et al. 1997, uang et al. 1998). In addton, Landa σ σ and orne (1997) use tme lapse sesmc data to estmate the change n saturaton wthn the reservor and then solved a form of. n approach that has been used n water resources s to assume that we know the form of the covarance matrx, but not the magntude of the common varances (arrera and Neuman, 1986). In ths way, nformaton on the relatonshp between the errors wthn each resdual type s ncluded n the objectve functon, but the weghts assocated wth the common varances must be selected by some other crtera. These weghts determne the relatve mportance of each type of nformaton. The revsed producton hstory objectve functon term becomes, W W + 1 t 1 ( ) ( ) Smlar expressons are used for wth weghtng W and wth weghtng W. In the lterature the weghts W K (where K, or ) have been chosen by a varety of methods. The new objectve functon becomes, W + W + W 4 One method that has been used wth success s to vary the weghts based on balancng the weghted varances as approxmated by the current estmate of the parameters. On the assumpton that at the soluton, the values of, and are close to ther true values, the weghted varances of,, and can be approxmated by, + 1 (5) (6) (7) 33-6 REWES Research Report Volume 10 (1998)

7 ontents Var On ncorporatng tme-lapse sesmc survey data W t 1 ( ) ( ' ) ( ' ) Var Var N W t 1 ( ) ( ' ) ( ' ) N W t 1 ( ) ( ' ) ( ' ) N The ndex ndcates values derved from the soluton at teraton, and N, N and N are the number of pressure measurements, sesmc attrbute values and pror estmates of parameters, respectvely. In order to balance the contrbutons of the dfferent data types, new weghts are chosen to balance the weghted varances, W 1 K K Var W ( K ) 1 The weghts are adjusted at the end of each run untl the varances are approxmately equal. Two or three teratons are generally requred to reach a balanced set of weghted varances (Wess and Smth, 1998). omputatonal Issues Gradent and Senstvty Matrx Several approaches have been used to solve the mnmzaton problem (e.g. equaton (5)). In the followng, we focus on the Marquardt method (Marquardt, 1963). Each Marquardt teraton, the gradent and the senstvty coeffcents must be computed. Defne the resdual vectors, r r r The resdual vectors at the soluton are denoted r K, where K, or. The global resdual vector s t r t t t [ r r r ] The producton hstory resdual vector contans N entres. These wll be arranged as tme seres data from several to tens of producton and njecton wells. It s possble for sesmc attrbute data to exst at each grd block wthn the smulator, and consequently, the dmenson of the vector can theoretcally be n the tens of (8) (9) (10) (11) (1) (13) (14) (15) REWES Research Report Volume 10 (1998) 33-7

8 ontents Bentley thousands. Wth three permeablty values (κ X, κ Y, κ Z ) and a porosty assocated wth each grd block, the number of parameters can be n the tens of thousands. senstvty coeffcent s the partal dervatve of an ndvdual resdual wth respect to a decson varable. Each type of resdual has a senstvty matrx assocated wth t. n element of the producton hstory senstvty matrx s, X j where each row 1 to N s assocated wth a producton hstory resdual and each column j1 to n s assocated wth a decson parameter. Smlarly, the sesmc attrbute resdual senstvty coeffcents are, X j j where 1 to N and j1 to n. ssume that varatons n sesmc attrbute can be calculated from the pressure and saturaton, j (16) (17) F( p, SO, SW, SG ) Then, the sesmc attrbute senstvtes can be calculated usng the chan rule, (18) F p F + p S O SO F + S W SW F + S G SG onsequently, the partal dervatve of the pressure and saturatons wth respect to each parameter s requred at each locaton of a sesmc attrbute value. These same dervatves are requred for the evaluaton of equaton (16), but only at the locatons of the wells used n the producton hstory match. In some cases, temperature would need to be modeled as a state varable, because t can also have a sgnfcant effect on the sesmc response. The senstvty coeffcents for the pror nformaton are, X j wth rows 1 to N and columns j1 to n. The pror nformaton matrx conssts of entres of ones and zeroes, and f every parameter has pror nformaton then the matrx s the dentty matrx. j (19) (0) 33-8 REWES Research Report Volume 10 (1998)

9 ontents The total senstvty matrx s constructed, On ncorporatng tme-lapse sesmc survey data t X t t t [ X X X ] and t has NN +N +N rows and n columns. It s possble for the number of parameters to be n the tens of thousands. The huge dmensonalty of the parameter space and the lmted amount of observatonal data lead to a problem that s nherently underdetermned. onsequently, unqueness and dentfablty are ssues n the parameter optmzaton problem. In practce, the dmenson of the parameter space s reduced by lumpng many grd blocks together n zones of equal value or to use nterpolaton methods such as the plot pont method to populate the reservor wth a smaller number decson varables located ate the nterpolaton ponts (plot ponts). We are currently nvestgatng the use of cluster algorthms for dynamc zonng. The calculaton of the senstvty matrx s a major computatonal burden. Three approaches have been used. In the perturbaton method, each parameter s perturbed and a forward smulaton s run to compute the new value of the resduals. The senstvty matrx s then constructed by the fnte dfference method. Ths method s only computatonally feasble wth a small number of parameters. In the adjont equaton method, the equvalent of a separate smulaton run s needed for each of the observaton locatons. Ths method was useful when the number of observaton locatons was lmted to a small set of producton and njecton wells. owever, the ncluson of spatally dense sesmc attrbute data requres the senstvty calculatons to be carred out at thousands of locatons, and the adjont equaton method s not as attractve for the cases n whch tme-lapse sesmc data s ncluded n the objectve functon. In the gradent smulaton method (nteron et al. 1989), the equvalent of an extra flow smulaton plus for each decson varable one back substtuton s requred for each Marquardt teraton. t present, ths appears to be the best approach for calculatng senstvty coeffcents for the cases wth tme-lapse sesmc terms n the objectve functon. The global weghtng matrx for objectve functon 4 s, (1) 1 W W W The other objectve functons have analogous weghtng matrces. The gradent of the objectve functon s, () G X k t 1 where k ndcates the form of the objectve functon (.e. k1,, 3, or 4). The vector G has a length of n. r (3) REWES Research Report Volume 10 (1998) 33-9

10 ontents Bentley If the resduals are small and/or the equaton s quas-lnear, then the essan matrx can be approxmated as, e The matrx e has dmensons n by n. k t 1 ( X X ) (4) The Marquardt algorthm update s, t 1 k ( X X ) + I ) G k + 1 k k 1 + λr λm where k s the teraton ndex, λ M s the Marquardt parameter and λ R s a relaxaton parameter to control the step sze. Transformaton and Scalng Improvng the condtonng of the objectve functon wll mprove the soluton and reduce the computatonal effort requred to reach a soluton. arameters and resduals are often scaled or transformed n order to provde a better condtoned objectve functon. In addton, transformed varables often have better statstcal propertes than the prmary varables. For example, permeablty s generally transformed to logpermeablty for geologc and statstcal reasons. pproprate weghts wll depend on the form of the scaled or transformed varables, so transformaton choces are related to weghtng choces. Often the decson varables are normalzed to one n order to mprove the condtonng of the objectve functon. If the current value of the parameters s, then the scalng takes the form, (5) S ej S ej G G S j (6) (7) (8) Error Estmates t the soluton, the common varance of the weghted errors can be estmated by lnear error analyss, s ( N ' 4 + N + N ' 4 ) n N where N D s the dfference between the number of resduals and the number of decson varables. D (9) REWES Research Report Volume 10 (1998)

11 ontents n estmate for the estmaton varance of the parameters s, Var On ncorporatng tme-lapse sesmc survey data t 1 ( ' ) s ( X ' X ') 1 where the prme ndcates that the values are evaluated at the optmal soluton. lnear approxmaton of the confdence regons s gven by, (30) t t 1 ( ' ) X ' X '( ') n s F ( n, N ) where F s an F dstrbuton wth n and N D degrees of freedom. α D (31) ONLUSION The goal of automatc hstory matchng (M) s to mprove the parameter selecton for petroleum reservor smulators n order to mprove ther reservor forecastng capablty. n approach for ncludng tme-lapse sesmc data nto M has been presented and some practcal ssues have been dscussed. M s stll not routnely used, even after more than twenty years of development. The dffcultes are related to the extreme nonlnearty of the objectve functon, the hgh dmensonalty of the decson varable set, problems assocated wth unqueness and dentfablty of parameters, and dffcultes assocated wth computng the senstvty matrces. M based solely on producton data observed at a lmted number of well locatons suffers because of the sparsty of the spatal sample. Sesmc data has the nherent advantage of beng a spatally dense data set, and prelmnary ndcatons are that ncludng tme-lapse sesmc data wll lead to mproved M. lthough the routne applcaton of M remans an elusve goal, studyng tmelapse sesmc survey results n the context of M s valuable. The mathematcal formulaton of M gves us nsght nto the hstory matchng process and helps analysts dentfy the underlyng structure of the hstory match problem. Study of the senstvty of sesmc attrbutes to changes n reservor parameters, objectve functon gradents and estmaton varance wll lead to nsghts nto the effectveness of ntegratng tme-lapse sesmc data nto reservor smulaton and reservor forecastng. In turn, these nsghts wll gude tme-lapse sesmc acquston and processng choces. REFERENES nteron, F., Eymard, R., Karcher, B., 1989, Use of parameter gradents for reservor hstory matchng, SE Bentley, L.R., 1997, Influence of the regularzaton weghtng matrx on parameter estmates, dv. Wat. Resour., 0(4), arrera,. and Neuman, S.., 1986, Estmaton of aqufer parameters under transent and steady state condtons: 1. Maxmum lkelhood estmaton ncorporatng pror nformaton, Wat. Resour. Res., (), havent, G., Dupuy, M. and Lemonner,., 1975, story matchng by use of optmal theory, Soc. et. Eng.., 15(1), REWES Research Report Volume 10 (1998) 33-11

12 ontents Bentley hu, L., Reynolds,.. and Olver,.S., 1995, Reservor descrpton from statc and well-test data usng effcent gradent methods, SE 9999, Gavalas, G.R., Shah,.. and Senfeld,.., 1976, Reservor hstory matchng by Bayesan estmaton, Soc. et. Eng., 16(6), uang, X., Mester, L. and Workman, R., 1998, Improvement and senstvty of reservor characterzaton derved from tme-lapse sesmc data, SE uang, X., Mester, L. and Workman, R., 1997, Reservor characterzaton by ntegraton of tmelapse sesmc producton data, SE Landa,.L. and orne, R.N., 1997, procedure to ntegrate well test data, reservor performance hstory and 4-D sesmc nformaton nto a reservor descrpton, SE Marquardt, D.T., 1963,. Soc. Ind. ppl. Math., 11, Wess, R. and Smth, L., 1998, arameter space methods n jont parameter estmaton for groundwater flow models, Wat. Resour. Res., 34(4), REWES Research Report Volume 10 (1998)

4DVAR, according to the name, is a four-dimensional variational method.

4DVAR, according to the name, is a four-dimensional variational method. 4D-Varatonal Data Assmlaton (4D-Var) 4DVAR, accordng to the name, s a four-dmensonal varatonal method. 4D-Var s actually a drect generalzaton of 3D-Var to handle observatons that are dstrbuted n tme. The

More information

Linear Approximation with Regularization and Moving Least Squares

Linear Approximation with Regularization and Moving Least Squares Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...

More information

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 30 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 2 Remedes for multcollnearty Varous technques have

More information

A Robust Method for Calculating the Correlation Coefficient

A Robust Method for Calculating the Correlation Coefficient A Robust Method for Calculatng the Correlaton Coeffcent E.B. Nven and C. V. Deutsch Relatonshps between prmary and secondary data are frequently quantfed usng the correlaton coeffcent; however, the tradtonal

More information

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also

More information

Numerical Heat and Mass Transfer

Numerical Heat and Mass Transfer Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and

More information

Feature Selection: Part 1

Feature Selection: Part 1 CSE 546: Machne Learnng Lecture 5 Feature Selecton: Part 1 Instructor: Sham Kakade 1 Regresson n the hgh dmensonal settng How do we learn when the number of features d s greater than the sample sze n?

More information

Comparison of Regression Lines

Comparison of Regression Lines STATGRAPHICS Rev. 9/13/2013 Comparson of Regresson Lnes Summary... 1 Data Input... 3 Analyss Summary... 4 Plot of Ftted Model... 6 Condtonal Sums of Squares... 6 Analyss Optons... 7 Forecasts... 8 Confdence

More information

Uncertainty as the Overlap of Alternate Conditional Distributions

Uncertainty as the Overlap of Alternate Conditional Distributions Uncertanty as the Overlap of Alternate Condtonal Dstrbutons Olena Babak and Clayton V. Deutsch Centre for Computatonal Geostatstcs Department of Cvl & Envronmental Engneerng Unversty of Alberta An mportant

More information

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:

More information

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons

More information

Chapter 13: Multiple Regression

Chapter 13: Multiple Regression Chapter 13: Multple Regresson 13.1 Developng the multple-regresson Model The general model can be descrbed as: It smplfes for two ndependent varables: The sample ft parameter b 0, b 1, and b are used to

More information

Chapter - 2. Distribution System Power Flow Analysis

Chapter - 2. Distribution System Power Flow Analysis Chapter - 2 Dstrbuton System Power Flow Analyss CHAPTER - 2 Radal Dstrbuton System Load Flow 2.1 Introducton Load flow s an mportant tool [66] for analyzng electrcal power system network performance. Load

More information

Chapter 11: Simple Linear Regression and Correlation

Chapter 11: Simple Linear Regression and Correlation Chapter 11: Smple Lnear Regresson and Correlaton 11-1 Emprcal Models 11-2 Smple Lnear Regresson 11-3 Propertes of the Least Squares Estmators 11-4 Hypothess Test n Smple Lnear Regresson 11-4.1 Use of t-tests

More information

x i1 =1 for all i (the constant ).

x i1 =1 for all i (the constant ). Chapter 5 The Multple Regresson Model Consder an economc model where the dependent varable s a functon of K explanatory varables. The economc model has the form: y = f ( x,x,..., ) xk Approxmate ths by

More information

Negative Binomial Regression

Negative Binomial Regression STATGRAPHICS Rev. 9/16/2013 Negatve Bnomal Regresson Summary... 1 Data Input... 3 Statstcal Model... 3 Analyss Summary... 4 Analyss Optons... 7 Plot of Ftted Model... 8 Observed Versus Predcted... 10 Predctons...

More information

Global Sensitivity. Tuesday 20 th February, 2018

Global Sensitivity. Tuesday 20 th February, 2018 Global Senstvty Tuesday 2 th February, 28 ) Local Senstvty Most senstvty analyses [] are based on local estmates of senstvty, typcally by expandng the response n a Taylor seres about some specfc values

More information

Statistics for Economics & Business

Statistics for Economics & Business Statstcs for Economcs & Busness Smple Lnear Regresson Learnng Objectves In ths chapter, you learn: How to use regresson analyss to predct the value of a dependent varable based on an ndependent varable

More information

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur Analyss of Varance and Desgn of Exerments-I MODULE III LECTURE - 2 EXPERIMENTAL DESIGN MODELS Dr. Shalabh Deartment of Mathematcs and Statstcs Indan Insttute of Technology Kanur 2 We consder the models

More information

Tracking with Kalman Filter

Tracking with Kalman Filter Trackng wth Kalman Flter Scott T. Acton Vrgna Image and Vdeo Analyss (VIVA), Charles L. Brown Department of Electrcal and Computer Engneerng Department of Bomedcal Engneerng Unversty of Vrgna, Charlottesvlle,

More information

2016 Wiley. Study Session 2: Ethical and Professional Standards Application

2016 Wiley. Study Session 2: Ethical and Professional Standards Application 6 Wley Study Sesson : Ethcal and Professonal Standards Applcaton LESSON : CORRECTION ANALYSIS Readng 9: Correlaton and Regresson LOS 9a: Calculate and nterpret a sample covarance and a sample correlaton

More information

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4) I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes

More information

Generalized Linear Methods

Generalized Linear Methods Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set

More information

Department of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6

Department of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6 Department of Quanttatve Methods & Informaton Systems Tme Seres and Ther Components QMIS 30 Chapter 6 Fall 00 Dr. Mohammad Zanal These sldes were modfed from ther orgnal source for educatonal purpose only.

More information

Report on Image warping

Report on Image warping Report on Image warpng Xuan Ne, Dec. 20, 2004 Ths document summarzed the algorthms of our mage warpng soluton for further study, and there s a detaled descrpton about the mplementaton of these algorthms.

More information

MACHINE APPLIED MACHINE LEARNING LEARNING. Gaussian Mixture Regression

MACHINE APPLIED MACHINE LEARNING LEARNING. Gaussian Mixture Regression 11 MACHINE APPLIED MACHINE LEARNING LEARNING MACHINE LEARNING Gaussan Mture Regresson 22 MACHINE APPLIED MACHINE LEARNING LEARNING Bref summary of last week s lecture 33 MACHINE APPLIED MACHINE LEARNING

More information

Predictive Analytics : QM901.1x Prof U Dinesh Kumar, IIMB. All Rights Reserved, Indian Institute of Management Bangalore

Predictive Analytics : QM901.1x Prof U Dinesh Kumar, IIMB. All Rights Reserved, Indian Institute of Management Bangalore Sesson Outlne Introducton to classfcaton problems and dscrete choce models. Introducton to Logstcs Regresson. Logstc functon and Logt functon. Maxmum Lkelhood Estmator (MLE) for estmaton of LR parameters.

More information

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE Analytcal soluton s usually not possble when exctaton vares arbtrarly wth tme or f the system s nonlnear. Such problems can be solved by numercal tmesteppng

More information

Normally, in one phase reservoir simulation we would deal with one of the following fluid systems:

Normally, in one phase reservoir simulation we would deal with one of the following fluid systems: TPG4160 Reservor Smulaton 2017 page 1 of 9 ONE-DIMENSIONAL, ONE-PHASE RESERVOIR SIMULATION Flud systems The term sngle phase apples to any system wth only one phase present n the reservor In some cases

More information

Inner Product. Euclidean Space. Orthonormal Basis. Orthogonal

Inner Product. Euclidean Space. Orthonormal Basis. Orthogonal Inner Product Defnton 1 () A Eucldean space s a fnte-dmensonal vector space over the reals R, wth an nner product,. Defnton 2 (Inner Product) An nner product, on a real vector space X s a symmetrc, blnear,

More information

Singular Value Decomposition: Theory and Applications

Singular Value Decomposition: Theory and Applications Sngular Value Decomposton: Theory and Applcatons Danel Khashab Sprng 2015 Last Update: March 2, 2015 1 Introducton A = UDV where columns of U and V are orthonormal and matrx D s dagonal wth postve real

More information

Psychology 282 Lecture #24 Outline Regression Diagnostics: Outliers

Psychology 282 Lecture #24 Outline Regression Diagnostics: Outliers Psychology 282 Lecture #24 Outlne Regresson Dagnostcs: Outlers In an earler lecture we studed the statstcal assumptons underlyng the regresson model, ncludng the followng ponts: Formal statement of assumptons.

More information

Composite Hypotheses testing

Composite Hypotheses testing Composte ypotheses testng In many hypothess testng problems there are many possble dstrbutons that can occur under each of the hypotheses. The output of the source s a set of parameters (ponts n a parameter

More information

NUMERICAL DIFFERENTIATION

NUMERICAL DIFFERENTIATION NUMERICAL DIFFERENTIATION 1 Introducton Dfferentaton s a method to compute the rate at whch a dependent output y changes wth respect to the change n the ndependent nput x. Ths rate of change s called the

More information

EEE 241: Linear Systems

EEE 241: Linear Systems EEE : Lnear Systems Summary #: Backpropagaton BACKPROPAGATION The perceptron rule as well as the Wdrow Hoff learnng were desgned to tran sngle layer networks. They suffer from the same dsadvantage: they

More information

Chapter 6. Supplemental Text Material

Chapter 6. Supplemental Text Material Chapter 6. Supplemental Text Materal S6-. actor Effect Estmates are Least Squares Estmates We have gven heurstc or ntutve explanatons of how the estmates of the factor effects are obtaned n the textboo.

More information

Errors for Linear Systems

Errors for Linear Systems Errors for Lnear Systems When we solve a lnear system Ax b we often do not know A and b exactly, but have only approxmatons  and ˆb avalable. Then the best thng we can do s to solve ˆx ˆb exactly whch

More information

Statistical Evaluation of WATFLOOD

Statistical Evaluation of WATFLOOD tatstcal Evaluaton of WATFLD By: Angela MacLean, Dept. of Cvl & Envronmental Engneerng, Unversty of Waterloo, n. ctober, 005 The statstcs program assocated wth WATFLD uses spl.csv fle that s produced wth

More information

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography CSc 6974 and ECSE 6966 Math. Tech. for Vson, Graphcs and Robotcs Lecture 21, Aprl 17, 2006 Estmatng A Plane Homography Overvew We contnue wth a dscusson of the major ssues, usng estmaton of plane projectve

More information

STAT 511 FINAL EXAM NAME Spring 2001

STAT 511 FINAL EXAM NAME Spring 2001 STAT 5 FINAL EXAM NAME Sprng Instructons: Ths s a closed book exam. No notes or books are allowed. ou may use a calculator but you are not allowed to store notes or formulas n the calculator. Please wrte

More information

x = , so that calculated

x = , so that calculated Stat 4, secton Sngle Factor ANOVA notes by Tm Plachowsk n chapter 8 we conducted hypothess tests n whch we compared a sngle sample s mean or proporton to some hypotheszed value Chapter 9 expanded ths to

More information

Parametric fractional imputation for missing data analysis. Jae Kwang Kim Survey Working Group Seminar March 29, 2010

Parametric fractional imputation for missing data analysis. Jae Kwang Kim Survey Working Group Seminar March 29, 2010 Parametrc fractonal mputaton for mssng data analyss Jae Kwang Km Survey Workng Group Semnar March 29, 2010 1 Outlne Introducton Proposed method Fractonal mputaton Approxmaton Varance estmaton Multple mputaton

More information

risk and uncertainty assessment

risk and uncertainty assessment Optmal forecastng of atmospherc qualty n ndustral regons: rsk and uncertanty assessment Vladmr Penenko Insttute of Computatonal Mathematcs and Mathematcal Geophyscs SD RAS Goal Development of theoretcal

More information

Computation of Higher Order Moments from Two Multinomial Overdispersion Likelihood Models

Computation of Higher Order Moments from Two Multinomial Overdispersion Likelihood Models Computaton of Hgher Order Moments from Two Multnomal Overdsperson Lkelhood Models BY J. T. NEWCOMER, N. K. NEERCHAL Department of Mathematcs and Statstcs, Unversty of Maryland, Baltmore County, Baltmore,

More information

ANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U)

ANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U) Econ 413 Exam 13 H ANSWERS Settet er nndelt 9 deloppgaver, A,B,C, som alle anbefales å telle lkt for å gøre det ltt lettere å stå. Svar er gtt . Unfortunately, there s a prntng error n the hnt of

More information

Feb 14: Spatial analysis of data fields

Feb 14: Spatial analysis of data fields Feb 4: Spatal analyss of data felds Mappng rregularly sampled data onto a regular grd Many analyss technques for geophyscal data requre the data be located at regular ntervals n space and/or tme. hs s

More information

1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands

1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands Content. Inference on Regresson Parameters a. Fndng Mean, s.d and covarance amongst estmates.. Confdence Intervals and Workng Hotellng Bands 3. Cochran s Theorem 4. General Lnear Testng 5. Measures of

More information

SIO 224. m(r) =(ρ(r),k s (r),µ(r))

SIO 224. m(r) =(ρ(r),k s (r),µ(r)) SIO 224 1. A bref look at resoluton analyss Here s some background for the Masters and Gubbns resoluton paper. Global Earth models are usually found teratvely by assumng a startng model and fndng small

More information

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 31 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 6. Rdge regresson The OLSE s the best lnear unbased

More information

Finite Element Modelling of truss/cable structures

Finite Element Modelling of truss/cable structures Pet Schreurs Endhoven Unversty of echnology Department of Mechancal Engneerng Materals echnology November 3, 214 Fnte Element Modellng of truss/cable structures 1 Fnte Element Analyss of prestressed structures

More information

Estimating the Fundamental Matrix by Transforming Image Points in Projective Space 1

Estimating the Fundamental Matrix by Transforming Image Points in Projective Space 1 Estmatng the Fundamental Matrx by Transformng Image Ponts n Projectve Space 1 Zhengyou Zhang and Charles Loop Mcrosoft Research, One Mcrosoft Way, Redmond, WA 98052, USA E-mal: fzhang,cloopg@mcrosoft.com

More information

International Journal of Pure and Applied Sciences and Technology

International Journal of Pure and Applied Sciences and Technology Int. J. Pure Appl. Sc. Technol., 4() (03), pp. 5-30 Internatonal Journal of Pure and Appled Scences and Technology ISSN 9-607 Avalable onlne at www.jopaasat.n Research Paper Schrödnger State Space Matrx

More information

Basic Statistical Analysis and Yield Calculations

Basic Statistical Analysis and Yield Calculations October 17, 007 Basc Statstcal Analyss and Yeld Calculatons Dr. José Ernesto Rayas Sánchez 1 Outlne Sources of desgn-performance uncertanty Desgn and development processes Desgn for manufacturablty A general

More information

Thermal-Fluids I. Chapter 18 Transient heat conduction. Dr. Primal Fernando Ph: (850)

Thermal-Fluids I. Chapter 18 Transient heat conduction. Dr. Primal Fernando Ph: (850) hermal-fluds I Chapter 18 ransent heat conducton Dr. Prmal Fernando prmal@eng.fsu.edu Ph: (850) 410-6323 1 ransent heat conducton In general, he temperature of a body vares wth tme as well as poston. In

More information

Note 10. Modeling and Simulation of Dynamic Systems

Note 10. Modeling and Simulation of Dynamic Systems Lecture Notes of ME 475: Introducton to Mechatroncs Note 0 Modelng and Smulaton of Dynamc Systems Department of Mechancal Engneerng, Unversty Of Saskatchewan, 57 Campus Drve, Saskatoon, SK S7N 5A9, Canada

More information

Uncertainty in measurements of power and energy on power networks

Uncertainty in measurements of power and energy on power networks Uncertanty n measurements of power and energy on power networks E. Manov, N. Kolev Department of Measurement and Instrumentaton, Techncal Unversty Sofa, bul. Klment Ohrdsk No8, bl., 000 Sofa, Bulgara Tel./fax:

More information

The Ordinary Least Squares (OLS) Estimator

The Ordinary Least Squares (OLS) Estimator The Ordnary Least Squares (OLS) Estmator 1 Regresson Analyss Regresson Analyss: a statstcal technque for nvestgatng and modelng the relatonshp between varables. Applcatons: Engneerng, the physcal and chemcal

More information

Some Comments on Accelerating Convergence of Iterative Sequences Using Direct Inversion of the Iterative Subspace (DIIS)

Some Comments on Accelerating Convergence of Iterative Sequences Using Direct Inversion of the Iterative Subspace (DIIS) Some Comments on Acceleratng Convergence of Iteratve Sequences Usng Drect Inverson of the Iteratve Subspace (DIIS) C. Davd Sherrll School of Chemstry and Bochemstry Georga Insttute of Technology May 1998

More information

Supplementary Notes for Chapter 9 Mixture Thermodynamics

Supplementary Notes for Chapter 9 Mixture Thermodynamics Supplementary Notes for Chapter 9 Mxture Thermodynamcs Key ponts Nne major topcs of Chapter 9 are revewed below: 1. Notaton and operatonal equatons for mxtures 2. PVTN EOSs for mxtures 3. General effects

More information

NON-CENTRAL 7-POINT FORMULA IN THE METHOD OF LINES FOR PARABOLIC AND BURGERS' EQUATIONS

NON-CENTRAL 7-POINT FORMULA IN THE METHOD OF LINES FOR PARABOLIC AND BURGERS' EQUATIONS IJRRAS 8 (3 September 011 www.arpapress.com/volumes/vol8issue3/ijrras_8_3_08.pdf NON-CENTRAL 7-POINT FORMULA IN THE METHOD OF LINES FOR PARABOLIC AND BURGERS' EQUATIONS H.O. Bakodah Dept. of Mathematc

More information

4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA

4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA 4 Analyss of Varance (ANOVA) 5 ANOVA 51 Introducton ANOVA ANOVA s a way to estmate and test the means of multple populatons We wll start wth one-way ANOVA If the populatons ncluded n the study are selected

More information

Lecture 12: Classification

Lecture 12: Classification Lecture : Classfcaton g Dscrmnant functons g The optmal Bayes classfer g Quadratc classfers g Eucldean and Mahalanobs metrcs g K Nearest Neghbor Classfers Intellgent Sensor Systems Rcardo Guterrez-Osuna

More information

Basic Business Statistics, 10/e

Basic Business Statistics, 10/e Chapter 13 13-1 Basc Busness Statstcs 11 th Edton Chapter 13 Smple Lnear Regresson Basc Busness Statstcs, 11e 009 Prentce-Hall, Inc. Chap 13-1 Learnng Objectves In ths chapter, you learn: How to use regresson

More information

The Geometry of Logit and Probit

The Geometry of Logit and Probit The Geometry of Logt and Probt Ths short note s meant as a supplement to Chapters and 3 of Spatal Models of Parlamentary Votng and the notaton and reference to fgures n the text below s to those two chapters.

More information

This column is a continuation of our previous column

This column is a continuation of our previous column Comparson of Goodness of Ft Statstcs for Lnear Regresson, Part II The authors contnue ther dscusson of the correlaton coeffcent n developng a calbraton for quanttatve analyss. Jerome Workman Jr. and Howard

More information

Maximum Likelihood Estimation of Binary Dependent Variables Models: Probit and Logit. 1. General Formulation of Binary Dependent Variables Models

Maximum Likelihood Estimation of Binary Dependent Variables Models: Probit and Logit. 1. General Formulation of Binary Dependent Variables Models ECO 452 -- OE 4: Probt and Logt Models ECO 452 -- OE 4 Maxmum Lkelhood Estmaton of Bnary Dependent Varables Models: Probt and Logt hs note demonstrates how to formulate bnary dependent varables models

More information

Lecture 21: Numerical methods for pricing American type derivatives

Lecture 21: Numerical methods for pricing American type derivatives Lecture 21: Numercal methods for prcng Amercan type dervatves Xaoguang Wang STAT 598W Aprl 10th, 2014 (STAT 598W) Lecture 21 1 / 26 Outlne 1 Fnte Dfference Method Explct Method Penalty Method (STAT 598W)

More information

A LINEAR PROGRAM TO COMPARE MULTIPLE GROSS CREDIT LOSS FORECASTS. Dr. Derald E. Wentzien, Wesley College, (302) ,

A LINEAR PROGRAM TO COMPARE MULTIPLE GROSS CREDIT LOSS FORECASTS. Dr. Derald E. Wentzien, Wesley College, (302) , A LINEAR PROGRAM TO COMPARE MULTIPLE GROSS CREDIT LOSS FORECASTS Dr. Derald E. Wentzen, Wesley College, (302) 736-2574, wentzde@wesley.edu ABSTRACT A lnear programmng model s developed and used to compare

More information

ECONOMICS 351*-A Mid-Term Exam -- Fall Term 2000 Page 1 of 13 pages. QUEEN'S UNIVERSITY AT KINGSTON Department of Economics

ECONOMICS 351*-A Mid-Term Exam -- Fall Term 2000 Page 1 of 13 pages. QUEEN'S UNIVERSITY AT KINGSTON Department of Economics ECOOMICS 35*-A Md-Term Exam -- Fall Term 000 Page of 3 pages QUEE'S UIVERSITY AT KIGSTO Department of Economcs ECOOMICS 35* - Secton A Introductory Econometrcs Fall Term 000 MID-TERM EAM ASWERS MG Abbott

More information

Kernel Methods and SVMs Extension

Kernel Methods and SVMs Extension Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general

More information

Time-Varying Systems and Computations Lecture 6

Time-Varying Systems and Computations Lecture 6 Tme-Varyng Systems and Computatons Lecture 6 Klaus Depold 14. Januar 2014 The Kalman Flter The Kalman estmaton flter attempts to estmate the actual state of an unknown dscrete dynamcal system, gven nosy

More information

Statistics for Business and Economics

Statistics for Business and Economics Statstcs for Busness and Economcs Chapter 11 Smple Regresson Copyrght 010 Pearson Educaton, Inc. Publshng as Prentce Hall Ch. 11-1 11.1 Overvew of Lnear Models n An equaton can be ft to show the best lnear

More information

Logistic Regression. CAP 5610: Machine Learning Instructor: Guo-Jun QI

Logistic Regression. CAP 5610: Machine Learning Instructor: Guo-Jun QI Logstc Regresson CAP 561: achne Learnng Instructor: Guo-Jun QI Bayes Classfer: A Generatve model odel the posteror dstrbuton P(Y X) Estmate class-condtonal dstrbuton P(X Y) for each Y Estmate pror dstrbuton

More information

Statistics for Managers Using Microsoft Excel/SPSS Chapter 13 The Simple Linear Regression Model and Correlation

Statistics for Managers Using Microsoft Excel/SPSS Chapter 13 The Simple Linear Regression Model and Correlation Statstcs for Managers Usng Mcrosoft Excel/SPSS Chapter 13 The Smple Lnear Regresson Model and Correlaton 1999 Prentce-Hall, Inc. Chap. 13-1 Chapter Topcs Types of Regresson Models Determnng the Smple Lnear

More information

See Book Chapter 11 2 nd Edition (Chapter 10 1 st Edition)

See Book Chapter 11 2 nd Edition (Chapter 10 1 st Edition) Count Data Models See Book Chapter 11 2 nd Edton (Chapter 10 1 st Edton) Count data consst of non-negatve nteger values Examples: number of drver route changes per week, the number of trp departure changes

More information

Winter 2008 CS567 Stochastic Linear/Integer Programming Guest Lecturer: Xu, Huan

Winter 2008 CS567 Stochastic Linear/Integer Programming Guest Lecturer: Xu, Huan Wnter 2008 CS567 Stochastc Lnear/Integer Programmng Guest Lecturer: Xu, Huan Class 2: More Modelng Examples 1 Capacty Expanson Capacty expanson models optmal choces of the tmng and levels of nvestments

More information

Second Order Analysis

Second Order Analysis Second Order Analyss In the prevous classes we looked at a method that determnes the load correspondng to a state of bfurcaton equlbrum of a perfect frame by egenvalye analyss The system was assumed to

More information

Resource Allocation and Decision Analysis (ECON 8010) Spring 2014 Foundations of Regression Analysis

Resource Allocation and Decision Analysis (ECON 8010) Spring 2014 Foundations of Regression Analysis Resource Allocaton and Decson Analss (ECON 800) Sprng 04 Foundatons of Regresson Analss Readng: Regresson Analss (ECON 800 Coursepak, Page 3) Defntons and Concepts: Regresson Analss statstcal technques

More information

Main Menu. characterization using surface reflection seismic data and sonic logs. Summary

Main Menu. characterization using surface reflection seismic data and sonic logs. Summary Stochastc Sesmc Inverson usng both Waveform and Traveltme Data and Its Applcaton to Tme-lapse Montorng Youl Quan* and Jerry M. Harrs, Geophyscs Department, Stanford Unversty Summary A stochastc approach

More information

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS Avalable onlne at http://sck.org J. Math. Comput. Sc. 3 (3), No., 6-3 ISSN: 97-537 COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

More information

The Finite Element Method

The Finite Element Method The Fnte Element Method GENERAL INTRODUCTION Read: Chapters 1 and 2 CONTENTS Engneerng and analyss Smulaton of a physcal process Examples mathematcal model development Approxmate solutons and methods of

More information

MMA and GCMMA two methods for nonlinear optimization

MMA and GCMMA two methods for nonlinear optimization MMA and GCMMA two methods for nonlnear optmzaton Krster Svanberg Optmzaton and Systems Theory, KTH, Stockholm, Sweden. krlle@math.kth.se Ths note descrbes the algorthms used n the author s 2007 mplementatons

More information

Appendix B. The Finite Difference Scheme

Appendix B. The Finite Difference Scheme 140 APPENDIXES Appendx B. The Fnte Dfference Scheme In ths appendx we present numercal technques whch are used to approxmate solutons of system 3.1 3.3. A comprehensve treatment of theoretcal and mplementaton

More information

Lecture 10 Support Vector Machines II

Lecture 10 Support Vector Machines II Lecture 10 Support Vector Machnes II 22 February 2016 Taylor B. Arnold Yale Statstcs STAT 365/665 1/28 Notes: Problem 3 s posted and due ths upcomng Frday There was an early bug n the fake-test data; fxed

More information

Chapter 2 - The Simple Linear Regression Model S =0. e i is a random error. S β2 β. This is a minimization problem. Solution is a calculus exercise.

Chapter 2 - The Simple Linear Regression Model S =0. e i is a random error. S β2 β. This is a minimization problem. Solution is a calculus exercise. Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where y + = β + β e for =,..., y and are observable varables e s a random error How can an estmaton rule be constructed for the

More information

Chapter 5 Multilevel Models

Chapter 5 Multilevel Models Chapter 5 Multlevel Models 5.1 Cross-sectonal multlevel models 5.1.1 Two-level models 5.1.2 Multple level models 5.1.3 Multple level modelng n other felds 5.2 Longtudnal multlevel models 5.2.1 Two-level

More information

1 Derivation of Rate Equations from Single-Cell Conductance (Hodgkin-Huxley-like) Equations

1 Derivation of Rate Equations from Single-Cell Conductance (Hodgkin-Huxley-like) Equations Physcs 171/271 -Davd Klenfeld - Fall 2005 (revsed Wnter 2011) 1 Dervaton of Rate Equatons from Sngle-Cell Conductance (Hodgkn-Huxley-lke) Equatons We consder a network of many neurons, each of whch obeys

More information

Structure and Drive Paul A. Jensen Copyright July 20, 2003

Structure and Drive Paul A. Jensen Copyright July 20, 2003 Structure and Drve Paul A. Jensen Copyrght July 20, 2003 A system s made up of several operatons wth flow passng between them. The structure of the system descrbes the flow paths from nputs to outputs.

More information

One-sided finite-difference approximations suitable for use with Richardson extrapolation

One-sided finite-difference approximations suitable for use with Richardson extrapolation Journal of Computatonal Physcs 219 (2006) 13 20 Short note One-sded fnte-dfference approxmatons sutable for use wth Rchardson extrapolaton Kumar Rahul, S.N. Bhattacharyya * Department of Mechancal Engneerng,

More information

[ ] λ λ λ. Multicollinearity. multicollinearity Ragnar Frisch (1934) perfect exact. collinearity. multicollinearity. exact

[ ] λ λ λ. Multicollinearity. multicollinearity Ragnar Frisch (1934) perfect exact. collinearity. multicollinearity. exact Multcollnearty multcollnearty Ragnar Frsch (934 perfect exact collnearty multcollnearty K exact λ λ λ K K x+ x+ + x 0 0.. λ, λ, λk 0 0.. x perfect ntercorrelated λ λ λ x+ x+ + KxK + v 0 0.. v 3 y β + β

More information

Module 3: Element Properties Lecture 1: Natural Coordinates

Module 3: Element Properties Lecture 1: Natural Coordinates Module 3: Element Propertes Lecture : Natural Coordnates Natural coordnate system s bascally a local coordnate system whch allows the specfcaton of a pont wthn the element by a set of dmensonless numbers

More information

Lecture 12: Discrete Laplacian

Lecture 12: Discrete Laplacian Lecture 12: Dscrete Laplacan Scrbe: Tanye Lu Our goal s to come up wth a dscrete verson of Laplacan operator for trangulated surfaces, so that we can use t n practce to solve related problems We are mostly

More information

Lecture Notes on Linear Regression

Lecture Notes on Linear Regression Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume

More information

Probability Theory (revisited)

Probability Theory (revisited) Probablty Theory (revsted) Summary Probablty v.s. plausblty Random varables Smulaton of Random Experments Challenge The alarm of a shop rang. Soon afterwards, a man was seen runnng n the street, persecuted

More information

Transfer Functions. Convenient representation of a linear, dynamic model. A transfer function (TF) relates one input and one output: ( ) system

Transfer Functions. Convenient representation of a linear, dynamic model. A transfer function (TF) relates one input and one output: ( ) system Transfer Functons Convenent representaton of a lnear, dynamc model. A transfer functon (TF) relates one nput and one output: x t X s y t system Y s The followng termnology s used: x y nput output forcng

More information

9. Binary Dependent Variables

9. Binary Dependent Variables 9. Bnar Dependent Varables 9. Homogeneous models Log, prob models Inference Tax preparers 9.2 Random effects models 9.3 Fxed effects models 9.4 Margnal models and GEE Appendx 9A - Lkelhood calculatons

More information

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix Lectures - Week 4 Matrx norms, Condtonng, Vector Spaces, Lnear Independence, Spannng sets and Bass, Null space and Range of a Matrx Matrx Norms Now we turn to assocatng a number to each matrx. We could

More information

Unified Subspace Analysis for Face Recognition

Unified Subspace Analysis for Face Recognition Unfed Subspace Analyss for Face Recognton Xaogang Wang and Xaoou Tang Department of Informaton Engneerng The Chnese Unversty of Hong Kong Shatn, Hong Kong {xgwang, xtang}@e.cuhk.edu.hk Abstract PCA, LDA

More information

Chat eld, C. and A.J.Collins, Introduction to multivariate analysis. Chapman & Hall, 1980

Chat eld, C. and A.J.Collins, Introduction to multivariate analysis. Chapman & Hall, 1980 MT07: Multvarate Statstcal Methods Mke Tso: emal mke.tso@manchester.ac.uk Webpage for notes: http://www.maths.manchester.ac.uk/~mkt/new_teachng.htm. Introducton to multvarate data. Books Chat eld, C. and

More information

RELIABILITY ASSESSMENT

RELIABILITY ASSESSMENT CHAPTER Rsk Analyss n Engneerng and Economcs RELIABILITY ASSESSMENT A. J. Clark School of Engneerng Department of Cvl and Envronmental Engneerng 4a CHAPMAN HALL/CRC Rsk Analyss for Engneerng Department

More information