On incorporating time-lapse seismic survey data into automatic history matching of reservoir simulations
|
|
- Blaise Hunt
- 5 years ago
- Views:
Transcription
1 ontents On ncorporatng tme-lapse sesmc survey data On ncorporatng tme-lapse sesmc survey data nto automatc hstory matchng of reservor smulatons Laurence R. Bentley BSTRT orosty, permeablty and other parameters must be specfed at every node wthn a petroleum reservor smulator. The parameters are developed from sparse and nosy data so that they are not known exactly. fter prelmnary assgnment of porosty and permeablty data, smulators are run n the forward mode, but they can seldom match the observed producton hstory adequately. onsequently, a hstory matchng step s requred n whch porosty, permeablty and other parameters are adjusted untl the model predctons match the producton hstory to a suffcent degree. In automatc hstory matchng, an objectve functon s formed by squarng and weghtng the dfference between observatons and the computed predctons. In addton, terms are often added to the objectve functon to penalze departures from orgnal parameter estmates. Ths objectve functon s then mnmzed wth respect to the parameters usng soluton technques such as the Marquardt method. Tme-lapse sesmc surveys produce mages at dfferent tmes n a reservor s hstory. The sesmc response of a reservor may change due to changes n pressure, flud saturaton and temperature. Gven approprate rock physcs models, the output of the reservor smulator can be used to predct the change n sesmc response. The dfference between the predcted change n sesmc response and the observed change n sesmc response forms another set of resduals. These resduals are squared, weghted and added to the objectve functon. INTRODUTION Reservor smulators are used to approxmately solve the mathematcal equatons that descrbe the physcs of flow of fluds wthn petroleum reservors. The smulators calculate changes n pressure and saturaton wthn reservors due to producton and the njecton of fluds durng secondary recovery operatons. Reservor smulators are used to forecast producton, assess rsk and test conceptual models. The mathematcal models used n reservor smulators requre the specfcaton of reservor parameters at all locatons wthn the reservor. In partcular, the ntrnsc permeablty and the porosty need to be specfed. The values of these attrbutes are extremely heterogeneous n geologc formatons, and they exert strong control on the flow and storage characterstcs of the reservor. In practce, these parameters are known approxmately, because hard data from wells are sparse, correlaton to densely spaced sesmc data s typcally weak and dfferences exst between measurement and modelng scales. In general, forward smulatons usng these values wll not adequately match the observed petroleum reservor producton hstory on the frst attempt, because of the uncertanty n the ntal estmates of the parameters. onsequently, the parameters REWES Research Report Volume 10 (1998) 33-1
2 ontents Bentley are teratvely adjusted untl an adequate match of the producton hstory s obtaned. Ths process s known as hstory matchng utomatc hstory matchng (M) s a process n whch hstory matchng s performed usng optmzaton technques. In ths approach, an objectve functon s formed whch s a functon of the msmatch between the calculated values of pressure and producton hstory and the observed pressure and producton hstory. The objectve functon s then mnmzed wth respect to the parameters to obtan an updated set of parameters for use n the smulator. DEVELOMENT Notaton vector of true producton hstory (pressure, water cut, gas ol rato, etc.) vector of measured producton hstory vector of computed producton hstory vector of computed producton hstory at the optmzaton pont N number of producton hstory vector entres e vector of errors assocated wth σ covarance of e covarance of e scaled by 1/σ σ common varance of e W producton hstory weght r producton hstory resdual vector X roducton hstory senstvty matrx vector of true sesmc attrbutes vector of measured sesmc attrbutes vector of computed sesmc attrbutes vector of computed sesmc attrbutes at the optmzaton pont N number of sesmc attrbute vector entres e vector of errors assocated wth 33- REWES Research Report Volume 10 (1998)
3 ontents On ncorporatng tme-lapse sesmc survey data σ covarance of e covarance of e scaled by 1/σ σ common varance of e W sesmc attrbute weght r sesmc attrbute resdual vector X sesmc attrbute senstvty matrx vector of true parameters values vector of measured parameter values (pror nformaton) vector of current parameter values derved from the optmzaton routne vector of parameter values at the optmzaton pont N number of pror nformaton vector entres e vector of errors assocated wth σ covarance of e covarance of e scaled by 1/σ σ common varance of e W pror nformaton weght r pror nformaton resdual vector X pror nformaton senstvty vector n number of decson varables, n N p reservor pressure S O ol saturaton S W water saturaton S G gas saturaton K objectve functon K objectve functon at soluton REWES Research Report Volume 10 (1998) 33-3
4 ontents Bentley X total senstvty (acoban) matrx X total senstvty matrx at soluton r augmented resdual vector r augmented resdual vector at soluton G gradent vector e approxmate essan matrx λ M Marquardt parameter λ R step sze relaxaton parameter s common varance Formulaton onsder three objectve functon terms assocated wth the producton hstory, sesmc attrbutes and pror knowledge of the parameter values. Typcally the decson parameters,, wll consst of the log-permeablty and the porosty. The producton values,, are calculated usng the smulator and the model parameters. set of rock physcs models, such as the Gassman equaton, are used wth the pressure and saturaton values computed by the flow smulator to calculate the sesmc attrbutes,. roducton story ssume that producton hstory measurements are related to the real producton hstory by, + Further, the form of e s assumed to be normal wth zero mean and covarance σ. The matrx has the form of the covarance of e, but t s scaled by the nverse of the common varance σ. The most common models for s that the producton measurement errors are uncorrelated n space but may be correlated by a one lag autocorrelaton functon n tme. Ths means that s a dagonal or block dagonal matrx. The dagonal terms of would vary f, for example, one set of pressure data was consdered less relable than another set of pressure data. e (1) 33-4 REWES Research Report Volume 10 (1998)
5 ontents The producton hstory objectve functon term s, On ncorporatng tme-lapse sesmc survey data t 1 ( ) ( ). 1 1 σ σ () 1 The weghtng terms σ and -1 : 1. Scale the equaton for varatons n unts (e.g. ps versus Kpa),. Weght more relable data more than less relable data, and 3. Flter the estmates based on the correlaton between errors. Sesmc ttrbutes In a manner analogous to the producton hstory match, the sesmc attrbute match leads to, t 1 ( ) ( ). 1 1 σ σ (3) In ths case, t s possble the e may be correlated and the optmal would be a non-dagonal matrx. ror Estmates of arameters Estmates of porosty have been developed usng well log nformaton or well log nformaton n conjuncton wth sesmc attrbutes. ermeablty estmates may be derved from upscalng core permeablty, DST analyss, and correlaton of porosty wth permeablty. The nformaton contaned n these pror estmates can be represented by the objectve functon term, t 1 ( ) ( ). 1 1 σ σ (4) In ths case, the form of the covarance of e Y may be determned from the estmaton errors generated n the nterpolaton step (e.g. krgng or cokrgng). Ths term s sometmes referred to as a regularzaton term and mproves the stablty of nverse procedures. In general, e wll be correlated, and usng the full correlaton structure whle developng the weghtng matrces has been shown to mprove estmates (Bentley, 1997). Optmzaton ssumng that the statstcal assumptons (normalty, etc.) are correct and that near the soluton the objectve functon s nearly lnear n the parameters, then the followng objectve functon s optmal n a least squares sense, REWES Research Report Volume 10 (1998) 33-5
6 ontents Bentley MIN 1... σ σ σ W R T 1 The correct weghtng s seen to be the nverse of the covarance of errors n the measurements and pror estmates. Usng ths form requres a pror knowledge of the covarance of the errors, whch are not known. In addton, we have neglected model error n the sense that the flow smulator may not be able to match the true system response due to nadequaces n the model equatons or dscretzaton. The assumpton of normally dstrbuted errors leads to problems f there are extremely large resduals. To date, mnmzaton of the equvalent of the full objectve functon 1 has not been reported. Researchers have optmzed the equvalent of σ σ (e.g. Gavalas et al. 1976, hu et al. 1995, havent et al. 1975), or the equvalent of (uang, et al. 1997, uang et al. 1998). In addton, Landa σ σ and orne (1997) use tme lapse sesmc data to estmate the change n saturaton wthn the reservor and then solved a form of. n approach that has been used n water resources s to assume that we know the form of the covarance matrx, but not the magntude of the common varances (arrera and Neuman, 1986). In ths way, nformaton on the relatonshp between the errors wthn each resdual type s ncluded n the objectve functon, but the weghts assocated wth the common varances must be selected by some other crtera. These weghts determne the relatve mportance of each type of nformaton. The revsed producton hstory objectve functon term becomes, W W + 1 t 1 ( ) ( ) Smlar expressons are used for wth weghtng W and wth weghtng W. In the lterature the weghts W K (where K, or ) have been chosen by a varety of methods. The new objectve functon becomes, W + W + W 4 One method that has been used wth success s to vary the weghts based on balancng the weghted varances as approxmated by the current estmate of the parameters. On the assumpton that at the soluton, the values of, and are close to ther true values, the weghted varances of,, and can be approxmated by, + 1 (5) (6) (7) 33-6 REWES Research Report Volume 10 (1998)
7 ontents Var On ncorporatng tme-lapse sesmc survey data W t 1 ( ) ( ' ) ( ' ) Var Var N W t 1 ( ) ( ' ) ( ' ) N W t 1 ( ) ( ' ) ( ' ) N The ndex ndcates values derved from the soluton at teraton, and N, N and N are the number of pressure measurements, sesmc attrbute values and pror estmates of parameters, respectvely. In order to balance the contrbutons of the dfferent data types, new weghts are chosen to balance the weghted varances, W 1 K K Var W ( K ) 1 The weghts are adjusted at the end of each run untl the varances are approxmately equal. Two or three teratons are generally requred to reach a balanced set of weghted varances (Wess and Smth, 1998). omputatonal Issues Gradent and Senstvty Matrx Several approaches have been used to solve the mnmzaton problem (e.g. equaton (5)). In the followng, we focus on the Marquardt method (Marquardt, 1963). Each Marquardt teraton, the gradent and the senstvty coeffcents must be computed. Defne the resdual vectors, r r r The resdual vectors at the soluton are denoted r K, where K, or. The global resdual vector s t r t t t [ r r r ] The producton hstory resdual vector contans N entres. These wll be arranged as tme seres data from several to tens of producton and njecton wells. It s possble for sesmc attrbute data to exst at each grd block wthn the smulator, and consequently, the dmenson of the vector can theoretcally be n the tens of (8) (9) (10) (11) (1) (13) (14) (15) REWES Research Report Volume 10 (1998) 33-7
8 ontents Bentley thousands. Wth three permeablty values (κ X, κ Y, κ Z ) and a porosty assocated wth each grd block, the number of parameters can be n the tens of thousands. senstvty coeffcent s the partal dervatve of an ndvdual resdual wth respect to a decson varable. Each type of resdual has a senstvty matrx assocated wth t. n element of the producton hstory senstvty matrx s, X j where each row 1 to N s assocated wth a producton hstory resdual and each column j1 to n s assocated wth a decson parameter. Smlarly, the sesmc attrbute resdual senstvty coeffcents are, X j j where 1 to N and j1 to n. ssume that varatons n sesmc attrbute can be calculated from the pressure and saturaton, j (16) (17) F( p, SO, SW, SG ) Then, the sesmc attrbute senstvtes can be calculated usng the chan rule, (18) F p F + p S O SO F + S W SW F + S G SG onsequently, the partal dervatve of the pressure and saturatons wth respect to each parameter s requred at each locaton of a sesmc attrbute value. These same dervatves are requred for the evaluaton of equaton (16), but only at the locatons of the wells used n the producton hstory match. In some cases, temperature would need to be modeled as a state varable, because t can also have a sgnfcant effect on the sesmc response. The senstvty coeffcents for the pror nformaton are, X j wth rows 1 to N and columns j1 to n. The pror nformaton matrx conssts of entres of ones and zeroes, and f every parameter has pror nformaton then the matrx s the dentty matrx. j (19) (0) 33-8 REWES Research Report Volume 10 (1998)
9 ontents The total senstvty matrx s constructed, On ncorporatng tme-lapse sesmc survey data t X t t t [ X X X ] and t has NN +N +N rows and n columns. It s possble for the number of parameters to be n the tens of thousands. The huge dmensonalty of the parameter space and the lmted amount of observatonal data lead to a problem that s nherently underdetermned. onsequently, unqueness and dentfablty are ssues n the parameter optmzaton problem. In practce, the dmenson of the parameter space s reduced by lumpng many grd blocks together n zones of equal value or to use nterpolaton methods such as the plot pont method to populate the reservor wth a smaller number decson varables located ate the nterpolaton ponts (plot ponts). We are currently nvestgatng the use of cluster algorthms for dynamc zonng. The calculaton of the senstvty matrx s a major computatonal burden. Three approaches have been used. In the perturbaton method, each parameter s perturbed and a forward smulaton s run to compute the new value of the resduals. The senstvty matrx s then constructed by the fnte dfference method. Ths method s only computatonally feasble wth a small number of parameters. In the adjont equaton method, the equvalent of a separate smulaton run s needed for each of the observaton locatons. Ths method was useful when the number of observaton locatons was lmted to a small set of producton and njecton wells. owever, the ncluson of spatally dense sesmc attrbute data requres the senstvty calculatons to be carred out at thousands of locatons, and the adjont equaton method s not as attractve for the cases n whch tme-lapse sesmc data s ncluded n the objectve functon. In the gradent smulaton method (nteron et al. 1989), the equvalent of an extra flow smulaton plus for each decson varable one back substtuton s requred for each Marquardt teraton. t present, ths appears to be the best approach for calculatng senstvty coeffcents for the cases wth tme-lapse sesmc terms n the objectve functon. The global weghtng matrx for objectve functon 4 s, (1) 1 W W W The other objectve functons have analogous weghtng matrces. The gradent of the objectve functon s, () G X k t 1 where k ndcates the form of the objectve functon (.e. k1,, 3, or 4). The vector G has a length of n. r (3) REWES Research Report Volume 10 (1998) 33-9
10 ontents Bentley If the resduals are small and/or the equaton s quas-lnear, then the essan matrx can be approxmated as, e The matrx e has dmensons n by n. k t 1 ( X X ) (4) The Marquardt algorthm update s, t 1 k ( X X ) + I ) G k + 1 k k 1 + λr λm where k s the teraton ndex, λ M s the Marquardt parameter and λ R s a relaxaton parameter to control the step sze. Transformaton and Scalng Improvng the condtonng of the objectve functon wll mprove the soluton and reduce the computatonal effort requred to reach a soluton. arameters and resduals are often scaled or transformed n order to provde a better condtoned objectve functon. In addton, transformed varables often have better statstcal propertes than the prmary varables. For example, permeablty s generally transformed to logpermeablty for geologc and statstcal reasons. pproprate weghts wll depend on the form of the scaled or transformed varables, so transformaton choces are related to weghtng choces. Often the decson varables are normalzed to one n order to mprove the condtonng of the objectve functon. If the current value of the parameters s, then the scalng takes the form, (5) S ej S ej G G S j (6) (7) (8) Error Estmates t the soluton, the common varance of the weghted errors can be estmated by lnear error analyss, s ( N ' 4 + N + N ' 4 ) n N where N D s the dfference between the number of resduals and the number of decson varables. D (9) REWES Research Report Volume 10 (1998)
11 ontents n estmate for the estmaton varance of the parameters s, Var On ncorporatng tme-lapse sesmc survey data t 1 ( ' ) s ( X ' X ') 1 where the prme ndcates that the values are evaluated at the optmal soluton. lnear approxmaton of the confdence regons s gven by, (30) t t 1 ( ' ) X ' X '( ') n s F ( n, N ) where F s an F dstrbuton wth n and N D degrees of freedom. α D (31) ONLUSION The goal of automatc hstory matchng (M) s to mprove the parameter selecton for petroleum reservor smulators n order to mprove ther reservor forecastng capablty. n approach for ncludng tme-lapse sesmc data nto M has been presented and some practcal ssues have been dscussed. M s stll not routnely used, even after more than twenty years of development. The dffcultes are related to the extreme nonlnearty of the objectve functon, the hgh dmensonalty of the decson varable set, problems assocated wth unqueness and dentfablty of parameters, and dffcultes assocated wth computng the senstvty matrces. M based solely on producton data observed at a lmted number of well locatons suffers because of the sparsty of the spatal sample. Sesmc data has the nherent advantage of beng a spatally dense data set, and prelmnary ndcatons are that ncludng tme-lapse sesmc data wll lead to mproved M. lthough the routne applcaton of M remans an elusve goal, studyng tmelapse sesmc survey results n the context of M s valuable. The mathematcal formulaton of M gves us nsght nto the hstory matchng process and helps analysts dentfy the underlyng structure of the hstory match problem. Study of the senstvty of sesmc attrbutes to changes n reservor parameters, objectve functon gradents and estmaton varance wll lead to nsghts nto the effectveness of ntegratng tme-lapse sesmc data nto reservor smulaton and reservor forecastng. In turn, these nsghts wll gude tme-lapse sesmc acquston and processng choces. REFERENES nteron, F., Eymard, R., Karcher, B., 1989, Use of parameter gradents for reservor hstory matchng, SE Bentley, L.R., 1997, Influence of the regularzaton weghtng matrx on parameter estmates, dv. Wat. Resour., 0(4), arrera,. and Neuman, S.., 1986, Estmaton of aqufer parameters under transent and steady state condtons: 1. Maxmum lkelhood estmaton ncorporatng pror nformaton, Wat. Resour. Res., (), havent, G., Dupuy, M. and Lemonner,., 1975, story matchng by use of optmal theory, Soc. et. Eng.., 15(1), REWES Research Report Volume 10 (1998) 33-11
12 ontents Bentley hu, L., Reynolds,.. and Olver,.S., 1995, Reservor descrpton from statc and well-test data usng effcent gradent methods, SE 9999, Gavalas, G.R., Shah,.. and Senfeld,.., 1976, Reservor hstory matchng by Bayesan estmaton, Soc. et. Eng., 16(6), uang, X., Mester, L. and Workman, R., 1998, Improvement and senstvty of reservor characterzaton derved from tme-lapse sesmc data, SE uang, X., Mester, L. and Workman, R., 1997, Reservor characterzaton by ntegraton of tmelapse sesmc producton data, SE Landa,.L. and orne, R.N., 1997, procedure to ntegrate well test data, reservor performance hstory and 4-D sesmc nformaton nto a reservor descrpton, SE Marquardt, D.T., 1963,. Soc. Ind. ppl. Math., 11, Wess, R. and Smth, L., 1998, arameter space methods n jont parameter estmaton for groundwater flow models, Wat. Resour. Res., 34(4), REWES Research Report Volume 10 (1998)
4DVAR, according to the name, is a four-dimensional variational method.
4D-Varatonal Data Assmlaton (4D-Var) 4DVAR, accordng to the name, s a four-dmensonal varatonal method. 4D-Var s actually a drect generalzaton of 3D-Var to handle observatons that are dstrbuted n tme. The
More informationLinear Approximation with Regularization and Moving Least Squares
Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...
More informationLINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity
LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 30 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 2 Remedes for multcollnearty Varous technques have
More informationA Robust Method for Calculating the Correlation Coefficient
A Robust Method for Calculatng the Correlaton Coeffcent E.B. Nven and C. V. Deutsch Relatonshps between prmary and secondary data are frequently quantfed usng the correlaton coeffcent; however, the tradtonal
More informationThe Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction
ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also
More informationNumerical Heat and Mass Transfer
Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and
More informationFeature Selection: Part 1
CSE 546: Machne Learnng Lecture 5 Feature Selecton: Part 1 Instructor: Sham Kakade 1 Regresson n the hgh dmensonal settng How do we learn when the number of features d s greater than the sample sze n?
More informationComparison of Regression Lines
STATGRAPHICS Rev. 9/13/2013 Comparson of Regresson Lnes Summary... 1 Data Input... 3 Analyss Summary... 4 Plot of Ftted Model... 6 Condtonal Sums of Squares... 6 Analyss Optons... 7 Forecasts... 8 Confdence
More informationUncertainty as the Overlap of Alternate Conditional Distributions
Uncertanty as the Overlap of Alternate Condtonal Dstrbutons Olena Babak and Clayton V. Deutsch Centre for Computatonal Geostatstcs Department of Cvl & Envronmental Engneerng Unversty of Alberta An mportant
More informationModule 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur
Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:
More informationChapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems
Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons
More informationChapter 13: Multiple Regression
Chapter 13: Multple Regresson 13.1 Developng the multple-regresson Model The general model can be descrbed as: It smplfes for two ndependent varables: The sample ft parameter b 0, b 1, and b are used to
More informationChapter - 2. Distribution System Power Flow Analysis
Chapter - 2 Dstrbuton System Power Flow Analyss CHAPTER - 2 Radal Dstrbuton System Load Flow 2.1 Introducton Load flow s an mportant tool [66] for analyzng electrcal power system network performance. Load
More informationChapter 11: Simple Linear Regression and Correlation
Chapter 11: Smple Lnear Regresson and Correlaton 11-1 Emprcal Models 11-2 Smple Lnear Regresson 11-3 Propertes of the Least Squares Estmators 11-4 Hypothess Test n Smple Lnear Regresson 11-4.1 Use of t-tests
More informationx i1 =1 for all i (the constant ).
Chapter 5 The Multple Regresson Model Consder an economc model where the dependent varable s a functon of K explanatory varables. The economc model has the form: y = f ( x,x,..., ) xk Approxmate ths by
More informationNegative Binomial Regression
STATGRAPHICS Rev. 9/16/2013 Negatve Bnomal Regresson Summary... 1 Data Input... 3 Statstcal Model... 3 Analyss Summary... 4 Analyss Optons... 7 Plot of Ftted Model... 8 Observed Versus Predcted... 10 Predctons...
More informationGlobal Sensitivity. Tuesday 20 th February, 2018
Global Senstvty Tuesday 2 th February, 28 ) Local Senstvty Most senstvty analyses [] are based on local estmates of senstvty, typcally by expandng the response n a Taylor seres about some specfc values
More informationStatistics for Economics & Business
Statstcs for Economcs & Busness Smple Lnear Regresson Learnng Objectves In ths chapter, you learn: How to use regresson analyss to predct the value of a dependent varable based on an ndependent varable
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analyss of Varance and Desgn of Exerments-I MODULE III LECTURE - 2 EXPERIMENTAL DESIGN MODELS Dr. Shalabh Deartment of Mathematcs and Statstcs Indan Insttute of Technology Kanur 2 We consder the models
More informationTracking with Kalman Filter
Trackng wth Kalman Flter Scott T. Acton Vrgna Image and Vdeo Analyss (VIVA), Charles L. Brown Department of Electrcal and Computer Engneerng Department of Bomedcal Engneerng Unversty of Vrgna, Charlottesvlle,
More information2016 Wiley. Study Session 2: Ethical and Professional Standards Application
6 Wley Study Sesson : Ethcal and Professonal Standards Applcaton LESSON : CORRECTION ANALYSIS Readng 9: Correlaton and Regresson LOS 9a: Calculate and nterpret a sample covarance and a sample correlaton
More informationEcon107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)
I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes
More informationGeneralized Linear Methods
Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set
More informationDepartment of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6
Department of Quanttatve Methods & Informaton Systems Tme Seres and Ther Components QMIS 30 Chapter 6 Fall 00 Dr. Mohammad Zanal These sldes were modfed from ther orgnal source for educatonal purpose only.
More informationReport on Image warping
Report on Image warpng Xuan Ne, Dec. 20, 2004 Ths document summarzed the algorthms of our mage warpng soluton for further study, and there s a detaled descrpton about the mplementaton of these algorthms.
More informationMACHINE APPLIED MACHINE LEARNING LEARNING. Gaussian Mixture Regression
11 MACHINE APPLIED MACHINE LEARNING LEARNING MACHINE LEARNING Gaussan Mture Regresson 22 MACHINE APPLIED MACHINE LEARNING LEARNING Bref summary of last week s lecture 33 MACHINE APPLIED MACHINE LEARNING
More informationPredictive Analytics : QM901.1x Prof U Dinesh Kumar, IIMB. All Rights Reserved, Indian Institute of Management Bangalore
Sesson Outlne Introducton to classfcaton problems and dscrete choce models. Introducton to Logstcs Regresson. Logstc functon and Logt functon. Maxmum Lkelhood Estmator (MLE) for estmaton of LR parameters.
More informationCHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE
CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE Analytcal soluton s usually not possble when exctaton vares arbtrarly wth tme or f the system s nonlnear. Such problems can be solved by numercal tmesteppng
More informationNormally, in one phase reservoir simulation we would deal with one of the following fluid systems:
TPG4160 Reservor Smulaton 2017 page 1 of 9 ONE-DIMENSIONAL, ONE-PHASE RESERVOIR SIMULATION Flud systems The term sngle phase apples to any system wth only one phase present n the reservor In some cases
More informationInner Product. Euclidean Space. Orthonormal Basis. Orthogonal
Inner Product Defnton 1 () A Eucldean space s a fnte-dmensonal vector space over the reals R, wth an nner product,. Defnton 2 (Inner Product) An nner product, on a real vector space X s a symmetrc, blnear,
More informationSingular Value Decomposition: Theory and Applications
Sngular Value Decomposton: Theory and Applcatons Danel Khashab Sprng 2015 Last Update: March 2, 2015 1 Introducton A = UDV where columns of U and V are orthonormal and matrx D s dagonal wth postve real
More informationPsychology 282 Lecture #24 Outline Regression Diagnostics: Outliers
Psychology 282 Lecture #24 Outlne Regresson Dagnostcs: Outlers In an earler lecture we studed the statstcal assumptons underlyng the regresson model, ncludng the followng ponts: Formal statement of assumptons.
More informationComposite Hypotheses testing
Composte ypotheses testng In many hypothess testng problems there are many possble dstrbutons that can occur under each of the hypotheses. The output of the source s a set of parameters (ponts n a parameter
More informationNUMERICAL DIFFERENTIATION
NUMERICAL DIFFERENTIATION 1 Introducton Dfferentaton s a method to compute the rate at whch a dependent output y changes wth respect to the change n the ndependent nput x. Ths rate of change s called the
More informationEEE 241: Linear Systems
EEE : Lnear Systems Summary #: Backpropagaton BACKPROPAGATION The perceptron rule as well as the Wdrow Hoff learnng were desgned to tran sngle layer networks. They suffer from the same dsadvantage: they
More informationChapter 6. Supplemental Text Material
Chapter 6. Supplemental Text Materal S6-. actor Effect Estmates are Least Squares Estmates We have gven heurstc or ntutve explanatons of how the estmates of the factor effects are obtaned n the textboo.
More informationErrors for Linear Systems
Errors for Lnear Systems When we solve a lnear system Ax b we often do not know A and b exactly, but have only approxmatons  and ˆb avalable. Then the best thng we can do s to solve ˆx ˆb exactly whch
More informationStatistical Evaluation of WATFLOOD
tatstcal Evaluaton of WATFLD By: Angela MacLean, Dept. of Cvl & Envronmental Engneerng, Unversty of Waterloo, n. ctober, 005 The statstcs program assocated wth WATFLD uses spl.csv fle that s produced wth
More informationCSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography
CSc 6974 and ECSE 6966 Math. Tech. for Vson, Graphcs and Robotcs Lecture 21, Aprl 17, 2006 Estmatng A Plane Homography Overvew We contnue wth a dscusson of the major ssues, usng estmaton of plane projectve
More informationSTAT 511 FINAL EXAM NAME Spring 2001
STAT 5 FINAL EXAM NAME Sprng Instructons: Ths s a closed book exam. No notes or books are allowed. ou may use a calculator but you are not allowed to store notes or formulas n the calculator. Please wrte
More informationx = , so that calculated
Stat 4, secton Sngle Factor ANOVA notes by Tm Plachowsk n chapter 8 we conducted hypothess tests n whch we compared a sngle sample s mean or proporton to some hypotheszed value Chapter 9 expanded ths to
More informationParametric fractional imputation for missing data analysis. Jae Kwang Kim Survey Working Group Seminar March 29, 2010
Parametrc fractonal mputaton for mssng data analyss Jae Kwang Km Survey Workng Group Semnar March 29, 2010 1 Outlne Introducton Proposed method Fractonal mputaton Approxmaton Varance estmaton Multple mputaton
More informationrisk and uncertainty assessment
Optmal forecastng of atmospherc qualty n ndustral regons: rsk and uncertanty assessment Vladmr Penenko Insttute of Computatonal Mathematcs and Mathematcal Geophyscs SD RAS Goal Development of theoretcal
More informationComputation of Higher Order Moments from Two Multinomial Overdispersion Likelihood Models
Computaton of Hgher Order Moments from Two Multnomal Overdsperson Lkelhood Models BY J. T. NEWCOMER, N. K. NEERCHAL Department of Mathematcs and Statstcs, Unversty of Maryland, Baltmore County, Baltmore,
More informationANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U)
Econ 413 Exam 13 H ANSWERS Settet er nndelt 9 deloppgaver, A,B,C, som alle anbefales å telle lkt for å gøre det ltt lettere å stå. Svar er gtt . Unfortunately, there s a prntng error n the hnt of
More informationFeb 14: Spatial analysis of data fields
Feb 4: Spatal analyss of data felds Mappng rregularly sampled data onto a regular grd Many analyss technques for geophyscal data requre the data be located at regular ntervals n space and/or tme. hs s
More information1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands
Content. Inference on Regresson Parameters a. Fndng Mean, s.d and covarance amongst estmates.. Confdence Intervals and Workng Hotellng Bands 3. Cochran s Theorem 4. General Lnear Testng 5. Measures of
More informationSIO 224. m(r) =(ρ(r),k s (r),µ(r))
SIO 224 1. A bref look at resoluton analyss Here s some background for the Masters and Gubbns resoluton paper. Global Earth models are usually found teratvely by assumng a startng model and fndng small
More informationLINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity
LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 31 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 6. Rdge regresson The OLSE s the best lnear unbased
More informationFinite Element Modelling of truss/cable structures
Pet Schreurs Endhoven Unversty of echnology Department of Mechancal Engneerng Materals echnology November 3, 214 Fnte Element Modellng of truss/cable structures 1 Fnte Element Analyss of prestressed structures
More informationEstimating the Fundamental Matrix by Transforming Image Points in Projective Space 1
Estmatng the Fundamental Matrx by Transformng Image Ponts n Projectve Space 1 Zhengyou Zhang and Charles Loop Mcrosoft Research, One Mcrosoft Way, Redmond, WA 98052, USA E-mal: fzhang,cloopg@mcrosoft.com
More informationInternational Journal of Pure and Applied Sciences and Technology
Int. J. Pure Appl. Sc. Technol., 4() (03), pp. 5-30 Internatonal Journal of Pure and Appled Scences and Technology ISSN 9-607 Avalable onlne at www.jopaasat.n Research Paper Schrödnger State Space Matrx
More informationBasic Statistical Analysis and Yield Calculations
October 17, 007 Basc Statstcal Analyss and Yeld Calculatons Dr. José Ernesto Rayas Sánchez 1 Outlne Sources of desgn-performance uncertanty Desgn and development processes Desgn for manufacturablty A general
More informationThermal-Fluids I. Chapter 18 Transient heat conduction. Dr. Primal Fernando Ph: (850)
hermal-fluds I Chapter 18 ransent heat conducton Dr. Prmal Fernando prmal@eng.fsu.edu Ph: (850) 410-6323 1 ransent heat conducton In general, he temperature of a body vares wth tme as well as poston. In
More informationNote 10. Modeling and Simulation of Dynamic Systems
Lecture Notes of ME 475: Introducton to Mechatroncs Note 0 Modelng and Smulaton of Dynamc Systems Department of Mechancal Engneerng, Unversty Of Saskatchewan, 57 Campus Drve, Saskatoon, SK S7N 5A9, Canada
More informationUncertainty in measurements of power and energy on power networks
Uncertanty n measurements of power and energy on power networks E. Manov, N. Kolev Department of Measurement and Instrumentaton, Techncal Unversty Sofa, bul. Klment Ohrdsk No8, bl., 000 Sofa, Bulgara Tel./fax:
More informationThe Ordinary Least Squares (OLS) Estimator
The Ordnary Least Squares (OLS) Estmator 1 Regresson Analyss Regresson Analyss: a statstcal technque for nvestgatng and modelng the relatonshp between varables. Applcatons: Engneerng, the physcal and chemcal
More informationSome Comments on Accelerating Convergence of Iterative Sequences Using Direct Inversion of the Iterative Subspace (DIIS)
Some Comments on Acceleratng Convergence of Iteratve Sequences Usng Drect Inverson of the Iteratve Subspace (DIIS) C. Davd Sherrll School of Chemstry and Bochemstry Georga Insttute of Technology May 1998
More informationSupplementary Notes for Chapter 9 Mixture Thermodynamics
Supplementary Notes for Chapter 9 Mxture Thermodynamcs Key ponts Nne major topcs of Chapter 9 are revewed below: 1. Notaton and operatonal equatons for mxtures 2. PVTN EOSs for mxtures 3. General effects
More informationNON-CENTRAL 7-POINT FORMULA IN THE METHOD OF LINES FOR PARABOLIC AND BURGERS' EQUATIONS
IJRRAS 8 (3 September 011 www.arpapress.com/volumes/vol8issue3/ijrras_8_3_08.pdf NON-CENTRAL 7-POINT FORMULA IN THE METHOD OF LINES FOR PARABOLIC AND BURGERS' EQUATIONS H.O. Bakodah Dept. of Mathematc
More information4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA
4 Analyss of Varance (ANOVA) 5 ANOVA 51 Introducton ANOVA ANOVA s a way to estmate and test the means of multple populatons We wll start wth one-way ANOVA If the populatons ncluded n the study are selected
More informationLecture 12: Classification
Lecture : Classfcaton g Dscrmnant functons g The optmal Bayes classfer g Quadratc classfers g Eucldean and Mahalanobs metrcs g K Nearest Neghbor Classfers Intellgent Sensor Systems Rcardo Guterrez-Osuna
More informationBasic Business Statistics, 10/e
Chapter 13 13-1 Basc Busness Statstcs 11 th Edton Chapter 13 Smple Lnear Regresson Basc Busness Statstcs, 11e 009 Prentce-Hall, Inc. Chap 13-1 Learnng Objectves In ths chapter, you learn: How to use regresson
More informationThe Geometry of Logit and Probit
The Geometry of Logt and Probt Ths short note s meant as a supplement to Chapters and 3 of Spatal Models of Parlamentary Votng and the notaton and reference to fgures n the text below s to those two chapters.
More informationThis column is a continuation of our previous column
Comparson of Goodness of Ft Statstcs for Lnear Regresson, Part II The authors contnue ther dscusson of the correlaton coeffcent n developng a calbraton for quanttatve analyss. Jerome Workman Jr. and Howard
More informationMaximum Likelihood Estimation of Binary Dependent Variables Models: Probit and Logit. 1. General Formulation of Binary Dependent Variables Models
ECO 452 -- OE 4: Probt and Logt Models ECO 452 -- OE 4 Maxmum Lkelhood Estmaton of Bnary Dependent Varables Models: Probt and Logt hs note demonstrates how to formulate bnary dependent varables models
More informationLecture 21: Numerical methods for pricing American type derivatives
Lecture 21: Numercal methods for prcng Amercan type dervatves Xaoguang Wang STAT 598W Aprl 10th, 2014 (STAT 598W) Lecture 21 1 / 26 Outlne 1 Fnte Dfference Method Explct Method Penalty Method (STAT 598W)
More informationA LINEAR PROGRAM TO COMPARE MULTIPLE GROSS CREDIT LOSS FORECASTS. Dr. Derald E. Wentzien, Wesley College, (302) ,
A LINEAR PROGRAM TO COMPARE MULTIPLE GROSS CREDIT LOSS FORECASTS Dr. Derald E. Wentzen, Wesley College, (302) 736-2574, wentzde@wesley.edu ABSTRACT A lnear programmng model s developed and used to compare
More informationECONOMICS 351*-A Mid-Term Exam -- Fall Term 2000 Page 1 of 13 pages. QUEEN'S UNIVERSITY AT KINGSTON Department of Economics
ECOOMICS 35*-A Md-Term Exam -- Fall Term 000 Page of 3 pages QUEE'S UIVERSITY AT KIGSTO Department of Economcs ECOOMICS 35* - Secton A Introductory Econometrcs Fall Term 000 MID-TERM EAM ASWERS MG Abbott
More informationKernel Methods and SVMs Extension
Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general
More informationTime-Varying Systems and Computations Lecture 6
Tme-Varyng Systems and Computatons Lecture 6 Klaus Depold 14. Januar 2014 The Kalman Flter The Kalman estmaton flter attempts to estmate the actual state of an unknown dscrete dynamcal system, gven nosy
More informationStatistics for Business and Economics
Statstcs for Busness and Economcs Chapter 11 Smple Regresson Copyrght 010 Pearson Educaton, Inc. Publshng as Prentce Hall Ch. 11-1 11.1 Overvew of Lnear Models n An equaton can be ft to show the best lnear
More informationLogistic Regression. CAP 5610: Machine Learning Instructor: Guo-Jun QI
Logstc Regresson CAP 561: achne Learnng Instructor: Guo-Jun QI Bayes Classfer: A Generatve model odel the posteror dstrbuton P(Y X) Estmate class-condtonal dstrbuton P(X Y) for each Y Estmate pror dstrbuton
More informationStatistics for Managers Using Microsoft Excel/SPSS Chapter 13 The Simple Linear Regression Model and Correlation
Statstcs for Managers Usng Mcrosoft Excel/SPSS Chapter 13 The Smple Lnear Regresson Model and Correlaton 1999 Prentce-Hall, Inc. Chap. 13-1 Chapter Topcs Types of Regresson Models Determnng the Smple Lnear
More informationSee Book Chapter 11 2 nd Edition (Chapter 10 1 st Edition)
Count Data Models See Book Chapter 11 2 nd Edton (Chapter 10 1 st Edton) Count data consst of non-negatve nteger values Examples: number of drver route changes per week, the number of trp departure changes
More informationWinter 2008 CS567 Stochastic Linear/Integer Programming Guest Lecturer: Xu, Huan
Wnter 2008 CS567 Stochastc Lnear/Integer Programmng Guest Lecturer: Xu, Huan Class 2: More Modelng Examples 1 Capacty Expanson Capacty expanson models optmal choces of the tmng and levels of nvestments
More informationSecond Order Analysis
Second Order Analyss In the prevous classes we looked at a method that determnes the load correspondng to a state of bfurcaton equlbrum of a perfect frame by egenvalye analyss The system was assumed to
More informationResource Allocation and Decision Analysis (ECON 8010) Spring 2014 Foundations of Regression Analysis
Resource Allocaton and Decson Analss (ECON 800) Sprng 04 Foundatons of Regresson Analss Readng: Regresson Analss (ECON 800 Coursepak, Page 3) Defntons and Concepts: Regresson Analss statstcal technques
More informationMain Menu. characterization using surface reflection seismic data and sonic logs. Summary
Stochastc Sesmc Inverson usng both Waveform and Traveltme Data and Its Applcaton to Tme-lapse Montorng Youl Quan* and Jerry M. Harrs, Geophyscs Department, Stanford Unversty Summary A stochastc approach
More informationCOMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS
Avalable onlne at http://sck.org J. Math. Comput. Sc. 3 (3), No., 6-3 ISSN: 97-537 COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS
More informationThe Finite Element Method
The Fnte Element Method GENERAL INTRODUCTION Read: Chapters 1 and 2 CONTENTS Engneerng and analyss Smulaton of a physcal process Examples mathematcal model development Approxmate solutons and methods of
More informationMMA and GCMMA two methods for nonlinear optimization
MMA and GCMMA two methods for nonlnear optmzaton Krster Svanberg Optmzaton and Systems Theory, KTH, Stockholm, Sweden. krlle@math.kth.se Ths note descrbes the algorthms used n the author s 2007 mplementatons
More informationAppendix B. The Finite Difference Scheme
140 APPENDIXES Appendx B. The Fnte Dfference Scheme In ths appendx we present numercal technques whch are used to approxmate solutons of system 3.1 3.3. A comprehensve treatment of theoretcal and mplementaton
More informationLecture 10 Support Vector Machines II
Lecture 10 Support Vector Machnes II 22 February 2016 Taylor B. Arnold Yale Statstcs STAT 365/665 1/28 Notes: Problem 3 s posted and due ths upcomng Frday There was an early bug n the fake-test data; fxed
More informationChapter 2 - The Simple Linear Regression Model S =0. e i is a random error. S β2 β. This is a minimization problem. Solution is a calculus exercise.
Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where y + = β + β e for =,..., y and are observable varables e s a random error How can an estmaton rule be constructed for the
More informationChapter 5 Multilevel Models
Chapter 5 Multlevel Models 5.1 Cross-sectonal multlevel models 5.1.1 Two-level models 5.1.2 Multple level models 5.1.3 Multple level modelng n other felds 5.2 Longtudnal multlevel models 5.2.1 Two-level
More information1 Derivation of Rate Equations from Single-Cell Conductance (Hodgkin-Huxley-like) Equations
Physcs 171/271 -Davd Klenfeld - Fall 2005 (revsed Wnter 2011) 1 Dervaton of Rate Equatons from Sngle-Cell Conductance (Hodgkn-Huxley-lke) Equatons We consder a network of many neurons, each of whch obeys
More informationStructure and Drive Paul A. Jensen Copyright July 20, 2003
Structure and Drve Paul A. Jensen Copyrght July 20, 2003 A system s made up of several operatons wth flow passng between them. The structure of the system descrbes the flow paths from nputs to outputs.
More informationOne-sided finite-difference approximations suitable for use with Richardson extrapolation
Journal of Computatonal Physcs 219 (2006) 13 20 Short note One-sded fnte-dfference approxmatons sutable for use wth Rchardson extrapolaton Kumar Rahul, S.N. Bhattacharyya * Department of Mechancal Engneerng,
More information[ ] λ λ λ. Multicollinearity. multicollinearity Ragnar Frisch (1934) perfect exact. collinearity. multicollinearity. exact
Multcollnearty multcollnearty Ragnar Frsch (934 perfect exact collnearty multcollnearty K exact λ λ λ K K x+ x+ + x 0 0.. λ, λ, λk 0 0.. x perfect ntercorrelated λ λ λ x+ x+ + KxK + v 0 0.. v 3 y β + β
More informationModule 3: Element Properties Lecture 1: Natural Coordinates
Module 3: Element Propertes Lecture : Natural Coordnates Natural coordnate system s bascally a local coordnate system whch allows the specfcaton of a pont wthn the element by a set of dmensonless numbers
More informationLecture 12: Discrete Laplacian
Lecture 12: Dscrete Laplacan Scrbe: Tanye Lu Our goal s to come up wth a dscrete verson of Laplacan operator for trangulated surfaces, so that we can use t n practce to solve related problems We are mostly
More informationLecture Notes on Linear Regression
Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume
More informationProbability Theory (revisited)
Probablty Theory (revsted) Summary Probablty v.s. plausblty Random varables Smulaton of Random Experments Challenge The alarm of a shop rang. Soon afterwards, a man was seen runnng n the street, persecuted
More informationTransfer Functions. Convenient representation of a linear, dynamic model. A transfer function (TF) relates one input and one output: ( ) system
Transfer Functons Convenent representaton of a lnear, dynamc model. A transfer functon (TF) relates one nput and one output: x t X s y t system Y s The followng termnology s used: x y nput output forcng
More information9. Binary Dependent Variables
9. Bnar Dependent Varables 9. Homogeneous models Log, prob models Inference Tax preparers 9.2 Random effects models 9.3 Fxed effects models 9.4 Margnal models and GEE Appendx 9A - Lkelhood calculatons
More informationLectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix
Lectures - Week 4 Matrx norms, Condtonng, Vector Spaces, Lnear Independence, Spannng sets and Bass, Null space and Range of a Matrx Matrx Norms Now we turn to assocatng a number to each matrx. We could
More informationUnified Subspace Analysis for Face Recognition
Unfed Subspace Analyss for Face Recognton Xaogang Wang and Xaoou Tang Department of Informaton Engneerng The Chnese Unversty of Hong Kong Shatn, Hong Kong {xgwang, xtang}@e.cuhk.edu.hk Abstract PCA, LDA
More informationChat eld, C. and A.J.Collins, Introduction to multivariate analysis. Chapman & Hall, 1980
MT07: Multvarate Statstcal Methods Mke Tso: emal mke.tso@manchester.ac.uk Webpage for notes: http://www.maths.manchester.ac.uk/~mkt/new_teachng.htm. Introducton to multvarate data. Books Chat eld, C. and
More informationRELIABILITY ASSESSMENT
CHAPTER Rsk Analyss n Engneerng and Economcs RELIABILITY ASSESSMENT A. J. Clark School of Engneerng Department of Cvl and Envronmental Engneerng 4a CHAPMAN HALL/CRC Rsk Analyss for Engneerng Department
More information