To Estimate or to Predict

Size: px
Start display at page:

Download "To Estimate or to Predict"

Transcription

1 Raer Schwabe o Esmae or o Predc Implcaos o he esg or Lear Mxed Models

2 o Esmae or o Predc - Implcaos o he esg or Lear Mxed Models Raer Schwabe, Marya Prus raer.schwabe@ovgu.de suppored by SKAVOE Germa ederal Msry o Educao ad Research INI Cambrdge 0, AEW0 Augus 9, 0

3 Oule Prologue: Shor roduco. Model escrpo. Esmao ad Predco 3. Opmal esg 4. A Smple Example 5. Oulook

4 Prologue: Shor roduco Example: Pharmacokecs measure he cocerao o a drug s.o. s blood over me e e

5 Example: Pharmacokecs observaos j j j j esmae respose curve, AUC area uder he curve, c max maxmal cocerao ec. opmal me pos o measuremes,...,?

6 Radom coeces each dvdual has s ow curve populao parameers ypcal curve dvdual parameers dvdual curves

7 . Model escrpo lear mea respose j j j j radom error observao j=,..., explaaory varable j Var..d. j regresso ucos,..., p,..., p parameer

8 Bu! each dvdual has s ow respose curve = = ocodo degus = 3 = 4 dvdual resposes ollow a commo model

9 Herarchcal model dvdual level dvdual parameer j j j dvdual =,..., replcao j=,...,m explaaory varable j ~ error N 0, populao level populao parameer ~N p, depede

10 Idvdual observaoal vecor ε b ε ε I m Cov m m m dvdual desg marx b 0 b b Cov, E, dvdual eec

11 Idvdual covarace srucure ε b dvdual covarace marx m I Cov observaos are correlaed m m m I Cov e.g. radom ercep equal correlaos

12 Sgle group desgs all dvduals a he same expermeal segs m m Cov j ull observaoal vecor j I m V I b ε Cov I V

13 . Esmao ad Predco esmao o populao parameer ad populao respose uco predco o dvdual eecs b, dvdual parameers ad dvdual respose ucos

14 Esmao BLUE: bes lear ubased esmaor o populao parameer does o requre he kowledge o WLS=OLS BLUE: bes lear ubased esmaor o populao respose uco

15 Covarace o he esmaors Cov Var covarace decomposes addvely o» covarace he model whou radom eecs» dsperso o he dvdual parameer 0

16 Predco regular BLUP: bes lear ubased predcor o dvdual eec b b predcor o dvdual respose uco Hederso 959 predcor o dvdual parameer b OLS,

17 MSE o he predcors regular I,..., Cov Var MSE or predco: weghed average o» Bayesa covarace» covarace he model whou radom eecs

18 Predco regular, kow predcor o dvdual parameer MSE o he predcor I,..., Cov Gladz, Plz 98 MSE = Bayesa covarace

19 Predco geeral predcor o dvdual respose uco predcor o dvdual parameer,ols BLUP: bes lear ubased predcor o dvdual eec b b

20 MSE o he predcors geeral I,..., Cov Var MSE or predco: weghed average o» covarace he model whou radom eecs» ad

21 3. Opmal esg exac desg,..., am: choose,, rom desg rego o mmse Cov or Var resp. o mmse Cov esmao or Var predco

22 IMSE crero mmse he Iegraed Mea Squared Error or he respose uco d race d E esmao d race d E predco

23 IMSE crero or esmao d race d race lear cosa! opmal desgs or esmao he model whou radom eecs rema opmal or esmao he model wh radom eecs d race IMSE whou radom eecs

24 IMSE crero or predco lear d race d race d race IMSE whou radom eecs Bayesa IMSE IMSE or predco: weghed average o» Bayesa IMSE crero» IMSE crero he model whou radom eecs

25 Radom ercep radom blocks parallel dvdual curves j j j IMSE or predco m race cosa opmal desgs or esmao he model whou radom eecs rema opmal or predco he model wh radom eecs IMSE whou radom eecs d

26 4. A Smple example dvdual respose: smple lear regresso o =[0,] j j j 0 j dvdual parameer ~ N,, ~ N, depede dvdual curves guea owls = = = 3 = 4

27 IMSE opmal desgs opmal segs a = 0 or = m m» m observaos a = m m IMSE opmal proporos small m observaos a = small large predco / esmao m / m / m m m = 00, m =

28 Ececy ececy o he equ-replcaed desg m = m/.0 ececy = 00, m = 0 small Bayesa opmal desg m = m sgular ececy = 0

29 5. Oulook opmal desgs may deped o dsperso marx» may badly perorm, s msspeced» averaged or mmax crera oher crera, G are more sesve o predco o dvdual eecs b» may resul sgular desgs o-lear respose?...

30 hak you!

Chapter 8. Simple Linear Regression

Chapter 8. Simple Linear Regression Chaper 8. Smple Lear Regresso Regresso aalyss: regresso aalyss s a sascal mehodology o esmae he relaoshp of a respose varable o a se of predcor varable. whe here s jus oe predcor varable, we wll use smple

More information

Final Exam Applied Econometrics

Final Exam Applied Econometrics Fal Eam Appled Ecoomercs. 0 Sppose we have he followg regresso resl: Depede Varable: SAT Sample: 437 Iclded observaos: 437 Whe heeroskedasc-cosse sadard errors & covarace Varable Coeffce Sd. Error -Sasc

More information

Use of Non-Conventional Measures of Dispersion for Improved Estimation of Population Mean

Use of Non-Conventional Measures of Dispersion for Improved Estimation of Population Mean Amerca Joural of Operaoal esearch 06 6(: 69-75 DOI: 0.59/.aor.06060.0 Use of o-coveoal Measures of Dsperso for Improve Esmao of Populao Mea ubhash Kumar aav.. Mshra * Alok Kumar hukla hak Kumar am agar

More information

θ = θ Π Π Parametric counting process models θ θ θ Log-likelihood: Consider counting processes: Score functions:

θ = θ Π Π Parametric counting process models θ θ θ Log-likelihood: Consider counting processes: Score functions: Paramerc coug process models Cosder coug processes: N,,..., ha cou he occurreces of a eve of eres for dvduals Iesy processes: Lelhood λ ( ;,,..., N { } λ < Log-lelhood: l( log L( Score fucos: U ( l( log

More information

Density estimation. Density estimations. CS 2750 Machine Learning. Lecture 5. Milos Hauskrecht 5329 Sennott Square

Density estimation. Density estimations. CS 2750 Machine Learning. Lecture 5. Milos Hauskrecht 5329 Sennott Square Lecure 5 esy esmao Mlos Hauskrec mlos@cs..edu 539 Seo Square esy esmaos ocs: esy esmao: Mamum lkelood ML Bayesa arameer esmaes M Beroull dsrbuo. Bomal dsrbuo Mulomal dsrbuo Normal dsrbuo Eoeal famly Noaramerc

More information

RATIO ESTIMATORS USING CHARACTERISTICS OF POISSON DISTRIBUTION WITH APPLICATION TO EARTHQUAKE DATA

RATIO ESTIMATORS USING CHARACTERISTICS OF POISSON DISTRIBUTION WITH APPLICATION TO EARTHQUAKE DATA The 7 h Ieraoal as of Sascs ad Ecoomcs Prague Sepember 9-0 Absrac RATIO ESTIMATORS USING HARATERISTIS OF POISSON ISTRIBUTION WITH APPLIATION TO EARTHQUAKE ATA Gamze Özel Naural pulaos bolog geecs educao

More information

(1) Cov(, ) E[( E( ))( E( ))]

(1) Cov(, ) E[( E( ))( E( ))] Impac of Auocorrelao o OLS Esmaes ECON 3033/Evas Cosder a smple bvarae me-seres model of he form: y 0 x The four key assumpos abou ε hs model are ) E(ε ) = E[ε x ]=0 ) Var(ε ) =Var(ε x ) = ) Cov(ε, ε )

More information

Linear Regression Linear Regression with Shrinkage

Linear Regression Linear Regression with Shrinkage Lear Regresso Lear Regresso h Shrkage Iroduco Regresso meas predcg a couous (usuall scalar oupu from a vecor of couous pus (feaures x. Example: Predcg vehcle fuel effcec (mpg from 8 arbues: Lear Regresso

More information

PubH 7440 Spring 2010 Midterm 2 April

PubH 7440 Spring 2010 Midterm 2 April ubh 7440 Sprg 00 Mderm Aprl roblem a: Because \hea^_ s a lear combao of ormal radom arables wll also be ormal. Thus he mea ad arace compleel characerze he dsrbuo. We also use ha he Z ad \hea^{-}_ are depede.

More information

As evident from the full-sample-model, we continue to assume that individual errors are identically and

As evident from the full-sample-model, we continue to assume that individual errors are identically and Maxmum Lkelhood smao Greee Ch.4; App. R scrp modsa, modsb If we feel safe makg assumpos o he sascal dsrbuo of he error erm, Maxmum Lkelhood smao (ML) s a aracve alerave o Leas Squares for lear regresso

More information

Density estimation III. Linear regression.

Density estimation III. Linear regression. Lecure 6 Mlos Hauskrec mlos@cs.p.eu 539 Seo Square Des esmao III. Lear regresso. Daa: Des esmao D { D D.. D} D a vecor of arbue values Obecve: r o esmae e uerlg rue probabl srbuo over varables X px usg

More information

EE 6885 Statistical Pattern Recognition

EE 6885 Statistical Pattern Recognition EE 6885 Sascal Paer Recogo Fall 005 Prof. Shh-Fu Chag hp://www.ee.columba.edu/~sfchag Lecure 5 (9//05 4- Readg Model Parameer Esmao ML Esmao, Chap. 3. Mure of Gaussa ad EM Referece Boo, HTF Chap. 8.5 Teboo,

More information

ECON 482 / WH Hong The Simple Regression Model 1. Definition of the Simple Regression Model

ECON 482 / WH Hong The Simple Regression Model 1. Definition of the Simple Regression Model ECON 48 / WH Hog The Smple Regresso Model. Defto of the Smple Regresso Model Smple Regresso Model Expla varable y terms of varable x y = β + β x+ u y : depedet varable, explaed varable, respose varable,

More information

Density estimation III.

Density estimation III. Lecure 6 esy esmao III. Mlos Hausrec mlos@cs..eu 539 Seo Square Oule Oule: esy esmao: Bomal srbuo Mulomal srbuo ormal srbuo Eoeal famly aa: esy esmao {.. } a vecor of arbue values Objecve: ry o esmae e

More information

Chapter 3: Maximum-Likelihood & Bayesian Parameter Estimation (part 1)

Chapter 3: Maximum-Likelihood & Bayesian Parameter Estimation (part 1) Aoucemes Reags o E-reserves Proec roosal ue oay Parameer Esmao Bomercs CSE 9-a Lecure 6 CSE9a Fall 6 CSE9a Fall 6 Paer Classfcao Chaer 3: Mamum-Lelhoo & Bayesa Parameer Esmao ar All maerals hese sles were

More information

Dr. Shalabh. Indian Institute of Technology Kanpur

Dr. Shalabh. Indian Institute of Technology Kanpur Aalyss of Varace ad Desg of Expermets-I MODULE -I LECTURE - SOME RESULTS ON LINEAR ALGEBRA, MATRIX THEORY AND DISTRIBUTIONS Dr. Shalabh Departmet t of Mathematcs t ad Statstcs t t Ida Isttute of Techology

More information

Density estimation III.

Density estimation III. Lecure 4 esy esmao III. Mlos Hauskrec mlos@cs..edu 539 Seo Square Oule Oule: esy esmao: Mamum lkelood ML Bayesa arameer esmaes MP Beroull dsrbuo. Bomal dsrbuo Mulomal dsrbuo Normal dsrbuo Eoeal famly Eoeal

More information

Real-time Classification of Large Data Sets using Binary Knapsack

Real-time Classification of Large Data Sets using Binary Knapsack Real-me Classfcao of Large Daa Ses usg Bary Kapsack Reao Bru bru@ds.uroma. Uversy of Roma La Sapeza AIRO 004-35h ANNUAL CONFERENCE OF THE ITALIAN OPERATIONS RESEARCH Sepember 7-0, 004, Lecce, Ialy Oule

More information

Determination of Antoine Equation Parameters. December 4, 2012 PreFEED Corporation Yoshio Kumagae. Introduction

Determination of Antoine Equation Parameters. December 4, 2012 PreFEED Corporation Yoshio Kumagae. Introduction refeed Soluos for R&D o Desg Deermao of oe Equao arameers Soluos for R&D o Desg December 4, 0 refeed orporao Yosho Kumagae refeed Iroduco hyscal propery daa s exremely mpora for performg process desg ad

More information

Lecture 2: The Simple Regression Model

Lecture 2: The Simple Regression Model Lectre Notes o Advaced coometrcs Lectre : The Smple Regresso Model Takash Yamao Fall Semester 5 I ths lectre we revew the smple bvarate lear regresso model. We focs o statstcal assmptos to obta based estmators.

More information

An Efficient Dual to Ratio and Product Estimator of Population Variance in Sample Surveys

An Efficient Dual to Ratio and Product Estimator of Population Variance in Sample Surveys "cece as True Here" Joural of Mahemacs ad ascal cece, Volume 06, 78-88 cece gpos Publshg A Effce Dual o Rao ad Produc Esmaor of Populao Varace ample urves ubhash Kumar Yadav Deparme of Mahemacs ad ascs

More information

14. Poisson Processes

14. Poisson Processes 4. Posso Processes I Lecure 4 we roduced Posso arrvals as he lmg behavor of Bomal radom varables. Refer o Posso approxmao of Bomal radom varables. From he dscusso here see 4-6-4-8 Lecure 4 " arrvals occur

More information

Introduction to Matrices and Matrix Approach to Simple Linear Regression

Introduction to Matrices and Matrix Approach to Simple Linear Regression Itroducto to Matrces ad Matrx Approach to Smple Lear Regresso Matrces Defto: A matrx s a rectagular array of umbers or symbolc elemets I may applcatos, the rows of a matrx wll represet dvduals cases (people,

More information

EE 6885 Statistical Pattern Recognition

EE 6885 Statistical Pattern Recognition EE 6885 Sascal Paer Recogo Fall 005 Prof. Shh-Fu Chag hp://.ee.columba.edu/~sfchag Reve: Fal Exam (//005) Reve-Fal- Fal Exam Dec. 6 h Frday :0-3 pm, Mudd Rm 644 Reve Fal- Chap 5: Lear Dscrma Fucos Reve

More information

Regression Approach to Parameter Estimation of an Exponential Software Reliability Model

Regression Approach to Parameter Estimation of an Exponential Software Reliability Model Amerca Joural of Theorecal ad Appled Sascs 06; 5(3): 80-86 hp://www.scecepublshggroup.com/j/ajas do: 0.648/j.ajas.060503. ISSN: 36-8999 (Pr); ISSN: 36-9006 (Ole) Regresso Approach o Parameer Esmao of a

More information

Other Topics in Kernel Method Statistical Inference with Reproducing Kernel Hilbert Space

Other Topics in Kernel Method Statistical Inference with Reproducing Kernel Hilbert Space Oher Topcs Kerel Mehod Sascal Iferece wh Reproducg Kerel Hlber Space Kej Fukumzu Isue of Sascal Mahemacs, ROIS Deparme of Sascal Scece, Graduae Uversy for Advaced Sudes Sepember 6, 008 / Sascal Learg Theory

More information

Solution set Stat 471/Spring 06. Homework 2

Solution set Stat 471/Spring 06. Homework 2 oluo se a 47/prg 06 Homework a Whe he upper ragular elemes are suppressed due o smmer b Le Y Y Y Y A weep o he frs colum o oba: A ˆ b chagg he oao eg ad ec YY weep o he secod colum o oba: Aˆ YY weep o

More information

EDUCATION COMMITTEE OF THE SOCIETY OF ACTUARIES ADVANCED TOPICS IN GENERAL INSURANCE STUDY NOTE CREDIBILITY WITH SHIFTING RISK PARAMETERS

EDUCATION COMMITTEE OF THE SOCIETY OF ACTUARIES ADVANCED TOPICS IN GENERAL INSURANCE STUDY NOTE CREDIBILITY WITH SHIFTING RISK PARAMETERS EDUCATION COMMITTEE OF THE SOCIETY OF ACTUARIES ADVANCED TOPICS IN GENERAL INSURANCE STUDY NOTE CREDIBILITY WITH SHIFTING RISK PARAMETERS Suar Klugma, FSA, CERA, PhD Copyrgh 04 Socey of Acuares The Educao

More information

X X X E[ ] E X E X. is the ()m n where the ( i,)th. j element is the mean of the ( i,)th., then

X X X E[ ] E X E X. is the ()m n where the ( i,)th. j element is the mean of the ( i,)th., then Secto 5 Vectors of Radom Varables Whe workg wth several radom varables,,..., to arrage them vector form x, t s ofte coveet We ca the make use of matrx algebra to help us orgaze ad mapulate large umbers

More information

Learning of Graphical Models Parameter Estimation and Structure Learning

Learning of Graphical Models Parameter Estimation and Structure Learning Learg of Grahal Models Parameer Esmao ad Sruure Learg e Fukumzu he Isue of Sasal Mahemas Comuaoal Mehodology Sasal Iferee II Work wh Grahal Models Deermg sruure Sruure gve by modelg d e.g. Mxure model

More information

The Poisson Process Properties of the Poisson Process

The Poisson Process Properties of the Poisson Process Posso Processes Summary The Posso Process Properes of he Posso Process Ierarrval mes Memoryless propery ad he resdual lfeme paradox Superposo of Posso processes Radom seleco of Posso Pos Bulk Arrvals ad

More information

Least Squares Fitting (LSQF) with a complicated function Theexampleswehavelookedatsofarhavebeenlinearintheparameters

Least Squares Fitting (LSQF) with a complicated function Theexampleswehavelookedatsofarhavebeenlinearintheparameters Leas Squares Fg LSQF wh a complcaed fuco Theeampleswehavelookedasofarhavebeelearheparameers ha we have bee rg o deerme e.g. slope, ercep. For he case where he fuco s lear he parameers we ca fd a aalc soluo

More information

Lecture 7. Confidence Intervals and Hypothesis Tests in the Simple CLR Model

Lecture 7. Confidence Intervals and Hypothesis Tests in the Simple CLR Model Lecture 7. Cofdece Itervals ad Hypothess Tests the Smple CLR Model I lecture 6 we troduced the Classcal Lear Regresso (CLR) model that s the radom expermet of whch the data Y,,, K, are the outcomes. The

More information

The algebraic immunity of a class of correlation immune H Boolean functions

The algebraic immunity of a class of correlation immune H Boolean functions Ieraoal Coferece o Advaced Elecroc Scece ad Techology (AEST 06) The algebrac mmuy of a class of correlao mmue H Boolea fucos a Jgla Huag ad Zhuo Wag School of Elecrcal Egeerg Norhwes Uversy for Naoales

More information

EE 6885 Statistical Pattern Recognition

EE 6885 Statistical Pattern Recognition EE 6885 Sascal Paer Recogo Fall 005 Prof. Shh-Fu Chag hp://.ee.columba.edu/~sfchag Lecure 8 (/8/05 8- Readg Feaure Dmeso Reduco PCA, ICA, LDA, Chaper 3.8, 0.3 ICA Tuoral: Fal Exam Aapo Hyväre ad Erkk Oja,

More information

FALL HOMEWORK NO. 6 - SOLUTION Problem 1.: Use the Storage-Indication Method to route the Input hydrograph tabulated below.

FALL HOMEWORK NO. 6 - SOLUTION Problem 1.: Use the Storage-Indication Method to route the Input hydrograph tabulated below. Jorge A. Ramírez HOMEWORK NO. 6 - SOLUTION Problem 1.: Use he Sorage-Idcao Mehod o roue he Ipu hydrograph abulaed below. Tme (h) Ipu Hydrograph (m 3 /s) Tme (h) Ipu Hydrograph (m 3 /s) 0 0 90 450 6 50

More information

Lecture Notes Forecasting the process of estimating or predicting unknown situations

Lecture Notes Forecasting the process of estimating or predicting unknown situations Lecture Notes. Ecoomc Forecastg. Forecastg the process of estmatg or predctg ukow stuatos Eample usuall ecoomsts predct future ecoomc varables Forecastg apples to a varet of data () tme seres data predctg

More information

The Linear Regression Of Weighted Segments

The Linear Regression Of Weighted Segments The Lear Regresso Of Weghed Segmes George Dael Maeescu Absrac. We proposed a regresso model where he depede varable s made o up of pos bu segmes. Ths suao correspods o he markes hroughou he da are observed

More information

IMPROVED PORTFOLIO OPTIMIZATION MODEL WITH TRANSACTION COST AND MINIMAL TRANSACTION LOTS

IMPROVED PORTFOLIO OPTIMIZATION MODEL WITH TRANSACTION COST AND MINIMAL TRANSACTION LOTS Vol.7 No.4 (200) p73-78 Joural of Maageme Scece & Sascal Decso IMPROVED PORTFOLIO OPTIMIZATION MODEL WITH TRANSACTION COST AND MINIMAL TRANSACTION LOTS TIANXIANG YAO AND ZAIWU GONG College of Ecoomcs &

More information

Forecasting Stock Prices Using a Hierarchical Bayesian Approach

Forecasting Stock Prices Using a Hierarchical Bayesian Approach Joural of Forecasg J. Forecas. 4, 39 59 (005) Publshed ole Wle IerScece (www.erscece.wle.com). DOI: 0.00/for.933 Forecasg Sock Prces Usg a Herarchcal Baesa Approach JUN YING, LYNN KUO * AND GIM S. SEOW

More information

Survival Prediction Based on Compound Covariate under Cox Proportional Hazard Models

Survival Prediction Based on Compound Covariate under Cox Proportional Hazard Models Ieraoal Bomerc Coferece 22/8/3, Kobe JAPAN Survval Predco Based o Compoud Covarae uder Co Proporoal Hazard Models PLoS ONE 7. do:.37/oural.poe.47627. hp://d.plos.org/.37/oural.poe.47627 Takesh Emura Graduae

More information

Objectives of Multiple Regression

Objectives of Multiple Regression Obectves of Multple Regresso Establsh the lear equato that best predcts values of a depedet varable Y usg more tha oe eplaator varable from a large set of potetal predctors {,,... k }. Fd that subset of

More information

Ordinary Least Squares Regression. Simple Regression. Algebra and Assumptions.

Ordinary Least Squares Regression. Simple Regression. Algebra and Assumptions. Ordary Least Squares egresso. Smple egresso. Algebra ad Assumptos. I ths part of the course we are gog to study a techque for aalysg the lear relatoshp betwee two varables Y ad X. We have pars of observatos

More information

Econometric Methods. Review of Estimation

Econometric Methods. Review of Estimation Ecoometrc Methods Revew of Estmato Estmatg the populato mea Radom samplg Pot ad terval estmators Lear estmators Ubased estmators Lear Ubased Estmators (LUEs) Effcecy (mmum varace) ad Best Lear Ubased Estmators

More information

Lecture 3 Topic 2: Distributions, hypothesis testing, and sample size determination

Lecture 3 Topic 2: Distributions, hypothesis testing, and sample size determination Lecure 3 Topc : Drbuo, hypohe eg, ad ample ze deermao The Sude - drbuo Coder a repeaed drawg of ample of ze from a ormal drbuo of mea. For each ample, compue,,, ad aoher ac,, where: The ac he devao of

More information

Econometrics. 3) Statistical properties of the OLS estimator

Econometrics. 3) Statistical properties of the OLS estimator 30C0000 Ecoometrcs 3) Statstcal propertes of the OLS estmator Tmo Kuosmae Professor, Ph.D. http://omepre.et/dex.php/tmokuosmae Today s topcs Whch assumptos are eeded for OLS to work? Statstcal propertes

More information

Wu-Hausman Test: But if X and ε are independent, βˆ. ECON 324 Page 1

Wu-Hausman Test: But if X and ε are independent, βˆ. ECON 324 Page 1 Wu-Hausma Test: Detectg Falure of E( ε X ) Caot drectly test ths assumpto because lack ubased estmator of ε ad the OLS resduals wll be orthogoal to X, by costructo as ca be see from the momet codto X'

More information

KRIGING METAMODELING IN DISCRETE-EVENT SIMULATION: AN OVERVIEW. Wim C.M. Van Beers

KRIGING METAMODELING IN DISCRETE-EVENT SIMULATION: AN OVERVIEW. Wim C.M. Van Beers Proceedgs of he 5 Wer Smulao Coferece M. E. Kuhl, N. M. Seger, F. B. Armsrog, ad J. A. Joes, eds. KRIGING METAMODELING IN DISCRETE-EVENT SIMULATION: AN OVERVIEW Wm C.M. Deparme of Iformao Sysems ad Maageme

More information

Quantum Mechanics II Lecture 11 Time-dependent perturbation theory. Time-dependent perturbation theory (degenerate or non-degenerate starting state)

Quantum Mechanics II Lecture 11 Time-dependent perturbation theory. Time-dependent perturbation theory (degenerate or non-degenerate starting state) Pro. O. B. Wrgh, Auum Quaum Mechacs II Lecure Tme-depede perurbao heory Tme-depede perurbao heory (degeerae or o-degeerae sarg sae) Cosder a sgle parcle whch, s uperurbed codo wh Hamloa H, ca exs a superposo

More information

Section 2 Notes. Elizabeth Stone and Charles Wang. January 15, Expectation and Conditional Expectation of a Random Variable.

Section 2 Notes. Elizabeth Stone and Charles Wang. January 15, Expectation and Conditional Expectation of a Random Variable. Secto Notes Elzabeth Stoe ad Charles Wag Jauar 5, 9 Jot, Margal, ad Codtoal Probablt Useful Rules/Propertes. P ( x) P P ( x; ) or R f (x; ) d. P ( xj ) P (x; ) P ( ) 3. P ( x; ) P ( xj ) P ( ) 4. Baes

More information

OLS bias for econometric models with errors-in-variables. The Lucas-critique Supplementary note to Lecture 17

OLS bias for econometric models with errors-in-variables. The Lucas-critique Supplementary note to Lecture 17 OLS bias for ecoomeric models wih errors-i-variables. The Lucas-criique Supplemeary oe o Lecure 7 RNy May 6, 03 Properies of OLS i RE models I Lecure 7 we discussed he followig example of a raioal expecaios

More information

Statistics. Correlational. Dr. Ayman Eldeib. Simple Linear Regression and Correlation. SBE 304: Linear Regression & Correlation 1/3/2018

Statistics. Correlational. Dr. Ayman Eldeib. Simple Linear Regression and Correlation. SBE 304: Linear Regression & Correlation 1/3/2018 /3/08 Sstems & Bomedcal Egeerg Departmet SBE 304: Bo-Statstcs Smple Lear Regresso ad Correlato Dr. Ama Eldeb Fall 07 Descrptve Orgasg, summarsg & descrbg data Statstcs Correlatoal Relatoshps Iferetal Geeralsg

More information

Available online Journal of Scientific and Engineering Research, 2014, 1(1): Research Article

Available online  Journal of Scientific and Engineering Research, 2014, 1(1): Research Article Avalable ole wwwjsaercom Joural o Scec ad Egeerg Research, 0, ():0-9 Research Arcle ISSN: 39-630 CODEN(USA): JSERBR NEW INFORMATION INEUALITIES ON DIFFERENCE OF GENERALIZED DIVERGENCES AND ITS APPLICATION

More information

Sampling Theory MODULE V LECTURE - 14 RATIO AND PRODUCT METHODS OF ESTIMATION

Sampling Theory MODULE V LECTURE - 14 RATIO AND PRODUCT METHODS OF ESTIMATION Samplg Theor MODULE V LECTUE - 4 ATIO AND PODUCT METHODS OF ESTIMATION D. SHALABH DEPATMENT OF MATHEMATICS AND STATISTICS INDIAN INSTITUTE OF TECHNOLOG KANPU A mportat objectve a statstcal estmato procedure

More information

COMPARISON OF ESTIMATORS OF PARAMETERS FOR THE RAYLEIGH DISTRIBUTION

COMPARISON OF ESTIMATORS OF PARAMETERS FOR THE RAYLEIGH DISTRIBUTION COMPARISON OF ESTIMATORS OF PARAMETERS FOR THE RAYLEIGH DISTRIBUTION Eldesoky E. Affy. Faculy of Eg. Shbee El kom Meoufa Uv. Key word : Raylegh dsrbuo, leas squares mehod, relave leas squares, leas absolue

More information

TESTS BASED ON MAXIMUM LIKELIHOOD

TESTS BASED ON MAXIMUM LIKELIHOOD ESE 5 Toy E. Smth. The Basc Example. TESTS BASED ON MAXIMUM LIKELIHOOD To llustrate the propertes of maxmum lkelhood estmates ad tests, we cosder the smplest possble case of estmatg the mea of the ormal

More information

Simple Linear Regression and Correlation.

Simple Linear Regression and Correlation. Smple Lear Regresso ad Correlato. Correspods to Chapter 0 Tamhae ad Dulop Sldes prepared b Elzabeth Newto (MIT) wth some sldes b Jacquele Telford (Johs Hopks Uverst) Smple lear regresso aalss estmates

More information

STATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS. x, where. = y - ˆ " 1

STATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS. x, where. = y - ˆ  1 STATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS Recall Assumpto E(Y x) η 0 + η x (lear codtoal mea fucto) Data (x, y ), (x 2, y 2 ),, (x, y ) Least squares estmator ˆ E (Y x) ˆ " 0 + ˆ " x, where ˆ

More information

Optimal Eye Movement Strategies in Visual Search (Supplement)

Optimal Eye Movement Strategies in Visual Search (Supplement) Opmal Eye Moveme Sraeges Vsual Search (Suppleme) Jr Naemk ad Wlso S. Gesler Ceer for Percepual Sysems ad Deparme of Psychology, Uversy of exas a Aus, Aus X 787 Here we derve he deal searcher for he case

More information

-distributed random variables consisting of n samples each. Determine the asymptotic confidence intervals for

-distributed random variables consisting of n samples each. Determine the asymptotic confidence intervals for Assgme Sepha Brumme Ocober 8h, 003 9 h semeser, 70544 PREFACE I 004, I ed o sped wo semesers o a sudy abroad as a posgraduae exchage sude a he Uversy of Techology Sydey, Ausrala. Each opporuy o ehace my

More information

REVISTA INVESTIGACIÓN OPERACIONAL VOL., 34, NO 1, 35-57, 2013

REVISTA INVESTIGACIÓN OPERACIONAL VOL., 34, NO 1, 35-57, 2013 EVISTA INVESTIGAIÓN OEAIONAL VOL., 34, NO, 35-57, 03 ON SOME MODIFIED ATIO AND ODUT TE ESTIMATOS-EVISITED A K Swa Former rofessor of Sascs, Ual Uvers,Bhubaeswar-75004, Ida ABSTAT I hs paper dffere modfed

More information

3/3/2014. CDS M Phil Econometrics. Heteroskedasticity is a problem where the error terms do not have a constant variance.

3/3/2014. CDS M Phil Econometrics. Heteroskedasticity is a problem where the error terms do not have a constant variance. 3/3/4 a Plla N OS Volao of Assmpos Assmpo of Sphercal Dsrbaces Var T T I Var O Cov, j, j,..., Therefore he reqreme for sphercal dsrbaces s ad j I O homoskedascy No aocorrelao Heeroskedascy: Defo Heeroscedascy

More information

ε. Therefore, the estimate

ε. Therefore, the estimate Suggested Aswers, Problem Set 3 ECON 333 Da Hugerma. Ths s ot a very good dea. We kow from the secod FOC problem b) that ( ) SSE / = y x x = ( ) Whch ca be reduced to read y x x = ε x = ( ) The OLS model

More information

Chapter 11 The Analysis of Variance

Chapter 11 The Analysis of Variance Chapter The Aalyss of Varace. Oe Factor Aalyss of Varace. Radomzed Bloc Desgs (ot for ths course) NIPRL . Oe Factor Aalyss of Varace.. Oe Factor Layouts (/4) Suppose that a expermeter s terested populatos

More information

Training Sample Model: Given n observations, [[( Yi, x i the sample model can be expressed as (1) where, zero and variance σ

Training Sample Model: Given n observations, [[( Yi, x i the sample model can be expressed as (1) where, zero and variance σ Stat 74 Estmato for Geeral Lear Model Prof. Goel Broad Outle Geeral Lear Model (GLM): Trag Samle Model: Gve observatos, [[( Y, x ), x = ( x,, xr )], =,,, the samle model ca be exressed as Y = µ ( x, x,,

More information

ENGI 3423 Simple Linear Regression Page 12-01

ENGI 3423 Simple Linear Regression Page 12-01 ENGI 343 mple Lear Regresso Page - mple Lear Regresso ometmes a expermet s set up where the expermeter has cotrol over the values of oe or more varables X ad measures the resultg values of aother varable

More information

Analyzing Two-Dimensional Data. Analyzing Two-Dimensional Data

Analyzing Two-Dimensional Data. Analyzing Two-Dimensional Data /7/06 Aalzg Two-Dmesoal Data The most commo aaltcal measuremets volve the determato of a ukow cocetrato based o the respose of a aaltcal procedure (usuall strumetal). Such a measuremet requres calbrato,

More information

{ }{ ( )} (, ) = ( ) ( ) ( ) Chapter 14 Exercises in Sampling Theory. Exercise 1 (Simple random sampling): Solution:

{ }{ ( )} (, ) = ( ) ( ) ( ) Chapter 14 Exercises in Sampling Theory. Exercise 1 (Simple random sampling): Solution: Chapter 4 Exercses Samplg Theory Exercse (Smple radom samplg: Let there be two correlated radom varables X ad A sample of sze s draw from a populato by smple radom samplg wthout replacemet The observed

More information

Special Instructions / Useful Data

Special Instructions / Useful Data JAM 6 Set of all real umbers P A..d. B, p Posso Specal Istructos / Useful Data x,, :,,, x x Probablty of a evet A Idepedetly ad detcally dstrbuted Bomal dstrbuto wth parameters ad p Posso dstrbuto wth

More information

ECONOMETRIC THEORY. MODULE VIII Lecture - 26 Heteroskedasticity

ECONOMETRIC THEORY. MODULE VIII Lecture - 26 Heteroskedasticity ECONOMETRIC THEORY MODULE VIII Lecture - 6 Heteroskedastcty Dr. Shalabh Departmet of Mathematcs ad Statstcs Ida Isttute of Techology Kapur . Breusch Paga test Ths test ca be appled whe the replcated data

More information

Multiple Linear Regression Analysis

Multiple Linear Regression Analysis LINEA EGESSION ANALYSIS MODULE III Lecture - 4 Multple Lear egresso Aalyss Dr. Shalabh Departmet of Mathematcs ad Statstcs Ida Isttute of Techology Kapur Cofdece terval estmato The cofdece tervals multple

More information

International Journal Of Engineering And Computer Science ISSN: Volume 5 Issue 12 Dec. 2016, Page No.

International Journal Of Engineering And Computer Science ISSN: Volume 5 Issue 12 Dec. 2016, Page No. www.jecs. Ieraoal Joural Of Egeerg Ad Compuer Scece ISSN: 19-74 Volume 5 Issue 1 Dec. 16, Page No. 196-1974 Sofware Relably Model whe mulple errors occur a a me cludg a faul correco process K. Harshchadra

More information

RAILWAY WHEELSET PARAMETER ESTIMATION USING SIGNALS FROM LATERAL VELOCITY SENSOR

RAILWAY WHEELSET PARAMETER ESTIMATION USING SIGNALS FROM LATERAL VELOCITY SENSOR IERAIOAL JOURAL O SMAR SESIG AD IELLIGE SYSEMS, VOL., O. 3, SEEMBER 8 RAILWAY WHEELSE ARAMEER ESIMAIO USIG SIGALS FROM LAERAL VELOCIY SESOR H. Seama, A. J. Am & Y. M. Sam Eecrca Egeerg Facu Uvers eoog

More information

Lecture Note to Rice Chapter 8

Lecture Note to Rice Chapter 8 ECON 430 HG revsed Nov 06 Lecture Note to Rce Chapter 8 Radom matrces Let Y, =,,, m, =,,, be radom varables (r.v. s). The matrx Y Y Y Y Y Y Y Y Y Y = m m m s called a radom matrx ( wth a ot m-dmesoal dstrbuto,

More information

Robustness Experiments with Two Variance Components

Robustness Experiments with Two Variance Components Naonal Insue of Sandards and Technology (NIST) Informaon Technology Laboraory (ITL) Sascal Engneerng Dvson (SED) Robusness Expermens wh Two Varance Componens by Ana Ivelsse Avlés avles@ns.gov Conference

More information

ASYMPTOTIC EQUIVALENCE OF NONPARAMETRIC REGRESSION AND WHITE NOISE. BY LAWRENCE D. BROWN 1 AND MARK G. LOW 2 University of Pennsylvania

ASYMPTOTIC EQUIVALENCE OF NONPARAMETRIC REGRESSION AND WHITE NOISE. BY LAWRENCE D. BROWN 1 AND MARK G. LOW 2 University of Pennsylvania The Aals of Sascs 996, Vol., No. 6, 38398 ASYMPTOTIC EQUIVALENCE OF NONPARAMETRIC REGRESSION AND WITE NOISE BY LAWRENCE D. BROWN AND MARK G. LOW Uversy of Pesylvaa The prcpal resul s ha, uder codos, o

More information

Comparison of the Bayesian and Maximum Likelihood Estimation for Weibull Distribution

Comparison of the Bayesian and Maximum Likelihood Estimation for Weibull Distribution Joural of Mahemacs ad Sascs 6 (2): 1-14, 21 ISSN 1549-3644 21 Scece Publcaos Comarso of he Bayesa ad Maxmum Lkelhood Esmao for Webull Dsrbuo Al Omar Mohammed Ahmed, Hadeel Salm Al-Kuub ad Noor Akma Ibrahm

More information

8. Queueing systems lect08.ppt S Introduction to Teletraffic Theory - Fall

8. Queueing systems lect08.ppt S Introduction to Teletraffic Theory - Fall 8. Queueg sysems lec8. S-38.45 - Iroduco o Teleraffc Theory - Fall 8. Queueg sysems Coes Refresher: Smle eleraffc model M/M/ server wag laces M/M/ servers wag laces 8. Queueg sysems Smle eleraffc model

More information

Structural Optimization Using Metamodels

Structural Optimization Using Metamodels Srucural Opmzaon Usng Meamodels 30 Mar. 007 Dep. o Mechancal Engneerng Dong-A Unvers Korea Kwon-Hee Lee Conens. Numercal Opmzaon. Opmzaon Usng Meamodels Impac beam desgn WB Door desgn 3. Robus Opmzaon

More information

Simple Linear Regression

Simple Linear Regression Statstcal Methods I (EST 75) Page 139 Smple Lear Regresso Smple regresso applcatos are used to ft a model descrbg a lear relatoshp betwee two varables. The aspects of least squares regresso ad correlato

More information

Generative classification models

Generative classification models CS 75 Mache Learg Lecture Geeratve classfcato models Mlos Hauskrecht mlos@cs.ptt.edu 539 Seott Square Data: D { d, d,.., d} d, Classfcato represets a dscrete class value Goal: lear f : X Y Bar classfcato

More information

Partial Molar Properties of solutions

Partial Molar Properties of solutions Paral Molar Properes of soluos A soluo s a homogeeous mxure; ha s, a soluo s a oephase sysem wh more ha oe compoe. A homogeeous mxures of wo or more compoes he gas, lqud or sold phase The properes of a

More information

Continuous Time Markov Chains

Continuous Time Markov Chains Couous me Markov chas have seay sae probably soluos f a oly f hey are ergoc, us lke scree me Markov chas. Fg he seay sae probably vecor for a couous me Markov cha s o more ffcul ha s he scree me case,

More information

Cyclone. Anti-cyclone

Cyclone. Anti-cyclone Adveco Cycloe A-cycloe Lorez (963) Low dmesoal aracors. Uclear f hey are a good aalogy o he rue clmae sysem, bu hey have some appealg characerscs. Dscusso Is he al codo balaced? Is here a al adjusme

More information

Imputation Based on Local Linear Regression for Nonmonotone Nonrespondents in Longitudinal Surveys

Imputation Based on Local Linear Regression for Nonmonotone Nonrespondents in Longitudinal Surveys Ope Joural of Sascs, 6, 6, 38-54 p://www.scrp.org/joural/ojs SSN Ole: 6-798 SSN Pr: 6-78X mpuao Based o Local Lear Regresso for Nomoooe Norespodes Logudal Surves Sara Pee, Carles K. Sego, Leo Odogo, George

More information

Machine Learning. Introduction to Regression. Lecture 3, September 19, Reading: Chap. 3, CB

Machine Learning. Introduction to Regression. Lecture 3, September 19, Reading: Chap. 3, CB ache Learg 0-70/5 70/5-78 78 all 006 Iroduco o Regresso Erc g Lecure 3 Sepember 9 006 Readg: Chap. 3 C Iferece wh he Jo Compue Codoals 0.4 0. P lu eadhead P lu eadhead P eadhead 0.7 0. 0.05 0.05 0.05 0.05

More information

Lecture Notes 2. The ability to manipulate matrices is critical in economics.

Lecture Notes 2. The ability to manipulate matrices is critical in economics. Lecture Notes. Revew of Matrces he ablt to mapulate matrces s crtcal ecoomcs.. Matr a rectagular arra of umbers, parameters, or varables placed rows ad colums. Matrces are assocated wth lear equatos. lemets

More information

Panel Data Regression Models

Panel Data Regression Models Panel Daa Regresson Models Wha s Panel Daa? () Mulple dmensoned Dmensons, e.g., cross-secon and me node-o-node (c) Pongsa Pornchawseskul, Faculy of Economcs, Chulalongkorn Unversy (c) Pongsa Pornchawseskul,

More information

The expected value of a sum of random variables,, is the sum of the expected values:

The expected value of a sum of random variables,, is the sum of the expected values: Sums of Radom Varables xpected Values ad Varaces of Sums ad Averages of Radom Varables The expected value of a sum of radom varables, say S, s the sum of the expected values: ( ) ( ) S Ths s always true

More information

DISTURBANCE TERMS. is a scalar and x i

DISTURBANCE TERMS. is a scalar and x i DISTURBANCE TERMS I a feld of research desg, we ofte have the qesto abot whether there s a relatoshp betwee a observed varable (sa, ) ad the other observed varables (sa, x ). To aswer the qesto, we ma

More information

Pricing of CDO s Based on the Multivariate Wang Transform*

Pricing of CDO s Based on the Multivariate Wang Transform* Prcg of DO s Based o he Mulvarae Wag Trasform* ASTIN 2009 olloquum @ Helsk 02 Jue 2009 Masaak Kma Tokyo Meropola versy/ Kyoo versy Emal: kma@mu.ac.p hp://www.comp.mu.ac.p/kmam * Jo Work wh Sh-ch Moomya

More information

( ) = ( ) ( ) Chapter 13 Asymptotic Theory and Stochastic Regressors. Stochastic regressors model

( ) = ( ) ( ) Chapter 13 Asymptotic Theory and Stochastic Regressors. Stochastic regressors model Chapter 3 Asmptotc Theor ad Stochastc Regressors The ature of eplaator varable s assumed to be o-stochastc or fed repeated samples a regresso aalss Such a assumpto s approprate for those epermets whch

More information

i 2 σ ) i = 1,2,...,n , and = 3.01 = 4.01

i 2 σ ) i = 1,2,...,n , and = 3.01 = 4.01 ECO 745, Homework 6 Le Cabrera. Assume that the followg data come from the lear model: ε ε ~ N, σ,,..., -6. -.5 7. 6.9 -. -. -.9. -..6.4.. -.6 -.7.7 Fd the mamum lkelhood estmates of,, ad σ ε s.6. 4. ε

More information

The Optimal Combination Forecasting Based on ARIMA,VAR and SSM

The Optimal Combination Forecasting Based on ARIMA,VAR and SSM Advaces Compuer, Sgals ad Sysems (206) : 3-7 Clausus Scefc Press, Caada The Opmal Combao Forecasg Based o ARIMA,VAR ad SSM Bebe Che,a, Mgya Jag,b* School of Iformao Scece ad Egeerg, Shadog Uversy, Ja,

More information

CONTROLLABILITY OF A CLASS OF SINGULAR SYSTEMS

CONTROLLABILITY OF A CLASS OF SINGULAR SYSTEMS 44 Asa Joural o Corol Vol 8 No 4 pp 44-43 December 6 -re Paper- CONTROLLAILITY OF A CLASS OF SINGULAR SYSTEMS Guagmg Xe ad Log Wag ASTRACT I hs paper several dere coceps o corollably are vesgaed or a class

More information

Chapter 3 Sampling For Proportions and Percentages

Chapter 3 Sampling For Proportions and Percentages Chapter 3 Samplg For Proportos ad Percetages I may stuatos, the characterstc uder study o whch the observatos are collected are qualtatve ature For example, the resposes of customers may marketg surveys

More information

Fundamentals of Speech Recognition Suggested Project The Hidden Markov Model

Fundamentals of Speech Recognition Suggested Project The Hidden Markov Model . Projec Iroduco Fudameals of Speech Recogo Suggesed Projec The Hdde Markov Model For hs projec, s proposed ha you desg ad mpleme a hdde Markov model (HMM) ha opmally maches he behavor of a se of rag sequeces

More information

Lecture 6: Learning for Control (Generalised Linear Regression)

Lecture 6: Learning for Control (Generalised Linear Regression) Lecure 6: Learnng for Conrol (Generalsed Lnear Regresson) Conens: Lnear Mehods for Regresson Leas Squares, Gauss Markov heorem Recursve Leas Squares Lecure 6: RLSC - Prof. Sehu Vjayakumar Lnear Regresson

More information

Probability and. Lecture 13: and Correlation

Probability and. Lecture 13: and Correlation 933 Probablty ad Statstcs for Software ad Kowledge Egeers Lecture 3: Smple Lear Regresso ad Correlato Mocha Soptkamo, Ph.D. Outle The Smple Lear Regresso Model (.) Fttg the Regresso Le (.) The Aalyss of

More information

Chapter 14 Logistic Regression Models

Chapter 14 Logistic Regression Models Chapter 4 Logstc Regresso Models I the lear regresso model X β + ε, there are two types of varables explaatory varables X, X,, X k ad study varable y These varables ca be measured o a cotuous scale as

More information