To Estimate or to Predict
|
|
- Henry Hopkins
- 5 years ago
- Views:
Transcription
1 Raer Schwabe o Esmae or o Predc Implcaos o he esg or Lear Mxed Models
2 o Esmae or o Predc - Implcaos o he esg or Lear Mxed Models Raer Schwabe, Marya Prus raer.schwabe@ovgu.de suppored by SKAVOE Germa ederal Msry o Educao ad Research INI Cambrdge 0, AEW0 Augus 9, 0
3 Oule Prologue: Shor roduco. Model escrpo. Esmao ad Predco 3. Opmal esg 4. A Smple Example 5. Oulook
4 Prologue: Shor roduco Example: Pharmacokecs measure he cocerao o a drug s.o. s blood over me e e
5 Example: Pharmacokecs observaos j j j j esmae respose curve, AUC area uder he curve, c max maxmal cocerao ec. opmal me pos o measuremes,...,?
6 Radom coeces each dvdual has s ow curve populao parameers ypcal curve dvdual parameers dvdual curves
7 . Model escrpo lear mea respose j j j j radom error observao j=,..., explaaory varable j Var..d. j regresso ucos,..., p,..., p parameer
8 Bu! each dvdual has s ow respose curve = = ocodo degus = 3 = 4 dvdual resposes ollow a commo model
9 Herarchcal model dvdual level dvdual parameer j j j dvdual =,..., replcao j=,...,m explaaory varable j ~ error N 0, populao level populao parameer ~N p, depede
10 Idvdual observaoal vecor ε b ε ε I m Cov m m m dvdual desg marx b 0 b b Cov, E, dvdual eec
11 Idvdual covarace srucure ε b dvdual covarace marx m I Cov observaos are correlaed m m m I Cov e.g. radom ercep equal correlaos
12 Sgle group desgs all dvduals a he same expermeal segs m m Cov j ull observaoal vecor j I m V I b ε Cov I V
13 . Esmao ad Predco esmao o populao parameer ad populao respose uco predco o dvdual eecs b, dvdual parameers ad dvdual respose ucos
14 Esmao BLUE: bes lear ubased esmaor o populao parameer does o requre he kowledge o WLS=OLS BLUE: bes lear ubased esmaor o populao respose uco
15 Covarace o he esmaors Cov Var covarace decomposes addvely o» covarace he model whou radom eecs» dsperso o he dvdual parameer 0
16 Predco regular BLUP: bes lear ubased predcor o dvdual eec b b predcor o dvdual respose uco Hederso 959 predcor o dvdual parameer b OLS,
17 MSE o he predcors regular I,..., Cov Var MSE or predco: weghed average o» Bayesa covarace» covarace he model whou radom eecs
18 Predco regular, kow predcor o dvdual parameer MSE o he predcor I,..., Cov Gladz, Plz 98 MSE = Bayesa covarace
19 Predco geeral predcor o dvdual respose uco predcor o dvdual parameer,ols BLUP: bes lear ubased predcor o dvdual eec b b
20 MSE o he predcors geeral I,..., Cov Var MSE or predco: weghed average o» covarace he model whou radom eecs» ad
21 3. Opmal esg exac desg,..., am: choose,, rom desg rego o mmse Cov or Var resp. o mmse Cov esmao or Var predco
22 IMSE crero mmse he Iegraed Mea Squared Error or he respose uco d race d E esmao d race d E predco
23 IMSE crero or esmao d race d race lear cosa! opmal desgs or esmao he model whou radom eecs rema opmal or esmao he model wh radom eecs d race IMSE whou radom eecs
24 IMSE crero or predco lear d race d race d race IMSE whou radom eecs Bayesa IMSE IMSE or predco: weghed average o» Bayesa IMSE crero» IMSE crero he model whou radom eecs
25 Radom ercep radom blocks parallel dvdual curves j j j IMSE or predco m race cosa opmal desgs or esmao he model whou radom eecs rema opmal or predco he model wh radom eecs IMSE whou radom eecs d
26 4. A Smple example dvdual respose: smple lear regresso o =[0,] j j j 0 j dvdual parameer ~ N,, ~ N, depede dvdual curves guea owls = = = 3 = 4
27 IMSE opmal desgs opmal segs a = 0 or = m m» m observaos a = m m IMSE opmal proporos small m observaos a = small large predco / esmao m / m / m m m = 00, m =
28 Ececy ececy o he equ-replcaed desg m = m/.0 ececy = 00, m = 0 small Bayesa opmal desg m = m sgular ececy = 0
29 5. Oulook opmal desgs may deped o dsperso marx» may badly perorm, s msspeced» averaged or mmax crera oher crera, G are more sesve o predco o dvdual eecs b» may resul sgular desgs o-lear respose?...
30 hak you!
Chapter 8. Simple Linear Regression
Chaper 8. Smple Lear Regresso Regresso aalyss: regresso aalyss s a sascal mehodology o esmae he relaoshp of a respose varable o a se of predcor varable. whe here s jus oe predcor varable, we wll use smple
More informationFinal Exam Applied Econometrics
Fal Eam Appled Ecoomercs. 0 Sppose we have he followg regresso resl: Depede Varable: SAT Sample: 437 Iclded observaos: 437 Whe heeroskedasc-cosse sadard errors & covarace Varable Coeffce Sd. Error -Sasc
More informationUse of Non-Conventional Measures of Dispersion for Improved Estimation of Population Mean
Amerca Joural of Operaoal esearch 06 6(: 69-75 DOI: 0.59/.aor.06060.0 Use of o-coveoal Measures of Dsperso for Improve Esmao of Populao Mea ubhash Kumar aav.. Mshra * Alok Kumar hukla hak Kumar am agar
More informationθ = θ Π Π Parametric counting process models θ θ θ Log-likelihood: Consider counting processes: Score functions:
Paramerc coug process models Cosder coug processes: N,,..., ha cou he occurreces of a eve of eres for dvduals Iesy processes: Lelhood λ ( ;,,..., N { } λ < Log-lelhood: l( log L( Score fucos: U ( l( log
More informationDensity estimation. Density estimations. CS 2750 Machine Learning. Lecture 5. Milos Hauskrecht 5329 Sennott Square
Lecure 5 esy esmao Mlos Hauskrec mlos@cs..edu 539 Seo Square esy esmaos ocs: esy esmao: Mamum lkelood ML Bayesa arameer esmaes M Beroull dsrbuo. Bomal dsrbuo Mulomal dsrbuo Normal dsrbuo Eoeal famly Noaramerc
More informationRATIO ESTIMATORS USING CHARACTERISTICS OF POISSON DISTRIBUTION WITH APPLICATION TO EARTHQUAKE DATA
The 7 h Ieraoal as of Sascs ad Ecoomcs Prague Sepember 9-0 Absrac RATIO ESTIMATORS USING HARATERISTIS OF POISSON ISTRIBUTION WITH APPLIATION TO EARTHQUAKE ATA Gamze Özel Naural pulaos bolog geecs educao
More information(1) Cov(, ) E[( E( ))( E( ))]
Impac of Auocorrelao o OLS Esmaes ECON 3033/Evas Cosder a smple bvarae me-seres model of he form: y 0 x The four key assumpos abou ε hs model are ) E(ε ) = E[ε x ]=0 ) Var(ε ) =Var(ε x ) = ) Cov(ε, ε )
More informationLinear Regression Linear Regression with Shrinkage
Lear Regresso Lear Regresso h Shrkage Iroduco Regresso meas predcg a couous (usuall scalar oupu from a vecor of couous pus (feaures x. Example: Predcg vehcle fuel effcec (mpg from 8 arbues: Lear Regresso
More informationPubH 7440 Spring 2010 Midterm 2 April
ubh 7440 Sprg 00 Mderm Aprl roblem a: Because \hea^_ s a lear combao of ormal radom arables wll also be ormal. Thus he mea ad arace compleel characerze he dsrbuo. We also use ha he Z ad \hea^{-}_ are depede.
More informationAs evident from the full-sample-model, we continue to assume that individual errors are identically and
Maxmum Lkelhood smao Greee Ch.4; App. R scrp modsa, modsb If we feel safe makg assumpos o he sascal dsrbuo of he error erm, Maxmum Lkelhood smao (ML) s a aracve alerave o Leas Squares for lear regresso
More informationDensity estimation III. Linear regression.
Lecure 6 Mlos Hauskrec mlos@cs.p.eu 539 Seo Square Des esmao III. Lear regresso. Daa: Des esmao D { D D.. D} D a vecor of arbue values Obecve: r o esmae e uerlg rue probabl srbuo over varables X px usg
More informationEE 6885 Statistical Pattern Recognition
EE 6885 Sascal Paer Recogo Fall 005 Prof. Shh-Fu Chag hp://www.ee.columba.edu/~sfchag Lecure 5 (9//05 4- Readg Model Parameer Esmao ML Esmao, Chap. 3. Mure of Gaussa ad EM Referece Boo, HTF Chap. 8.5 Teboo,
More informationECON 482 / WH Hong The Simple Regression Model 1. Definition of the Simple Regression Model
ECON 48 / WH Hog The Smple Regresso Model. Defto of the Smple Regresso Model Smple Regresso Model Expla varable y terms of varable x y = β + β x+ u y : depedet varable, explaed varable, respose varable,
More informationDensity estimation III.
Lecure 6 esy esmao III. Mlos Hausrec mlos@cs..eu 539 Seo Square Oule Oule: esy esmao: Bomal srbuo Mulomal srbuo ormal srbuo Eoeal famly aa: esy esmao {.. } a vecor of arbue values Objecve: ry o esmae e
More informationChapter 3: Maximum-Likelihood & Bayesian Parameter Estimation (part 1)
Aoucemes Reags o E-reserves Proec roosal ue oay Parameer Esmao Bomercs CSE 9-a Lecure 6 CSE9a Fall 6 CSE9a Fall 6 Paer Classfcao Chaer 3: Mamum-Lelhoo & Bayesa Parameer Esmao ar All maerals hese sles were
More informationDr. Shalabh. Indian Institute of Technology Kanpur
Aalyss of Varace ad Desg of Expermets-I MODULE -I LECTURE - SOME RESULTS ON LINEAR ALGEBRA, MATRIX THEORY AND DISTRIBUTIONS Dr. Shalabh Departmet t of Mathematcs t ad Statstcs t t Ida Isttute of Techology
More informationDensity estimation III.
Lecure 4 esy esmao III. Mlos Hauskrec mlos@cs..edu 539 Seo Square Oule Oule: esy esmao: Mamum lkelood ML Bayesa arameer esmaes MP Beroull dsrbuo. Bomal dsrbuo Mulomal dsrbuo Normal dsrbuo Eoeal famly Eoeal
More informationReal-time Classification of Large Data Sets using Binary Knapsack
Real-me Classfcao of Large Daa Ses usg Bary Kapsack Reao Bru bru@ds.uroma. Uversy of Roma La Sapeza AIRO 004-35h ANNUAL CONFERENCE OF THE ITALIAN OPERATIONS RESEARCH Sepember 7-0, 004, Lecce, Ialy Oule
More informationDetermination of Antoine Equation Parameters. December 4, 2012 PreFEED Corporation Yoshio Kumagae. Introduction
refeed Soluos for R&D o Desg Deermao of oe Equao arameers Soluos for R&D o Desg December 4, 0 refeed orporao Yosho Kumagae refeed Iroduco hyscal propery daa s exremely mpora for performg process desg ad
More informationLecture 2: The Simple Regression Model
Lectre Notes o Advaced coometrcs Lectre : The Smple Regresso Model Takash Yamao Fall Semester 5 I ths lectre we revew the smple bvarate lear regresso model. We focs o statstcal assmptos to obta based estmators.
More informationAn Efficient Dual to Ratio and Product Estimator of Population Variance in Sample Surveys
"cece as True Here" Joural of Mahemacs ad ascal cece, Volume 06, 78-88 cece gpos Publshg A Effce Dual o Rao ad Produc Esmaor of Populao Varace ample urves ubhash Kumar Yadav Deparme of Mahemacs ad ascs
More information14. Poisson Processes
4. Posso Processes I Lecure 4 we roduced Posso arrvals as he lmg behavor of Bomal radom varables. Refer o Posso approxmao of Bomal radom varables. From he dscusso here see 4-6-4-8 Lecure 4 " arrvals occur
More informationIntroduction to Matrices and Matrix Approach to Simple Linear Regression
Itroducto to Matrces ad Matrx Approach to Smple Lear Regresso Matrces Defto: A matrx s a rectagular array of umbers or symbolc elemets I may applcatos, the rows of a matrx wll represet dvduals cases (people,
More informationEE 6885 Statistical Pattern Recognition
EE 6885 Sascal Paer Recogo Fall 005 Prof. Shh-Fu Chag hp://.ee.columba.edu/~sfchag Reve: Fal Exam (//005) Reve-Fal- Fal Exam Dec. 6 h Frday :0-3 pm, Mudd Rm 644 Reve Fal- Chap 5: Lear Dscrma Fucos Reve
More informationRegression Approach to Parameter Estimation of an Exponential Software Reliability Model
Amerca Joural of Theorecal ad Appled Sascs 06; 5(3): 80-86 hp://www.scecepublshggroup.com/j/ajas do: 0.648/j.ajas.060503. ISSN: 36-8999 (Pr); ISSN: 36-9006 (Ole) Regresso Approach o Parameer Esmao of a
More informationOther Topics in Kernel Method Statistical Inference with Reproducing Kernel Hilbert Space
Oher Topcs Kerel Mehod Sascal Iferece wh Reproducg Kerel Hlber Space Kej Fukumzu Isue of Sascal Mahemacs, ROIS Deparme of Sascal Scece, Graduae Uversy for Advaced Sudes Sepember 6, 008 / Sascal Learg Theory
More informationSolution set Stat 471/Spring 06. Homework 2
oluo se a 47/prg 06 Homework a Whe he upper ragular elemes are suppressed due o smmer b Le Y Y Y Y A weep o he frs colum o oba: A ˆ b chagg he oao eg ad ec YY weep o he secod colum o oba: Aˆ YY weep o
More informationEDUCATION COMMITTEE OF THE SOCIETY OF ACTUARIES ADVANCED TOPICS IN GENERAL INSURANCE STUDY NOTE CREDIBILITY WITH SHIFTING RISK PARAMETERS
EDUCATION COMMITTEE OF THE SOCIETY OF ACTUARIES ADVANCED TOPICS IN GENERAL INSURANCE STUDY NOTE CREDIBILITY WITH SHIFTING RISK PARAMETERS Suar Klugma, FSA, CERA, PhD Copyrgh 04 Socey of Acuares The Educao
More informationX X X E[ ] E X E X. is the ()m n where the ( i,)th. j element is the mean of the ( i,)th., then
Secto 5 Vectors of Radom Varables Whe workg wth several radom varables,,..., to arrage them vector form x, t s ofte coveet We ca the make use of matrx algebra to help us orgaze ad mapulate large umbers
More informationLearning of Graphical Models Parameter Estimation and Structure Learning
Learg of Grahal Models Parameer Esmao ad Sruure Learg e Fukumzu he Isue of Sasal Mahemas Comuaoal Mehodology Sasal Iferee II Work wh Grahal Models Deermg sruure Sruure gve by modelg d e.g. Mxure model
More informationThe Poisson Process Properties of the Poisson Process
Posso Processes Summary The Posso Process Properes of he Posso Process Ierarrval mes Memoryless propery ad he resdual lfeme paradox Superposo of Posso processes Radom seleco of Posso Pos Bulk Arrvals ad
More informationLeast Squares Fitting (LSQF) with a complicated function Theexampleswehavelookedatsofarhavebeenlinearintheparameters
Leas Squares Fg LSQF wh a complcaed fuco Theeampleswehavelookedasofarhavebeelearheparameers ha we have bee rg o deerme e.g. slope, ercep. For he case where he fuco s lear he parameers we ca fd a aalc soluo
More informationLecture 7. Confidence Intervals and Hypothesis Tests in the Simple CLR Model
Lecture 7. Cofdece Itervals ad Hypothess Tests the Smple CLR Model I lecture 6 we troduced the Classcal Lear Regresso (CLR) model that s the radom expermet of whch the data Y,,, K, are the outcomes. The
More informationThe algebraic immunity of a class of correlation immune H Boolean functions
Ieraoal Coferece o Advaced Elecroc Scece ad Techology (AEST 06) The algebrac mmuy of a class of correlao mmue H Boolea fucos a Jgla Huag ad Zhuo Wag School of Elecrcal Egeerg Norhwes Uversy for Naoales
More informationEE 6885 Statistical Pattern Recognition
EE 6885 Sascal Paer Recogo Fall 005 Prof. Shh-Fu Chag hp://.ee.columba.edu/~sfchag Lecure 8 (/8/05 8- Readg Feaure Dmeso Reduco PCA, ICA, LDA, Chaper 3.8, 0.3 ICA Tuoral: Fal Exam Aapo Hyväre ad Erkk Oja,
More informationFALL HOMEWORK NO. 6 - SOLUTION Problem 1.: Use the Storage-Indication Method to route the Input hydrograph tabulated below.
Jorge A. Ramírez HOMEWORK NO. 6 - SOLUTION Problem 1.: Use he Sorage-Idcao Mehod o roue he Ipu hydrograph abulaed below. Tme (h) Ipu Hydrograph (m 3 /s) Tme (h) Ipu Hydrograph (m 3 /s) 0 0 90 450 6 50
More informationLecture Notes Forecasting the process of estimating or predicting unknown situations
Lecture Notes. Ecoomc Forecastg. Forecastg the process of estmatg or predctg ukow stuatos Eample usuall ecoomsts predct future ecoomc varables Forecastg apples to a varet of data () tme seres data predctg
More informationThe Linear Regression Of Weighted Segments
The Lear Regresso Of Weghed Segmes George Dael Maeescu Absrac. We proposed a regresso model where he depede varable s made o up of pos bu segmes. Ths suao correspods o he markes hroughou he da are observed
More informationIMPROVED PORTFOLIO OPTIMIZATION MODEL WITH TRANSACTION COST AND MINIMAL TRANSACTION LOTS
Vol.7 No.4 (200) p73-78 Joural of Maageme Scece & Sascal Decso IMPROVED PORTFOLIO OPTIMIZATION MODEL WITH TRANSACTION COST AND MINIMAL TRANSACTION LOTS TIANXIANG YAO AND ZAIWU GONG College of Ecoomcs &
More informationForecasting Stock Prices Using a Hierarchical Bayesian Approach
Joural of Forecasg J. Forecas. 4, 39 59 (005) Publshed ole Wle IerScece (www.erscece.wle.com). DOI: 0.00/for.933 Forecasg Sock Prces Usg a Herarchcal Baesa Approach JUN YING, LYNN KUO * AND GIM S. SEOW
More informationSurvival Prediction Based on Compound Covariate under Cox Proportional Hazard Models
Ieraoal Bomerc Coferece 22/8/3, Kobe JAPAN Survval Predco Based o Compoud Covarae uder Co Proporoal Hazard Models PLoS ONE 7. do:.37/oural.poe.47627. hp://d.plos.org/.37/oural.poe.47627 Takesh Emura Graduae
More informationObjectives of Multiple Regression
Obectves of Multple Regresso Establsh the lear equato that best predcts values of a depedet varable Y usg more tha oe eplaator varable from a large set of potetal predctors {,,... k }. Fd that subset of
More informationOrdinary Least Squares Regression. Simple Regression. Algebra and Assumptions.
Ordary Least Squares egresso. Smple egresso. Algebra ad Assumptos. I ths part of the course we are gog to study a techque for aalysg the lear relatoshp betwee two varables Y ad X. We have pars of observatos
More informationEconometric Methods. Review of Estimation
Ecoometrc Methods Revew of Estmato Estmatg the populato mea Radom samplg Pot ad terval estmators Lear estmators Ubased estmators Lear Ubased Estmators (LUEs) Effcecy (mmum varace) ad Best Lear Ubased Estmators
More informationLecture 3 Topic 2: Distributions, hypothesis testing, and sample size determination
Lecure 3 Topc : Drbuo, hypohe eg, ad ample ze deermao The Sude - drbuo Coder a repeaed drawg of ample of ze from a ormal drbuo of mea. For each ample, compue,,, ad aoher ac,, where: The ac he devao of
More informationEconometrics. 3) Statistical properties of the OLS estimator
30C0000 Ecoometrcs 3) Statstcal propertes of the OLS estmator Tmo Kuosmae Professor, Ph.D. http://omepre.et/dex.php/tmokuosmae Today s topcs Whch assumptos are eeded for OLS to work? Statstcal propertes
More informationWu-Hausman Test: But if X and ε are independent, βˆ. ECON 324 Page 1
Wu-Hausma Test: Detectg Falure of E( ε X ) Caot drectly test ths assumpto because lack ubased estmator of ε ad the OLS resduals wll be orthogoal to X, by costructo as ca be see from the momet codto X'
More informationKRIGING METAMODELING IN DISCRETE-EVENT SIMULATION: AN OVERVIEW. Wim C.M. Van Beers
Proceedgs of he 5 Wer Smulao Coferece M. E. Kuhl, N. M. Seger, F. B. Armsrog, ad J. A. Joes, eds. KRIGING METAMODELING IN DISCRETE-EVENT SIMULATION: AN OVERVIEW Wm C.M. Deparme of Iformao Sysems ad Maageme
More informationQuantum Mechanics II Lecture 11 Time-dependent perturbation theory. Time-dependent perturbation theory (degenerate or non-degenerate starting state)
Pro. O. B. Wrgh, Auum Quaum Mechacs II Lecure Tme-depede perurbao heory Tme-depede perurbao heory (degeerae or o-degeerae sarg sae) Cosder a sgle parcle whch, s uperurbed codo wh Hamloa H, ca exs a superposo
More informationSection 2 Notes. Elizabeth Stone and Charles Wang. January 15, Expectation and Conditional Expectation of a Random Variable.
Secto Notes Elzabeth Stoe ad Charles Wag Jauar 5, 9 Jot, Margal, ad Codtoal Probablt Useful Rules/Propertes. P ( x) P P ( x; ) or R f (x; ) d. P ( xj ) P (x; ) P ( ) 3. P ( x; ) P ( xj ) P ( ) 4. Baes
More informationOLS bias for econometric models with errors-in-variables. The Lucas-critique Supplementary note to Lecture 17
OLS bias for ecoomeric models wih errors-i-variables. The Lucas-criique Supplemeary oe o Lecure 7 RNy May 6, 03 Properies of OLS i RE models I Lecure 7 we discussed he followig example of a raioal expecaios
More informationStatistics. Correlational. Dr. Ayman Eldeib. Simple Linear Regression and Correlation. SBE 304: Linear Regression & Correlation 1/3/2018
/3/08 Sstems & Bomedcal Egeerg Departmet SBE 304: Bo-Statstcs Smple Lear Regresso ad Correlato Dr. Ama Eldeb Fall 07 Descrptve Orgasg, summarsg & descrbg data Statstcs Correlatoal Relatoshps Iferetal Geeralsg
More informationAvailable online Journal of Scientific and Engineering Research, 2014, 1(1): Research Article
Avalable ole wwwjsaercom Joural o Scec ad Egeerg Research, 0, ():0-9 Research Arcle ISSN: 39-630 CODEN(USA): JSERBR NEW INFORMATION INEUALITIES ON DIFFERENCE OF GENERALIZED DIVERGENCES AND ITS APPLICATION
More informationSampling Theory MODULE V LECTURE - 14 RATIO AND PRODUCT METHODS OF ESTIMATION
Samplg Theor MODULE V LECTUE - 4 ATIO AND PODUCT METHODS OF ESTIMATION D. SHALABH DEPATMENT OF MATHEMATICS AND STATISTICS INDIAN INSTITUTE OF TECHNOLOG KANPU A mportat objectve a statstcal estmato procedure
More informationCOMPARISON OF ESTIMATORS OF PARAMETERS FOR THE RAYLEIGH DISTRIBUTION
COMPARISON OF ESTIMATORS OF PARAMETERS FOR THE RAYLEIGH DISTRIBUTION Eldesoky E. Affy. Faculy of Eg. Shbee El kom Meoufa Uv. Key word : Raylegh dsrbuo, leas squares mehod, relave leas squares, leas absolue
More informationTESTS BASED ON MAXIMUM LIKELIHOOD
ESE 5 Toy E. Smth. The Basc Example. TESTS BASED ON MAXIMUM LIKELIHOOD To llustrate the propertes of maxmum lkelhood estmates ad tests, we cosder the smplest possble case of estmatg the mea of the ormal
More informationSimple Linear Regression and Correlation.
Smple Lear Regresso ad Correlato. Correspods to Chapter 0 Tamhae ad Dulop Sldes prepared b Elzabeth Newto (MIT) wth some sldes b Jacquele Telford (Johs Hopks Uverst) Smple lear regresso aalss estmates
More informationSTATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS. x, where. = y - ˆ " 1
STATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS Recall Assumpto E(Y x) η 0 + η x (lear codtoal mea fucto) Data (x, y ), (x 2, y 2 ),, (x, y ) Least squares estmator ˆ E (Y x) ˆ " 0 + ˆ " x, where ˆ
More informationOptimal Eye Movement Strategies in Visual Search (Supplement)
Opmal Eye Moveme Sraeges Vsual Search (Suppleme) Jr Naemk ad Wlso S. Gesler Ceer for Percepual Sysems ad Deparme of Psychology, Uversy of exas a Aus, Aus X 787 Here we derve he deal searcher for he case
More information-distributed random variables consisting of n samples each. Determine the asymptotic confidence intervals for
Assgme Sepha Brumme Ocober 8h, 003 9 h semeser, 70544 PREFACE I 004, I ed o sped wo semesers o a sudy abroad as a posgraduae exchage sude a he Uversy of Techology Sydey, Ausrala. Each opporuy o ehace my
More informationREVISTA INVESTIGACIÓN OPERACIONAL VOL., 34, NO 1, 35-57, 2013
EVISTA INVESTIGAIÓN OEAIONAL VOL., 34, NO, 35-57, 03 ON SOME MODIFIED ATIO AND ODUT TE ESTIMATOS-EVISITED A K Swa Former rofessor of Sascs, Ual Uvers,Bhubaeswar-75004, Ida ABSTAT I hs paper dffere modfed
More information3/3/2014. CDS M Phil Econometrics. Heteroskedasticity is a problem where the error terms do not have a constant variance.
3/3/4 a Plla N OS Volao of Assmpos Assmpo of Sphercal Dsrbaces Var T T I Var O Cov, j, j,..., Therefore he reqreme for sphercal dsrbaces s ad j I O homoskedascy No aocorrelao Heeroskedascy: Defo Heeroscedascy
More informationε. Therefore, the estimate
Suggested Aswers, Problem Set 3 ECON 333 Da Hugerma. Ths s ot a very good dea. We kow from the secod FOC problem b) that ( ) SSE / = y x x = ( ) Whch ca be reduced to read y x x = ε x = ( ) The OLS model
More informationChapter 11 The Analysis of Variance
Chapter The Aalyss of Varace. Oe Factor Aalyss of Varace. Radomzed Bloc Desgs (ot for ths course) NIPRL . Oe Factor Aalyss of Varace.. Oe Factor Layouts (/4) Suppose that a expermeter s terested populatos
More informationTraining Sample Model: Given n observations, [[( Yi, x i the sample model can be expressed as (1) where, zero and variance σ
Stat 74 Estmato for Geeral Lear Model Prof. Goel Broad Outle Geeral Lear Model (GLM): Trag Samle Model: Gve observatos, [[( Y, x ), x = ( x,, xr )], =,,, the samle model ca be exressed as Y = µ ( x, x,,
More informationENGI 3423 Simple Linear Regression Page 12-01
ENGI 343 mple Lear Regresso Page - mple Lear Regresso ometmes a expermet s set up where the expermeter has cotrol over the values of oe or more varables X ad measures the resultg values of aother varable
More informationAnalyzing Two-Dimensional Data. Analyzing Two-Dimensional Data
/7/06 Aalzg Two-Dmesoal Data The most commo aaltcal measuremets volve the determato of a ukow cocetrato based o the respose of a aaltcal procedure (usuall strumetal). Such a measuremet requres calbrato,
More information{ }{ ( )} (, ) = ( ) ( ) ( ) Chapter 14 Exercises in Sampling Theory. Exercise 1 (Simple random sampling): Solution:
Chapter 4 Exercses Samplg Theory Exercse (Smple radom samplg: Let there be two correlated radom varables X ad A sample of sze s draw from a populato by smple radom samplg wthout replacemet The observed
More informationSpecial Instructions / Useful Data
JAM 6 Set of all real umbers P A..d. B, p Posso Specal Istructos / Useful Data x,, :,,, x x Probablty of a evet A Idepedetly ad detcally dstrbuted Bomal dstrbuto wth parameters ad p Posso dstrbuto wth
More informationECONOMETRIC THEORY. MODULE VIII Lecture - 26 Heteroskedasticity
ECONOMETRIC THEORY MODULE VIII Lecture - 6 Heteroskedastcty Dr. Shalabh Departmet of Mathematcs ad Statstcs Ida Isttute of Techology Kapur . Breusch Paga test Ths test ca be appled whe the replcated data
More informationMultiple Linear Regression Analysis
LINEA EGESSION ANALYSIS MODULE III Lecture - 4 Multple Lear egresso Aalyss Dr. Shalabh Departmet of Mathematcs ad Statstcs Ida Isttute of Techology Kapur Cofdece terval estmato The cofdece tervals multple
More informationInternational Journal Of Engineering And Computer Science ISSN: Volume 5 Issue 12 Dec. 2016, Page No.
www.jecs. Ieraoal Joural Of Egeerg Ad Compuer Scece ISSN: 19-74 Volume 5 Issue 1 Dec. 16, Page No. 196-1974 Sofware Relably Model whe mulple errors occur a a me cludg a faul correco process K. Harshchadra
More informationRAILWAY WHEELSET PARAMETER ESTIMATION USING SIGNALS FROM LATERAL VELOCITY SENSOR
IERAIOAL JOURAL O SMAR SESIG AD IELLIGE SYSEMS, VOL., O. 3, SEEMBER 8 RAILWAY WHEELSE ARAMEER ESIMAIO USIG SIGALS FROM LAERAL VELOCIY SESOR H. Seama, A. J. Am & Y. M. Sam Eecrca Egeerg Facu Uvers eoog
More informationLecture Note to Rice Chapter 8
ECON 430 HG revsed Nov 06 Lecture Note to Rce Chapter 8 Radom matrces Let Y, =,,, m, =,,, be radom varables (r.v. s). The matrx Y Y Y Y Y Y Y Y Y Y = m m m s called a radom matrx ( wth a ot m-dmesoal dstrbuto,
More informationRobustness Experiments with Two Variance Components
Naonal Insue of Sandards and Technology (NIST) Informaon Technology Laboraory (ITL) Sascal Engneerng Dvson (SED) Robusness Expermens wh Two Varance Componens by Ana Ivelsse Avlés avles@ns.gov Conference
More informationASYMPTOTIC EQUIVALENCE OF NONPARAMETRIC REGRESSION AND WHITE NOISE. BY LAWRENCE D. BROWN 1 AND MARK G. LOW 2 University of Pennsylvania
The Aals of Sascs 996, Vol., No. 6, 38398 ASYMPTOTIC EQUIVALENCE OF NONPARAMETRIC REGRESSION AND WITE NOISE BY LAWRENCE D. BROWN AND MARK G. LOW Uversy of Pesylvaa The prcpal resul s ha, uder codos, o
More informationComparison of the Bayesian and Maximum Likelihood Estimation for Weibull Distribution
Joural of Mahemacs ad Sascs 6 (2): 1-14, 21 ISSN 1549-3644 21 Scece Publcaos Comarso of he Bayesa ad Maxmum Lkelhood Esmao for Webull Dsrbuo Al Omar Mohammed Ahmed, Hadeel Salm Al-Kuub ad Noor Akma Ibrahm
More information8. Queueing systems lect08.ppt S Introduction to Teletraffic Theory - Fall
8. Queueg sysems lec8. S-38.45 - Iroduco o Teleraffc Theory - Fall 8. Queueg sysems Coes Refresher: Smle eleraffc model M/M/ server wag laces M/M/ servers wag laces 8. Queueg sysems Smle eleraffc model
More informationStructural Optimization Using Metamodels
Srucural Opmzaon Usng Meamodels 30 Mar. 007 Dep. o Mechancal Engneerng Dong-A Unvers Korea Kwon-Hee Lee Conens. Numercal Opmzaon. Opmzaon Usng Meamodels Impac beam desgn WB Door desgn 3. Robus Opmzaon
More informationSimple Linear Regression
Statstcal Methods I (EST 75) Page 139 Smple Lear Regresso Smple regresso applcatos are used to ft a model descrbg a lear relatoshp betwee two varables. The aspects of least squares regresso ad correlato
More informationGenerative classification models
CS 75 Mache Learg Lecture Geeratve classfcato models Mlos Hauskrecht mlos@cs.ptt.edu 539 Seott Square Data: D { d, d,.., d} d, Classfcato represets a dscrete class value Goal: lear f : X Y Bar classfcato
More informationPartial Molar Properties of solutions
Paral Molar Properes of soluos A soluo s a homogeeous mxure; ha s, a soluo s a oephase sysem wh more ha oe compoe. A homogeeous mxures of wo or more compoes he gas, lqud or sold phase The properes of a
More informationContinuous Time Markov Chains
Couous me Markov chas have seay sae probably soluos f a oly f hey are ergoc, us lke scree me Markov chas. Fg he seay sae probably vecor for a couous me Markov cha s o more ffcul ha s he scree me case,
More informationCyclone. Anti-cyclone
Adveco Cycloe A-cycloe Lorez (963) Low dmesoal aracors. Uclear f hey are a good aalogy o he rue clmae sysem, bu hey have some appealg characerscs. Dscusso Is he al codo balaced? Is here a al adjusme
More informationImputation Based on Local Linear Regression for Nonmonotone Nonrespondents in Longitudinal Surveys
Ope Joural of Sascs, 6, 6, 38-54 p://www.scrp.org/joural/ojs SSN Ole: 6-798 SSN Pr: 6-78X mpuao Based o Local Lear Regresso for Nomoooe Norespodes Logudal Surves Sara Pee, Carles K. Sego, Leo Odogo, George
More informationMachine Learning. Introduction to Regression. Lecture 3, September 19, Reading: Chap. 3, CB
ache Learg 0-70/5 70/5-78 78 all 006 Iroduco o Regresso Erc g Lecure 3 Sepember 9 006 Readg: Chap. 3 C Iferece wh he Jo Compue Codoals 0.4 0. P lu eadhead P lu eadhead P eadhead 0.7 0. 0.05 0.05 0.05 0.05
More informationLecture Notes 2. The ability to manipulate matrices is critical in economics.
Lecture Notes. Revew of Matrces he ablt to mapulate matrces s crtcal ecoomcs.. Matr a rectagular arra of umbers, parameters, or varables placed rows ad colums. Matrces are assocated wth lear equatos. lemets
More informationPanel Data Regression Models
Panel Daa Regresson Models Wha s Panel Daa? () Mulple dmensoned Dmensons, e.g., cross-secon and me node-o-node (c) Pongsa Pornchawseskul, Faculy of Economcs, Chulalongkorn Unversy (c) Pongsa Pornchawseskul,
More informationThe expected value of a sum of random variables,, is the sum of the expected values:
Sums of Radom Varables xpected Values ad Varaces of Sums ad Averages of Radom Varables The expected value of a sum of radom varables, say S, s the sum of the expected values: ( ) ( ) S Ths s always true
More informationDISTURBANCE TERMS. is a scalar and x i
DISTURBANCE TERMS I a feld of research desg, we ofte have the qesto abot whether there s a relatoshp betwee a observed varable (sa, ) ad the other observed varables (sa, x ). To aswer the qesto, we ma
More informationPricing of CDO s Based on the Multivariate Wang Transform*
Prcg of DO s Based o he Mulvarae Wag Trasform* ASTIN 2009 olloquum @ Helsk 02 Jue 2009 Masaak Kma Tokyo Meropola versy/ Kyoo versy Emal: kma@mu.ac.p hp://www.comp.mu.ac.p/kmam * Jo Work wh Sh-ch Moomya
More information( ) = ( ) ( ) Chapter 13 Asymptotic Theory and Stochastic Regressors. Stochastic regressors model
Chapter 3 Asmptotc Theor ad Stochastc Regressors The ature of eplaator varable s assumed to be o-stochastc or fed repeated samples a regresso aalss Such a assumpto s approprate for those epermets whch
More informationi 2 σ ) i = 1,2,...,n , and = 3.01 = 4.01
ECO 745, Homework 6 Le Cabrera. Assume that the followg data come from the lear model: ε ε ~ N, σ,,..., -6. -.5 7. 6.9 -. -. -.9. -..6.4.. -.6 -.7.7 Fd the mamum lkelhood estmates of,, ad σ ε s.6. 4. ε
More informationThe Optimal Combination Forecasting Based on ARIMA,VAR and SSM
Advaces Compuer, Sgals ad Sysems (206) : 3-7 Clausus Scefc Press, Caada The Opmal Combao Forecasg Based o ARIMA,VAR ad SSM Bebe Che,a, Mgya Jag,b* School of Iformao Scece ad Egeerg, Shadog Uversy, Ja,
More informationCONTROLLABILITY OF A CLASS OF SINGULAR SYSTEMS
44 Asa Joural o Corol Vol 8 No 4 pp 44-43 December 6 -re Paper- CONTROLLAILITY OF A CLASS OF SINGULAR SYSTEMS Guagmg Xe ad Log Wag ASTRACT I hs paper several dere coceps o corollably are vesgaed or a class
More informationChapter 3 Sampling For Proportions and Percentages
Chapter 3 Samplg For Proportos ad Percetages I may stuatos, the characterstc uder study o whch the observatos are collected are qualtatve ature For example, the resposes of customers may marketg surveys
More informationFundamentals of Speech Recognition Suggested Project The Hidden Markov Model
. Projec Iroduco Fudameals of Speech Recogo Suggesed Projec The Hdde Markov Model For hs projec, s proposed ha you desg ad mpleme a hdde Markov model (HMM) ha opmally maches he behavor of a se of rag sequeces
More informationLecture 6: Learning for Control (Generalised Linear Regression)
Lecure 6: Learnng for Conrol (Generalsed Lnear Regresson) Conens: Lnear Mehods for Regresson Leas Squares, Gauss Markov heorem Recursve Leas Squares Lecure 6: RLSC - Prof. Sehu Vjayakumar Lnear Regresson
More informationProbability and. Lecture 13: and Correlation
933 Probablty ad Statstcs for Software ad Kowledge Egeers Lecture 3: Smple Lear Regresso ad Correlato Mocha Soptkamo, Ph.D. Outle The Smple Lear Regresso Model (.) Fttg the Regresso Le (.) The Aalyss of
More informationChapter 14 Logistic Regression Models
Chapter 4 Logstc Regresso Models I the lear regresso model X β + ε, there are two types of varables explaatory varables X, X,, X k ad study varable y These varables ca be measured o a cotuous scale as
More information