( ) = ( ) ( ) Chapter 13 Asymptotic Theory and Stochastic Regressors. Stochastic regressors model
|
|
- Angel Stone
- 6 years ago
- Views:
Transcription
1 Chapter 3 Asmptotc Theor ad Stochastc Regressors The ature of eplaator varable s assumed to be o-stochastc or fed repeated samples a regresso aalss Such a assumpto s approprate for those epermets whch are coducted sde the laboratores where the epermeter ca cotrol the values of eplaator varables The the repeated observatos o stud varable ca be obtaed for fed values of eplaator varables I practce, such a assumpto ma ot alwas be satsfed Sometmes, the eplaator varables a gve model are the stud varable aother model Thus the stud varable depeds o the eplaator varables that are stochastc ature Uder such stuatos, the statstcal fereces draw from the lear regresso model based o the assumpto of fed eplaator varables ma ot rema vald We assume ow that the eplaator varables are stochastc but ucorrelated wth the dsturbace term I case, the are correlated the the ssue s addressed through strumetal varable estmato Such a stuato arses the case of measuremet error models Stochastc regressors model Cosder the lear regresso model Xβ + ε where X s a ( k matr of observatos o k eplaator varables X, X,, X k whch are stochastc ature, s a ( vector of observatos o stud varable, β s a ( k vector of regresso coeffcets ad ε s the ( vector of dsturbaces Uder the assumpto ( E( ε 0, V ε I, the dstrbuto of ε, codtoal o, satsf these propertes for all all values of X where deotes the th row of X Ths s demostrated as follows: Let p( ε be the codtoal probablt dest fucto of ε gve ad ( p ε s the ucodtoal probablt dest fucto of ε The ( ( p( d E ε ε p ε dε E 0 ε ε ε ( ε Ecoometrcs Chapter 3 Asmptotc Theor ad Stochastc Regressors Shalabh, IIT Kapur
2 ( ( p( d E ( ε E ε ε p ε dε ε ε ε I case, ε ad are depedet, the p( ε p( ε Least squares estmato of parameters The addtoal assumpto that the eplaator varables are stochastc poses o problem the ordar least squares estmato of β ad wth respect β as ( b X X X ad estmator of s obtaed as ( ( s Xb Xb k The OLSE of β s obtaed b mmzg ( Xβ ( Xβ Mamum lkelhood estmato of parameters: Assumg ~ N( 0, I ε the model Xβ + ε alog wth X s stochastc ad depedet of ε, the jot probablt dest fucto ε ad X ca be derved from the jot probablt dest fucto of ad X as follows: ( ε, ( ε, ε,, ε,,,, f X f ( ε ( f f ( ( f f ( f ( f ( f (, (,,,,,,, f f ( X, Ecoometrcs Chapter 3 Asmptotc Theor ad Stochastc Regressors Shalabh, IIT Kapur
3 Ths mples that the mamum lkelhood estmators of β ad f ( f ( ε so the wll be same as based o the assumpto that s,,,, mamum lkelhood estmators of β ( X X X ( X ( X β β β ad wll be based o ε are dstrbuted as ( N 0, So the whe the eplaator varables are stochastc are obtaed as Alteratve approach for dervg the mamum lkelhood estmates Alteratvel, the mamum lkelhood estmators of β ad probablt dest fucto of ad X ca also be derved usg the jot Note: Note that the vector ( k whch ecludes the tercept term s represeted b a uderscore ths secto to deote that t s order s Let,,,, are from a multvarate ormal dstrbuto wth mea vector µ ad covarace matr Σ, e, ~ (, N µ Σ ad the jot dstrbuto of ad µ Σ ~ N, µ Σ Σ s Let the lear regresso model s where ( β0 + β + ε,,,, s a ( k vector of observato of radom vector, β 0 s the tercept term ad β s the k vector of regresso coeffcets Further depedet of ε s dsturbace term wth ~ N ( 0, ε ad s Ecoometrcs Chapter 3 Asmptotc Theor ad Stochastc Regressors Shalabh, IIT Kapur 3
4 Suppose µ Σ ~ N, µ Σ Σ The jot probablt dest fucto of (, f µ µ, ep k Σ µ µ ( ( π Now usg the followg result, we fd based o radom sample of sze s Σ Σ : Result: Let A be a osgular matr whch parttoed sutabl as B C A, D E where E ad F B CE D are osgular matrces, the A F F CE E DF E + E DF CE Note that Thus AA A A I where Σ Σ Σ ΣΣ Σ +Σ ΣΣΣ Σ Σ Σ, The ( π { ( ( ( } µ µ µ µ f(, ep k Σ Σ + Σ Σ The margal dstrbuto of ( k varate multvarate ormal dstrbuto as ( π s obtaed b tegratg f(, over ad the resultg dstrbuto s g( ep ( µ ( µ k Σ Σ Ecoometrcs Chapter 3 Asmptotc Theor ad Stochastc Regressors Shalabh, IIT Kapur 4
5 The codtoal probablt dest fucto of gve f ( f (, ( g s {( ( } µ µ ep Σ Σ π whch s the probablt dest fucto of ormal dstrbuto wth where codtoal mea ( E( µ + µ Σ Σ ad codtoal varace ( ( Var ρ Σ Σ Σ ρ s the populato multple correlato coeffcet I the model β + β + ε, 0 the codtoal mea s ( β0 + β+ ( ε E E β + β 0 Comparg ths codtoal mea wth the codtoal mea of ormal dstrbuto, we obta the relatoshp wth β 0 ad β as follows: β Σ Σ β µ µβ 0 The lkelhood fucto of (, based o a sample of sze s µ µ L ep k Σ ( µ µ π Σ Mamzg the log lkelhood fucto wth respect to µ, µ, Σ ad Σ, the mamum lkelhood estmates of respectve parameters are obtaed as Ecoometrcs Chapter 3 Asmptotc Theor ad Stochastc Regressors Shalabh, IIT Kapur 5
6 µ µ (,,, 3 k Σ S Σ S where (, 3,, k, S s [( k- ( k-] matr wth elemets ( t ( tj j ad S s t [( k- ] vector wth elemets ( t ( t Based o these estmates, the mamum lkelhood estmators of β ad β 0 are obtaed as β S S β β β 0 β β 0 ( X X X Propertes of the estmators of least squares estmator: The estmato error of OLSE ( ( ( X X X ( X ( X X b β X X X β β + ε β X ε The assumg that ( b X X X of β s E X X X ests, we have ( ε {( ε } Eb ( β E X X X because ( X X E E X X X X 0 ( ( ε E X X X E X ad ε are depedet So b s a ubased estmator of β Ecoometrcs Chapter 3 Asmptotc Theor ad Stochastc Regressors Shalabh, IIT Kapur 6
7 The covarace matr of b s obtaed as ( ( β( β V b E b b E ( X X X εε X ( X X E E{ ( X X X εε X ( X X X} E ( X X X E( εε X ( X X X E ( X X X X ( X X E ( X X Thus the covarace matr volves a mathematcal epectato The ukow ee ˆ k ( Xb ( Xb k where e Xb s the resdual ad ( ˆ ( ˆ E E E X ee E E X k E ( Note that the OLSE ( ca be estmated b b X X X volves the stochastc matr X ad stochastc vector, so b s ot a lear estmator It s also o more the best lear ubased estmator of β as the case whe X s ostochastc The estmator of as beg codtoal o gve X s a effcet estmator Asmptotc theor: The asmptotc propertes of a estmator cocers the propertes of the estmator whe sample sze grows large For the eed ad uderstadg of asmptotc theor, we cosder a eample Cosder the smple lear regresso model wth oe eplaator varable ad observatos as ( ( β0 + β + ε, E ε 0, Var ε,,,, Ecoometrcs Chapter 3 Asmptotc Theor ad Stochastc Regressors Shalabh, IIT Kapur 7
8 The OLSE of β s b ( ( ad ts varace s ( Var ( b If the sample sze grows large, the the varace of b gets smaller The shrkage varace mples that as sample sze creases, the probablt dest of OLSE b collapses aroud ts mea because Var( b becomes zero Let there are three OLSEs b, b ad b 3 whch are based o sample szes, ad 3 respectvel such that < < sa If c ad δ are some arbtrarl chose postve costats, the the probablt that the 3, value of b les wth the terval β ± c ca be made to be greater tha ( δ for a large value of Ths propert s the cosstec of b whch esure that eve f the sample s ver large, the we ca be cofdet wth hgh probablt that b wll eld a estmate that s close to β Probablt lmt Let ˆ β be a estmator of β based o a sample of sze Let γ be a small postve costat The for large, the requremet that b takes values wth probablt almost oe a arbtrar small eghborhood of the true parameter value β s lm P ˆ β β < γ whch s deoted as plm ˆ β β ad t s sad that ˆ β coverges to β probablt The estmator ˆ β s sad to be a cosstet estmator of β A suffcet but ot ecessar codto for ˆ β to be a cosstet estmator of β s that ad lm E ˆ β β lm Var ˆ β 0 Ecoometrcs Chapter 3 Asmptotc Theor ad Stochastc Regressors Shalabh, IIT Kapur 8
9 Cosstec of estmators Now we look at the cosstec of the estmators of β ad ( Cosstec of b Uder the assumpto that X X lm ests as a ostochastc ad osgular matr (wth fte elemets, we have X X lm Vb ( lm lm 0 Ths mples that OLSE coverges to β quadratc mea Thus OLSE s a cosstet estmator of β Ths also holds true for mamum lkelhood estmators also Same cocluso ca also be proved usg the cocept of covergece probablt The cosstec of OLSE ca be obtaed uder the weaker assumpto that X X plm ests ad s a osgular ad ostochastc matr ad Sce So X ε plm 0 b β ( X X X ε X X X ε X X X ε plm( b β plm plm 0 0 Thus b s a cosstet estmator of β The same s true for mamum lkelhood estmators also Ecoometrcs Chapter 3 Asmptotc Theor ad Stochastc Regressors Shalabh, IIT Kapur 9
10 ( Cosstec of s Now we look at the cosstec of s ee k ε Hε k s as a estmate of k ( X X X X εεε ε We have k εε ε X X X X ε εε Note that cossts of ε ad { ε,,,, } s a sequece of depedetl ad detcall dstrbuted radom varables wth mea Thus εε plm Usg the law of large umbers ε X X X X ε εx X X X ε plm plm plm plm s plm( ( 0 0 s s a cosstet estmator of The same holds true for mamum lkelhood estmates also Asmptotc dstrbutos: Suppose we have a sequece of radom varables { α } wth a correspodg sequece of cumulatve dest fuctos { F } for a radom varable α wth cumulatve dest fucto F The α coverges dstrbuto to α f F coverges to F pot wse I ths case, F s called the asmptotc dstrbuto of α Note that sce covergece probablt mples the covergece dstrbuto, so D plm α α α α ( α ted to α dstrbuto, e, the asmptotc dstrbuto of whch s the dstrbuto of α Ecoometrcs Chapter 3 Asmptotc Theor ad Stochastc Regressors Shalabh, IIT Kapur α s F 0
11 Note that E ( α : Mea of asmptotc dstrbuto Var( α : Varace of asmptotc dstrbuto lm E( α : Asmptotc mea lm E α lm E( α : Asmptotc varace Asmptotc dstrbuto of sample mea ad least squares estmato Let α be the sample mea based o a sample of sze Sce sample mea s a cosstet estmator of populato mea, so plm whch s costat Thus the asmptotc dstrbuto of s the dstrbuto of a costat Ths s ot a regular dstrbuto as all the probablt mass s cocetrated at oe pot Thus as sample sze creases, the dstrbuto of collapses Suppose cosder ol the oe thrd observatos the sample ad fd sample mea as 3 3 The E( ad Var as 3 ( Var ( Ecoometrcs Chapter 3 Asmptotc Theor ad Stochastc Regressors Shalabh, IIT Kapur
12 Thus plm ad has the same degeerate dstrbuto as Sce Var ( Var ( >, so s preferred over Now we observe the asmptotc behavour of ad Cosder a sequece of radom varables { α } Thus for all, we have α α ( ( ( α ( ( α ( E E 0 E E 0 Var ( α E ( 3 Var ( α E ( 3 Assumg the populato to be ormal, the asmptotc dstrbuto of s N( 0, s ( 0,3 N So ow s preferable over The cetral lmt theorem ca be used to show that asmptotcall ormal dstrbuto eve f the populato s ot ormall dstrbuted α wll have a Also, sce Z ( ~ ( 0, ( N ( ~ N 0, ad ths statemet holds true fte sample as well as asmptotc dstrbutos Cosder the ordar least squares estmate ( Xβ + ε If X s ostochastc the the fte covarace matr of b s Vb ( ( X X b X X X of β lear regresso model Ecoometrcs Chapter 3 Asmptotc Theor ad Stochastc Regressors Shalabh, IIT Kapur
13 The asmptotc covarace matr of b uder the assumpto that lm X X Σ ests ad s osgular It s gve b X X lm ( X X lm lm 0 Σ 0 whch s a ull matr Cosder the asmptotc dstrbuto of ( b β the asmptotcall ( β ~ N( 0, Σ b ( β Σ ( b β b χ ~ k The eve f ε s ot ecessarl ormall dstrbuted, If X X s cosdered as a estmator of Σ, the X X ( β ( bβ ( bβ X X ( bβ b ( s the usual test statstc as s the case of fte samples wth b N β ( X X ~, Ecoometrcs Chapter 3 Asmptotc Theor ad Stochastc Regressors Shalabh, IIT Kapur 3
ECONOMETRIC THEORY. MODULE VIII Lecture - 26 Heteroskedasticity
ECONOMETRIC THEORY MODULE VIII Lecture - 6 Heteroskedastcty Dr. Shalabh Departmet of Mathematcs ad Statstcs Ida Isttute of Techology Kapur . Breusch Paga test Ths test ca be appled whe the replcated data
More informationEconometrics. 3) Statistical properties of the OLS estimator
30C0000 Ecoometrcs 3) Statstcal propertes of the OLS estmator Tmo Kuosmae Professor, Ph.D. http://omepre.et/dex.php/tmokuosmae Today s topcs Whch assumptos are eeded for OLS to work? Statstcal propertes
More informationLecture 7. Confidence Intervals and Hypothesis Tests in the Simple CLR Model
Lecture 7. Cofdece Itervals ad Hypothess Tests the Smple CLR Model I lecture 6 we troduced the Classcal Lear Regresso (CLR) model that s the radom expermet of whch the data Y,,, K, are the outcomes. The
More informationUNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS
UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS Exam: ECON430 Statstcs Date of exam: Frday, December 8, 07 Grades are gve: Jauary 4, 08 Tme for exam: 0900 am 00 oo The problem set covers 5 pages Resources allowed:
More informationChapter 5 Properties of a Random Sample
Lecture 6 o BST 63: Statstcal Theory I Ku Zhag, /0/008 Revew for the prevous lecture Cocepts: t-dstrbuto, F-dstrbuto Theorems: Dstrbutos of sample mea ad sample varace, relatoshp betwee sample mea ad sample
More informationEconometric Methods. Review of Estimation
Ecoometrc Methods Revew of Estmato Estmatg the populato mea Radom samplg Pot ad terval estmators Lear estmators Ubased estmators Lear Ubased Estmators (LUEs) Effcecy (mmum varace) ad Best Lear Ubased Estmators
More informationENGI 4421 Joint Probability Distributions Page Joint Probability Distributions [Navidi sections 2.5 and 2.6; Devore sections
ENGI 441 Jot Probablty Dstrbutos Page 7-01 Jot Probablty Dstrbutos [Navd sectos.5 ad.6; Devore sectos 5.1-5.] The jot probablty mass fucto of two dscrete radom quattes, s, P ad p x y x y The margal probablty
More informationSummary of the lecture in Biostatistics
Summary of the lecture Bostatstcs Probablty Desty Fucto For a cotuos radom varable, a probablty desty fucto s a fucto such that: 0 dx a b) b a dx A probablty desty fucto provdes a smple descrpto of the
More informationMultiple Linear Regression Analysis
LINEA EGESSION ANALYSIS MODULE III Lecture - 4 Multple Lear egresso Aalyss Dr. Shalabh Departmet of Mathematcs ad Statstcs Ida Isttute of Techology Kapur Cofdece terval estmato The cofdece tervals multple
More informationX X X E[ ] E X E X. is the ()m n where the ( i,)th. j element is the mean of the ( i,)th., then
Secto 5 Vectors of Radom Varables Whe workg wth several radom varables,,..., to arrage them vector form x, t s ofte coveet We ca the make use of matrx algebra to help us orgaze ad mapulate large umbers
More informationDISTURBANCE TERMS. is a scalar and x i
DISTURBANCE TERMS I a feld of research desg, we ofte have the qesto abot whether there s a relatoshp betwee a observed varable (sa, ) ad the other observed varables (sa, x ). To aswer the qesto, we ma
More informationLecture Notes 2. The ability to manipulate matrices is critical in economics.
Lecture Notes. Revew of Matrces he ablt to mapulate matrces s crtcal ecoomcs.. Matr a rectagular arra of umbers, parameters, or varables placed rows ad colums. Matrces are assocated wth lear equatos. lemets
More informationSTATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS. x, where. = y - ˆ " 1
STATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS Recall Assumpto E(Y x) η 0 + η x (lear codtoal mea fucto) Data (x, y ), (x 2, y 2 ),, (x, y ) Least squares estmator ˆ E (Y x) ˆ " 0 + ˆ " x, where ˆ
More information4. Standard Regression Model and Spatial Dependence Tests
4. Stadard Regresso Model ad Spatal Depedece Tests Stadard regresso aalss fals the presece of spatal effects. I case of spatal depedeces ad/or spatal heterogeet a stadard regresso model wll be msspecfed.
More informationDr. Shalabh. Indian Institute of Technology Kanpur
Aalyss of Varace ad Desg of Expermets-I MODULE -I LECTURE - SOME RESULTS ON LINEAR ALGEBRA, MATRIX THEORY AND DISTRIBUTIONS Dr. Shalabh Departmet t of Mathematcs t ad Statstcs t t Ida Isttute of Techology
More information{ }{ ( )} (, ) = ( ) ( ) ( ) Chapter 14 Exercises in Sampling Theory. Exercise 1 (Simple random sampling): Solution:
Chapter 4 Exercses Samplg Theory Exercse (Smple radom samplg: Let there be two correlated radom varables X ad A sample of sze s draw from a populato by smple radom samplg wthout replacemet The observed
More informationLinear Regression with One Regressor
Lear Regresso wth Oe Regressor AIM QA.7. Expla how regresso aalyss ecoometrcs measures the relatoshp betwee depedet ad depedet varables. A regresso aalyss has the goal of measurg how chages oe varable,
More informationSpecial Instructions / Useful Data
JAM 6 Set of all real umbers P A..d. B, p Posso Specal Istructos / Useful Data x,, :,,, x x Probablty of a evet A Idepedetly ad detcally dstrbuted Bomal dstrbuto wth parameters ad p Posso dstrbuto wth
More informationUNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS
UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS Postpoed exam: ECON430 Statstcs Date of exam: Jauary 0, 0 Tme for exam: 09:00 a.m. :00 oo The problem set covers 5 pages Resources allowed: All wrtte ad prted
More informationX ε ) = 0, or equivalently, lim
Revew for the prevous lecture Cocepts: order statstcs Theorems: Dstrbutos of order statstcs Examples: How to get the dstrbuto of order statstcs Chapter 5 Propertes of a Radom Sample Secto 55 Covergece
More informationMidterm Exam 1, section 2 (Solution) Thursday, February hour, 15 minutes
coometrcs, CON Sa Fracsco State Uverst Mchael Bar Sprg 5 Mdterm xam, secto Soluto Thursda, Februar 6 hour, 5 mutes Name: Istructos. Ths s closed book, closed otes exam.. No calculators of a kd are allowed..
More informationChapter 3 Sampling For Proportions and Percentages
Chapter 3 Samplg For Proportos ad Percetages I may stuatos, the characterstc uder study o whch the observatos are collected are qualtatve ature For example, the resposes of customers may marketg surveys
More informationChapter 14 Logistic Regression Models
Chapter 4 Logstc Regresso Models I the lear regresso model X β + ε, there are two types of varables explaatory varables X, X,, X k ad study varable y These varables ca be measured o a cotuous scale as
More informationObjectives of Multiple Regression
Obectves of Multple Regresso Establsh the lear equato that best predcts values of a depedet varable Y usg more tha oe eplaator varable from a large set of potetal predctors {,,... k }. Fd that subset of
More informationSimulation Output Analysis
Smulato Output Aalyss Summary Examples Parameter Estmato Sample Mea ad Varace Pot ad Iterval Estmato ermatg ad o-ermatg Smulato Mea Square Errors Example: Sgle Server Queueg System x(t) S 4 S 4 S 3 S 5
More informationENGI 3423 Simple Linear Regression Page 12-01
ENGI 343 mple Lear Regresso Page - mple Lear Regresso ometmes a expermet s set up where the expermeter has cotrol over the values of oe or more varables X ad measures the resultg values of aother varable
More informationChapter 4 Multiple Random Variables
Revew for the prevous lecture: Theorems ad Examples: How to obta the pmf (pdf) of U = g (, Y) ad V = g (, Y) Chapter 4 Multple Radom Varables Chapter 44 Herarchcal Models ad Mxture Dstrbutos Examples:
More informationModule 7. Lecture 7: Statistical parameter estimation
Lecture 7: Statstcal parameter estmato Parameter Estmato Methods of Parameter Estmato 1) Method of Matchg Pots ) Method of Momets 3) Mamum Lkelhood method Populato Parameter Sample Parameter Ubased estmato
More informationOrdinary Least Squares Regression. Simple Regression. Algebra and Assumptions.
Ordary Least Squares egresso. Smple egresso. Algebra ad Assumptos. I ths part of the course we are gog to study a techque for aalysg the lear relatoshp betwee two varables Y ad X. We have pars of observatos
More informationSampling Theory MODULE V LECTURE - 14 RATIO AND PRODUCT METHODS OF ESTIMATION
Samplg Theor MODULE V LECTUE - 4 ATIO AND PODUCT METHODS OF ESTIMATION D. SHALABH DEPATMENT OF MATHEMATICS AND STATISTICS INDIAN INSTITUTE OF TECHNOLOG KANPU A mportat objectve a statstcal estmato procedure
More informationSimple Linear Regression and Correlation.
Smple Lear Regresso ad Correlato. Correspods to Chapter 0 Tamhae ad Dulop Sldes prepared b Elzabeth Newto (MIT) wth some sldes b Jacquele Telford (Johs Hopks Uverst) Smple lear regresso aalss estmates
More informationLecture Notes Forecasting the process of estimating or predicting unknown situations
Lecture Notes. Ecoomc Forecastg. Forecastg the process of estmatg or predctg ukow stuatos Eample usuall ecoomsts predct future ecoomc varables Forecastg apples to a varet of data () tme seres data predctg
More informationComparison of Dual to Ratio-Cum-Product Estimators of Population Mean
Research Joural of Mathematcal ad Statstcal Sceces ISS 30 6047 Vol. 1(), 5-1, ovember (013) Res. J. Mathematcal ad Statstcal Sc. Comparso of Dual to Rato-Cum-Product Estmators of Populato Mea Abstract
More informationSection 2 Notes. Elizabeth Stone and Charles Wang. January 15, Expectation and Conditional Expectation of a Random Variable.
Secto Notes Elzabeth Stoe ad Charles Wag Jauar 5, 9 Jot, Margal, ad Codtoal Probablt Useful Rules/Propertes. P ( x) P P ( x; ) or R f (x; ) d. P ( xj ) P (x; ) P ( ) 3. P ( x; ) P ( xj ) P ( ) 4. Baes
More informationECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors
ECONOMETRIC THEORY MODULE XIII Lecture - 34 Asymptotic Theory ad Stochastic Regressors Dr. Shalabh Departmet of Mathematics ad Statistics Idia Istitute of Techology Kapur Asymptotic theory The asymptotic
More informationLINEAR REGRESSION ANALYSIS
LINEAR REGRESSION ANALYSIS MODULE V Lecture - Correctg Model Iadequaces Through Trasformato ad Weghtg Dr. Shalabh Departmet of Mathematcs ad Statstcs Ida Isttute of Techology Kapur Aalytcal methods for
More informationECON 482 / WH Hong The Simple Regression Model 1. Definition of the Simple Regression Model
ECON 48 / WH Hog The Smple Regresso Model. Defto of the Smple Regresso Model Smple Regresso Model Expla varable y terms of varable x y = β + β x+ u y : depedet varable, explaed varable, respose varable,
More informationMidterm Exam 1, section 1 (Solution) Thursday, February hour, 15 minutes
coometrcs, CON Sa Fracsco State Uversty Mchael Bar Sprg 5 Mdterm am, secto Soluto Thursday, February 6 hour, 5 mutes Name: Istructos. Ths s closed book, closed otes eam.. No calculators of ay kd are allowed..
More informationWu-Hausman Test: But if X and ε are independent, βˆ. ECON 324 Page 1
Wu-Hausma Test: Detectg Falure of E( ε X ) Caot drectly test ths assumpto because lack ubased estmator of ε ad the OLS resduals wll be orthogoal to X, by costructo as ca be see from the momet codto X'
More informationLecture 3 Probability review (cont d)
STATS 00: Itroducto to Statstcal Iferece Autum 06 Lecture 3 Probablty revew (cot d) 3. Jot dstrbutos If radom varables X,..., X k are depedet, the ther dstrbuto may be specfed by specfyg the dvdual dstrbuto
More information9.1 Introduction to the probit and logit models
EC3000 Ecoometrcs Lecture 9 Probt & Logt Aalss 9. Itroducto to the probt ad logt models 9. The logt model 9.3 The probt model Appedx 9. Itroducto to the probt ad logt models These models are used regressos
More informationLecture 3. Sampling, sampling distributions, and parameter estimation
Lecture 3 Samplg, samplg dstrbutos, ad parameter estmato Samplg Defto Populato s defed as the collecto of all the possble observatos of terest. The collecto of observatos we take from the populato s called
More informationRecall MLR 5 Homskedasticity error u has the same variance given any values of the explanatory variables Var(u x1,...,xk) = 2 or E(UU ) = 2 I
Chapter 8 Heterosedastcty Recall MLR 5 Homsedastcty error u has the same varace gve ay values of the eplaatory varables Varu,..., = or EUU = I Suppose other GM assumptos hold but have heterosedastcty.
More informationGenerative classification models
CS 75 Mache Learg Lecture Geeratve classfcato models Mlos Hauskrecht mlos@cs.ptt.edu 539 Seott Square Data: D { d, d,.., d} d, Classfcato represets a dscrete class value Goal: lear f : X Y Bar classfcato
More informationSTA 108 Applied Linear Models: Regression Analysis Spring Solution for Homework #1
STA 08 Appled Lear Models: Regresso Aalyss Sprg 0 Soluto for Homework #. Let Y the dollar cost per year, X the umber of vsts per year. The the mathematcal relato betwee X ad Y s: Y 300 + X. Ths s a fuctoal
More informationTESTS BASED ON MAXIMUM LIKELIHOOD
ESE 5 Toy E. Smth. The Basc Example. TESTS BASED ON MAXIMUM LIKELIHOOD To llustrate the propertes of maxmum lkelhood estmates ad tests, we cosder the smplest possble case of estmatg the mea of the ormal
More informationChapter 2 Supplemental Text Material
-. Models for the Data ad the t-test Chapter upplemetal Text Materal The model preseted the text, equato (-3) s more properl called a meas model. ce the mea s a locato parameter, ths tpe of model s also
More informationChapter 5 Transformation and Weighting to Correct Model Inadequacies
Chapter 5 Trasformato ad Weghtg to Correct Model Iadequaces The graphcal methods help detectg the volato of basc assumptos regresso aalss. Now we cosder the methods ad procedures for buldg the models through
More informationρ < 1 be five real numbers. The
Lecture o BST 63: Statstcal Theory I Ku Zhag, /0/006 Revew for the prevous lecture Deftos: covarace, correlato Examples: How to calculate covarace ad correlato Theorems: propertes of correlato ad covarace
More informationLecture Note to Rice Chapter 8
ECON 430 HG revsed Nov 06 Lecture Note to Rce Chapter 8 Radom matrces Let Y, =,,, m, =,,, be radom varables (r.v. s). The matrx Y Y Y Y Y Y Y Y Y Y = m m m s called a radom matrx ( wth a ot m-dmesoal dstrbuto,
More informationChapter 11 Systematic Sampling
Chapter stematc amplg The sstematc samplg techue s operatoall more coveet tha the smple radom samplg. It also esures at the same tme that each ut has eual probablt of cluso the sample. I ths method of
More informationParameter, Statistic and Random Samples
Parameter, Statstc ad Radom Samples A parameter s a umber that descrbes the populato. It s a fxed umber, but practce we do ot kow ts value. A statstc s a fucto of the sample data,.e., t s a quatty whose
More informationLECTURE - 4 SIMPLE RANDOM SAMPLING DR. SHALABH DEPARTMENT OF MATHEMATICS AND STATISTICS INDIAN INSTITUTE OF TECHNOLOGY KANPUR
amplg Theory MODULE II LECTURE - 4 IMPLE RADOM AMPLIG DR. HALABH DEPARTMET OF MATHEMATIC AD TATITIC IDIA ITITUTE OF TECHOLOGY KAPUR Estmato of populato mea ad populato varace Oe of the ma objectves after
More informationChapter 3 Multiple Linear Regression Model
Chapter 3 Multple Lear Regresso Model We cosder the problem of regresso whe study varable depeds o more tha oe explaatory or depedet varables, called as multple lear regresso model. Ths model geeralzes
More informationSimple Linear Regression
Statstcal Methods I (EST 75) Page 139 Smple Lear Regresso Smple regresso applcatos are used to ft a model descrbg a lear relatoshp betwee two varables. The aspects of least squares regresso ad correlato
More informationSTK4011 and STK9011 Autumn 2016
STK4 ad STK9 Autum 6 Pot estmato Covers (most of the followg materal from chapter 7: Secto 7.: pages 3-3 Secto 7..: pages 3-33 Secto 7..: pages 35-3 Secto 7..3: pages 34-35 Secto 7.3.: pages 33-33 Secto
More information= 2. Statistic - function that doesn't depend on any of the known parameters; examples:
of Samplg Theory amples - uemploymet househol cosumpto survey Raom sample - set of rv's... ; 's have ot strbuto [ ] f f s vector of parameters e.g. Statstc - fucto that oes't epe o ay of the ow parameters;
More informationCHAPTER VI Statistical Analysis of Experimental Data
Chapter VI Statstcal Aalyss of Expermetal Data CHAPTER VI Statstcal Aalyss of Expermetal Data Measuremets do ot lead to a uque value. Ths s a result of the multtude of errors (maly radom errors) that ca
More informationi 2 σ ) i = 1,2,...,n , and = 3.01 = 4.01
ECO 745, Homework 6 Le Cabrera. Assume that the followg data come from the lear model: ε ε ~ N, σ,,..., -6. -.5 7. 6.9 -. -. -.9. -..6.4.. -.6 -.7.7 Fd the mamum lkelhood estmates of,, ad σ ε s.6. 4. ε
More informationSTK3100 and STK4100 Autumn 2018
SK3 ad SK4 Autum 8 Geeralzed lear models Part III Covers the followg materal from chaters 4 ad 5: Cofdece tervals by vertg tests Cosder a model wth a sgle arameter β We may obta a ( α% cofdece terval for
More informationChapter Two. An Introduction to Regression ( )
ubject: A Itroducto to Regresso Frst tage Chapter Two A Itroducto to Regresso (018-019) 1 pg. ubject: A Itroducto to Regresso Frst tage A Itroducto to Regresso Regresso aalss s a statstcal tool for the
More informationSimple Linear Regression
Correlato ad Smple Lear Regresso Berl Che Departmet of Computer Scece & Iformato Egeerg Natoal Tawa Normal Uversty Referece:. W. Navd. Statstcs for Egeerg ad Scetsts. Chapter 7 (7.-7.3) & Teachg Materal
More informationMean is only appropriate for interval or ratio scales, not ordinal or nominal.
Mea Same as ordary average Sum all the data values ad dvde by the sample sze. x = ( x + x +... + x Usg summato otato, we wrte ths as x = x = x = = ) x Mea s oly approprate for terval or rato scales, ot
More informationSTK3100 and STK4100 Autumn 2017
SK3 ad SK4 Autum 7 Geeralzed lear models Part III Covers the followg materal from chaters 4 ad 5: Sectos 4..5, 4.3.5, 4.3.6, 4.4., 4.4., ad 4.4.3 Sectos 5.., 5.., ad 5.5. Ørulf Borga Deartmet of Mathematcs
More informationChapter 4 Multiple Random Variables
Revew o BST 63: Statstcal Theory I Ku Zhag, /0/008 Revew for Chapter 4-5 Notes: Although all deftos ad theorems troduced our lectures ad ths ote are mportat ad you should be famlar wth, but I put those
More informationLine Fitting and Regression
Marquette Uverst MSCS6 Le Fttg ad Regresso Dael B. Rowe, Ph.D. Professor Departmet of Mathematcs, Statstcs, ad Computer Scece Coprght 8 b Marquette Uverst Least Squares Regresso MSCS6 For LSR we have pots
More informationSTATISTICAL INFERENCE
(STATISTICS) STATISTICAL INFERENCE COMPLEMENTARY COURSE B.Sc. MATHEMATICS III SEMESTER ( Admsso) UNIVERSITY OF CALICUT SCHOOL OF DISTANCE EDUCATION CALICUT UNIVERSITY P.O., MALAPPURAM, KERALA, INDIA -
More informationChapter 13, Part A Analysis of Variance and Experimental Design. Introduction to Analysis of Variance. Introduction to Analysis of Variance
Chapter, Part A Aalyss of Varace ad Epermetal Desg Itroducto to Aalyss of Varace Aalyss of Varace: Testg for the Equalty of Populato Meas Multple Comparso Procedures Itroducto to Aalyss of Varace Aalyss
More informationBayesian Inferences for Two Parameter Weibull Distribution Kipkoech W. Cheruiyot 1, Abel Ouko 2, Emily Kirimi 3
IOSR Joural of Mathematcs IOSR-JM e-issn: 78-578, p-issn: 9-765X. Volume, Issue Ver. II Ja - Feb. 05, PP 4- www.osrjourals.org Bayesa Ifereces for Two Parameter Webull Dstrbuto Kpkoech W. Cheruyot, Abel
More informationClass 13,14 June 17, 19, 2015
Class 3,4 Jue 7, 9, 05 Pla for Class3,4:. Samplg dstrbuto of sample mea. The Cetral Lmt Theorem (CLT). Cofdece terval for ukow mea.. Samplg Dstrbuto for Sample mea. Methods used are based o CLT ( Cetral
More informationLecture 2: The Simple Regression Model
Lectre Notes o Advaced coometrcs Lectre : The Smple Regresso Model Takash Yamao Fall Semester 5 I ths lectre we revew the smple bvarate lear regresso model. We focs o statstcal assmptos to obta based estmators.
More informationCorrelation and Simple Linear Regression
Correlato ad Smple Lear Regresso Berl Che Departmet of Computer Scece & Iformato Egeerg Natoal Tawa Normal Uverst Referece:. W. Navd. Statstcs for Egeerg ad Scetsts. Chapter 7 (7.-7.3) & Teachg Materal
More informationBAYESIAN INFERENCES FOR TWO PARAMETER WEIBULL DISTRIBUTION
Iteratoal Joural of Mathematcs ad Statstcs Studes Vol.4, No.3, pp.5-39, Jue 06 Publshed by Europea Cetre for Research Trag ad Developmet UK (www.eajourals.org BAYESIAN INFERENCES FOR TWO PARAMETER WEIBULL
More informationCS 2750 Machine Learning. Lecture 8. Linear regression. CS 2750 Machine Learning. Linear regression. is a linear combination of input components x
CS 75 Mache Learg Lecture 8 Lear regresso Mlos Hauskrecht mlos@cs.ptt.edu 539 Seott Square CS 75 Mache Learg Lear regresso Fucto f : X Y s a lear combato of put compoets f + + + K d d K k - parameters
More informationStudy of Correlation using Bayes Approach under bivariate Distributions
Iteratoal Joural of Scece Egeerg ad Techolog Research IJSETR Volume Issue Februar 4 Stud of Correlato usg Baes Approach uder bvarate Dstrbutos N.S.Padharkar* ad. M.N.Deshpade** *Govt.Vdarbha Isttute of
More informationECON 5360 Class Notes GMM
ECON 560 Class Notes GMM Geeralzed Method of Momets (GMM) I beg by outlg the classcal method of momets techque (Fsher, 95) ad the proceed to geeralzed method of momets (Hase, 98).. radtoal Method of Momets
More informationSTA 105-M BASIC STATISTICS (This is a multiple choice paper.)
DCDM BUSINESS SCHOOL September Mock Eamatos STA 0-M BASIC STATISTICS (Ths s a multple choce paper.) Tme: hours 0 mutes INSTRUCTIONS TO CANDIDATES Do ot ope ths questo paper utl you have bee told to do
More informationStatistics MINITAB - Lab 5
Statstcs 10010 MINITAB - Lab 5 PART I: The Correlato Coeffcet Qute ofte statstcs we are preseted wth data that suggests that a lear relatoshp exsts betwee two varables. For example the plot below s of
More informationChapter 8: Statistical Analysis of Simulated Data
Marquette Uversty MSCS600 Chapter 8: Statstcal Aalyss of Smulated Data Dael B. Rowe, Ph.D. Departmet of Mathematcs, Statstcs, ad Computer Scece Copyrght 08 by Marquette Uversty MSCS600 Ageda 8. The Sample
More informationLecture Notes Types of economic variables
Lecture Notes 3 1. Types of ecoomc varables () Cotuous varable takes o a cotuum the sample space, such as all pots o a le or all real umbers Example: GDP, Polluto cocetrato, etc. () Dscrete varables fte
More informationTHE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA
THE ROYAL STATISTICAL SOCIETY EXAMINATIONS SOLUTIONS GRADUATE DIPLOMA PAPER II STATISTICAL THEORY & METHODS The Socety provdes these solutos to assst caddates preparg for the examatos future years ad for
More informationThe Mathematical Appendix
The Mathematcal Appedx Defto A: If ( Λ, Ω, where ( λ λ λ whch the probablty dstrbutos,,..., Defto A. uppose that ( Λ,,..., s a expermet type, the σ-algebra o λ λ λ are defed s deoted by ( (,,...,, σ Ω.
More informationPROPERTIES OF GOOD ESTIMATORS
ESTIMATION INTRODUCTION Estmato s the statstcal process of fdg a appromate value for a populato parameter. A populato parameter s a characterstc of the dstrbuto of a populato such as the populato mea,
More informationPart 4b Asymptotic Results for MRR2 using PRESS. Recall that the PRESS statistic is a special type of cross validation procedure (see Allen (1971))
art 4b Asymptotc Results for MRR usg RESS Recall that the RESS statstc s a specal type of cross valdato procedure (see Alle (97)) partcular to the regresso problem ad volves fdg Y $,, the estmate at the
More informationRegresso What s a Model? 1. Ofte Descrbe Relatoshp betwee Varables 2. Types - Determstc Models (o radomess) - Probablstc Models (wth radomess) EPI 809/Sprg 2008 9 Determstc Models 1. Hypothesze
More informationSTA302/1001-Fall 2008 Midterm Test October 21, 2008
STA3/-Fall 8 Mdterm Test October, 8 Last Name: Frst Name: Studet Number: Erolled (Crcle oe) STA3 STA INSTRUCTIONS Tme allowed: hour 45 mutes Ads allowed: A o-programmable calculator A table of values from
More informationChapter 8. Inferences about More Than Two Population Central Values
Chapter 8. Ifereces about More Tha Two Populato Cetral Values Case tudy: Effect of Tmg of the Treatmet of Port-We tas wth Lasers ) To vestgate whether treatmet at a youg age would yeld better results tha
More informationCan we take the Mysticism Out of the Pearson Coefficient of Linear Correlation?
Ca we tae the Mstcsm Out of the Pearso Coeffcet of Lear Correlato? Itroducto As the ttle of ths tutoral dcates, our purpose s to egeder a clear uderstadg of the Pearso coeffcet of lear correlato studets
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Aalyss of Varace ad Desg of Exermets-I MODULE II LECTURE - GENERAL LINEAR HYPOTHESIS AND ANALYSIS OF VARIANCE Dr Shalabh Deartmet of Mathematcs ad Statstcs Ida Isttute of Techology Kaur Tukey s rocedure
More informationESS Line Fitting
ESS 5 014 17. Le Fttg A very commo problem data aalyss s lookg for relatoshpetwee dfferet parameters ad fttg les or surfaces to data. The smplest example s fttg a straght le ad we wll dscuss that here
More informationMultiple Choice Test. Chapter Adequacy of Models for Regression
Multple Choce Test Chapter 06.0 Adequac of Models for Regresso. For a lear regresso model to be cosdered adequate, the percetage of scaled resduals that eed to be the rage [-,] s greater tha or equal to
More informationChapter -2 Simple Random Sampling
Chapter - Smple Radom Samplg Smple radom samplg (SRS) s a method of selecto of a sample comprsg of umber of samplg uts out of the populato havg umber of samplg uts such that every samplg ut has a equal
More informationContinuous Distributions
7//3 Cotuous Dstrbutos Radom Varables of the Cotuous Type Desty Curve Percet Desty fucto, f (x) A smooth curve that ft the dstrbuto 3 4 5 6 7 8 9 Test scores Desty Curve Percet Probablty Desty Fucto, f
More informationMaximum Likelihood Estimation
Marquette Uverst Maxmum Lkelhood Estmato Dael B. Rowe, Ph.D. Professor Departmet of Mathematcs, Statstcs, ad Computer Scece Coprght 08 b Marquette Uverst Maxmum Lkelhood Estmato We have bee sag that ~
More informationLecture 1: Introduction to Regression
Lecture : Itroducto to Regresso A Eample: Eplag State Homcde Rates What kds of varables mght we use to epla/predct state homcde rates? Let s cosder just oe predctor for ow: povert Igore omtted varables,
More informationMEASURES OF DISPERSION
MEASURES OF DISPERSION Measure of Cetral Tedecy: Measures of Cetral Tedecy ad Dsperso ) Mathematcal Average: a) Arthmetc mea (A.M.) b) Geometrc mea (G.M.) c) Harmoc mea (H.M.) ) Averages of Posto: a) Meda
More informationSampling Theory MODULE X LECTURE - 35 TWO STAGE SAMPLING (SUB SAMPLING)
Samplg Theory ODULE X LECTURE - 35 TWO STAGE SAPLIG (SUB SAPLIG) DR SHALABH DEPARTET OF ATHEATICS AD STATISTICS IDIA ISTITUTE OF TECHOLOG KAPUR Two stage samplg wth uequal frst stage uts: Cosder two stage
More information22 Nonparametric Methods.
22 oparametrc Methods. I parametrc models oe assumes apror that the dstrbutos have a specfc form wth oe or more ukow parameters ad oe tres to fd the best or atleast reasoably effcet procedures that aswer
More informationQualifying Exam Statistical Theory Problem Solutions August 2005
Qualfyg Exam Statstcal Theory Problem Solutos August 5. Let X, X,..., X be d uform U(,),
More informationChapter 11 The Analysis of Variance
Chapter The Aalyss of Varace. Oe Factor Aalyss of Varace. Radomzed Bloc Desgs (ot for ths course) NIPRL . Oe Factor Aalyss of Varace.. Oe Factor Layouts (/4) Suppose that a expermeter s terested populatos
More information