Econ 388 R. Butler 2016 rev Lecture 5 Multivariate 2 I. Partitioned Regression and Partial Regression Table 1: Projections everywhere
|
|
- Joel Gilmore
- 5 years ago
- Views:
Transcription
1 Eco 388 R. Butler 06 rev Lecture 5 Multvarate I. Parttoed Regresso ad Partal Regresso Table : Projectos everywhere P = ( ) ad M = I ( ) ad s a vector of oes assocated wth the costat term Sample Model Regresso Fdg the mea: = α + μ Smple regresso: = β 0 + β + μ Geeral regresso: = β + μ Cetered R: ad s devated from meas = β + μ M = M β + μ So we ca square both sdes, smplfy Frsch theorem for = β + β + μ, where we have parttoed the s to two arbtrary subsets, Normal Equato (mmze resdual vector by choosg parameter values to make the resdual vector orthogoal to lear combatos of the rght had sde predctor varables) μ = 0, or ( α ) = 0, or (y α ) = 0, or (y ) = (α ), or y =α, or y =α μ = 0 ad μ = 0, has order x, or ( β 0 β ) = 0, ( β 0 β ) = 0, (y β 0 β x ) = 0, x (y β 0 β x ) = 0, see chapter of text ad appedx A for soluto μ = 0, has order xk, k equatos k ukows: ( β ) = 0 Where M are devatos from the meas, so (M ) (M ) = (M β + μ ) (M β + μ ) = (M β ) (M β ) + (μ μ ) + (M β ) μ + ((M β ) μ ) the last two r.h.s. terms=0 (why?), so (y y ) = ((y y ) + (y y )) = (y y ) + (y y ), or SST= SSM + SSR Prelmary cleasg of (of correlatos): M = ( ) part of ucorrel wth Prelmary cleasg of (of correlatos): M = ( ) part of that s ucorrel wth Regressg cleased o cleased : β = ((M ) (M )) (M ) (M ) = ( M ) ( M ) Resultg parameter estmator α = β = (x x )(y y )/ (x x ) β 0 = y β x β = ( ) cetered R = SSM SSR = - SST SST Symmetry ad dempotecy of M esure the last equvaleces Notes Decompose vector to ts mea, α =, ad devatos from ts mea μ = (order x) β = rato of the cov of (x,y) to varace of x; β 0 s the mea of y oce the effect of x s take out. β j geeralzes the smple model: rato of partal covar to partal varaces I our class, almost everythg s doe wth the cetered R ; adj- R compares two regressos wth the same, but wth dfferet s Eve for subsets of varables (ot just a sgle varable), the respectve coeffcets are the cleased (of corr w/ ) partal correl of ad
2 Ths last result s partalg or ettg out the effect of. For ths reaso, the coeffcets a multple regresso are ofte called the partal regresso coeffcets. Based o Frsch Theorem, we also have the followg results: II. Goodess of Ft ad the Aalyss of Varace R aga, wth more detals o the dervato (the coeffcet of determato, ths s actually the cetered R-square, whe we talk about R-square ormal ecoometrese, we mea the cetered R-square)-- the proporto of the varato the depedet (respose) varable that s 'explaed' by the varato the depedet varables. The dea s that the varato the depedet varable, (called the total sum of squares, SST= ( ), ca be dvded up to two parts: ) a part that s explaed by the regresso model (the sum of squares explaed by the regresso model, SSM) ad ) a part that s uexplaed by the model ( sum of squared resduals, SSR). Some of the math s gve Wooldrdge, chapter where he has used the followg algebra result: (A B ) (A A B B ) = Where ˆ ˆ ˆ A A B B. The step that s omtted s showg that ( ˆ ) uˆ =0. Ths bols dow pretty quckly to ˆ uˆ uˆ = ˆ u ˆ 0, so you just have to show that ˆ u ˆ = 0 order to prove the result. It s zero because OLS resduals are costructed to be ucorrelated wth predcted values of, sce resduals are chose so that they are ucorrelated wth (or orthogoal to) the depedet varables, they wll be orthogoal to ay lear combato of the depedet varables cludg the predcted value of. So a very reasoable measure of goodess of ft would be the explaed sum of squares (by the regresso) relatve to the total sum of squares. I fact, ths s just what R s: R SSM / SST SSR / SST It s the amout of varace the depedet varable that s explaed by the regresso model (amely, explaed by all of the depedet varables). R = s a perfect ft (determstc relatoshp), R = 0 dcates o relatoshp betwee the ad the slope regressors the data matrx. The dark sde of R : R ca oly rse whe aother varable s added as dcated above. We ca get to the same result more quckly by applyg the M orthogoal projecto operator (ths takes devatos from the mea, as seem above) to the stadard sample regresso fucto. Adjusted R-Squared ad a Measure of Ft Oe problem wth R s, t wll ever decrease whe aother varable s added to a regresso equato. To correct ths, the adjusted R (deoted as adj-r ) was created by Thel (oe of my teachers at the Uv of Chcago): ˆ' ˆ /( k) adj R ' M /( ) Wth the coecto betwee R ad adj-r beg adj R ( ) ( R ( k) )
3 The adjusted R may rse or fall wth the addto of aother depedet varable, so t s used to compare models wth the same depedet varable wth sample sze fxed, ad the umber of rght had sde varables chagg. [[[[ Do ou Wat a Whole Hershey Bar? Well, cosder the followg dagram for a smple regresso model whe aswerg these three multple choce questos:. The sum of the squared dffereces betwee where the sold bar ( ) hts the axs ad the dotted les ht the axs: a. Is the SST (sum of squares total) b. ( ) c. A estmate of the varace of (whe dvdg by -) d. all of the above. The sum of the square of the dstaces represeted by the short, thck les are a. SST (sum of squares total) b. SSE (explaed sum of squares) c. SSR (resdual sum of squares) d. oe of the above 3. The sum of squares metoed questo wll equal the sum of squares metoed whe ˆ, ˆ both must be equal to zero a. 0 b. ˆ s equal to zero, regardless of the tercept coeffcets value ˆ 0 c. s equal to zero, regardless of the slope coeffcet value d. whe me at BU are ecouraged to wear beards ]]]]] III. Matrx form of Assumptos I ad II: Assumpto I: = β + μ Assumpto II: ( ) exsts (so we ca solve for uque values of the least squares estmator, β ) Now: Assumpto III, the most mportat assumpto--the error term μ has a expected value of zero, for ay values of the depedet varables. E(μ ) = 0. Wth radom samplg, ths assumpto of zero codtoal mea for the error allows us to treat the s as f they were fxed umbers (fxed repeated samples), smplfyg the dervato of ubased estmated regresso parameters. Prove E( ˆ )=, wth just these frst three assumptos (remember: start wth defto, make substtutos that relate to model assumptos, smplfy, ad take expected values): 3
4 ˆ ( ' ) ' ( ' ) '( u) ( ' ) ' ( ' ) ( ' ) ' u Now take expectato of both sdes (codtog o ) to get E ( ˆ) ( ' ) ' E( u ) ( ' ) 0 Note o the E( )=0 assumpto. Ths s actually stroger tha eeded for most proofs ad theorems that we wll employ: What s eeded that E( μ) = 0 where we clude the tercept (a vector of oes) amog the depedet varables. Hece E( μ) = 0 mples the followg two results: ( ) 0 ad Cov( j, ) 0 j,..., k What extra does E( μ) = 0 gve us? Not oly that E(μ) = 0 but also that s ucorrelated wth ay fucto of (ot just ucorrelated wth that the Cov(, ) 0 assumpto gve us). Ths s equvalet to sayg that j we have fully accouted for the mpact of o, or equvaletly, that the fuctoal form of E( ) s properly specfed. IV. A Implcato of Model assumptos so far A. Omtted varable bas: True Model: = β + Zα + μ Here we let the omtted varable be deoted by Z. But we omt the Z varable (we assume that just oe varable s omtted ths example, so that s a scalar--a sgle, real umber but the otato also apples the more geeral case) from the specfcato, ad estmate stead: u Wll the omsso of Z from the estmated model, affect the bas of the ˆ vector? Gve the omsso of Z, the estmated coeffcets (whch we wll deote by ~ sce the model s msspecfed) wll be β = ( ) = ( ) (β + Zα + μ) = β + ( ) Zα + ( ) μ Now takg the expectato of both sdes (codtog o ) we have E(β ) = β + ( ) Zα + ( ) E(μ ) = β + ( ) Zα Hece, the bas from omttg a varable our model s equal to ( ) Z α Ths cossts of two parts. The frst correspods to the regresso of Z o (( ) Z); f there are four slope regressors, the the regresso of Z o would produce the partal correlato of each of those regressors wth respect to Z. Each of these partal correlatos would the be multpled by to get the bas preset for each elemet of ˆ. Smply stated, the bas would have the same sg as the product of the partal correlato tmes the omtted coeffcet. For example, f wages were regressed o o-fatal jury rsk (ad other worker s characterstcs), but omtted workers compesato beeft geerosty, there mght be a bas. The sg of the bas would equal: Sg(bas) = Sg(partal correlato betwee jury rsk ad beefts * ), where would be the coeffcet of jury beeft geerosty the wage equato. We would expect to be egatve ths cotext. Further, t may be that hgher beefts are pad where there s greater jury rsk, so the partal correlato would be postve. The et bas, uder these crcumstaces, would be egatve (( + )*( -) =( -)). If we omt beefts geerosty from the equato, but we would be less lkely to fd a compesatg wage sce our estmated coeffcet would be based dowwards. ' u Fally, we see that there are two cases where there s o bas: a. whe the correlato betwee Z ad s zero, ad b. whe Z has a coeffcet of 0 (so t ca safely be omtted ayway). 4
5 [[[TIME TO PLA: DO OU WANT A WHOLE HERSE BAR? :. To say that ˆ s ubased meas: a. t does t md who moves to ts eghborhood b. t always equals the populato parameter vector c. ts mea equals the populato parameter vector d. there are o omtted varables the specfcato. omtted varable bas: a. wll always be a problem whe we omt varables the model b. your cyclcal bout wth amesa caused you to forget your mother s brthday c. equals the regresso of the omtted varable o the cluded varables,, tmes the coeffcet of the omtted varable d. oe of the above 3. the proof of ubasedess for ˆ depeds o: a. the tercept havg a value of 0 b. the ormalty of the error terms c. the resduals summg to zero d. oe of the above]]]]]] Appedx o Frsch (or Partal Dervatve) Theorem A Pcture of the theorem three dmesos The partal dervatve theorem for regresso models says that for the followg two regressos: ˆ ˆ ˆ ad M ˆ ˆ M ` M, t s the case that ˆ ˆ ad ˆ ˆ M, where the varables the secod regresso are resduals from regressg ad o respectvely: ˆ M ad ˆ M. So frst, we show just the frst regresso: O Upper sde vew of regresso Top vew of the, plae Now we do the secod regresso (usg the resduals from the regressos) by tself (essetally decomposg ad terms of ) 5
6 O Upper sde vew of regresso Top vew of the, plae Ad fally we add them together so that equvaleces become apparet obvously ˆ ˆ ˆ ˆ M by specto of the graphs below, ad by the law of smlar tragles. I fact, that s all the partal dervatve (Frsch) theorem really s just a restatemet of the Pythagorea theorem ad elemetary propertes of geometry ( Eucldea space). O Upper sde vew of regresso Top vew of the, plae Geeral Results o the Frsch Theorem Apples wheever there are two or more regressors (rght had sde terms) our model. Cosder a arbtrary dvso of the regressors ad wrte them as 6) resduals Let s the projecto of to the space orthogoal to, or other words, the resduals of the regresso of oto (ths s aalogous to the decomposto of to the part explaed by the whole vector, =P + M, but t s a dfferet decomposto, as s lower dmeso tha, ad M s hgher dmeso tha M): exp part by laed of y to orthogoal part of y Smlarly, f has dmeso -x-z ad has dmeso -x-(k-z), are the resduals from regresso(s) of o ( are the depedet varable(s) ad are the depedet varables), the dmeso of beg -x- ad the dmeso of -x-z so that has dmeso -x-z. The cosder aother regresso: 7) resduals 6
7 The the Frsch Theorem says that a) the estmate of from equato (6) wll be detcal to the estmate of from equato (7), b) the resduals from these two equatos wll also be detcal, ad c) ˆ s the estmate of the effect of o, after the fluece of has bee factored out, d) ad as a result of a ad b, we have ' M ' M ' P or M M M P, or M M P M. M Applyg ths result to the case where s just the tercept (the vector of oes we deote as ), ad as all the regressors, cludg the tercept, the result (d) becomes ' M ' M ' P or M M M P M, or M P M, M that s, varato (where varato s calculato by devatg from ts mea usg a vector of oes, M) ca be explaed by varato due to varato the s (more specfcally, that part of the s ot assocated wth the costat, PM ) ad the varato that s uexplaed by all the s (cludg the tercept, M ). Equvaletly, the total sum of squares for (SST) equals the part of the varatos explaed by varatos the model (SSM, where the s are the model, ad M devates from ther meas, or takes varatos of ) ad the part left uexplaed, captured by the sum of squared resduals (SSR). APPENDI: Projecto Vew of Omtted Varable Bas. Z Z Estmato Model (leavg out Z): Projecto Vew. The ) ( Z ( Z) Z Now ad let Z So that But So That s, whe we omt Z, our estmators for the effect of s based by. The bas s, aga, 0 f 0 or f Z 0 whch would be the case f ad Z were orthogoal (ucorrected). 7
Econometric Methods. Review of Estimation
Ecoometrc Methods Revew of Estmato Estmatg the populato mea Radom samplg Pot ad terval estmators Lear estmators Ubased estmators Lear Ubased Estmators (LUEs) Effcecy (mmum varace) ad Best Lear Ubased Estmators
More informationLecture 7. Confidence Intervals and Hypothesis Tests in the Simple CLR Model
Lecture 7. Cofdece Itervals ad Hypothess Tests the Smple CLR Model I lecture 6 we troduced the Classcal Lear Regresso (CLR) model that s the radom expermet of whch the data Y,,, K, are the outcomes. The
More informationSimple Linear Regression
Statstcal Methods I (EST 75) Page 139 Smple Lear Regresso Smple regresso applcatos are used to ft a model descrbg a lear relatoshp betwee two varables. The aspects of least squares regresso ad correlato
More informationSTATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS. x, where. = y - ˆ " 1
STATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS Recall Assumpto E(Y x) η 0 + η x (lear codtoal mea fucto) Data (x, y ), (x 2, y 2 ),, (x, y ) Least squares estmator ˆ E (Y x) ˆ " 0 + ˆ " x, where ˆ
More informationECON 482 / WH Hong The Simple Regression Model 1. Definition of the Simple Regression Model
ECON 48 / WH Hog The Smple Regresso Model. Defto of the Smple Regresso Model Smple Regresso Model Expla varable y terms of varable x y = β + β x+ u y : depedet varable, explaed varable, respose varable,
More information12.2 Estimating Model parameters Assumptions: ox and y are related according to the simple linear regression model
1. Estmatg Model parameters Assumptos: ox ad y are related accordg to the smple lear regresso model (The lear regresso model s the model that says that x ad y are related a lear fasho, but the observed
More informationLinear Regression with One Regressor
Lear Regresso wth Oe Regressor AIM QA.7. Expla how regresso aalyss ecoometrcs measures the relatoshp betwee depedet ad depedet varables. A regresso aalyss has the goal of measurg how chages oe varable,
More informationENGI 3423 Simple Linear Regression Page 12-01
ENGI 343 mple Lear Regresso Page - mple Lear Regresso ometmes a expermet s set up where the expermeter has cotrol over the values of oe or more varables X ad measures the resultg values of aother varable
More informationX X X E[ ] E X E X. is the ()m n where the ( i,)th. j element is the mean of the ( i,)th., then
Secto 5 Vectors of Radom Varables Whe workg wth several radom varables,,..., to arrage them vector form x, t s ofte coveet We ca the make use of matrx algebra to help us orgaze ad mapulate large umbers
More informationCHAPTER 4 RADICAL EXPRESSIONS
6 CHAPTER RADICAL EXPRESSIONS. The th Root of a Real Number A real umber a s called the th root of a real umber b f Thus, for example: s a square root of sce. s also a square root of sce ( ). s a cube
More informationMATH 247/Winter Notes on the adjoint and on normal operators.
MATH 47/Wter 00 Notes o the adjot ad o ormal operators I these otes, V s a fte dmesoal er product space over, wth gve er * product uv, T, S, T, are lear operators o V U, W are subspaces of V Whe we say
More informationOrdinary Least Squares Regression. Simple Regression. Algebra and Assumptions.
Ordary Least Squares egresso. Smple egresso. Algebra ad Assumptos. I ths part of the course we are gog to study a techque for aalysg the lear relatoshp betwee two varables Y ad X. We have pars of observatos
More information{ }{ ( )} (, ) = ( ) ( ) ( ) Chapter 14 Exercises in Sampling Theory. Exercise 1 (Simple random sampling): Solution:
Chapter 4 Exercses Samplg Theory Exercse (Smple radom samplg: Let there be two correlated radom varables X ad A sample of sze s draw from a populato by smple radom samplg wthout replacemet The observed
More informationMultiple Linear Regression Analysis
LINEA EGESSION ANALYSIS MODULE III Lecture - 4 Multple Lear egresso Aalyss Dr. Shalabh Departmet of Mathematcs ad Statstcs Ida Isttute of Techology Kapur Cofdece terval estmato The cofdece tervals multple
More informationMultiple Choice Test. Chapter Adequacy of Models for Regression
Multple Choce Test Chapter 06.0 Adequac of Models for Regresso. For a lear regresso model to be cosdered adequate, the percetage of scaled resduals that eed to be the rage [-,] s greater tha or equal to
More informationInvestigation of Partially Conditional RP Model with Response Error. Ed Stanek
Partally Codtoal Radom Permutato Model 7- vestgato of Partally Codtoal RP Model wth Respose Error TRODUCTO Ed Staek We explore the predctor that wll result a smple radom sample wth respose error whe a
More informationStatistics MINITAB - Lab 5
Statstcs 10010 MINITAB - Lab 5 PART I: The Correlato Coeffcet Qute ofte statstcs we are preseted wth data that suggests that a lear relatoshp exsts betwee two varables. For example the plot below s of
More informationRecall MLR 5 Homskedasticity error u has the same variance given any values of the explanatory variables Var(u x1,...,xk) = 2 or E(UU ) = 2 I
Chapter 8 Heterosedastcty Recall MLR 5 Homsedastcty error u has the same varace gve ay values of the eplaatory varables Varu,..., = or EUU = I Suppose other GM assumptos hold but have heterosedastcty.
More informationMidterm Exam 1, section 2 (Solution) Thursday, February hour, 15 minutes
coometrcs, CON Sa Fracsco State Uverst Mchael Bar Sprg 5 Mdterm xam, secto Soluto Thursda, Februar 6 hour, 5 mutes Name: Istructos. Ths s closed book, closed otes exam.. No calculators of a kd are allowed..
More informationLecture Notes 2. The ability to manipulate matrices is critical in economics.
Lecture Notes. Revew of Matrces he ablt to mapulate matrces s crtcal ecoomcs.. Matr a rectagular arra of umbers, parameters, or varables placed rows ad colums. Matrces are assocated wth lear equatos. lemets
More informationSTA302/1001-Fall 2008 Midterm Test October 21, 2008
STA3/-Fall 8 Mdterm Test October, 8 Last Name: Frst Name: Studet Number: Erolled (Crcle oe) STA3 STA INSTRUCTIONS Tme allowed: hour 45 mutes Ads allowed: A o-programmable calculator A table of values from
More informationresidual. (Note that usually in descriptions of regression analysis, upper-case
Regresso Aalyss Regresso aalyss fts or derves a model that descres the varato of a respose (or depedet ) varale as a fucto of oe or more predctor (or depedet ) varales. The geeral regresso model s oe of
More informationMidterm Exam 1, section 1 (Solution) Thursday, February hour, 15 minutes
coometrcs, CON Sa Fracsco State Uversty Mchael Bar Sprg 5 Mdterm am, secto Soluto Thursday, February 6 hour, 5 mutes Name: Istructos. Ths s closed book, closed otes eam.. No calculators of ay kd are allowed..
More informationLecture Notes Types of economic variables
Lecture Notes 3 1. Types of ecoomc varables () Cotuous varable takes o a cotuum the sample space, such as all pots o a le or all real umbers Example: GDP, Polluto cocetrato, etc. () Dscrete varables fte
More informationLecture 8: Linear Regression
Lecture 8: Lear egresso May 4, GENOME 56, Sprg Goals Develop basc cocepts of lear regresso from a probablstc framework Estmatg parameters ad hypothess testg wth lear models Lear regresso Su I Lee, CSE
More informationChapter Business Statistics: A First Course Fifth Edition. Learning Objectives. Correlation vs. Regression. In this chapter, you learn:
Chapter 3 3- Busess Statstcs: A Frst Course Ffth Edto Chapter 2 Correlato ad Smple Lear Regresso Busess Statstcs: A Frst Course, 5e 29 Pretce-Hall, Ic. Chap 2- Learg Objectves I ths chapter, you lear:
More informationECONOMETRIC THEORY. MODULE VIII Lecture - 26 Heteroskedasticity
ECONOMETRIC THEORY MODULE VIII Lecture - 6 Heteroskedastcty Dr. Shalabh Departmet of Mathematcs ad Statstcs Ida Isttute of Techology Kapur . Breusch Paga test Ths test ca be appled whe the replcated data
More informationProbability and. Lecture 13: and Correlation
933 Probablty ad Statstcs for Software ad Kowledge Egeers Lecture 3: Smple Lear Regresso ad Correlato Mocha Soptkamo, Ph.D. Outle The Smple Lear Regresso Model (.) Fttg the Regresso Le (.) The Aalyss of
More informationMultiple Regression. More than 2 variables! Grade on Final. Multiple Regression 11/21/2012. Exam 2 Grades. Exam 2 Re-grades
STAT 101 Dr. Kar Lock Morga 11/20/12 Exam 2 Grades Multple Regresso SECTIONS 9.2, 10.1, 10.2 Multple explaatory varables (10.1) Parttog varablty R 2, ANOVA (9.2) Codtos resdual plot (10.2) Trasformatos
More informationLecture 3 Probability review (cont d)
STATS 00: Itroducto to Statstcal Iferece Autum 06 Lecture 3 Probablty revew (cot d) 3. Jot dstrbutos If radom varables X,..., X k are depedet, the ther dstrbuto may be specfed by specfyg the dvdual dstrbuto
More informationChapter 4 Multiple Random Variables
Revew for the prevous lecture: Theorems ad Examples: How to obta the pmf (pdf) of U = g (, Y) ad V = g (, Y) Chapter 4 Multple Radom Varables Chapter 44 Herarchcal Models ad Mxture Dstrbutos Examples:
More informationChapter 13 Student Lecture Notes 13-1
Chapter 3 Studet Lecture Notes 3- Basc Busess Statstcs (9 th Edto) Chapter 3 Smple Lear Regresso 4 Pretce-Hall, Ic. Chap 3- Chapter Topcs Types of Regresso Models Determg the Smple Lear Regresso Equato
More informationCLASS NOTES. for. PBAF 528: Quantitative Methods II SPRING Instructor: Jean Swanson. Daniel J. Evans School of Public Affairs
CLASS NOTES for PBAF 58: Quattatve Methods II SPRING 005 Istructor: Jea Swaso Dael J. Evas School of Publc Affars Uversty of Washgto Ackowledgemet: The structor wshes to thak Rachel Klet, Assstat Professor,
More informationThe Mathematical Appendix
The Mathematcal Appedx Defto A: If ( Λ, Ω, where ( λ λ λ whch the probablty dstrbutos,,..., Defto A. uppose that ( Λ,,..., s a expermet type, the σ-algebra o λ λ λ are defed s deoted by ( (,,...,, σ Ω.
More informationExample: Multiple linear regression. Least squares regression. Repetition: Simple linear regression. Tron Anders Moger
Example: Multple lear regresso 5000,00 4000,00 Tro Aders Moger 0.0.007 brthweght 3000,00 000,00 000,00 0,00 50,00 00,00 50,00 00,00 50,00 weght pouds Repetto: Smple lear regresso We defe a model Y = β0
More informationSimple Linear Regression
Correlato ad Smple Lear Regresso Berl Che Departmet of Computer Scece & Iformato Egeerg Natoal Tawa Normal Uversty Referece:. W. Navd. Statstcs for Egeerg ad Scetsts. Chapter 7 (7.-7.3) & Teachg Materal
More information9 U-STATISTICS. Eh =(m!) 1 Eh(X (1),..., X (m ) ) i.i.d
9 U-STATISTICS Suppose,,..., are P P..d. wth CDF F. Our goal s to estmate the expectato t (P)=Eh(,,..., m ). Note that ths expectato requres more tha oe cotrast to E, E, or Eh( ). Oe example s E or P((,
More informationUNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS
UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS Exam: ECON430 Statstcs Date of exam: Frday, December 8, 07 Grades are gve: Jauary 4, 08 Tme for exam: 0900 am 00 oo The problem set covers 5 pages Resources allowed:
More informationSummary of the lecture in Biostatistics
Summary of the lecture Bostatstcs Probablty Desty Fucto For a cotuos radom varable, a probablty desty fucto s a fucto such that: 0 dx a b) b a dx A probablty desty fucto provdes a smple descrpto of the
More informationρ < 1 be five real numbers. The
Lecture o BST 63: Statstcal Theory I Ku Zhag, /0/006 Revew for the prevous lecture Deftos: covarace, correlato Examples: How to calculate covarace ad correlato Theorems: propertes of correlato ad covarace
More informationChapter 9 Jordan Block Matrices
Chapter 9 Jorda Block atrces I ths chapter we wll solve the followg problem. Gve a lear operator T fd a bass R of F such that the matrx R (T) s as smple as possble. f course smple s a matter of taste.
More informationb. There appears to be a positive relationship between X and Y; that is, as X increases, so does Y.
.46. a. The frst varable (X) s the frst umber the par ad s plotted o the horzotal axs, whle the secod varable (Y) s the secod umber the par ad s plotted o the vertcal axs. The scatterplot s show the fgure
More information4. Standard Regression Model and Spatial Dependence Tests
4. Stadard Regresso Model ad Spatal Depedece Tests Stadard regresso aalss fals the presece of spatal effects. I case of spatal depedeces ad/or spatal heterogeet a stadard regresso model wll be msspecfed.
More informationObjectives of Multiple Regression
Obectves of Multple Regresso Establsh the lear equato that best predcts values of a depedet varable Y usg more tha oe eplaator varable from a large set of potetal predctors {,,... k }. Fd that subset of
More informationFunctions of Random Variables
Fuctos of Radom Varables Chapter Fve Fuctos of Radom Varables 5. Itroducto A geeral egeerg aalyss model s show Fg. 5.. The model output (respose) cotas the performaces of a system or product, such as weght,
More informationTESTS BASED ON MAXIMUM LIKELIHOOD
ESE 5 Toy E. Smth. The Basc Example. TESTS BASED ON MAXIMUM LIKELIHOOD To llustrate the propertes of maxmum lkelhood estmates ad tests, we cosder the smplest possble case of estmatg the mea of the ormal
More information( ) = ( ) ( ) Chapter 13 Asymptotic Theory and Stochastic Regressors. Stochastic regressors model
Chapter 3 Asmptotc Theor ad Stochastc Regressors The ature of eplaator varable s assumed to be o-stochastc or fed repeated samples a regresso aalss Such a assumpto s approprate for those epermets whch
More informationChapter Two. An Introduction to Regression ( )
ubject: A Itroducto to Regresso Frst tage Chapter Two A Itroducto to Regresso (018-019) 1 pg. ubject: A Itroducto to Regresso Frst tage A Itroducto to Regresso Regresso aalss s a statstcal tool for the
More informationLecture 3. Sampling, sampling distributions, and parameter estimation
Lecture 3 Samplg, samplg dstrbutos, ad parameter estmato Samplg Defto Populato s defed as the collecto of all the possble observatos of terest. The collecto of observatos we take from the populato s called
More informationHandout #8. X\Y f(x) 0 1/16 1/ / /16 3/ / /16 3/16 0 3/ /16 1/16 1/8 g(y) 1/16 1/4 3/8 1/4 1/16 1
Hadout #8 Ttle: Foudatos of Ecoometrcs Course: Eco 367 Fall/05 Istructor: Dr. I-Mg Chu Lear Regresso Model So far we have focused mostly o the study of a sgle radom varable, ts correspodg theoretcal dstrbuto,
More informationMean is only appropriate for interval or ratio scales, not ordinal or nominal.
Mea Same as ordary average Sum all the data values ad dvde by the sample sze. x = ( x + x +... + x Usg summato otato, we wrte ths as x = x = x = = ) x Mea s oly approprate for terval or rato scales, ot
More informationThe equation is sometimes presented in form Y = a + b x. This is reasonable, but it s not the notation we use.
INTRODUCTORY NOTE ON LINEAR REGREION We have data of the form (x y ) (x y ) (x y ) These wll most ofte be preseted to us as two colum of a spreadsheet As the topc develops we wll see both upper case ad
More informationESS Line Fitting
ESS 5 014 17. Le Fttg A very commo problem data aalyss s lookg for relatoshpetwee dfferet parameters ad fttg les or surfaces to data. The smplest example s fttg a straght le ad we wll dscuss that here
More informationLecture 1: Introduction to Regression
Lecture : Itroducto to Regresso A Eample: Eplag State Homcde Rates What kds of varables mght we use to epla/predct state homcde rates? Let s cosder just oe predctor for ow: povert Igore omtted varables,
More informationStatistics: Unlocking the Power of Data Lock 5
STAT 0 Dr. Kar Lock Morga Exam 2 Grades: I- Class Multple Regresso SECTIONS 9.2, 0., 0.2 Multple explaatory varables (0.) Parttog varablty R 2, ANOVA (9.2) Codtos resdual plot (0.2) Exam 2 Re- grades Re-
More informationLecture 2: The Simple Regression Model
Lectre Notes o Advaced coometrcs Lectre : The Smple Regresso Model Takash Yamao Fall Semester 5 I ths lectre we revew the smple bvarate lear regresso model. We focs o statstcal assmptos to obta based estmators.
More informationUNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS
UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS Postpoed exam: ECON430 Statstcs Date of exam: Jauary 0, 0 Tme for exam: 09:00 a.m. :00 oo The problem set covers 5 pages Resources allowed: All wrtte ad prted
More informationSimple Linear Regression and Correlation.
Smple Lear Regresso ad Correlato. Correspods to Chapter 0 Tamhae ad Dulop Sldes prepared b Elzabeth Newto (MIT) wth some sldes b Jacquele Telford (Johs Hopks Uverst) Smple lear regresso aalss estmates
More informationDISTURBANCE TERMS. is a scalar and x i
DISTURBANCE TERMS I a feld of research desg, we ofte have the qesto abot whether there s a relatoshp betwee a observed varable (sa, ) ad the other observed varables (sa, x ). To aswer the qesto, we ma
More informationChapter 3 Sampling For Proportions and Percentages
Chapter 3 Samplg For Proportos ad Percetages I may stuatos, the characterstc uder study o whch the observatos are collected are qualtatve ature For example, the resposes of customers may marketg surveys
More informationhp calculators HP 30S Statistics Averages and Standard Deviations Average and Standard Deviation Practice Finding Averages and Standard Deviations
HP 30S Statstcs Averages ad Stadard Devatos Average ad Stadard Devato Practce Fdg Averages ad Stadard Devatos HP 30S Statstcs Averages ad Stadard Devatos Average ad stadard devato The HP 30S provdes several
More informationThird handout: On the Gini Index
Thrd hadout: O the dex Corrado, a tala statstca, proposed (, 9, 96) to measure absolute equalt va the mea dfferece whch s defed as ( / ) where refers to the total umber of dvduals socet. Assume that. The
More informationPart 4b Asymptotic Results for MRR2 using PRESS. Recall that the PRESS statistic is a special type of cross validation procedure (see Allen (1971))
art 4b Asymptotc Results for MRR usg RESS Recall that the RESS statstc s a specal type of cross valdato procedure (see Alle (97)) partcular to the regresso problem ad volves fdg Y $,, the estmate at the
More informationLecture Notes Forecasting the process of estimating or predicting unknown situations
Lecture Notes. Ecoomc Forecastg. Forecastg the process of estmatg or predctg ukow stuatos Eample usuall ecoomsts predct future ecoomc varables Forecastg apples to a varet of data () tme seres data predctg
More informationMultivariate Transformation of Variables and Maximum Likelihood Estimation
Marquette Uversty Multvarate Trasformato of Varables ad Maxmum Lkelhood Estmato Dael B. Rowe, Ph.D. Assocate Professor Departmet of Mathematcs, Statstcs, ad Computer Scece Copyrght 03 by Marquette Uversty
More informationENGI 4421 Propagation of Error Page 8-01
ENGI 441 Propagato of Error Page 8-01 Propagato of Error [Navd Chapter 3; ot Devore] Ay realstc measuremet procedure cotas error. Ay calculatos based o that measuremet wll therefore also cota a error.
More informationRegresso What s a Model? 1. Ofte Descrbe Relatoshp betwee Varables 2. Types - Determstc Models (o radomess) - Probablstc Models (wth radomess) EPI 809/Sprg 2008 9 Determstc Models 1. Hypothesze
More informationPoint Estimation: definition of estimators
Pot Estmato: defto of estmators Pot estmator: ay fucto W (X,..., X ) of a data sample. The exercse of pot estmato s to use partcular fuctos of the data order to estmate certa ukow populato parameters.
More informationLecture Note to Rice Chapter 8
ECON 430 HG revsed Nov 06 Lecture Note to Rce Chapter 8 Radom matrces Let Y, =,,, m, =,,, be radom varables (r.v. s). The matrx Y Y Y Y Y Y Y Y Y Y = m m m s called a radom matrx ( wth a ot m-dmesoal dstrbuto,
More informationLecture 2: Linear Least Squares Regression
Lecture : Lear Least Squares Regresso Dave Armstrog UW Mlwaukee February 8, 016 Is the Relatoshp Lear? lbrary(car) data(davs) d 150) Davs$weght[d]
More informationENGI 4421 Joint Probability Distributions Page Joint Probability Distributions [Navidi sections 2.5 and 2.6; Devore sections
ENGI 441 Jot Probablty Dstrbutos Page 7-01 Jot Probablty Dstrbutos [Navd sectos.5 ad.6; Devore sectos 5.1-5.] The jot probablty mass fucto of two dscrete radom quattes, s, P ad p x y x y The margal probablty
More informationε. Therefore, the estimate
Suggested Aswers, Problem Set 3 ECON 333 Da Hugerma. Ths s ot a very good dea. We kow from the secod FOC problem b) that ( ) SSE / = y x x = ( ) Whch ca be reduced to read y x x = ε x = ( ) The OLS model
More informationIntroduction to Matrices and Matrix Approach to Simple Linear Regression
Itroducto to Matrces ad Matrx Approach to Smple Lear Regresso Matrces Defto: A matrx s a rectagular array of umbers or symbolc elemets I may applcatos, the rows of a matrx wll represet dvduals cases (people,
More informationClass 13,14 June 17, 19, 2015
Class 3,4 Jue 7, 9, 05 Pla for Class3,4:. Samplg dstrbuto of sample mea. The Cetral Lmt Theorem (CLT). Cofdece terval for ukow mea.. Samplg Dstrbuto for Sample mea. Methods used are based o CLT ( Cetral
More informationWu-Hausman Test: But if X and ε are independent, βˆ. ECON 324 Page 1
Wu-Hausma Test: Detectg Falure of E( ε X ) Caot drectly test ths assumpto because lack ubased estmator of ε ad the OLS resduals wll be orthogoal to X, by costructo as ca be see from the momet codto X'
More informationSTA 108 Applied Linear Models: Regression Analysis Spring Solution for Homework #1
STA 08 Appled Lear Models: Regresso Aalyss Sprg 0 Soluto for Homework #. Let Y the dollar cost per year, X the umber of vsts per year. The the mathematcal relato betwee X ad Y s: Y 300 + X. Ths s a fuctoal
More informationStatistics. Correlational. Dr. Ayman Eldeib. Simple Linear Regression and Correlation. SBE 304: Linear Regression & Correlation 1/3/2018
/3/08 Sstems & Bomedcal Egeerg Departmet SBE 304: Bo-Statstcs Smple Lear Regresso ad Correlato Dr. Ama Eldeb Fall 07 Descrptve Orgasg, summarsg & descrbg data Statstcs Correlatoal Relatoshps Iferetal Geeralsg
More informationLecture 9: Tolerant Testing
Lecture 9: Tolerat Testg Dael Kae Scrbe: Sakeerth Rao Aprl 4, 07 Abstract I ths lecture we prove a quas lear lower boud o the umber of samples eeded to do tolerat testg for L dstace. Tolerat Testg We have
More informationbest estimate (mean) for X uncertainty or error in the measurement (systematic, random or statistical) best
Error Aalyss Preamble Wheever a measuremet s made, the result followg from that measuremet s always subject to ucertaty The ucertaty ca be reduced by makg several measuremets of the same quatty or by mprovg
More informationCorrelation and Simple Linear Regression
Correlato ad Smple Lear Regresso Berl Che Departmet of Computer Scece & Iformato Egeerg Natoal Tawa Normal Uverst Referece:. W. Navd. Statstcs for Egeerg ad Scetsts. Chapter 7 (7.-7.3) & Teachg Materal
More informationLecture 1: Introduction to Regression
Lecture : Itroducto to Regresso A Eample: Eplag State Homcde Rates What kds of varables mght we use to epla/predct state homcde rates? Let s cosder just oe predctor for ow: povert Igore omtted varables,
More informationChapter 5 Properties of a Random Sample
Lecture 6 o BST 63: Statstcal Theory I Ku Zhag, /0/008 Revew for the prevous lecture Cocepts: t-dstrbuto, F-dstrbuto Theorems: Dstrbutos of sample mea ad sample varace, relatoshp betwee sample mea ad sample
More informationTHE ROYAL STATISTICAL SOCIETY 2016 EXAMINATIONS SOLUTIONS HIGHER CERTIFICATE MODULE 5
THE ROYAL STATISTICAL SOCIETY 06 EAMINATIONS SOLUTIONS HIGHER CERTIFICATE MODULE 5 The Socety s provdg these solutos to assst cadtes preparg for the examatos 07. The solutos are teded as learg ads ad should
More informationAssignment 5/MATH 247/Winter Due: Friday, February 19 in class (!) (answers will be posted right after class)
Assgmet 5/MATH 7/Wter 00 Due: Frday, February 9 class (!) (aswers wll be posted rght after class) As usual, there are peces of text, before the questos [], [], themselves. Recall: For the quadratc form
More informationSpecial Instructions / Useful Data
JAM 6 Set of all real umbers P A..d. B, p Posso Specal Istructos / Useful Data x,, :,,, x x Probablty of a evet A Idepedetly ad detcally dstrbuted Bomal dstrbuto wth parameters ad p Posso dstrbuto wth
More information2SLS Estimates ECON In this case, begin with the assumption that E[ i
SLS Estmates ECON 3033 Bll Evas Fall 05 Two-Stage Least Squares (SLS Cosder a stadard lear bvarate regresso model y 0 x. I ths case, beg wth the assumto that E[ x] 0 whch meas that OLS estmates of wll
More informationTraining Sample Model: Given n observations, [[( Yi, x i the sample model can be expressed as (1) where, zero and variance σ
Stat 74 Estmato for Geeral Lear Model Prof. Goel Broad Outle Geeral Lear Model (GLM): Trag Samle Model: Gve observatos, [[( Y, x ), x = ( x,, xr )], =,,, the samle model ca be exressed as Y = µ ( x, x,,
More information4 Inner Product Spaces
11.MH1 LINEAR ALGEBRA Summary Notes 4 Ier Product Spaces Ier product s the abstracto to geeral vector spaces of the famlar dea of the scalar product of two vectors or 3. I what follows, keep these key
More informationChapter 10 Two Stage Sampling (Subsampling)
Chapter 0 To tage amplg (usamplg) I cluster samplg, all the elemets the selected clusters are surveyed oreover, the effcecy cluster samplg depeds o sze of the cluster As the sze creases, the effcecy decreases
More informationFundamentals of Regression Analysis
Fdametals of Regresso Aalyss Regresso aalyss s cocered wth the stdy of the depedece of oe varable, the depedet varable, o oe or more other varables, the explaatory varables, wth a vew of estmatg ad/or
More informationCan we take the Mysticism Out of the Pearson Coefficient of Linear Correlation?
Ca we tae the Mstcsm Out of the Pearso Coeffcet of Lear Correlato? Itroducto As the ttle of ths tutoral dcates, our purpose s to egeder a clear uderstadg of the Pearso coeffcet of lear correlato studets
More information1 Solution to Problem 6.40
1 Soluto to Problem 6.40 (a We wll wrte T τ (X 1,...,X where the X s are..d. wth PDF f(x µ, σ 1 ( x µ σ g, σ where the locato parameter µ s ay real umber ad the scale parameter σ s > 0. Lettg Z X µ σ we
More informationChapter 14 Logistic Regression Models
Chapter 4 Logstc Regresso Models I the lear regresso model X β + ε, there are two types of varables explaatory varables X, X,, X k ad study varable y These varables ca be measured o a cotuous scale as
More informationTopic 4: Simple Correlation and Regression Analysis
Topc 4: Smple Correlato ad Regresso Aalyss Questo: How do we determe how the chages oe varable are related to chages aother varable or varables? Aswer: REGRESSION ANALYSIS Whch derves a descrpto of the
More informationChapter -2 Simple Random Sampling
Chapter - Smple Radom Samplg Smple radom samplg (SRS) s a method of selecto of a sample comprsg of umber of samplg uts out of the populato havg umber of samplg uts such that every samplg ut has a equal
More informationCHAPTER 2. = y ˆ β x (.1022) So we can write
CHAPTER SOLUTIONS TO PROBLEMS. () Let y = GPA, x = ACT, ad = 8. The x = 5.875, y = 3.5, (x x )(y y ) = 5.85, ad (x x ) = 56.875. From equato (.9), we obta the slope as ˆβ = = 5.85/56.875., rouded to four
More informationChapter -2 Simple Random Sampling
Chapter - Smple Radom Samplg Smple radom samplg (SRS) s a method of selecto of a sample comprsg of umber of samplg uts out of the populato havg umber of samplg uts such that every samplg ut has a equal
More informationChapter 13, Part A Analysis of Variance and Experimental Design. Introduction to Analysis of Variance. Introduction to Analysis of Variance
Chapter, Part A Aalyss of Varace ad Epermetal Desg Itroducto to Aalyss of Varace Aalyss of Varace: Testg for the Equalty of Populato Meas Multple Comparso Procedures Itroducto to Aalyss of Varace Aalyss
More informationMu Sequences/Series Solutions National Convention 2014
Mu Sequeces/Seres Solutos Natoal Coveto 04 C 6 E A 6C A 6 B B 7 A D 7 D C 7 A B 8 A B 8 A C 8 E 4 B 9 B 4 E 9 B 4 C 9 E C 0 A A 0 D B 0 C C Usg basc propertes of arthmetc sequeces, we fd a ad bm m We eed
More informationHomework 1: Solutions Sid Banerjee Problem 1: (Practice with Asymptotic Notation) ORIE 4520: Stochastics at Scale Fall 2015
Fall 05 Homework : Solutos Problem : (Practce wth Asymptotc Notato) A essetal requremet for uderstadg scalg behavor s comfort wth asymptotc (or bg-o ) otato. I ths problem, you wll prove some basc facts
More information