A First Guide to Hypothesis Testing in Linear Regression Models. A Generic Linear Regression Model: Scalar Formulation

Similar documents
F-Tests and Analysis of Variance (ANOVA) in the Simple Linear Regression Model. 1. Introduction

Tests of Single Linear Coefficient Restrictions: t-tests and F-tests. 1. Basic Rules. 2. Testing Single Linear Coefficient Restrictions

ECON 351* -- Note 23: Tests for Coefficient Differences: Examples Introduction. Sample data: A random sample of 534 paid employees.

Department of Economics University of Toronto

Interval Estimation in the Classical Normal Linear Regression Model. 1. Introduction

Hypothesis Testing in the Classical Normal Linear Regression Model. 1. Components of Hypothesis Tests

January Examinations 2012

In the complete model, these slopes are ANALYSIS OF VARIANCE FOR THE COMPLETE TWO-WAY MODEL. (! i+1 -! i ) + [(!") i+1,q - [(!

Marginal Effects in Probit Models: Interpretation and Testing. 1. Interpreting Probit Coefficients

Data Collection Definitions of Variables - Conceptualize vs Operationalize Sample Selection Criteria Source of Data Consistency of Data

Linear Regression Analysis: Terminology and Notation

LINEAR REGRESSION ANALYSIS. MODULE VIII Lecture Indicator Variables

Professor Chris Murray. Midterm Exam

Lecture 2 M/G/1 queues. M/G/1-queue

Interpreting Slope Coefficients in Multiple Linear Regression Models: An Example

Economics 120C Final Examination Spring Quarter June 11 th, 2009 Version A

John Geweke a and Gianni Amisano b a Departments of Economics and Statistics, University of Iowa, USA b European Central Bank, Frankfurt, Germany

TSS = SST + SSE An orthogonal partition of the total SS

RELATIONSHIP BETWEEN VOLATILITY AND TRADING VOLUME: THE CASE OF HSI STOCK RETURNS DATA

( t) Outline of program: BGC1: Survival and event history analysis Oslo, March-May Recapitulation. The additive regression model

NPTEL Project. Econometric Modelling. Module23: Granger Causality Test. Lecture35: Granger Causality Test. Vinod Gupta School of Management

Appendix H: Rarefaction and extrapolation of Hill numbers for incidence data

ECONOMICS 351*-A Mid-Term Exam -- Fall Term 2000 Page 1 of 13 pages. QUEEN'S UNIVERSITY AT KINGSTON Department of Economics

Chapter 8 Indicator Variables

a. (All your answers should be in the letter!

(10) (a) Derive and plot the spectrum of y. Discuss how the seasonality in the process is evident in spectrum.

Introduction to Dummy Variable Regressors. 1. An Example of Dummy Variable Regressors

CH.3. COMPATIBILITY EQUATIONS. Continuum Mechanics Course (MMC) - ETSECCPB - UPC

[Link to MIT-Lab 6P.1 goes here.] After completing the lab, fill in the following blanks: Numerical. Simulation s Calculations

Linear Regression with 1 Regressor. Introduction to Econometrics Spring 2012 Ken Simons

CHAPTER 5: MULTIVARIATE METHODS

CS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 4

Maximum Likelihood Estimation of Binary Dependent Variables Models: Probit and Logit. 1. General Formulation of Binary Dependent Variables Models

Maximum Likelihood Estimation of Binary Dependent Variables Models: Probit and Logit. 1. General Formulation of Binary Dependent Variables Models

THEORETICAL AUTOCORRELATIONS. ) if often denoted by γ. Note that

Scatter Plot x

Biostatistics 360 F&t Tests and Intervals in Regression 1

x i1 =1 for all i (the constant ).

Chapter 5. The linear fixed-effects estimators: matrix creation

Tests of Exclusion Restrictions on Regression Coefficients: Formulation and Interpretation

Sociology 301. Bivariate Regression II: Testing Slope and Coefficient of Determination. Bivariate Regression. Calculating Expected Values

P R = P 0. The system is shown on the next figure:

New M-Estimator Objective Function. in Simultaneous Equations Model. (A Comparative Study)

Econ107 Applied Econometrics Topic 5: Specification: Choosing Independent Variables (Studenmund, Chapter 6)

Chapter 11: Simple Linear Regression and Correlation

J i-1 i. J i i+1. Numerical integration of the diffusion equation (I) Finite difference method. Spatial Discretization. Internal nodes.

Lecture Notes for STATISTICAL METHODS FOR BUSINESS II BMGT 212. Chapters 14, 15 & 16. Professor Ahmadi, Ph.D. Department of Management

Department of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6

Survival Analysis and Reliability. A Note on the Mean Residual Life Function of a Parallel System

Solution in semi infinite diffusion couples (error function analysis)

Endogeneity. Is the term given to the situation when one or more of the regressors in the model are correlated with the error term such that

[The following data appear in Wooldridge Q2.3.] The table below contains the ACT score and college GPA for eight college students.

Comparing Means: t-tests for One Sample & Two Related Samples

CHAPTER 10: LINEAR DISCRIMINATION

Statistics for Business and Economics

Bayesian Inference of the GARCH model with Rational Errors

Lecture 18: The Laplace Transform (See Sections and 14.7 in Boas)

On One Analytic Method of. Constructing Program Controls

Normal Random Variable and its discriminant functions

Should Exact Index Numbers have Standard Errors? Theory and Application to Asian Growth

Least Squares Parameter Es.ma.on

The Simple Regression Model. Simple Regression Model 1

STAT 3008 Applied Regression Analysis

Lecture 5. Time series: ECM. Bernardina Algieri Department Economics, Statistics and Finance

Now we relax this assumption and allow that the error variance depends on the independent variables, i.e., heteroskedasticity

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)

Statistics MINITAB - Lab 2

[ ] 2. [ ]3 + (Δx i + Δx i 1 ) / 2. Δx i-1 Δx i Δx i+1. TPG4160 Reservoir Simulation 2018 Lecture note 3. page 1 of 5

Panel Data Regression Models

1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands

ECONOMICS 351* -- Stata 10 Tutorial 6. Stata 10 Tutorial 6

Y = β 0 + β 1 X 1 + β 2 X β k X k + ε

Module Contact: Dr Susan Long, ECO Copyright of the University of East Anglia Version 1

Econ Autocorrelation. Sanjaya DeSilva

Applied Econometrics and International Development Vol- 8-2 (2008)

Properties of Least Squares

Analysis And Evaluation of Econometric Time Series Models: Dynamic Transfer Function Approach

PROPERTIES OF TRANSFORMATION QUANTILE REGRESSION MODEL

General Linear Model (Chapter 4)

( ) () we define the interaction representation by the unitary transformation () = ()

F8: Heteroscedasticity

Fall 2009 Social Sciences 7418 University of Wisconsin-Madison. Problem Set 2 Answers (4) (6) di = D (10)

Vectorautoregressive Model and Cointegration Analysis. Time Series Analysis Dr. Sevtap Kestel 1

Chapter 2 - The Simple Linear Regression Model S =0. e i is a random error. S β2 β. This is a minimization problem. Solution is a calculus exercise.

Geographically weighted regression (GWR)

Dynamic Team Decision Theory. EECS 558 Project Shrutivandana Sharma and David Shuman December 10, 2005

Empirical Application of Simple Regression (Chapter 2)

ANOVA models for Brownian motion

Chapter 3. Two-Variable Regression Model: The Problem of Estimation

β0 + β1xi and want to estimate the unknown

Outline. lse-logo. Outline. Outline. 1 Wald Test. 2 The Likelihood Ratio Test. 3 Lagrange Multiplier Tests

Exam. Econometrics - Exam 1

Probabilistic Forecasting of Wind Power Ramps Using Autoregressive Logit Models

Let s treat the problem of the response of a system to an applied external force. Again,

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction

since [1-( 0+ 1x1i+ 2x2 i)] [ 0+ 1x1i+ assumed to be a reasonable approximation

Statistics for Economics & Business

A Simple Efficient Instrumental Variable Estimator for Panel AR(p) Models When Both N and T are Large

Introduction to Analysis of Variance (ANOVA) Part 1

Final Exam. Economics 835: Econometrics. Fall 2010

Transcription:

ECON 5* -- A rs Gude o Hypoess Tesng MG Abbo A rs Gude o Hypoess Tesng n Lnear Regresson Models A Generc Lnear Regresson Model: Scalar mulaon e - populaon ( sample observaon, e scalar fmulaon of e PRE s wren as: Y β + β X + β X + L + β X + u Noe: k u k k β + β X + ( k β X + u, were X Y e - populaon value of e regressand, dependen varable; X e - populaon value of e - regress, ndependen varable; β e paral regresson coeffcen of X ; u e - populaon value of e unobservable random err erm ( Lower case k denoes e number of slope coeffcens n e PR ( Upper case K denoes e oal number of regresson coeffcens n e PR ( Terefe: K k + ECON 5*: A rs Gude o Hypoess Tesng Page of 9 5gudedoc

ECON 5* -- A rs Gude o Hypoess Tesng MG Abbo Tess of One Coeffcen Resrcon: One Resrcon on One Coeffcen H specfes only one equaly resrcon on one coeffcen Two-Tal Tess of One Resrcon on One Coeffcen Example: H : β b versus H : β b were b s a specfed consan Use: eer a wo-al -es an -es Tes Sascs: β (ˆ β sample value sê(ˆ β [N K] ( β (ˆ β [, N K] sample value Vâr(ˆ β Noe: [ ] Decson Rules: ( $ β ( β $ (ˆ (ˆ β Reec H f [N K] / Rean H f [N K] b (ˆ β sê(ˆ β ( b (ˆ β Vâr(ˆ β β and [ [N K] ] [, N K] α / α > α wo-al p-value f Pr( > < α Pr( > < > α [, N K] p-value f α / α [, N ; α wo-al p-value f Pr( > α K] p-value f Pr( > α ; ECON 5*: A rs Gude o Hypoess Tesng Page of 9 5gudedoc

ECON 5* -- A rs Gude o Hypoess Tesng MG Abbo One-Tal Tess of One Resrcon on One Coeffcen Examples: H : β b ( β b versus H : β < b a lef-al es H : β b ( β b versus H : β > b a rg-al es Use: a one-al -es Tes Sasc: β (ˆ β sample value sê(ˆ β [N K] b (ˆ β sê(ˆ β Decson Rules -- lef-al -es: Reec H f Rean H f < α[n K] lef-al p-value f Pr( < < α ; α[n K] lef-al p-value f Pr( < α Decson Rules -- rg-al -es: Reec H f > α [N K] rg-al p-value f Pr( > < α ; Rean H f α [N K] rg-al p-value f Pr( > α ECON 5*: A rs Gude o Hypoess Tesng Page of 9 5gudedoc

ECON 5* -- A rs Gude o Hypoess Tesng MG Abbo Tess of One Lnear Resrcon on Two Me Coeffcens H specfes only one lnear resrcon on wo me regresson coeffcens Two-Tal Tess of One Lnear Resrcon on Two Coeffcens Example: H : c β + c β c versus H : c β + c β c Use: eer a wo-al -es an -es Tes Sascs: c β ˆ (c (c β sê(c + c β ( [N K] [N K ] were: sê(c β ˆ Vâr(c Vâr(c c Vâr(ˆ β sample value ( c ˆ ( c β ˆ + c Vâr(ˆ β (c ˆ ˆ β + cβ c β sê(c [(c (c β + c β ] + c c Côv(ˆ β, [, N K] [, N K] Vâr(c were: ˆ ˆ Vâr(c β + c β c Vâr(ˆ β + c Vâr(ˆ β + c c Côv(ˆ β, sample value ( c β ˆ Decson Rules: Reec H f [N K] / Rean H f [N K] [(c c ] Vâr(c > α wo-al p-value f Pr( > < α Pr( > < > α [, N K] p-value f α / α [, N ; α wo-al p-value f Pr( > α K] p-value f Pr( > α ; ECON 5*: A rs Gude o Hypoess Tesng Page of 9 5gudedoc

ECON 5* -- A rs Gude o Hypoess Tesng MG Abbo One-Tal Tess of One Lnear Resrcon on Two Coeffcens Examples: H : c β + c β c vs H : c β + c β < c a lef-al es H : c β + c β c vs H : c β + c β > c a rg-al es Use: a one-al -es Tes Sasc: c β ˆ (c (c β sê(c + c β ( [N K] [N K ] were sê(c β ˆ Vâr(c Vâr(c c Vâr(ˆ β sample value ( c ˆ Decson Rules -- lef-al -es: + c Vâr(ˆ β (c ˆ ˆ β + cβ c β sê(c + c c Côv(ˆ β, Reec H f Rean H f < α[n K] lef-al p-value f Pr( < < α ; α[n K] lef-al p-value f Pr( < α Decson Rules -- rg-al -es: Reec H f > α [N K] rg-al p-value f Pr( > < α ; Rean H f α [N K] rg-al p-value f Pr( > α ECON 5*: A rs Gude o Hypoess Tesng Page 5 of 9 5gudedoc

ECON 5* -- A rs Gude o Hypoess Tesng MG Abbo Tess of Two Me Lnear Coeffcen Resrcons H specfes wo me lnear coeffcen resrcons Example: H : β β and β β 5 H : β β and/ β β 5 Use: a general -es; only an -es can be used o es only wo me coeffcen resrcons Tes Sascs: Eer of e followng wo general -sascs (RSS RSS (df RSS df df (RSS RSS (K K RSS (N K (R U R R (df df (R U R R (K K ( R df ( R (N K U U df N df f RSS ; df N K df f RSS K Null dsrbuon: [df df, df ] [K K, N K] Sample value of -sasc under H Decson Rules: Reec H f > α [df df, df] α [K K, N K] p-value f Pr( > < α Rean H f α [df df, df] α [K K, N K] p-value f Pr( > α ECON 5*: A rs Gude o Hypoess Tesng Page 6 of 9 5gudedoc

ECON 5* -- A rs Gude o Hypoess Tesng MG Abbo Tess of Two Lnear Coeffcen Resrcons: Example Example: H : β β and β β 5 H : β β and/ β β 5 Unresrced model s gven by PRE (: Y β + β X + β X + β X + β X + β X + u ( 5 5 Resrced model s gven by PRE (: se β β and β 5 β n PRE (: Y β + β X + β X + β X + β X + β X + u ( Y β + β X + β X + β X + β X + β X + Y β + β X + β (X + X + β (X + X + u ( 5 5 5 5 u OLS esmaon of ( yelds e unresrced SRE (*: Y + X + X + X + X + X + û (* 5 5 N RSS û û T û w df N K N 6 OLS esmaon of ( yelds e resrced SRE (*: Y + (* β + βx + β(x + X + β(x + X5 u β β and β5 β RSS N u u T u w df N K N Subsue values of RSS, RSS, df and df no fmula f general -sasc: (RSS RSS (df RSS df df (RSS RSS (K K RSS (N K Apply decson rule ECON 5*: A rs Gude o Hypoess Tesng Page 7 of 9 5gudedoc

ECON 5* -- A rs Gude o Hypoess Tesng MG Abbo Example of Tess of Two Lnear Coeffcen Resrcons: Saa Commands Example: H : β β and β β 5 H : β β and/ β β 5 Unresrced model s gven by PRE (: Y β + β X + β X + β X + β X + β X + u ( 5 5 Esmae unresrced model gven by PRE ( by OLS usng regress command: regress y x x x x x5 Perfm on -es of H versus H usng es command: es x x es x x5, accumulae es x - x es x - x5, accumulae ECON 5*: A rs Gude o Hypoess Tesng Page 8 of 9 5gudedoc

ECON 5* -- A rs Gude o Hypoess Tesng MG Abbo Example of Tess of One Lnear Coeffcen Resrcon: Saa Commands Perfm ndvdual wo-al -es of H : β β versus H : β β usng lncom command: lncom x - x lncom _b[x] - _b[x] Perfm ndvdual -es of H : β β versus H : β β usng es command: es x x es x - x How s sasc produced by lncom command relaed o sasc produced by es command? lncom command compues: ˆ ˆ ˆ ˆ ( ˆ ˆ ( β β ( β β β [ N 6 β ] under H sê( sê( es command compues: ( [ ˆ ˆ ] ˆ ˆ ˆ ˆ ( β β ( β β β [, N 6 β ] Vâr( Vâr( under H Relaonsp beween and ess: ey yeld dencal nferences because ( ˆ ( ( β β ( β ˆ ˆ and [, N 6] [ N ] α α 6 p-value f wo-al p-value f ECON 5*: A rs Gude o Hypoess Tesng Page 9 of 9 5gudedoc