Spurious Fixed E ects Regression
|
|
- Annice McCarthy
- 5 years ago
- Views:
Transcription
1 Spurious Fixed E ects Regressio I Choi First Draft: April, 00; This versio: Jue, 0 Abstract This paper shows that spurious regressio results ca occur for a xed e ects model with weak time series variatio i the regressor ad/or strog time series variatio i the regressio errors whe the rst-di ereced ad Withi-OLS estimators are used. Asymptotic properties of these estimators ad the related t-tests ad model selectio criteria are studied by sedig the umber of crosssectioal observatios to i ity. This paper shows that the rst-di ereced ad Withi-OLS estimators diverge i probability, that the related t-tests are icosistet, that R s coverge to zero i probability ad that AIC ad BIC diverge to i probability. The results of the paper war that oe should ot jump to the use of xed e ects regressios without cosiderig the degree of time series variatios i the data. Itroductio Regressios that do ot reveal true statistical relatios are called spurious. Spurious regressios are kow to occur i various time series settigs. Yule (96) tries to explai ureasoably high correlatio betwee the mortality rate for the years ad the ratio of Church of Eglad marriages to all marriages by usig time series which, ad the rst di erece of which, are positively correlated. Yule is regarded as the rst work that studied spurious regressios. More recetly, Grager ad Newbold (974) demostrate via simulatio that osese regressio results ca be observed betwee two idepedet radom walks. Their aalysis has bee exteded to various models ivolvig stochastic ad/or determiistic treds. I thak Woho Sog ad a aoymous referee for their helpful commets. Research assistace for this paper was provided by Michul Yum whom I thak. Departmet of Ecoomics, Sogag Uiversity, # Shisu-dog, Mapo-gu, Seoul, -74 Korea. ichoi@gmail.com, ichoi@sogag.ac.kr See Aldrich (995) for a historical accout of spurious correlatios. Accordig to Aldrich, the coectio betwee Yule (96) ad Grager ad Newbold (974) had bee largely igored util poited out by Hedry (986).
2 However, spurious regressio results for covetioal micro paels have ever bee reported formally. This paper shows that spurious regressio results ca occur for a xed e ects model with weak time series variatio i the regressor ad/or strog time series variatio i the regressio errors whe such popular estimators as rst-di ereced ad Withi-OLS estimators are used. Uder the weak time series variatio, the variace of the regressor shriks to zero as the umber of cross-sectioal observatios goes to i ity. Some micro paels display weak time series variatios. For example, real wages collected over a short spa of time or moopoly prices uder regulatios do ot chage much over time. The strog time series variatio i the regressio errors is modelled by the divergig variace of the regressio errors. More speci cally, this paper will show by sedig the umber of cross-sectioal observatios to i ity that the rst-di ereced ad Withi-OLS estimators diverge i probability, that the related t-tests are icosistet, that R s coverge to zero i probability ad that AIC ad BIC diverge to i probability whe the regressor has weak time series variatio ad/or the regressio errors have strog time series variatio. Because these results are ot expected from stadard pael regressio theory, such results should obviously ot be take seriously. This paper has the followig pla. Sectio illustrates a spurious pael regressio usig a two-period xed e ects model. The basic model ad assumptios are also itroduced i this sectio. Sectio 3 exteds the results of Sectio to the case of a multiperiod xed e ects model. Sectio 4 reports simulatio results regardig the t-tests ad coe ciets of determiatio. Sectio 5 cotais a summary ad further remarks. All the limits are take by sedig to. A illustratio Cosider the followig two-period xed e ects model with a sigle regressor, x it y it = i + x it + u it ; (i = ; : : : ; ; t = ; ); () where x it = z i + a it ad u it = v i + b it () ad z i ad v i are radom variables. As usual, i is a idividual e ects variable correlated with x it. Observed data are fy it g ad fx it g. But fz i g ad fa it g are ot separately observed. Radom variables fa it g ad fb it g brig time series variatios to the observed data. For fa it g ad fb it g, we assume
3 Assumptio a it b it iid 0; " a 0 0 b # for every, i ad t; Assumptio 0 ad + < 0: As will be show, spurious regressio results about the di ereced estimator, t-test ad R arise uder Assumptios ad. Assumptio has two cases > 0; < ad = 0; < : I the former case, there is weak time series variatio i the regressor for large which implies the well-kow multicolliearity problem of regressio. Spurious regressio results are well expected i this case. This case is relevat i practice because some pael data display such behavior. For example, real wages collected over a short time spa or moopoly prices uder regulatios do ot chage much over time. I the latter case, there is o multicolliearity problem, but there is strog time series variatio i the regressio errors. We will use otatio w i = w i w i throughout this sectio. The Withi- OLS ad rst-di ereced estimators are kow to be idetical for a two-period xed e ects model. These estimators also yield the same t-ratio ad R. The P rst-di ereced estimator is writte as ^ d = x P P iy i = + (x i) P a ib i : Sice (a i) a i iid (0; a); b i iid (0; b ) ad Cov( a i ; b i ) = 0 for every, we obtai by the cetral limit theorem + p d a i b i N(0; ) (3) h with = E (+) (a i ) (b i ) i = 4 a b. Furthermore, the law of large umbers yields Relatios (3) ad (4) give (a i ) p a : (4) + (^ d ) d N 0; b : (5) a This ca also be writte as ^ d = + O p + ; which shows that ^ d diverges i probability to whe + < 0. I fact, the coditio 0 is ot required for spurious regressio results, but we are iterested i this case because it correspods to weak ( > 0) ad moderate time series variatio ( = 0) i the regressor. 3
4 Next, we study properties of the t-test. The t-ratio for the ull hypothesis H 0 : = 0 is writte as t = Sice ^ = q^ ( P ^ d (x i) ) ; where ^ = P (y i ^ d x i ). (b i ) + (^ d ) = O p + O p + O p ; (a i ) (^ d ) a i b i (6) due to relatios (3), (4), (5) ad the law of large umbers applied to the rst term of (6), we have Relatios (4), (5) ad (7) yield ^ p b : (7) t = r ^ + ^ d P (x i) N(0; b ) d a q = N(0; ): b = a This shows that the t-ratio has a stadard ormal distributio i the limit uder the ull hypothesis. However, uder the alterative hypothesis H : 6= 0, t = + (^ d ) + + r ^ P = c (x i) + d ; say, ad c d N(0; ); d = O p +. This shows that the t-ratio has a stadard ormal distributio i the limit whe + < 0. That is, the t-test is ot cosistet whe + < 0 or equivaletly whe ^ d diverges i probability. The coe ciet of determiatio obtaied by regressig y i o x i is de ed by R = ^ d (5) P P (x i) y i = C D ;say. Lettig = ^ d C = (a i ) +, we d from relatios (4) ad (a i ) + (a i ) = O p + O p + O p : (8) Moreover, D = (a i ) + (b i ) + a i b i (9) = O p + O p + O p : 4
5 Relatios (8) ad (9) show that R = O p + + O p + + O p () ; (0) O p ( + ) + O p () + O p + implyig R p 0 whe + < 0. Thus, regardless of the quality of x it as a regressor, small values of R will be observed. I the stadard pael regressio case (; ) = (0:0; 0:0), relatio (0) reduces to R = O p () (but ot o p ()). If > 0, such model selectio criteria as AIC ad BIC diverge to i probability, sice their commo term l(^ ) does so as is expected from relatio (7). But of course, this does ot mea that the selected regressors are optimal. It is simply a idicatio of a spurious pael regressio. 3 Spurious regressios for a multiperiod xed e ects model This sectio cosiders the model of Sectio ad studies properties of the Withi- OLS ad rst-di ereced estimators for T >. The model cotiues to have a sigle regressor i this sectio, which will simplify the expositio. Assumptios ad are also retaied. 3. Withi-OLS estimator The Withi-OLS estimator is writte as P P T t= ^ w = (x it x i )(y it y i ) P P T t= (x it x i ) P PT t= (a it a i )b it = + P PT t= (a it a i ) ; where q i = P T T t= q PT it. Because + t= (a it a i )b it iid 0; (T ) a b for each T, the cetral limit theorem yields + d p (a it a i )b it N(0; (T ) a b ): () t= PT Moreover, sice E t= (a it a i ) = (T ) a, the law of large umbers gives (a it a i ) t= 5 p (T ) a : ()
6 Relatios () ad () provide the limitig distributio of ^ w as + (^ w ) b d N(0; (T ) ): (3) a As i the previous sectio, ^ w diverges i probability to whe + < 0. As usual, the t-ratio is de ed as t w = q^ ( P ^ w P T t= (x it x i ) ) ; where ^ = P P T (T ) t= (y it y i ^ d (x it x i )) : Usig relatios P T t= (a it a i ) iid 0; (T ) a, P T t= b it bi iid 0; (T ) b ad (), we have ^ = = (T ) (T ) (^ w ) t= " t= t= b it bi (^ w ) (a it a i ) b it bi + (^w ) # (b it bi )(a it a i ) = O p + O p + O p ; t= (a it a i ) which implies ^ p b : (4) Relatios (), (3) ad (4) yield uder the ull hypothesis t w = r ^ P N 0; d P q T t= (x it x i ) b = ((T ) a) + ^ w b (T ) a = N(0; ): Uder the alterative hypothesis H : 6= 0, however, we have t w d N(0; ) whe + < 0 as i Sectio. Thus, the t-test is ot cosistet whe + < 0. We ca also show that R p 0 whe + < 0 usig the same methods as i Sectio ad that AIC ad BIC diverge to i probability whe > 0. Details are ot worth reportig here. 3. First-di ereced estimator P P T t= Write the rst-di ereced estimator as ^ d = + a itb it PT P P T : Sice + t= (a it) t= a itb it iid 0; (6T 8) a b for each T; we have P p + PT d t= a itb it N(0; (6T 8) a b ): I additio, PT t= (a it) are idepedet ad idetically distributed with 6
7 PT E t= (a it) = (T ) a, which gives P PT t= (a it) p (T ) a: Thus, we obtai + (^ d ) d N (6T 8) b 0; 4(T ) : (5) a Agai, it is foud that ^ d diverges i probability to whe + < 0. Relatios (3) ad (5) show that, whereas the Withi-OLS ad rst-di ereced estimators have the same limitig distributio whe T =, they have di eret distributios whe T >. Because fx it g ad fu it g are movig-average processes of order, we should ot use the usual stadard error for the t-ratio that does ot accout for the serial correlatio. Istead, the t-ratio should be de ed by usig a robust stadard error. Lettig ^u it = y it dvar(^ d ) = t= ^ d x it, a robust estimator of the variace of ^ d is (x it ) (x it ^u it ) + x it x i(t+) ^u it ^u i(t+) ; t= which utilizes the fact that fx it g ad fu it g are movig average processes of order. Usig this, we de e the t-ratio for the ull hypothesis H 0 : = 0 as t d = Writig t d = r (+) t= + p P P T t= a itb it q ^ d ^. V ar(^ d ) P PT t= (a it^u it ) + P T t= a ita i(t+) ^u it ^u i(t+) ad usig the fact that the deomiator coverges to q (6T 8) a b i probability, we d that t d d N(0; ) uder the ull hypothesis. Uder the alterative hypothesis H : 6= 0; the t-ratio also has a stadard ormal distributio i the limit whe + < 0. This follows i the same maer as i Sectio. Last, we also have R p 0 whe + < 0, as i Sectio, ad divergig AIC ad BIC (to i probability) whe > 0. 4 Simulatio This sectio reports some simulatio results regardig the t-tests ad R s from the rst-di ereced ad Withi-OLS regressios. The data were geerated by equatios 7
8 () ad () of Sectio with T = ; 6; = 00; 00; 500; i = z i = v i = 0 for all i; ad = 0:0; 0:05; 0:0; 0:5; 0:0. For " fa it g ad # fb it g; stadard ormal umbers were a it 0 geerated by iid N 0;. We cosidered three cases, (; ) = b it 0 (0:9; 0:3); (0:0; 0:6); (0:0; 0:0). The case (; ) = (0:9; 0:3) correspods to weak time series variatios both i the regressor ad regressio errors, while (; ) = (0:0; 0:6) to moderate time series variatio i the regressor ad strog variatio i the errors. These cases geerate spurious pael regressio results, while (; ) = (0:0; 0:0) leads to a stadard pael regressio. Simulatio results of this sectio are based 50,000 iteratios. I Figure, rejectio frequecies of the t-tests for the ull hypothesis H 0 : = 0 are plotted. Left-side ad middle paels show the rejectio frequecies of the t-tests for the spurious pael regressio cases (; ) = (0:9; 0:3); (0:0; 0:6). As predicted by the asymptotic theory of Sectios ad 3, the empirical rejectio frequecies are close to 0.05 for all the values of, T ad, which implies the t-tests lack asymptotic power. Right-side paels show the rejectio frequecies of the t-tests for the stadard pael regressio case, (; ) = (0:0; 0:0). Uder the ull hypothesis, = 0, the rejectio frequecy is close to 0.05, but icreases with ad, as is well expected from stadard pael regressio theory. Figure plots R s from the rst-di ereced ad Withi-OLS regressios. Whe (; ) = (0:9; 0:3); (0:0; 0:6), R coverges to zero as icreases for all the values of, which is cosistet with the asymptotic theory of Sectios ad 3 but is cotrary to the commo perceptio that R should icrease as sigals from the regressors become stroger. By cotrast, whe (; ) = (0:0; 0:0); R steadily icreases with the value of, as predicted by stadard pael regressio theory. Figure illustrates that R s from the spurious pael regressios take values close to zero. 5 Summary ad further remarks This paper sets up a pael regressio model with varyig degree of time series variatios i the regressor ad errors ad aalyzes asymptotic properties of the estimators, t-tests ad model selectio criteria from the rst-di ereced ad Withi-OLS estimatios. Weak time series variatio i the regressor ad/or strog time series variatio i the regressio errors are cosidered. These cases are show to brig spurious regressio results for the rst-di ereced ad With-OLS estimators ad related t-tests ad R : I additio, such iformatio criteria as AIC ad BIC are show to diverge 8
9 to mius i ity i probability whe the regressio errors have weak time series variatio. The results of this paper suggest that it is iappropriate to use xed e ects pael regressios i some cases. But it is also admitted that the theory of this paper does ot provide ay guidelie for judgig the appropriateess of xed e ects pael regressios ad that further research is required for the implemetatio of the guidelie. As a temporary remedy, however, it may be prudet to iterpret a xed e ects regressio that yields a large (i modulus) value of the estimator i use ad a moderate value of the t-ratio, alog with small values of R, AIC ad BIC, as evidece for spuriousess. I additio, if oe ds markedly di eret results from the pooled-ols ad xed e ects regressios, spurious xed e ects regressio results should also be suspected. I a utshell, this paper wars that jumpig to the use of xed e ects regressios without cosiderig the degree of time series variatio i the data should be avoided i empirical practice. This paper cosiders the case of sigle regressor oly. It is expected that similar result will hold i the case of multiple regressors, but more work eeds to be doe for this case. Refereces Aldrich, J. (995). Correlatios Geuie ad Spurious i Pearso ad Yule, Statistical Sciece, Vol. 0, pp Grager, C.W.J., ad P. Newbold. (974). Spurious Regressios i Ecoometrics, Joural of Ecoometrics, Vol., pp. 0. Hedry, D.F. (986). Ecoometric Modellig with Coitegrated Variables: Overview, Oxford Bulleti of Ecoomics ad Statistics, Vol. 48, pp. 0. A Yule, G.U. (96). Why Do We Sometimes Get Nosese-Correlatios betwee Time-Series? A Study i Samplig ad the Nature of Time-Series, Joural of the Royal Statistical Society, Vol. 89, pp
10
11
Properties and Hypothesis Testing
Chapter 3 Properties ad Hypothesis Testig 3.1 Types of data The regressio techiques developed i previous chapters ca be applied to three differet kids of data. 1. Cross-sectioal data. 2. Time series data.
More information1 Inferential Methods for Correlation and Regression Analysis
1 Iferetial Methods for Correlatio ad Regressio Aalysis I the chapter o Correlatio ad Regressio Aalysis tools for describig bivariate cotiuous data were itroduced. The sample Pearso Correlatio Coefficiet
More informationEcon 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1.
Eco 325/327 Notes o Sample Mea, Sample Proportio, Cetral Limit Theorem, Chi-square Distributio, Studet s t distributio 1 Sample Mea By Hiro Kasahara We cosider a radom sample from a populatio. Defiitio
More informationResampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.
Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator
More informationFinal Examination Solutions 17/6/2010
The Islamic Uiversity of Gaza Faculty of Commerce epartmet of Ecoomics ad Political Scieces A Itroductio to Statistics Course (ECOE 30) Sprig Semester 009-00 Fial Eamiatio Solutios 7/6/00 Name: I: Istructor:
More informationFirst Year Quantitative Comp Exam Spring, Part I - 203A. f X (x) = 0 otherwise
First Year Quatitative Comp Exam Sprig, 2012 Istructio: There are three parts. Aswer every questio i every part. Questio I-1 Part I - 203A A radom variable X is distributed with the margial desity: >
More informationMA Advanced Econometrics: Properties of Least Squares Estimators
MA Advaced Ecoometrics: Properties of Least Squares Estimators Karl Whela School of Ecoomics, UCD February 5, 20 Karl Whela UCD Least Squares Estimators February 5, 20 / 5 Part I Least Squares: Some Fiite-Sample
More informationMathematical Notation Math Introduction to Applied Statistics
Mathematical Notatio Math 113 - Itroductio to Applied Statistics Name : Use Word or WordPerfect to recreate the followig documets. Each article is worth 10 poits ad ca be prited ad give to the istructor
More informationStatistical Inference Based on Extremum Estimators
T. Rotheberg Fall, 2007 Statistical Iferece Based o Extremum Estimators Itroductio Suppose 0, the true value of a p-dimesioal parameter, is kow to lie i some subset S R p : Ofte we choose to estimate 0
More informationA statistical method to determine sample size to estimate characteristic value of soil parameters
A statistical method to determie sample size to estimate characteristic value of soil parameters Y. Hojo, B. Setiawa 2 ad M. Suzuki 3 Abstract Sample size is a importat factor to be cosidered i determiig
More informationSpatial Nonstationarity and Spurious Regression: The Case with Row-Normalized Spatial Weights Matrix
Spatial Nostatioarity ad Spurious Regressio: The Case with Row-Normalized Spatial Weights Matrix March 26, 29 Abstract This paper ivestigates the spurious regressio i the spatial settig where the regressat
More informationThe standard deviation of the mean
Physics 6C Fall 20 The stadard deviatio of the mea These otes provide some clarificatio o the distictio betwee the stadard deviatio ad the stadard deviatio of the mea.. The sample mea ad variace Cosider
More informationKolmogorov-Smirnov type Tests for Local Gaussianity in High-Frequency Data
Proceedigs 59th ISI World Statistics Cogress, 5-30 August 013, Hog Kog (Sessio STS046) p.09 Kolmogorov-Smirov type Tests for Local Gaussiaity i High-Frequecy Data George Tauche, Duke Uiversity Viktor Todorov,
More informationBecause it tests for differences between multiple pairs of means in one test, it is called an omnibus test.
Math 308 Sprig 018 Classes 19 ad 0: Aalysis of Variace (ANOVA) Page 1 of 6 Itroductio ANOVA is a statistical procedure for determiig whether three or more sample meas were draw from populatios with equal
More informationECON 3150/4150, Spring term Lecture 3
Itroductio Fidig the best fit by regressio Residuals ad R-sq Regressio ad causality Summary ad ext step ECON 3150/4150, Sprig term 2014. Lecture 3 Ragar Nymoe Uiversity of Oslo 21 Jauary 2014 1 / 30 Itroductio
More informationAlgebra of Least Squares
October 19, 2018 Algebra of Least Squares Geometry of Least Squares Recall that out data is like a table [Y X] where Y collects observatios o the depedet variable Y ad X collects observatios o the k-dimesioal
More informationStatistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.
Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized
More informationEconomics 326 Methods of Empirical Research in Economics. Lecture 8: Multiple regression model
Ecoomics 326 Methods of Empirical Research i Ecoomics Lecture 8: Multiple regressio model Hiro Kasahara Uiversity of British Columbia December 24, 2014 Why we eed a multiple regressio model I There are
More informationBull. Korean Math. Soc. 36 (1999), No. 3, pp. 451{457 THE STRONG CONSISTENCY OF NONLINEAR REGRESSION QUANTILES ESTIMATORS Seung Hoe Choi and Hae Kyung
Bull. Korea Math. Soc. 36 (999), No. 3, pp. 45{457 THE STRONG CONSISTENCY OF NONLINEAR REGRESSION QUANTILES ESTIMATORS Abstract. This paper provides suciet coditios which esure the strog cosistecy of regressio
More informationChapter 6 Sampling Distributions
Chapter 6 Samplig Distributios 1 I most experimets, we have more tha oe measuremet for ay give variable, each measuremet beig associated with oe radomly selected a member of a populatio. Hece we eed to
More informationCointegration versus Spurious Regression and Heterogeneity in Large Panels
Coitegratio versus Spurious Regressio ad Heterogeeity i Large Paels Lorezo rapai Cass Busiess School Jauary 8, 009 Abstract his paper provides a estimatio ad testig framework to idetify the source(s) of
More information1 Introduction to reducing variance in Monte Carlo simulations
Copyright c 010 by Karl Sigma 1 Itroductio to reducig variace i Mote Carlo simulatios 11 Review of cofidece itervals for estimatig a mea I statistics, we estimate a ukow mea µ = E(X) of a distributio by
More informationRegression with an Evaporating Logarithmic Trend
Regressio with a Evaporatig Logarithmic Tred Peter C. B. Phillips Cowles Foudatio, Yale Uiversity, Uiversity of Aucklad & Uiversity of York ad Yixiao Su Departmet of Ecoomics Yale Uiversity October 5,
More informationAsymptotic Results for the Linear Regression Model
Asymptotic Results for the Liear Regressio Model C. Fli November 29, 2000 1. Asymptotic Results uder Classical Assumptios The followig results apply to the liear regressio model y = Xβ + ε, where X is
More informationLecture 2: Monte Carlo Simulation
STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: Ye-Chi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?
More informationEfficient GMM LECTURE 12 GMM II
DECEMBER 1 010 LECTURE 1 II Efficiet The estimator depeds o the choice of the weight matrix A. The efficiet estimator is the oe that has the smallest asymptotic variace amog all estimators defied by differet
More informationFACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures
FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING Lectures MODULE 5 STATISTICS II. Mea ad stadard error of sample data. Biomial distributio. Normal distributio 4. Samplig 5. Cofidece itervals
More informationLECTURE 8: ASYMPTOTICS I
LECTURE 8: ASYMPTOTICS I We are iterested i the properties of estimators as. Cosider a sequece of radom variables {, X 1}. N. M. Kiefer, Corell Uiversity, Ecoomics 60 1 Defiitio: (Weak covergece) A sequece
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS
MASSACHUSTTS INSTITUT OF TCHNOLOGY 6.436J/5.085J Fall 2008 Lecture 9 /7/2008 LAWS OF LARG NUMBRS II Cotets. The strog law of large umbers 2. The Cheroff boud TH STRONG LAW OF LARG NUMBRS While the weak
More informationSolutions to Odd-Numbered End-of-Chapter Exercises: Chapter 9
Itroductio to Ecoometrics (3 rd Updated Editio) by James H. Stock ad Mark W. Watso Solutios to Odd-Numbered Ed-of-Chapter Exercises: Chapter 9 (This versio July 0, 04) Stock/Watso - Itroductio to Ecoometrics
More informationApproximate Confidence Interval for the Reciprocal of a Normal Mean with a Known Coefficient of Variation
Metodološki zvezki, Vol. 13, No., 016, 117-130 Approximate Cofidece Iterval for the Reciprocal of a Normal Mea with a Kow Coefficiet of Variatio Wararit Paichkitkosolkul 1 Abstract A approximate cofidece
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationRandom Matrices with Blocks of Intermediate Scale Strongly Correlated Band Matrices
Radom Matrices with Blocks of Itermediate Scale Strogly Correlated Bad Matrices Jiayi Tog Advisor: Dr. Todd Kemp May 30, 07 Departmet of Mathematics Uiversity of Califoria, Sa Diego Cotets Itroductio Notatio
More informationRandom Variables, Sampling and Estimation
Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig
More information10. Comparative Tests among Spatial Regression Models. Here we revisit the example in Section 8.1 of estimating the mean of a normal random
Part III. Areal Data Aalysis 0. Comparative Tests amog Spatial Regressio Models While the otio of relative likelihood values for differet models is somewhat difficult to iterpret directly (as metioed above),
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationIntroduction to Econometrics (3 rd Updated Edition) Solutions to Odd- Numbered End- of- Chapter Exercises: Chapter 3
Itroductio to Ecoometrics (3 rd Updated Editio) by James H. Stock ad Mark W. Watso Solutios to Odd- Numbered Ed- of- Chapter Exercises: Chapter 3 (This versio August 17, 014) 015 Pearso Educatio, Ic. Stock/Watso
More informationECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors
ECONOMETRIC THEORY MODULE XIII Lecture - 34 Asymptotic Theory ad Stochastic Regressors Dr. Shalabh Departmet of Mathematics ad Statistics Idia Istitute of Techology Kapur Asymptotic theory The asymptotic
More informationLimit distributions for products of sums
Statistics & Probability Letters 62 (23) 93 Limit distributios for products of sums Yogcheg Qi Departmet of Mathematics ad Statistics, Uiversity of Miesota-Duluth, Campus Ceter 4, 7 Uiversity Drive, Duluth,
More informationSimple Linear Regression
Chapter 2 Simple Liear Regressio 2.1 Simple liear model The simple liear regressio model shows how oe kow depedet variable is determied by a sigle explaatory variable (regressor). Is is writte as: Y i
More informationCentral limit theorem and almost sure central limit theorem for the product of some partial sums
Proc. Idia Acad. Sci. Math. Sci. Vol. 8, No. 2, May 2008, pp. 289 294. Prited i Idia Cetral it theorem ad almost sure cetral it theorem for the product of some partial sums YU MIAO College of Mathematics
More informationCEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering
CEE 5 Autum 005 Ucertaity Cocepts for Geotechical Egieerig Basic Termiology Set A set is a collectio of (mutually exclusive) objects or evets. The sample space is the (collectively exhaustive) collectio
More informationInvestigating the Significance of a Correlation Coefficient using Jackknife Estimates
Iteratioal Joural of Scieces: Basic ad Applied Research (IJSBAR) ISSN 2307-4531 (Prit & Olie) http://gssrr.org/idex.php?joural=jouralofbasicadapplied ---------------------------------------------------------------------------------------------------------------------------
More informationChapter 13, Part A Analysis of Variance and Experimental Design
Slides Prepared by JOHN S. LOUCKS St. Edward s Uiversity Slide 1 Chapter 13, Part A Aalysis of Variace ad Eperimetal Desig Itroductio to Aalysis of Variace Aalysis of Variace: Testig for the Equality of
More informationAsymptotic distribution of products of sums of independent random variables
Proc. Idia Acad. Sci. Math. Sci. Vol. 3, No., May 03, pp. 83 9. c Idia Academy of Scieces Asymptotic distributio of products of sums of idepedet radom variables YANLING WANG, SUXIA YAO ad HONGXIA DU ollege
More informationSDS 321: Introduction to Probability and Statistics
SDS 321: Itroductio to Probability ad Statistics Lecture 23: Cotiuous radom variables- Iequalities, CLT Puramrita Sarkar Departmet of Statistics ad Data Sciece The Uiversity of Texas at Austi www.cs.cmu.edu/
More informationMath 152. Rumbos Fall Solutions to Review Problems for Exam #2. Number of Heads Frequency
Math 152. Rumbos Fall 2009 1 Solutios to Review Problems for Exam #2 1. I the book Experimetatio ad Measuremet, by W. J. Youde ad published by the by the Natioal Sciece Teachers Associatio i 1962, the
More informationDouble Stage Shrinkage Estimator of Two Parameters. Generalized Exponential Distribution
Iteratioal Mathematical Forum, Vol., 3, o. 3, 3-53 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/.9/imf.3.335 Double Stage Shrikage Estimator of Two Parameters Geeralized Expoetial Distributio Alaa M.
More informationEconomics 241B Relation to Method of Moments and Maximum Likelihood OLSE as a Maximum Likelihood Estimator
Ecoomics 24B Relatio to Method of Momets ad Maximum Likelihood OLSE as a Maximum Likelihood Estimator Uder Assumptio 5 we have speci ed the distributio of the error, so we ca estimate the model parameters
More informationDS 100: Principles and Techniques of Data Science Date: April 13, Discussion #10
DS 00: Priciples ad Techiques of Data Sciece Date: April 3, 208 Name: Hypothesis Testig Discussio #0. Defie these terms below as they relate to hypothesis testig. a) Data Geeratio Model: Solutio: A set
More informationGeometry of LS. LECTURE 3 GEOMETRY OF LS, PROPERTIES OF σ 2, PARTITIONED REGRESSION, GOODNESS OF FIT
OCTOBER 7, 2016 LECTURE 3 GEOMETRY OF LS, PROPERTIES OF σ 2, PARTITIONED REGRESSION, GOODNESS OF FIT Geometry of LS We ca thik of y ad the colums of X as members of the -dimesioal Euclidea space R Oe ca
More informationSolution to Chapter 2 Analytical Exercises
Nov. 25, 23, Revised Dec. 27, 23 Hayashi Ecoometrics Solutio to Chapter 2 Aalytical Exercises. For ay ε >, So, plim z =. O the other had, which meas that lim E(z =. 2. As show i the hit, Prob( z > ε =
More informationLECTURE 14 NOTES. A sequence of α-level tests {ϕ n (x)} is consistent if
LECTURE 14 NOTES 1. Asymptotic power of tests. Defiitio 1.1. A sequece of -level tests {ϕ x)} is cosistet if β θ) := E θ [ ϕ x) ] 1 as, for ay θ Θ 1. Just like cosistecy of a sequece of estimators, Defiitio
More informationSampling Distributions, Z-Tests, Power
Samplig Distributios, Z-Tests, Power We draw ifereces about populatio parameters from sample statistics Sample proportio approximates populatio proportio Sample mea approximates populatio mea Sample variace
More informationLinear Regression Models
Liear Regressio Models Dr. Joh Mellor-Crummey Departmet of Computer Sciece Rice Uiversity johmc@cs.rice.edu COMP 528 Lecture 9 15 February 2005 Goals for Today Uderstad how to Use scatter diagrams to ispect
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationStudy the bias (due to the nite dimensional approximation) and variance of the estimators
2 Series Methods 2. Geeral Approach A model has parameters (; ) where is ite-dimesioal ad is oparametric. (Sometimes, there is o :) We will focus o regressio. The fuctio is approximated by a series a ite
More informationOutput Analysis (2, Chapters 10 &11 Law)
B. Maddah ENMG 6 Simulatio Output Aalysis (, Chapters 10 &11 Law) Comparig alterative system cofiguratio Sice the output of a simulatio is radom, the comparig differet systems via simulatio should be doe
More informationDescribing the Relation between Two Variables
Copyright 010 Pearso Educatio, Ic. Tables ad Formulas for Sulliva, Statistics: Iformed Decisios Usig Data 010 Pearso Educatio, Ic Chapter Orgaizig ad Summarizig Data Relative frequecy = frequecy sum of
More informationGUIDE FOR THE USE OF THE DECISION SUPPORT SYSTEM (DSS)*
GUIDE FOR THE USE OF THE DECISION SUPPORT SYSTEM (DSS)* *Note: I Frech SAD (Système d Aide à la Décisio) 1. Itroductio to the DSS Eightee statistical distributios are available i HYFRAN-PLUS software to
More informationUnderstanding Samples
1 Will Moroe CS 109 Samplig ad Bootstrappig Lecture Notes #17 August 2, 2017 Based o a hadout by Chris Piech I this chapter we are goig to talk about statistics calculated o samples from a populatio. We
More information1 General linear Model Continued..
Geeral liear Model Cotiued.. We have We kow y = X + u X o radom u v N(0; I ) b = (X 0 X) X 0 y E( b ) = V ar( b ) = (X 0 X) We saw that b = (X 0 X) X 0 u so b is a liear fuctio of a ormally distributed
More informationEconomics 326 Methods of Empirical Research in Economics. Lecture 18: The asymptotic variance of OLS and heteroskedasticity
Ecoomics 326 Methods of Empirical Research i Ecoomics Lecture 8: The asymptotic variace of OLS ad heteroskedasticity Hiro Kasahara Uiversity of British Columbia December 24, 204 Asymptotic ormality I I
More informationGUIDELINES ON REPRESENTATIVE SAMPLING
DRUGS WORKING GROUP VALIDATION OF THE GUIDELINES ON REPRESENTATIVE SAMPLING DOCUMENT TYPE : REF. CODE: ISSUE NO: ISSUE DATE: VALIDATION REPORT DWG-SGL-001 002 08 DECEMBER 2012 Ref code: DWG-SGL-001 Issue
More informationSTA6938-Logistic Regression Model
Dr. Yig Zhag STA6938-Logistic Regressio Model Topic -Simple (Uivariate) Logistic Regressio Model Outlies:. Itroductio. A Example-Does the liear regressio model always work? 3. Maximum Likelihood Curve
More informationLast Lecture. Wald Test
Last Lecture Biostatistics 602 - Statistical Iferece Lecture 22 Hyu Mi Kag April 9th, 2013 Is the exact distributio of LRT statistic typically easy to obtai? How about its asymptotic distributio? For testig
More informationThere is no straightforward approach for choosing the warmup period l.
B. Maddah INDE 504 Discrete-Evet Simulatio Output Aalysis () Statistical Aalysis for Steady-State Parameters I a otermiatig simulatio, the iterest is i estimatig the log ru steady state measures of performace.
More informationControl Charts for Mean for Non-Normally Correlated Data
Joural of Moder Applied Statistical Methods Volume 16 Issue 1 Article 5 5-1-017 Cotrol Charts for Mea for No-Normally Correlated Data J. R. Sigh Vikram Uiversity, Ujjai, Idia Ab Latif Dar School of Studies
More informationA goodness-of-fit test based on the empirical characteristic function and a comparison of tests for normality
A goodess-of-fit test based o the empirical characteristic fuctio ad a compariso of tests for ormality J. Marti va Zyl Departmet of Mathematical Statistics ad Actuarial Sciece, Uiversity of the Free State,
More informationChapter 22. Comparing Two Proportions. Copyright 2010, 2007, 2004 Pearson Education, Inc.
Chapter 22 Comparig Two Proportios Copyright 2010, 2007, 2004 Pearso Educatio, Ic. Comparig Two Proportios Read the first two paragraphs of pg 504. Comparisos betwee two percetages are much more commo
More informationStatisticians use the word population to refer the total number of (potential) observations under consideration
6 Samplig Distributios Statisticias use the word populatio to refer the total umber of (potetial) observatios uder cosideratio The populatio is just the set of all possible outcomes i our sample space
More informationOutput Analysis and Run-Length Control
IEOR E4703: Mote Carlo Simulatio Columbia Uiversity c 2017 by Marti Haugh Output Aalysis ad Ru-Legth Cotrol I these otes we describe how the Cetral Limit Theorem ca be used to costruct approximate (1 α%
More informationOverview. p 2. Chapter 9. Pooled Estimate of. q = 1 p. Notation for Two Proportions. Inferences about Two Proportions. Assumptions
Chapter 9 Slide Ifereces from Two Samples 9- Overview 9- Ifereces about Two Proportios 9- Ifereces about Two Meas: Idepedet Samples 9-4 Ifereces about Matched Pairs 9-5 Comparig Variatio i Two Samples
More informationA RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS
J. Japa Statist. Soc. Vol. 41 No. 1 2011 67 73 A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS Yoichi Nishiyama* We cosider k-sample ad chage poit problems for idepedet data i a
More informationQuantile regression with multilayer perceptrons.
Quatile regressio with multilayer perceptros. S.-F. Dimby ad J. Rykiewicz Uiversite Paris 1 - SAMM 90 Rue de Tolbiac, 75013 Paris - Frace Abstract. We cosider oliear quatile regressio ivolvig multilayer
More information7-1. Chapter 4. Part I. Sampling Distributions and Confidence Intervals
7-1 Chapter 4 Part I. Samplig Distributios ad Cofidece Itervals 1 7- Sectio 1. Samplig Distributio 7-3 Usig Statistics Statistical Iferece: Predict ad forecast values of populatio parameters... Test hypotheses
More informationBayesian Methods: Introduction to Multi-parameter Models
Bayesia Methods: Itroductio to Multi-parameter Models Parameter: θ = ( θ, θ) Give Likelihood p(y θ) ad prior p(θ ), the posterior p proportioal to p(y θ) x p(θ ) Margial posterior ( θ, θ y) is Iterested
More information3/3/2014. CDS M Phil Econometrics. Types of Relationships. Types of Relationships. Types of Relationships. Vijayamohanan Pillai N.
3/3/04 CDS M Phil Old Least Squares (OLS) Vijayamohaa Pillai N CDS M Phil Vijayamoha CDS M Phil Vijayamoha Types of Relatioships Oly oe idepedet variable, Relatioship betwee ad is Liear relatioships Curviliear
More informationContinuous Data that can take on any real number (time/length) based on sample data. Categorical data can only be named or categorised
Questio 1. (Topics 1-3) A populatio cosists of all the members of a group about which you wat to draw a coclusio (Greek letters (μ, σ, Ν) are used) A sample is the portio of the populatio selected for
More informationEstimation for Complete Data
Estimatio for Complete Data complete data: there is o loss of iformatio durig study. complete idividual complete data= grouped data A complete idividual data is the oe i which the complete iformatio of
More informationApril 18, 2017 CONFIDENCE INTERVALS AND HYPOTHESIS TESTING, UNDERGRADUATE MATH 526 STYLE
April 18, 2017 CONFIDENCE INTERVALS AND HYPOTHESIS TESTING, UNDERGRADUATE MATH 526 STYLE TERRY SOO Abstract These otes are adapted from whe I taught Math 526 ad meat to give a quick itroductio to cofidece
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More informationJournal of Multivariate Analysis. Superefficient estimation of the marginals by exploiting knowledge on the copula
Joural of Multivariate Aalysis 102 (2011) 1315 1319 Cotets lists available at ScieceDirect Joural of Multivariate Aalysis joural homepage: www.elsevier.com/locate/jmva Superefficiet estimatio of the margials
More informationStatistics 511 Additional Materials
Cofidece Itervals o mu Statistics 511 Additioal Materials This topic officially moves us from probability to statistics. We begi to discuss makig ifereces about the populatio. Oe way to differetiate probability
More informationPrecise Rates in Complete Moment Convergence for Negatively Associated Sequences
Commuicatios of the Korea Statistical Society 29, Vol. 16, No. 5, 841 849 Precise Rates i Complete Momet Covergece for Negatively Associated Sequeces Dae-Hee Ryu 1,a a Departmet of Computer Sciece, ChugWoo
More informationStatistical Fundamentals and Control Charts
Statistical Fudametals ad Cotrol Charts 1. Statistical Process Cotrol Basics Chace causes of variatio uavoidable causes of variatios Assigable causes of variatio large variatios related to machies, materials,
More information4 Multidimensional quantitative data
Chapter 4 Multidimesioal quatitative data 4 Multidimesioal statistics Basic statistics are ow part of the curriculum of most ecologists However, statistical techiques based o such simple distributios as
More informationRandom Walks on Discrete and Continuous Circles. by Jeffrey S. Rosenthal School of Mathematics, University of Minnesota, Minneapolis, MN, U.S.A.
Radom Walks o Discrete ad Cotiuous Circles by Jeffrey S. Rosethal School of Mathematics, Uiversity of Miesota, Mieapolis, MN, U.S.A. 55455 (Appeared i Joural of Applied Probability 30 (1993), 780 789.)
More informationEcon 325 Notes on Point Estimator and Confidence Interval 1 By Hiro Kasahara
Poit Estimator Eco 325 Notes o Poit Estimator ad Cofidece Iterval 1 By Hiro Kasahara Parameter, Estimator, ad Estimate The ormal probability desity fuctio is fully characterized by two costats: populatio
More informationChapter 8: Estimating with Confidence
Chapter 8: Estimatig with Cofidece Sectio 8.2 The Practice of Statistics, 4 th editio For AP* STARNES, YATES, MOORE Chapter 8 Estimatig with Cofidece 8.1 Cofidece Itervals: The Basics 8.2 8.3 Estimatig
More informationData Analysis and Statistical Methods Statistics 651
Data Aalysis ad Statistical Methods Statistics 651 http://www.stat.tamu.edu/~suhasii/teachig.html Suhasii Subba Rao Review of testig: Example The admistrator of a ursig home wats to do a time ad motio
More information(all terms are scalars).the minimization is clearer in sum notation:
7 Multiple liear regressio: with predictors) Depedet data set: y i i = 1, oe predictad, predictors x i,k i = 1,, k = 1, ' The forecast equatio is ŷ i = b + Use matrix otatio: k =1 b k x ik Y = y 1 y 1
More information11 Correlation and Regression
11 Correlatio Regressio 11.1 Multivariate Data Ofte we look at data where several variables are recorded for the same idividuals or samplig uits. For example, at a coastal weather statio, we might record
More informationTesting Statistical Hypotheses for Compare. Means with Vague Data
Iteratioal Mathematical Forum 5 o. 3 65-6 Testig Statistical Hypotheses for Compare Meas with Vague Data E. Baloui Jamkhaeh ad A. adi Ghara Departmet of Statistics Islamic Azad iversity Ghaemshahr Brach
More information[ ] ( ) ( ) [ ] ( ) 1 [ ] [ ] Sums of Random Variables Y = a 1 X 1 + a 2 X 2 + +a n X n The expected value of Y is:
PROBABILITY FUNCTIONS A radom variable X has a probabilit associated with each of its possible values. The probabilit is termed a discrete probabilit if X ca assume ol discrete values, or X = x, x, x 3,,
More informationECON 3150/4150, Spring term Lecture 1
ECON 3150/4150, Sprig term 2013. Lecture 1 Ragar Nymoe Uiversity of Oslo 15 Jauary 2013 1 / 42 Refereces to Lecture 1 ad 2 Hill, Griffiths ad Lim, 4 ed (HGL) Ch 1-1.5; Ch 2.8-2.9,4.3-4.3.1.3 Bårdse ad
More informationThe Sampling Distribution of the Maximum. Likelihood Estimators for the Parameters of. Beta-Binomial Distribution
Iteratioal Mathematical Forum, Vol. 8, 2013, o. 26, 1263-1277 HIKARI Ltd, www.m-hikari.com http://d.doi.org/10.12988/imf.2013.3475 The Samplig Distributio of the Maimum Likelihood Estimators for the Parameters
More informationConvergence of random variables. (telegram style notes) P.J.C. Spreij
Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space
More information32 estimating the cumulative distribution function
32 estimatig the cumulative distributio fuctio 4.6 types of cofidece itervals/bads Let F be a class of distributio fuctios F ad let θ be some quatity of iterest, such as the mea of F or the whole fuctio
More informationENGI 4421 Confidence Intervals (Two Samples) Page 12-01
ENGI 44 Cofidece Itervals (Two Samples) Page -0 Two Sample Cofidece Iterval for a Differece i Populatio Meas [Navidi sectios 5.4-5.7; Devore chapter 9] From the cetral limit theorem, we kow that, for sufficietly
More information