Properties and Hypothesis Testing
|
|
- Kristian Watson
- 6 years ago
- Views:
Transcription
1 Chapter 3 Properties ad Hypothesis Testig 3.1 Types of data The regressio techiques developed i previous chapters ca be applied to three differet kids of data. 1. Cross-sectioal data. 2. Time series data. 3. Pael data. The first cosists o observig various ecoomic uit (e.g. firms, coutries, households, idividuals) at oe poit i time. For example, we observe the wages, experiece ad educatio of may idividuals, oly oce ad at all at the same time. The secod cosists o observig the same ecoomic uit at differet poit i time. For example, we observe daily stock prices over may years. Fially, the third combies the characteristics of the first ad the secod. That is, we observe various ecoomic uits at repeated poits i time. For example, we have iformatio about the iflatio, uemploymet ad GDP of a group of coutries ad over may years. 3.2 Assumptios of the model Whe the regressors i our ecoometric model are o stochastic, we will make the followig six assumptios. 1. The model is liear i the parameters ad it is correctly specified. Equatio 2.1 is liear i β, while Equatio 2.2 is ot. Y = β 1 + β 2 X+ u (3.1) Y = β 1 X β 2 + u (3.2) 23
2 24 3 Properties ad Hypothesis Testig 2. There is some variatio i the regressor i the sample. We eed variatio i the variable X to idetify the relatioship. Cosider the OLS estimator for β 2 : b 2 = i=0 (X i X)(Y i Ȳ) i=0 (X i X) 2. (3.3) If there is o variatio i X, the the deomiator is zero ad we caot obtai b The expected value of the disturbace term is zero. E(u i )=0 for all i. (3.4) Some u i will be egative, some will be positive, but o average they will be zero. If a costat is icluded i the model, the coditio is satisfied automatically. 4. The disturbace term is homoscedastic. Homoscedasticity meas that the variace of the error terms u i is costat across all observatios i. Hece, we ca write: σ 2 u i = σ 2 u for all i. (3.5) Because the error term has zero mea (from assumptio 3), the the populatio variace of u i is equal to: E(u 2 i)=σ 2 u for all i. (3.6) σ 2 u is a populatio parameter, therefore it is ukow ad eed to be estimated. 5. The values of the disturbace terms have idepedet distributios. u i is distributed idepedetly of u j for all j i. (3.7) This meas that there is o autocorrrelatio i the error term. This meas that the populatio covariace betwee u i ad u j is zero: σ ui u j = 0. (3.8) With assumptios 1 through 5, we says that OLS coefficiets are BLUE: Best Liear Ubiased Estimators. They are best, because they have the smallest variace across all ubiased estimators. 6. The disturbace term has a ormal distributio. u i N[0,σ 2 u] for all i. (3.9) The error term is distributed ormal with mea zero ad variace σ 2 u. This assumptio becomes useful at the time of performig t tests, F tests, ad costructig cofidece itervals for β 1 ad β 2 usig the regressio results. The justificatio for this assumptio depeds o the cetral limit theorem. This oe state that if a radom variable is the composite result of the effects of a large umber of
3 3.4 Precisio of the coefficiets 25 other radom variables (that are ot ecessarily ormal), it will have a approximately ormal distributio. 3.3 Ubiasedess of the coefficiets Recall that a estimator ˆθ is ubiased if E( ˆθ)=θ. The expected value of the estimator is equal to the true populatio parameter. For the slope coefficiet i the OLS regressio we have: where b 2 = i=0 (X i X)(Y i Ȳ) i=0 (X i X) 2 (3.10) = β 2 + i=0 (X i X)u i i=0 (X i X) 2 = β 2 + a i = a i u i (X i X) i=0 (X i X) 2. (3.11) Thus, this shows that b 2 is equal to its true value, β 2, plus a liear combiatio of the values of the error terms. If we take expectatios of b 2 we have: E(b 2 )=E(β 2 )+E ( ) a i u i = β2 + E(a i u i )=β 2 + a i E(u i )=β. (3.12) The term a i goes out of the expectatio because a i is oly a fuctio of costat Xs. I additio, the last equality holds because E(u i )=0. Hece, b 2 is a ubiased estimator of β 2, E(b 2 )=β Precisio of the coefficiets We are also iterested o how precise b 1 ad b 2 are i estimatig the populatio parameters β 1 ad β 2. A measure of this precisio are their populatio variaces, give by: σ 2 b 1 = σ 2 u σ 2 b 2 = ( 1 + X i=0 (X i X) 2 ), ad (3.13) σ 2 u i=0 (X i X) 2 (3.14)
4 26 3 Properties ad Hypothesis Testig Oe cocer i the implemetatio of the above formulas is that σ 2 u is a ukow populatio parameter ad eed to be estimated. A atural estimator for this regressio variace is the variace of the regressio errors. Because the populatio regressio errors u i are also ukow, we use the sample couterparts e i ad adjust for the correspodig degrees of freedom. Hece, we have: Su 2 = 1 2 e 2 i. (3.15) This Su 2 is the ubiased estimator of σu 2, ad 2 are the degrees of freedom. We subtract two from the sample size because we are estimatig two parameters: the regressio costat ad oe slope coefficiet. The, we use the followig formulas to estimate the stadard errors of b 1 ad b 2 : S b1 = S b2 = S 2 u ( 1 + X i=0 (X i X) 2 ), ad (3.16) Su 2 i=0 (X i X) 2. (3.17) 3.5 The Gauss-Markov theorem The Gauss-Markov theorem simply states that whe assumptios 1 through 5 above are satisfied, the OLS estimators are Best Liear Ubiased Estimators (BLUE) of the regressio parameters. Best refers to smallest variace. 3.6 Hypotheses testig Hypothesis testig is simply a method of makig decisios usig data. It starts with the formulatio of the ull ad the alterative hypotheses ad the uses some test statistics to assess the truth of the ull hypothesis Formulatio of the ull hypothesis The formulatio of the ull hypothesis starts with a relatioship i mid. For example, that the percetage rate of price iflatio (p) depeds o the percetage rate of wage iflatio (w) followig the liear equatio: p i = β 1 + β 2 w i + u i (3.18)
5 3.6 Hypotheses testig 27 The, you wat to test the hypothesis that the price iflatio is equal to the wage iflatio. This is deoted by H 0 ad it is kow as the ull hypothesis. I additio, we also defie a alterative hypothesis, deoted by H 1 ad represets the coclusio of the test if the ull hypothesis is rejected. For our example the ull ad the alterative hypothesis are writte as: I geeral, the ull ad alterative hypotheses are: H 0 : β 2 = 1 (3.19) H 1 : β 2 1 (3.20) H 0 : β 2 = β 0 2 (3.21) H 1 : β 2 β 0 2. (3.22) t-tests Recall that β 2 is ukow ad that we have to use the estimate b 2. The, the decisio rule to reject the ull hypothesis should compare the estimate b 2 with the hypothesized value β2 0. Ituitively, if the values are far apart, the there is evidece agaist the ull. This compariso should take ito accout the fact that b 2 is subject to some samplig variatio (it is ot the actual β 2 ). We will use the followig statistic: z= b 2 β 0 2 σ b2 (3.23) The umerator is just the distace betwee the regressio estimate ad the hypothesized value, with the deomiator is the stadard deviatio of b 2, give by the square root of the expressio i Equatio z is the umber of stadard deviatios betwee b 2 ad β 2. For a kow σ b2, this oe follows a ormal distributio. However σ b2 is ukow ad we eed to use the estimate of the stadard error of b 2. This oe is give by S b2 ad it is preseted i Equatio The we use the followig t-statistic: t = b 2 β 0 2 S b2 (3.24) To kow if the deviatios betwee b 2 ad β2 0 are sigificatly large, we compare this t-statistic with the critical values from the table t distributio with 2 degrees of freedom. The ull hypothesis is ot rejected if the followig coditio is met: t 2,α/2 b 2 β 0 2 S b2 t 2,α/2 (3.25) Where t 2,α/2 is just the otatio of the critical value tha comes from the t distributio with 2 degrees of freedom ad at sigificace level α. The sigificace
6 28 3 Properties ad Hypothesis Testig Fig. 3.1 Acceptace regio for the t-test. level is the probability that we reject the ull hypothesis whe i fact it is true. The rejectio regios are illustrated i Figure Cofidece itervals The cofidece iterval idicates the reliability of a estimate. The cofidece iterval for the populatio parameter β 2 ca be derived from Equatio 3.25 i the followig way: 1 α = P ( t 2,α/2 b 2 β 2 S b2 t 2,α/2 ) 1 α = P ( t 2,α/2 S b2 b 2 β 2 t 2,α/2 S b2 ) 1 α = P ( b 2 t 2,α/2 S b2 β 2 b 2 +t 2,α/2 S b2 ) (3.26) The meaig of the above equatio is that the populatio parameter β 2 will be betwee the lower cofidece limit b 2 t 2,α/2 S b2 ad the upper cofidece limit b 2 +t 2,α/2 S b2 with probability (1 α) or 100 (1 α)%. The p values provide a alterative approach to reportig the sigificace of regressio coefficiets or whe carryig out more geeral hypothesis testig. As you ca see from Equatio 3.25 ad Figure 3.1, differet sigificace levels α ca yield a differet coclusio i the rejectio or ot of the ull hypothesis. The p value of a hypothesis test represet the miimum sigificace level at which the ull is rejected. The, whe the p value is below the sigificace level α we reject the ull.
7 3.6 Hypotheses testig 29 Fig. 3.2 Cofidece iterval for β F test A useful tool if we wat to test if there is o relatioship betwee X ad Y if the F test. I the simple liear regressio model with oly oe slope coefficiet, the ull ad the alterative i a F test are: H 0 : β 2 = 0 (3.27) H 1 : β 2 0. (3.28) This test is build o the idea of testig how good is the regressio model i explaiig the variatio i Y. I Equatio 2.15 we already separated the variatio of Y ito its explaied ad uexplaied compoets. These are: (Y i Ȳ) 2 = (Ŷ i Ȳ) 2 + (Y i Ŷ i ) 2 (3.29) T SS = ESS+RSS. (3.30) The total sum of squares (TSS) is the summatio of the explaied sum of squares (ESS) ad the residual sum of squares (RSS). The, the F statistic for goodess of fit of a regressio is writte as the explaied sum of squares, per explaatory variable, divided by the residual sum of squares, per remaiig degrees of freedom: F = ESS/(k 1) RSS/( k) (3.31)
8 30 3 Properties ad Hypothesis Testig Fig. 3.3 Regressio output i MS Excel. where k is the total umber of coefficiets we are estimatig, hece (k 1) is the umber of slope coefficiets. That is, the total umber of parameters we are estimatig mius the costat parameter. If we divide the umerator ad the deomiator by T SS, the the F statistics ca be writte i terms of the R 2 as follows: F = (ESS/T SS)/(k 1) (RSS/T SS)/( k) = R2 /(k 1) (1 R 2 )/( k) (3.32) If this F statistic is greater that the critical value from the table F distributio with (k 1) ad ( k) degrees of freedom, F k 1, k, we reject the ull hypothesis ad coclude that the regressio model does ot sigificatly explai the variatio i variable Y. For the simple regressio model with oly oe slope coefficiet, k = 2, we have: R 2 F = (1 R 2 )/( 2). (3.33) If this F statistic>f 1, 2 we reject the ull hypothesis preseted i Equatio 3.28.
9 3.7 Computer output Computer output The computer regressio output is very similar across differet statistical packages. Figure 3.3 shows the output usig MS Excel for the estimatio of the followig simple regressio model: wage = β 1 + β 2 exper i + u i (3.34) To obtai the regressio estimated coefficiets we use Equatios 2.4 ad 2.5: b 2 = (X i X)(Y i Ȳ) (X i X) 2 = (3.35) b 1 = Ȳ b 2 X = (3.36) The total sum of squares, estimates sum of squares, ad residual sum of squares are obtaied usig 2.15 ad 2.15: T SS = ESS = RSS = The regressio R 2 comes from Equatio 2.18: R 2 = 1 From the square root of Equatio 3.15: 1 S u = 2 (Y i Ȳ) 2 = (3.37) (Ŷ i Ȳ) 2 = (3.38) (Y i Ŷ i ) 2 = (3.39) e2 i (Y = (3.40) 2 i Ȳ) e 2 i = (3.41) The, the stadard errors of the coefficiets are computer usig Equatios 3.17 ad 3.17: ( 1 S b1 = Su 2 + X ) i=0 (X i X) 2 = (3.42) Su S b2 = 2 i=0 (X = (3.43) i X) 2 The F statistic uses Equatio 3.32:
10 32 3 Properties ad Hypothesis Testig The t statistics use Equatio 3.24: F = R2 /(k 1) (1 R 2 = (3.44) )/( k) t = b 1 S b1 = (3.45) t = b 2 S b2 = (3.46) Fially, for the 95% upper ad lower cofidece levels, we use Equatio 3.26: b 1 t 2,α/2 S b1 = (3.47) b 1 +t 2,α/2 S b1 = (3.48) b 2 t 2,α/2 S b2 = (3.49) b 2 +t 2,α/2 S b2 = (3.50)
Simple Linear Regression
Chapter 2 Simple Liear Regressio 2.1 Simple liear model The simple liear regressio model shows how oe kow depedet variable is determied by a sigle explaatory variable (regressor). Is is writte as: Y i
More information3/3/2014. CDS M Phil Econometrics. Types of Relationships. Types of Relationships. Types of Relationships. Vijayamohanan Pillai N.
3/3/04 CDS M Phil Old Least Squares (OLS) Vijayamohaa Pillai N CDS M Phil Vijayamoha CDS M Phil Vijayamoha Types of Relatioships Oly oe idepedet variable, Relatioship betwee ad is Liear relatioships Curviliear
More informationRandom Variables, Sampling and Estimation
Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig
More information1 Inferential Methods for Correlation and Regression Analysis
1 Iferetial Methods for Correlatio ad Regressio Aalysis I the chapter o Correlatio ad Regressio Aalysis tools for describig bivariate cotiuous data were itroduced. The sample Pearso Correlatio Coefficiet
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationStatistical Properties of OLS estimators
1 Statistical Properties of OLS estimators Liear Model: Y i = β 0 + β 1 X i + u i OLS estimators: β 0 = Y β 1X β 1 = Best Liear Ubiased Estimator (BLUE) Liear Estimator: β 0 ad β 1 are liear fuctio of
More informationS Y Y = ΣY 2 n. Using the above expressions, the correlation coefficient is. r = SXX S Y Y
1 Sociology 405/805 Revised February 4, 004 Summary of Formulae for Bivariate Regressio ad Correlatio Let X be a idepedet variable ad Y a depedet variable, with observatios for each of the values of these
More informationEcon 325 Notes on Point Estimator and Confidence Interval 1 By Hiro Kasahara
Poit Estimator Eco 325 Notes o Poit Estimator ad Cofidece Iterval 1 By Hiro Kasahara Parameter, Estimator, ad Estimate The ormal probability desity fuctio is fully characterized by two costats: populatio
More informationMOST PEOPLE WOULD RATHER LIVE WITH A PROBLEM THEY CAN'T SOLVE, THAN ACCEPT A SOLUTION THEY CAN'T UNDERSTAND.
XI-1 (1074) MOST PEOPLE WOULD RATHER LIVE WITH A PROBLEM THEY CAN'T SOLVE, THAN ACCEPT A SOLUTION THEY CAN'T UNDERSTAND. R. E. D. WOOLSEY AND H. S. SWANSON XI-2 (1075) STATISTICAL DECISION MAKING Advaced
More informationCommon Large/Small Sample Tests 1/55
Commo Large/Small Sample Tests 1/55 Test of Hypothesis for the Mea (σ Kow) Covert sample result ( x) to a z value Hypothesis Tests for µ Cosider the test H :μ = μ H 1 :μ > μ σ Kow (Assume the populatio
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationLinear Regression Models, OLS, Assumptions and Properties
Chapter 2 Liear Regressio Models, OLS, Assumptios ad Properties 2.1 The Liear Regressio Model The liear regressio model is the sigle most useful tool i the ecoometricia s kit. The multiple regressio model
More informationStatistical inference: example 1. Inferential Statistics
Statistical iferece: example 1 Iferetial Statistics POPULATION SAMPLE A clothig store chai regularly buys from a supplier large quatities of a certai piece of clothig. Each item ca be classified either
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationLesson 11: Simple Linear Regression
Lesso 11: Simple Liear Regressio Ka-fu WONG December 2, 2004 I previous lessos, we have covered maily about the estimatio of populatio mea (or expected value) ad its iferece. Sometimes we are iterested
More informationOverview. p 2. Chapter 9. Pooled Estimate of. q = 1 p. Notation for Two Proportions. Inferences about Two Proportions. Assumptions
Chapter 9 Slide Ifereces from Two Samples 9- Overview 9- Ifereces about Two Proportios 9- Ifereces about Two Meas: Idepedet Samples 9-4 Ifereces about Matched Pairs 9-5 Comparig Variatio i Two Samples
More informationIf, for instance, we were required to test whether the population mean μ could be equal to a certain value μ
STATISTICAL INFERENCE INTRODUCTION Statistical iferece is that brach of Statistics i which oe typically makes a statemet about a populatio based upo the results of a sample. I oesample testig, we essetially
More information(all terms are scalars).the minimization is clearer in sum notation:
7 Multiple liear regressio: with predictors) Depedet data set: y i i = 1, oe predictad, predictors x i,k i = 1,, k = 1, ' The forecast equatio is ŷ i = b + Use matrix otatio: k =1 b k x ik Y = y 1 y 1
More informationChapter 13, Part A Analysis of Variance and Experimental Design
Slides Prepared by JOHN S. LOUCKS St. Edward s Uiversity Slide 1 Chapter 13, Part A Aalysis of Variace ad Eperimetal Desig Itroductio to Aalysis of Variace Aalysis of Variace: Testig for the Equality of
More informationAlgebra of Least Squares
October 19, 2018 Algebra of Least Squares Geometry of Least Squares Recall that out data is like a table [Y X] where Y collects observatios o the depedet variable Y ad X collects observatios o the k-dimesioal
More informationSample Size Determination (Two or More Samples)
Sample Sie Determiatio (Two or More Samples) STATGRAPHICS Rev. 963 Summary... Data Iput... Aalysis Summary... 5 Power Curve... 5 Calculatios... 6 Summary This procedure determies a suitable sample sie
More informationHYPOTHESIS TESTS FOR ONE POPULATION MEAN WORKSHEET MTH 1210, FALL 2018
HYPOTHESIS TESTS FOR ONE POPULATION MEAN WORKSHEET MTH 1210, FALL 2018 We are resposible for 2 types of hypothesis tests that produce ifereces about the ukow populatio mea, µ, each of which has 3 possible
More informationFACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures
FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING Lectures MODULE 5 STATISTICS II. Mea ad stadard error of sample data. Biomial distributio. Normal distributio 4. Samplig 5. Cofidece itervals
More informationSTATISTICAL INFERENCE
STATISTICAL INFERENCE POPULATION AND SAMPLE Populatio = all elemets of iterest Characterized by a distributio F with some parameter θ Sample = the data X 1,..., X, selected subset of the populatio = sample
More information2 1. The r.s., of size n2, from population 2 will be. 2 and 2. 2) The two populations are independent. This implies that all of the n1 n2
Chapter 8 Comparig Two Treatmets Iferece about Two Populatio Meas We wat to compare the meas of two populatios to see whether they differ. There are two situatios to cosider, as show i the followig examples:
More information[ ] ( ) ( ) [ ] ( ) 1 [ ] [ ] Sums of Random Variables Y = a 1 X 1 + a 2 X 2 + +a n X n The expected value of Y is:
PROBABILITY FUNCTIONS A radom variable X has a probabilit associated with each of its possible values. The probabilit is termed a discrete probabilit if X ca assume ol discrete values, or X = x, x, x 3,,
More informationRegression, Inference, and Model Building
Regressio, Iferece, ad Model Buildig Scatter Plots ad Correlatio Correlatio coefficiet, r -1 r 1 If r is positive, the the scatter plot has a positive slope ad variables are said to have a positive relatioship
More informationStat 200 -Testing Summary Page 1
Stat 00 -Testig Summary Page 1 Mathematicias are like Frechme; whatever you say to them, they traslate it ito their ow laguage ad forthwith it is somethig etirely differet Goethe 1 Large Sample Cofidece
More informationt distribution [34] : used to test a mean against an hypothesized value (H 0 : µ = µ 0 ) or the difference
EXST30 Backgroud material Page From the textbook The Statistical Sleuth Mea [0]: I your text the word mea deotes a populatio mea (µ) while the work average deotes a sample average ( ). Variace [0]: The
More informationPSYCHOLOGICAL RESEARCH (PYC 304-C) Lecture 9
Hypothesis testig PSYCHOLOGICAL RESEARCH (PYC 34-C Lecture 9 Statistical iferece is that brach of Statistics i which oe typically makes a statemet about a populatio based upo the results of a sample. I
More information- E < p. ˆ p q ˆ E = q ˆ = 1 - p ˆ = sample proportion of x failures in a sample size of n. where. x n sample proportion. population proportion
1 Chapter 7 ad 8 Review for Exam Chapter 7 Estimates ad Sample Sizes 2 Defiitio Cofidece Iterval (or Iterval Estimate) a rage (or a iterval) of values used to estimate the true value of the populatio parameter
More informationECON 3150/4150, Spring term Lecture 3
Itroductio Fidig the best fit by regressio Residuals ad R-sq Regressio ad causality Summary ad ext step ECON 3150/4150, Sprig term 2014. Lecture 3 Ragar Nymoe Uiversity of Oslo 21 Jauary 2014 1 / 30 Itroductio
More informationFrequentist Inference
Frequetist Iferece The topics of the ext three sectios are useful applicatios of the Cetral Limit Theorem. Without kowig aythig about the uderlyig distributio of a sequece of radom variables {X i }, for
More informationExpectation and Variance of a random variable
Chapter 11 Expectatio ad Variace of a radom variable The aim of this lecture is to defie ad itroduce mathematical Expectatio ad variace of a fuctio of discrete & cotiuous radom variables ad the distributio
More informationInvestigating the Significance of a Correlation Coefficient using Jackknife Estimates
Iteratioal Joural of Scieces: Basic ad Applied Research (IJSBAR) ISSN 2307-4531 (Prit & Olie) http://gssrr.org/idex.php?joural=jouralofbasicadapplied ---------------------------------------------------------------------------------------------------------------------------
More informationDS 100: Principles and Techniques of Data Science Date: April 13, Discussion #10
DS 00: Priciples ad Techiques of Data Sciece Date: April 3, 208 Name: Hypothesis Testig Discussio #0. Defie these terms below as they relate to hypothesis testig. a) Data Geeratio Model: Solutio: A set
More informationGeometry of LS. LECTURE 3 GEOMETRY OF LS, PROPERTIES OF σ 2, PARTITIONED REGRESSION, GOODNESS OF FIT
OCTOBER 7, 2016 LECTURE 3 GEOMETRY OF LS, PROPERTIES OF σ 2, PARTITIONED REGRESSION, GOODNESS OF FIT Geometry of LS We ca thik of y ad the colums of X as members of the -dimesioal Euclidea space R Oe ca
More informationResampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.
Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator
More informationChapter 13: Tests of Hypothesis Section 13.1 Introduction
Chapter 13: Tests of Hypothesis Sectio 13.1 Itroductio RECAP: Chapter 1 discussed the Likelihood Ratio Method as a geeral approach to fid good test procedures. Testig for the Normal Mea Example, discussed
More informationFinal Examination Solutions 17/6/2010
The Islamic Uiversity of Gaza Faculty of Commerce epartmet of Ecoomics ad Political Scieces A Itroductio to Statistics Course (ECOE 30) Sprig Semester 009-00 Fial Eamiatio Solutios 7/6/00 Name: I: Istructor:
More informationUNIVERSITY OF TORONTO Faculty of Arts and Science APRIL/MAY 2009 EXAMINATIONS ECO220Y1Y PART 1 OF 2 SOLUTIONS
PART of UNIVERSITY OF TORONTO Faculty of Arts ad Sciece APRIL/MAY 009 EAMINATIONS ECO0YY PART OF () The sample media is greater tha the sample mea whe there is. (B) () A radom variable is ormally distributed
More information11 Correlation and Regression
11 Correlatio Regressio 11.1 Multivariate Data Ofte we look at data where several variables are recorded for the same idividuals or samplig uits. For example, at a coastal weather statio, we might record
More informationStatistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.
Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized
More informationA statistical method to determine sample size to estimate characteristic value of soil parameters
A statistical method to determie sample size to estimate characteristic value of soil parameters Y. Hojo, B. Setiawa 2 ad M. Suzuki 3 Abstract Sample size is a importat factor to be cosidered i determiig
More informationSTATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS. Comments:
Recall: STATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS Commets:. So far we have estimates of the parameters! 0 ad!, but have o idea how good these estimates are. Assumptio: E(Y x)! 0 +! x (liear coditioal
More informationCEU Department of Economics Econometrics 1, Problem Set 1 - Solutions
CEU Departmet of Ecoomics Ecoometrics, Problem Set - Solutios Part A. Exogeeity - edogeeity The liear coditioal expectatio (CE) model has the followig form: We would like to estimate the effect of some
More informationLinear Regression Models
Liear Regressio Models Dr. Joh Mellor-Crummey Departmet of Computer Sciece Rice Uiversity johmc@cs.rice.edu COMP 528 Lecture 9 15 February 2005 Goals for Today Uderstad how to Use scatter diagrams to ispect
More informationBIOS 4110: Introduction to Biostatistics. Breheny. Lab #9
BIOS 4110: Itroductio to Biostatistics Brehey Lab #9 The Cetral Limit Theorem is very importat i the realm of statistics, ad today's lab will explore the applicatio of it i both categorical ad cotiuous
More informationEfficient GMM LECTURE 12 GMM II
DECEMBER 1 010 LECTURE 1 II Efficiet The estimator depeds o the choice of the weight matrix A. The efficiet estimator is the oe that has the smallest asymptotic variace amog all estimators defied by differet
More informationDescribing the Relation between Two Variables
Copyright 010 Pearso Educatio, Ic. Tables ad Formulas for Sulliva, Statistics: Iformed Decisios Usig Data 010 Pearso Educatio, Ic Chapter Orgaizig ad Summarizig Data Relative frequecy = frequecy sum of
More informationCLRM estimation Pietro Coretto Econometrics
Slide Set 4 CLRM estimatio Pietro Coretto pcoretto@uisa.it Ecoometrics Master i Ecoomics ad Fiace (MEF) Uiversità degli Studi di Napoli Federico II Versio: Thursday 24 th Jauary, 2019 (h08:41) P. Coretto
More informationEconomics 241B Relation to Method of Moments and Maximum Likelihood OLSE as a Maximum Likelihood Estimator
Ecoomics 24B Relatio to Method of Momets ad Maximum Likelihood OLSE as a Maximum Likelihood Estimator Uder Assumptio 5 we have speci ed the distributio of the error, so we ca estimate the model parameters
More informationContinuous Data that can take on any real number (time/length) based on sample data. Categorical data can only be named or categorised
Questio 1. (Topics 1-3) A populatio cosists of all the members of a group about which you wat to draw a coclusio (Greek letters (μ, σ, Ν) are used) A sample is the portio of the populatio selected for
More informationMA Advanced Econometrics: Properties of Least Squares Estimators
MA Advaced Ecoometrics: Properties of Least Squares Estimators Karl Whela School of Ecoomics, UCD February 5, 20 Karl Whela UCD Least Squares Estimators February 5, 20 / 5 Part I Least Squares: Some Fiite-Sample
More informationBecause it tests for differences between multiple pairs of means in one test, it is called an omnibus test.
Math 308 Sprig 018 Classes 19 ad 0: Aalysis of Variace (ANOVA) Page 1 of 6 Itroductio ANOVA is a statistical procedure for determiig whether three or more sample meas were draw from populatios with equal
More informationChapter 22. Comparing Two Proportions. Copyright 2010, 2007, 2004 Pearson Education, Inc.
Chapter 22 Comparig Two Proportios Copyright 2010, 2007, 2004 Pearso Educatio, Ic. Comparig Two Proportios Read the first two paragraphs of pg 504. Comparisos betwee two percetages are much more commo
More informationMath 152. Rumbos Fall Solutions to Review Problems for Exam #2. Number of Heads Frequency
Math 152. Rumbos Fall 2009 1 Solutios to Review Problems for Exam #2 1. I the book Experimetatio ad Measuremet, by W. J. Youde ad published by the by the Natioal Sciece Teachers Associatio i 1962, the
More informationComparing Two Populations. Topic 15 - Two Sample Inference I. Comparing Two Means. Comparing Two Pop Means. Background Reading
Topic 15 - Two Sample Iferece I STAT 511 Professor Bruce Craig Comparig Two Populatios Research ofte ivolves the compariso of two or more samples from differet populatios Graphical summaries provide visual
More informationMATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4
MATH 30: Probability ad Statistics 9. Estimatio ad Testig of Parameters Estimatio ad Testig of Parameters We have bee dealig situatios i which we have full kowledge of the distributio of a radom variable.
More informationUNIT 11 MULTIPLE LINEAR REGRESSION
UNIT MULTIPLE LINEAR REGRESSION Structure. Itroductio release relies Obectives. Multiple Liear Regressio Model.3 Estimatio of Model Parameters Use of Matrix Notatio Properties of Least Squares Estimates.4
More informationProblem Set 4 Due Oct, 12
EE226: Radom Processes i Systems Lecturer: Jea C. Walrad Problem Set 4 Due Oct, 12 Fall 06 GSI: Assae Gueye This problem set essetially reviews detectio theory ad hypothesis testig ad some basic otios
More informationGG313 GEOLOGICAL DATA ANALYSIS
GG313 GEOLOGICAL DATA ANALYSIS 1 Testig Hypothesis GG313 GEOLOGICAL DATA ANALYSIS LECTURE NOTES PAUL WESSEL SECTION TESTING OF HYPOTHESES Much of statistics is cocered with testig hypothesis agaist data
More informationSTA Learning Objectives. Population Proportions. Module 10 Comparing Two Proportions. Upon completing this module, you should be able to:
STA 2023 Module 10 Comparig Two Proportios Learig Objectives Upo completig this module, you should be able to: 1. Perform large-sample ifereces (hypothesis test ad cofidece itervals) to compare two populatio
More information4. Hypothesis testing (Hotelling s T 2 -statistic)
4. Hypothesis testig (Hotellig s T -statistic) Cosider the test of hypothesis H 0 : = 0 H A = 6= 0 4. The Uio-Itersectio Priciple W accept the hypothesis H 0 as valid if ad oly if H 0 (a) : a T = a T 0
More informationEXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY
EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA, 016 MODULE : Statistical Iferece Time allowed: Three hours Cadidates should aswer FIVE questios. All questios carry equal marks. The umber
More informationIntroduction to Econometrics (3 rd Updated Edition) Solutions to Odd- Numbered End- of- Chapter Exercises: Chapter 3
Itroductio to Ecoometrics (3 rd Updated Editio) by James H. Stock ad Mark W. Watso Solutios to Odd- Numbered Ed- of- Chapter Exercises: Chapter 3 (This versio August 17, 014) 015 Pearso Educatio, Ic. Stock/Watso
More informationThe variance of a sum of independent variables is the sum of their variances, since covariances are zero. Therefore. V (xi )= n n 2 σ2 = σ2.
SAMPLE STATISTICS A radom sample x 1,x,,x from a distributio f(x) is a set of idepedetly ad idetically variables with x i f(x) for all i Their joit pdf is f(x 1,x,,x )=f(x 1 )f(x ) f(x )= f(x i ) The sample
More informationCorrelation Regression
Correlatio Regressio While correlatio methods measure the stregth of a liear relatioship betwee two variables, we might wish to go a little further: How much does oe variable chage for a give chage i aother
More information1 Review of Probability & Statistics
1 Review of Probability & Statistics a. I a group of 000 people, it has bee reported that there are: 61 smokers 670 over 5 960 people who imbibe (drik alcohol) 86 smokers who imbibe 90 imbibers over 5
More informationLecture 3. Properties of Summary Statistics: Sampling Distribution
Lecture 3 Properties of Summary Statistics: Samplig Distributio Mai Theme How ca we use math to justify that our umerical summaries from the sample are good summaries of the populatio? Lecture Summary
More informationChapter 11: Asking and Answering Questions About the Difference of Two Proportions
Chapter 11: Askig ad Aswerig Questios About the Differece of Two Proportios These otes reflect material from our text, Statistics, Learig from Data, First Editio, by Roxy Peck, published by CENGAGE Learig,
More informationLast Lecture. Wald Test
Last Lecture Biostatistics 602 - Statistical Iferece Lecture 22 Hyu Mi Kag April 9th, 2013 Is the exact distributio of LRT statistic typically easy to obtai? How about its asymptotic distributio? For testig
More informationFirst, note that the LS residuals are orthogonal to the regressors. X Xb X y = 0 ( normal equations ; (k 1) ) So,
0 2. OLS Part II The OLS residuals are orthogoal to the regressors. If the model icludes a itercept, the orthogoality of the residuals ad regressors gives rise to three results, which have limited practical
More informationMathematical Notation Math Introduction to Applied Statistics
Mathematical Notatio Math 113 - Itroductio to Applied Statistics Name : Use Word or WordPerfect to recreate the followig documets. Each article is worth 10 poits ad ca be prited ad give to the istructor
More informationSimple Linear Regression
Simple Liear Regressio 1. Model ad Parameter Estimatio (a) Suppose our data cosist of a collectio of pairs (x i, y i ), where x i is a observed value of variable X ad y i is the correspodig observatio
More informationThis is an introductory course in Analysis of Variance and Design of Experiments.
1 Notes for M 384E, Wedesday, Jauary 21, 2009 (Please ote: I will ot pass out hard-copy class otes i future classes. If there are writte class otes, they will be posted o the web by the ight before class
More informationMA238 Assignment 4 Solutions (part a)
(i) Sigle sample tests. Questio. MA38 Assigmet 4 Solutios (part a) (a) (b) (c) H 0 : = 50 sq. ft H A : < 50 sq. ft H 0 : = 3 mpg H A : > 3 mpg H 0 : = 5 mm H A : 5mm Questio. (i) What are the ull ad alterative
More informationStat 319 Theory of Statistics (2) Exercises
Kig Saud Uiversity College of Sciece Statistics ad Operatios Research Departmet Stat 39 Theory of Statistics () Exercises Refereces:. Itroductio to Mathematical Statistics, Sixth Editio, by R. Hogg, J.
More informationSection 9.2. Tests About a Population Proportion 12/17/2014. Carrying Out a Significance Test H A N T. Parameters & Hypothesis
Sectio 9.2 Tests About a Populatio Proportio P H A N T O M S Parameters Hypothesis Assess Coditios Name the Test Test Statistic (Calculate) Obtai P value Make a decisio State coclusio Sectio 9.2 Tests
More informationStatistics 511 Additional Materials
Cofidece Itervals o mu Statistics 511 Additioal Materials This topic officially moves us from probability to statistics. We begi to discuss makig ifereces about the populatio. Oe way to differetiate probability
More informationChapter 22. Comparing Two Proportions. Copyright 2010 Pearson Education, Inc.
Chapter 22 Comparig Two Proportios Copyright 2010 Pearso Educatio, Ic. Comparig Two Proportios Comparisos betwee two percetages are much more commo tha questios about isolated percetages. Ad they are more
More information7-1. Chapter 4. Part I. Sampling Distributions and Confidence Intervals
7-1 Chapter 4 Part I. Samplig Distributios ad Cofidece Itervals 1 7- Sectio 1. Samplig Distributio 7-3 Usig Statistics Statistical Iferece: Predict ad forecast values of populatio parameters... Test hypotheses
More informationStatistical Inference About Means and Proportions With Two Populations
Departmet of Quatitative Methods & Iformatio Systems Itroductio to Busiess Statistics QM 220 Chapter 10 Statistical Iferece About Meas ad Proportios With Two Populatios Fall 2010 Dr. Mohammad Zaial 1 Chapter
More informationTopic 18: Composite Hypotheses
Toc 18: November, 211 Simple hypotheses limit us to a decisio betwee oe of two possible states of ature. This limitatio does ot allow us, uder the procedures of hypothesis testig to address the basic questio:
More informationStat 139 Homework 7 Solutions, Fall 2015
Stat 139 Homework 7 Solutios, Fall 2015 Problem 1. I class we leared that the classical simple liear regressio model assumes the followig distributio of resposes: Y i = β 0 + β 1 X i + ɛ i, i = 1,...,,
More informationTAMS24: Notations and Formulas
TAMS4: Notatios ad Formulas Basic otatios ad defiitios X: radom variable stokastiska variabel Mea Vätevärde: µ = X = by Xiagfeg Yag kpx k, if X is discrete, xf Xxdx, if X is cotiuous Variace Varias: =
More informationFirst Year Quantitative Comp Exam Spring, Part I - 203A. f X (x) = 0 otherwise
First Year Quatitative Comp Exam Sprig, 2012 Istructio: There are three parts. Aswer every questio i every part. Questio I-1 Part I - 203A A radom variable X is distributed with the margial desity: >
More informationLecture 22: Review for Exam 2. 1 Basic Model Assumptions (without Gaussian Noise)
Lecture 22: Review for Exam 2 Basic Model Assumptios (without Gaussia Noise) We model oe cotiuous respose variable Y, as a liear fuctio of p umerical predictors, plus oise: Y = β 0 + β X +... β p X p +
More informationA quick activity - Central Limit Theorem and Proportions. Lecture 21: Testing Proportions. Results from the GSS. Statistics and the General Population
A quick activity - Cetral Limit Theorem ad Proportios Lecture 21: Testig Proportios Statistics 10 Coli Rudel Flip a coi 30 times this is goig to get loud! Record the umber of heads you obtaied ad calculate
More informationLecture 5: Parametric Hypothesis Testing: Comparing Means. GENOME 560, Spring 2016 Doug Fowler, GS
Lecture 5: Parametric Hypothesis Testig: Comparig Meas GENOME 560, Sprig 2016 Doug Fowler, GS (dfowler@uw.edu) 1 Review from last week What is a cofidece iterval? 2 Review from last week What is a cofidece
More information6 Sample Size Calculations
6 Sample Size Calculatios Oe of the major resposibilities of a cliical trial statisticia is to aid the ivestigators i determiig the sample size required to coduct a study The most commo procedure for determiig
More information[412] A TEST FOR HOMOGENEITY OF THE MARGINAL DISTRIBUTIONS IN A TWO-WAY CLASSIFICATION
[412] A TEST FOR HOMOGENEITY OF THE MARGINAL DISTRIBUTIONS IN A TWO-WAY CLASSIFICATION BY ALAN STUART Divisio of Research Techiques, Lodo School of Ecoomics 1. INTRODUCTION There are several circumstaces
More informationChapter 6 Sampling Distributions
Chapter 6 Samplig Distributios 1 I most experimets, we have more tha oe measuremet for ay give variable, each measuremet beig associated with oe radomly selected a member of a populatio. Hece we eed to
More information5. Likelihood Ratio Tests
1 of 5 7/29/2009 3:16 PM Virtual Laboratories > 9. Hy pothesis Testig > 1 2 3 4 5 6 7 5. Likelihood Ratio Tests Prelimiaries As usual, our startig poit is a radom experimet with a uderlyig sample space,
More informationLecture 2: Monte Carlo Simulation
STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: Ye-Chi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?
More informationSampling, Sampling Distribution and Normality
4/17/11 Tools of Busiess Statistics Samplig, Samplig Distributio ad ormality Preseted by: Mahedra Adhi ugroho, M.Sc Descriptive statistics Collectig, presetig, ad describig data Iferetial statistics Drawig
More informationEstimation for Complete Data
Estimatio for Complete Data complete data: there is o loss of iformatio durig study. complete idividual complete data= grouped data A complete idividual data is the oe i which the complete iformatio of
More informationGoodness-Of-Fit For The Generalized Exponential Distribution. Abstract
Goodess-Of-Fit For The Geeralized Expoetial Distributio By Amal S. Hassa stitute of Statistical Studies & Research Cairo Uiversity Abstract Recetly a ew distributio called geeralized expoetial or expoetiated
More informationOpen book and notes. 120 minutes. Cover page and six pages of exam. No calculators.
IE 330 Seat # Ope book ad otes 120 miutes Cover page ad six pages of exam No calculators Score Fial Exam (example) Schmeiser Ope book ad otes No calculator 120 miutes 1 True or false (for each, 2 poits
More informationLecture 6 Chi Square Distribution (χ 2 ) and Least Squares Fitting
Lecture 6 Chi Square Distributio (χ ) ad Least Squares Fittig Chi Square Distributio (χ ) Suppose: We have a set of measuremets {x 1, x, x }. We kow the true value of each x i (x t1, x t, x t ). We would
More information