Table 1: Mean FEV1 (and sample size) by smoking status and time. FEV (L/sec)
|
|
- Tobias Jennings
- 5 years ago
- Views:
Transcription
1 1. A study i the Netherlads followed me ad wome for up to 21 years. At three year itervals, participats aswered questios about respiratory symptoms ad smokig status. Pulmoary fuctio was determied by forced expiratory volume i oe secod (FEV1) at each observatio time. The data i this questio cosist of participats who did ot chage smokig status over the duratio of the study. There are 32 former smokers ad 101 curret smokers for a total of 133 participats. Although it was iteded for FEV1 to be recorded at all time poits (baselie, every three years through year 15, ad at year 19), ot all idividuals have FEV at every time poit. Some possibly helpful descriptive statistics ad plots are show below. Former Smoker Curret Smoker Time (N=32) (N=101) (23) 3.23 (85) (27) 3.12 (95) (28) 3.09 (89) (30) 2.87 (85) (29) 2.80 (81) (24) 2.68 (73) (28) 2.50 (74) Table 1: Mea FEV1 (ad sample size) by smokig status ad time. Curret Smokers Former Smokers FEV (L/sec) FEV (L/sec) Time Time Figure 1: Mea trajectory (solid lie) ad idividual trajectories (dashed lie) by smokig status.
2 The results from fittig the model E(Y ij X) =β 0 + β 1 t ij + β 2 S i usig ordiary least squares are show below. Here i idicates the subject (1 to 133), j idexes the time measuremets o a specific subject, ad S i is the biary idicator of smokig status (1=curret smoker).. regress fev year smoke Source SS df MS Number of obs = F( 2, 768) = Model Prob > F = Residual R-squared = Adj R-squared = Total Root MSE = fev Coef. Std. Err. t P> t [95% Cof. Iterval] year smoke _cos (a) For each of the followig, describe the effect o the value if the regressio were ru usig GEE with a idepedet workig covariace matrix. (Chose from: stay the same, icrease, decrease, differ but could be i either directio, or caot be determied). Provide a brief justificatio for your choice. i. ˆβ0 Solutio: All of these poit estimates will stay the same because the equatios used to solve for the estimates are the same usig OLS ( ˆβ =(X T X) 1 (X T Y )) ad GEE with workig idepedece ( ˆβ =(X T W 1 X) 1 (X T W 1 Y ), W = I) ii. ˆβ1 Solutio: All poit estimates stay the same. iii. ˆβ2 Solutio: All poit estimates stay the same. Page 2
3 iv. Stadard error of ˆβ 0 Solutio: The stadard errors icrease for estimates of betas that must be made betwee subjects (effect of smokig ad mea at baselie) due to loss of idepedet subjects whe ot assumig that all measuremets are idepedet. v. Stadard error of ˆβ 1 Solutio: The stadard errors decrease for estimates of betas that ca be made withi subject (i.e. tred over time) due to positive correlatio of measuremets withi idividuals. vi. Stadard error of ˆβ 2 Solutio: The stadard errors icrease for estimates of betas that must be made betwee subjects (effect of smokig ad mea at baselie) due to loss of idepedet subjects whe ot assumig that all measuremets are idepedet. (b) A statistics studet brigs output from Stata ad expresses cocer that the results are slightly differet whe usig differet workig covariace matrices i GEE. Explai to this statistics studet why the results may be differet usig differet workig covariace structures. Be sure to iclude (a) why the poit estimates may be differet, (b) why the stadard errors may be differet, ad (c) if these differeces represet a substatial problem with the GEE method. You may assume that the statistics studet ca uderstad mathematical otatio, but you should iclude writte explaatio as well. Solutio: Estimates i GEE come from solvig the equatio ˆβ = (X T W 1 X) 1 (X T W 1 Y ), where W is the workig covariace matrix. Therefore, usig a differet form of the workig covariace matrix will lead to slightly differet estimates. The stadard errors of ˆβ are give by (X T W 1 X) 1 X T W 1 (rr T )W 1 X(X T W 1 X) 1, where r is the vector of residuals. Thus the stadard errors will also differ based o the choice of workig covariace matrix. These differeces do ot represet a problem with the GEE method although choosig a workig covariace structure that is close to the truth will be more efficiet, all choices will result i estimates ad stadard errors with the correct iferetial properties (e.g., ubiased estimates ad omial type I error rate). Page 3
4 (c) A collaborator suggests usig a radom effects model istead of GEE. This collaborator is satisfied with the model of a liear time effect ad a fixed effect of smokig that was used above. The collaborator suggests icludig a radom itercept ad a radom time effect (radom slope). There are three possible models: oe with radom itercepts, oe with idepedet radom itercepts ad slopes, ad oe with possibly correlated radom itercepts ad slopes. Which of these models is most aalogous to the GEE model usig workig exchageable? Explai your choice. Solutio: The model with radom itercepts oly is aalogous to GEE with a exchageable correlatio structure; the robust stadard errors do ot formally assume that this model is maitaied, but the exchageable covariace structure assumes a costat correlatio betwee measuremets o the same idividual, which is exactly what is assumed with the radom itercept model. (d) The STATA output from fittig the model with possibly correlated radom itercepts ad slopes is show below. As alluded to previously, this model is: Y ij = β 0 + β 1 t ij + β 2 S i +b 0i +b 1i t ij + ij As before, i idicates the subject (1 to 133), j idexes the time measuremets o a specific subject, ad S i is the biary idicator of smokig status (1=curret smoker).. xtmixed fev year smoke id: year, cov(ustructured) [some output omitted] fev Coef. Std. Err. z P> z [95% Cof. Iterval] year smoke _cos Radom-effects Parameters Estimate Std. Err. [95% Cof. Iterval] id: Ustructured sd(year) sd(_cos) corr(year,_cos) sd(residual) Page 4
5 For each term below, (1) ote the estimate provided by this model ad (2) provide a iterpretatio suitable for a o-statisticia. Estimate ˆβ Iterpretatio This is the estimated FEV1 at baselie for a typical former smoker. ˆβ This is the estimated chage i FEV1 for each year i the study for a typical idividual, holdig smokig status costat. ˆβ This is the estimated differece i mea FEV1 betwee curret ad former smokers. ˆσ b This represets a measure of the idividual variability i the baselie FEV1 values. ˆσ b This represets a measure of the idividual variability i the slope. ˆρ b0,b This is the estimated correlatio betwee the radom itercepts ad radom slopes, idicatig that idividuals with higher estimated itercepts have more egative slopes (faster rate of FEV1 declie). Page 5
6 (e) Adifferet collaborator suggests ceterig the time variable usig t ij = t ij 9. If the same model is ru usig this ew cetered time variable, describe what you kow about the results based o the results of the model with the ucetered time variable ad the descriptive statistics of the data. Provide justificatio for your respose. i. What will happe to the estimate ad stadard error of ˆβ 1? Solutio: The estimate of the slope ad the stadard error of this estimate will be uchaged due to the ceterig of the time values. ii. What will happe to the estimate ad stadard error of ˆβ 2? Solutio: The estimate of the slope ad the stadard error of this estimate will be uchaged due to the ceterig of the time values. iii. What will happe to the estimate ad stadard error of ˆβ 0? Solutio: The estimate of the itercept will be exactly ˆβ 0old 9( ˆβ 1 ), which is The stadard error will differ depedig o variatio i the data; we would expect it to be smaller if the data are truly homoscedastic. iv. What will happe to the estimate of ˆσ b0? Solutio: The estimate of the variability of the radom itercept effect may be differet. If the data were truly homoscedastic, we would expect the variability of the radom itercept to be slightly less after early ceterig the time values. v. What will happe to the estimate of ˆσ b1? Solutio: The estimate of the variability of the radom slopes should remai uchaged. vi. What will happe to the estimate of ˆρ b0,b 1? Solutio: The correlatio betwee the radom effects will likely decrease i absolute value due to the itercept at t = 9. With the itercept at t =0, we saw that the radom itercept ad slope were egatively correlated, idicatig that higher that average values at t =0leadtosteeperslopes (egative values of b 1 ). At t =9,weexpectthiscorrelatiotobeless strog. (f) Fially, ot all participats completed the lug fuctio assessmet at each scheduled time poit. A collaborator turs to you ad asks, is this a problem? Briefly discuss the missig data mechaism assumed i the followig two approaches. Use Page 6
7 laguage appropriate for a scietific collaborator. i. A GEE approach? Solutio: The GEE approach assumes that the missig data mechaism is missig completely at radom; i this sceario this might be because the machie was broke o radom days. However, if the data were missig due to smokig status or rate of lug fuctio declie (i.e., ot missig completely at radom), the GEE approach could be problematic. I such asceario,estimatesmaybebiasedduetotheuobserveddata. ii. A radom effects model? Solutio: The radom effects model assumes that the missig data mechaism is missig at radom; i this sceario the missig mechaism might be related to smokig status (for istace) ad the radom effects model would be valid. However, if the data were missig based o uobserved factors (i.e., missig ot at radom), this would pose a problem similar to that described usig the GEE approach. Page 7
8 Divisio of Biostatistics Q2 Exam Day 1 Methods ad Applicatios Survival Questio Cosider a idepedet cesorship model i which failure time T is expoetial with hazard rate θ ad cesorig time C follows a arbitrary oparametric distributio free of θ. The observed data are {(x i,δ i ),i =1,...,} where x i =mi(t i,c i ) ad δ i = I(t i c i ). 1. Write out the full likelihood fuctio L f. Obtai the MLE, say ˆθ 1, of θ from the fuctio L f based o the observed data. The full likelihood fuctio o the basis of (x 1,δ 1 ),...,(x,δ ) is L f = [f(x i ; θ)s C (x i )] δ i [f C (x i )S(x i ; θ)] 1 δ i f(x i ; θ) δ i S(x i ; θ) 1 δ i = Score fuctio is l (θ) = i (δ i/θ x i ) MLE of θ is ˆθ 1 = i δ i i x i. (θe θx i ) δ i (e θx i ) 1 δ i 2. What is the asymptotic distributio of ˆθ 1? Provide a estimator of the asymptotic variace of ˆθ 1. We have l (θ) = i δ i/θ 2, by the asymptotic ormality of MLE, (ˆθ1 θ) D N (0, θ 2 i δ ) i 3. What is the role of the distributio of C i i the maximum likelihood derivatio of ˆθ 1, ad the asymptotic distributio of ˆθ 1? Explai with details. Uder idepedet cesorig, both the likelihood fuctio used to derive ˆθ 1 ad the asymptotic distributio of ˆθ 1 does ot ivolve C distributio. It is uisace ad does ot cotribute to the estimatio ad iferece of parameter θ i T distributio. I the followig, assume that cesorig time C also follows a expoetial distributio with hazard rate λ, ad λ = θ. 1
9 4. Obtai the MLE, say ˆθ 2, of θ based o the observed data. The full likelihood fuctio becomes L f = {θe θx i e λx i } δ i (λe λx i e θx i ) 1 δ i = θe 2θx i Score fuctio is l f = i (1/θ 2x i) MLE of θ is ˆθ 2 = 2. i x i 5. What is the asymptotic distributio of ˆθ 2? Be explicit with the distributioal parameters. l f = θ 2, so we have (ˆθ2 θ) D N (0, θ2 ) (X =mi(t,c) exp(2θ), so i x i/ p 1/2θ ad ˆθ 2 = 2 i x i p θ) 6. I this case, does the distributio of C i provide iformatio i estimatio of θ? Compare the asymptotic variaces of ˆθ 1 ad ˆθ 2, ad discuss the results (less tha 50 words). The distributio of C cotributes i the likelihood derivatio ad does provide iformatio i estimatio of θ. The ratio of the two asymptotic variace is V ar(ˆθ 2 ) V ar(ˆθ 1 ) = i δ i From Q4, we kow {δ i,i = 1,...,} are i.i.d. radom variables with Beroulli ( θ =1/2as λ = θ), thus i δ i 1/2 whe. θ+λ The asymptotic variace of ˆθ 2 is half of that of ˆθ 1 i large sample. It is reasoable because additioal iformatio o cesorig time C is used i the estimatio ad iferece of θ by ˆθ 2. 2
10 Solutio to Qual 2 Theory Questio # September Exam We assume at least oe x i is ozero. (a) The log likelihood fuctio is give by log(l) =(log 2π) log(σ) 1 2σ 2 (y i βx i ) 2, ad log L β log L σ 2 log L β 2 = 1 σ 2 = 1 σ 2 x i (y i βx i ) = σ + 1 σ 3 (y i βx i ) 2 2 log L σ 2 = σ 2 3 σ 4 2 log L σ β x 2 i (y i βx i ) 2 = 2 σ 3 x i (y i βx i ) The solutio of the first two equatios is give by: ˆβ = x iy i, x2 i ad ˆσ 2 = 1 (y i ˆβx i ) 2. This solutio is uique ad at ( ˆβ, ˆσ) the2 2 matrix of secod order derivatives is egative defiite (at least oe of the diagoal etries is egative ad the determiat is positive) wheever at least oe x i is ozero. (b) Sice ˆβ is a liear fuctio of idepedet ormal radom variables, it is agai ormally distributed with mea β ad variace σ 2 /{ x2 i }. 1
11 (c) Variace of ˆβ is the smallest wheever the sum of the x 2 i is the largest. This is possible whe the x i are either +1 or 1. So, there are 2 10 differet possible choices for the x i that lead to the smallest variace for ˆβ. (d) Likelihood ratio test statistic is give by ad upo simplificatio, we get whe σ = 1 or Λ = sup β=1 L(β) L( ˆβ) Λ =exp{ 1 2 ( x 2 i )( ˆβ 1)} 2 2 log(λ) =( x 2 i )( ˆβ 1) 2. [Not asked: Clearly, whe H 0 is true, this statistic has a χ 2 distributio with 1 degree of freedom sice Var( ˆβ) =1/( x 2 i ), ad ˆβ is ormally distributed with mea β]. (e) We reject H 0 whe ˆβ is outside the iterval (1 (1.96/10), 1+(1.96/10)) or outside (0.804, 1.196). [Oe ca also describe the critical regio i terms of χ 2 (1) critical value.] (f) No because i Model 1, the alterative hypothesis correspods to the slope aloe while the itercept is assumed to be held at 0 whereas i the test for 0 mea for the differece Y i x i correspods to a test for 0 itercept where the slope parameter β is held at 1. 2
12
13
1 Models for Matched Pairs
1 Models for Matched Pairs Matched pairs occur whe we aalyse samples such that for each measuremet i oe of the samples there is a measuremet i the other sample that directly relates to the measuremet i
More information1 Inferential Methods for Correlation and Regression Analysis
1 Iferetial Methods for Correlatio ad Regressio Aalysis I the chapter o Correlatio ad Regressio Aalysis tools for describig bivariate cotiuous data were itroduced. The sample Pearso Correlatio Coefficiet
More information3/3/2014. CDS M Phil Econometrics. Types of Relationships. Types of Relationships. Types of Relationships. Vijayamohanan Pillai N.
3/3/04 CDS M Phil Old Least Squares (OLS) Vijayamohaa Pillai N CDS M Phil Vijayamoha CDS M Phil Vijayamoha Types of Relatioships Oly oe idepedet variable, Relatioship betwee ad is Liear relatioships Curviliear
More informationProperties and Hypothesis Testing
Chapter 3 Properties ad Hypothesis Testig 3.1 Types of data The regressio techiques developed i previous chapters ca be applied to three differet kids of data. 1. Cross-sectioal data. 2. Time series data.
More informationCircle the single best answer for each multiple choice question. Your choice should be made clearly.
TEST #1 STA 4853 March 6, 2017 Name: Please read the followig directios. DO NOT TURN THE PAGE UNTIL INSTRUCTED TO DO SO Directios This exam is closed book ad closed otes. There are 32 multiple choice questios.
More informationRandom Variables, Sampling and Estimation
Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig
More informationOpen book and notes. 120 minutes. Cover page and six pages of exam. No calculators.
IE 330 Seat # Ope book ad otes 120 miutes Cover page ad six pages of exam No calculators Score Fial Exam (example) Schmeiser Ope book ad otes No calculator 120 miutes 1 True or false (for each, 2 poits
More informationStat 139 Homework 7 Solutions, Fall 2015
Stat 139 Homework 7 Solutios, Fall 2015 Problem 1. I class we leared that the classical simple liear regressio model assumes the followig distributio of resposes: Y i = β 0 + β 1 X i + ɛ i, i = 1,...,,
More informationSTA6938-Logistic Regression Model
Dr. Yig Zhag STA6938-Logistic Regressio Model Topic -Simple (Uivariate) Logistic Regressio Model Outlies:. Itroductio. A Example-Does the liear regressio model always work? 3. Maximum Likelihood Curve
More informationStatistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.
Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized
More informationLinear regression. Daniel Hsu (COMS 4771) (y i x T i β)2 2πσ. 2 2σ 2. 1 n. (x T i β y i ) 2. 1 ˆβ arg min. β R n d
Liear regressio Daiel Hsu (COMS 477) Maximum likelihood estimatio Oe of the simplest liear regressio models is the followig: (X, Y ),..., (X, Y ), (X, Y ) are iid radom pairs takig values i R d R, ad Y
More informationLecture 22: Review for Exam 2. 1 Basic Model Assumptions (without Gaussian Noise)
Lecture 22: Review for Exam 2 Basic Model Assumptios (without Gaussia Noise) We model oe cotiuous respose variable Y, as a liear fuctio of p umerical predictors, plus oise: Y = β 0 + β X +... β p X p +
More informationStatistical Properties of OLS estimators
1 Statistical Properties of OLS estimators Liear Model: Y i = β 0 + β 1 X i + u i OLS estimators: β 0 = Y β 1X β 1 = Best Liear Ubiased Estimator (BLUE) Liear Estimator: β 0 ad β 1 are liear fuctio of
More informationMaximum Likelihood Estimation
Chapter 9 Maximum Likelihood Estimatio 9.1 The Likelihood Fuctio The maximum likelihood estimator is the most widely used estimatio method. This chapter discusses the most importat cocepts behid maximum
More information( θ. sup θ Θ f X (x θ) = L. sup Pr (Λ (X) < c) = α. x : Λ (x) = sup θ H 0. sup θ Θ f X (x θ) = ) < c. NH : θ 1 = θ 2 against AH : θ 1 θ 2
82 CHAPTER 4. MAXIMUM IKEIHOOD ESTIMATION Defiitio: et X be a radom sample with joit p.m/d.f. f X x θ. The geeralised likelihood ratio test g.l.r.t. of the NH : θ H 0 agaist the alterative AH : θ H 1,
More informationChapter 6 Part 5. Confidence Intervals t distribution chi square distribution. October 23, 2008
Chapter 6 Part 5 Cofidece Itervals t distributio chi square distributio October 23, 2008 The will be o help sessio o Moday, October 27. Goal: To clearly uderstad the lik betwee probability ad cofidece
More informationStatistical Theory MT 2008 Problems 1: Solution sketches
Statistical Theory MT 008 Problems : Solutio sketches. Which of the followig desities are withi a expoetial family? Explai your reasoig. a) Let 0 < θ < ad put fx, θ) = θ)θ x ; x = 0,,,... b) c) where α
More informationLecture 3: MLE and Regression
STAT/Q SCI 403: Itroductio to Resamplig Methods Sprig 207 Istructor: Ye-Chi Che Lecture 3: MLE ad Regressio 3. Parameters ad Distributios Some distributios are idexed by their uderlyig parameters. Thus,
More informationGoodness-of-Fit Tests and Categorical Data Analysis (Devore Chapter Fourteen)
Goodess-of-Fit Tests ad Categorical Data Aalysis (Devore Chapter Fourtee) MATH-252-01: Probability ad Statistics II Sprig 2019 Cotets 1 Chi-Squared Tests with Kow Probabilities 1 1.1 Chi-Squared Testig................
More informationStatistical Theory MT 2009 Problems 1: Solution sketches
Statistical Theory MT 009 Problems : Solutio sketches. Which of the followig desities are withi a expoetial family? Explai your reasoig. (a) Let 0 < θ < ad put f(x, θ) = ( θ)θ x ; x = 0,,,... (b) (c) where
More informationStatistical inference: example 1. Inferential Statistics
Statistical iferece: example 1 Iferetial Statistics POPULATION SAMPLE A clothig store chai regularly buys from a supplier large quatities of a certai piece of clothig. Each item ca be classified either
More informationThis exam contains 19 pages (including this cover page) and 10 questions. A Formulae sheet is provided with the exam.
Probability ad Statistics FS 07 Secod Sessio Exam 09.0.08 Time Limit: 80 Miutes Name: Studet ID: This exam cotais 9 pages (icludig this cover page) ad 0 questios. A Formulae sheet is provided with the
More informationQuestions and Answers on Maximum Likelihood
Questios ad Aswers o Maximum Likelihood L. Magee Fall, 2008 1. Give: a observatio-specific log likelihood fuctio l i (θ) = l f(y i x i, θ) the log likelihood fuctio l(θ y, X) = l i(θ) a data set (x i,
More informationDirection: This test is worth 250 points. You are required to complete this test within 50 minutes.
Term Test October 3, 003 Name Math 56 Studet Number Directio: This test is worth 50 poits. You are required to complete this test withi 50 miutes. I order to receive full credit, aswer each problem completely
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More information11 Correlation and Regression
11 Correlatio Regressio 11.1 Multivariate Data Ofte we look at data where several variables are recorded for the same idividuals or samplig uits. For example, at a coastal weather statio, we might record
More information10-701/ Machine Learning Mid-term Exam Solution
0-70/5-78 Machie Learig Mid-term Exam Solutio Your Name: Your Adrew ID: True or False (Give oe setece explaatio) (20%). (F) For a cotiuous radom variable x ad its probability distributio fuctio p(x), it
More informationTMA4245 Statistics. Corrected 30 May and 4 June Norwegian University of Science and Technology Department of Mathematical Sciences.
Norwegia Uiversity of Sciece ad Techology Departmet of Mathematical Scieces Corrected 3 May ad 4 Jue Solutios TMA445 Statistics Saturday 6 May 9: 3: Problem Sow desity a The probability is.9.5 6x x dx
More informationStatistics 20: Final Exam Solutions Summer Session 2007
1. 20 poits Testig for Diabetes. Statistics 20: Fial Exam Solutios Summer Sessio 2007 (a) 3 poits Give estimates for the sesitivity of Test I ad of Test II. Solutio: 156 patiets out of total 223 patiets
More informationof the matrix is =-85, so it is not positive definite. Thus, the first
BOSTON COLLEGE Departmet of Ecoomics EC771: Ecoometrics Sprig 4 Prof. Baum, Ms. Uysal Solutio Key for Problem Set 1 1. Are the followig quadratic forms positive for all values of x? (a) y = x 1 8x 1 x
More informationCEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering
CEE 5 Autum 005 Ucertaity Cocepts for Geotechical Egieerig Basic Termiology Set A set is a collectio of (mutually exclusive) objects or evets. The sample space is the (collectively exhaustive) collectio
More informationLecture Notes 15 Hypothesis Testing (Chapter 10)
1 Itroductio Lecture Notes 15 Hypothesis Testig Chapter 10) Let X 1,..., X p θ x). Suppose we we wat to kow if θ = θ 0 or ot, where θ 0 is a specific value of θ. For example, if we are flippig a coi, we
More informationMATH 472 / SPRING 2013 ASSIGNMENT 2: DUE FEBRUARY 4 FINALIZED
MATH 47 / SPRING 013 ASSIGNMENT : DUE FEBRUARY 4 FINALIZED Please iclude a cover sheet that provides a complete setece aswer to each the followig three questios: (a) I your opiio, what were the mai ideas
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationLecture 11 Simple Linear Regression
Lecture 11 Simple Liear Regressio Fall 2013 Prof. Yao Xie, yao.xie@isye.gatech.edu H. Milto Stewart School of Idustrial Systems & Egieerig Georgia Tech Midterm 2 mea: 91.2 media: 93.75 std: 6.5 2 Meddicorp
More informationEconomics 241B Relation to Method of Moments and Maximum Likelihood OLSE as a Maximum Likelihood Estimator
Ecoomics 24B Relatio to Method of Momets ad Maximum Likelihood OLSE as a Maximum Likelihood Estimator Uder Assumptio 5 we have speci ed the distributio of the error, so we ca estimate the model parameters
More informationUNIVERSITY OF TORONTO Faculty of Arts and Science APRIL/MAY 2009 EXAMINATIONS ECO220Y1Y PART 1 OF 2 SOLUTIONS
PART of UNIVERSITY OF TORONTO Faculty of Arts ad Sciece APRIL/MAY 009 EAMINATIONS ECO0YY PART OF () The sample media is greater tha the sample mea whe there is. (B) () A radom variable is ormally distributed
More informationEstimation for Complete Data
Estimatio for Complete Data complete data: there is o loss of iformatio durig study. complete idividual complete data= grouped data A complete idividual data is the oe i which the complete iformatio of
More informationSimple Linear Regression
Chapter 2 Simple Liear Regressio 2.1 Simple liear model The simple liear regressio model shows how oe kow depedet variable is determied by a sigle explaatory variable (regressor). Is is writte as: Y i
More informationLecture 6 Chi Square Distribution (χ 2 ) and Least Squares Fitting
Lecture 6 Chi Square Distributio (χ ) ad Least Squares Fittig Chi Square Distributio (χ ) Suppose: We have a set of measuremets {x 1, x, x }. We kow the true value of each x i (x t1, x t, x t ). We would
More informationMatrix Representation of Data in Experiment
Matrix Represetatio of Data i Experimet Cosider a very simple model for resposes y ij : y ij i ij, i 1,; j 1,,..., (ote that for simplicity we are assumig the two () groups are of equal sample size ) Y
More informationII. Descriptive Statistics D. Linear Correlation and Regression. 1. Linear Correlation
II. Descriptive Statistics D. Liear Correlatio ad Regressio I this sectio Liear Correlatio Cause ad Effect Liear Regressio 1. Liear Correlatio Quatifyig Liear Correlatio The Pearso product-momet correlatio
More informationEconomics 326 Methods of Empirical Research in Economics. Lecture 18: The asymptotic variance of OLS and heteroskedasticity
Ecoomics 326 Methods of Empirical Research i Ecoomics Lecture 8: The asymptotic variace of OLS ad heteroskedasticity Hiro Kasahara Uiversity of British Columbia December 24, 204 Asymptotic ormality I I
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationSTATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS. Comments:
Recall: STATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS Commets:. So far we have estimates of the parameters! 0 ad!, but have o idea how good these estimates are. Assumptio: E(Y x)! 0 +! x (liear coditioal
More informationLecture 6 Chi Square Distribution (χ 2 ) and Least Squares Fitting
Lecture 6 Chi Square Distributio (χ ) ad Least Squares Fittig Chi Square Distributio (χ ) Suppose: We have a set of measuremets {x 1, x, x }. We kow the true value of each x i (x t1, x t, x t ). We would
More informationAsymptotics. Hypothesis Testing UMP. Asymptotic Tests and p-values
of the secod half Biostatistics 6 - Statistical Iferece Lecture 6 Fial Exam & Practice Problems for the Fial Hyu Mi Kag Apil 3rd, 3 Hyu Mi Kag Biostatistics 6 - Lecture 6 Apil 3rd, 3 / 3 Rao-Blackwell
More informationDirection: This test is worth 150 points. You are required to complete this test within 55 minutes.
Term Test 3 (Part A) November 1, 004 Name Math 6 Studet Number Directio: This test is worth 10 poits. You are required to complete this test withi miutes. I order to receive full credit, aswer each problem
More informationEfficient GMM LECTURE 12 GMM II
DECEMBER 1 010 LECTURE 1 II Efficiet The estimator depeds o the choice of the weight matrix A. The efficiet estimator is the oe that has the smallest asymptotic variace amog all estimators defied by differet
More information1.010 Uncertainty in Engineering Fall 2008
MIT OpeCourseWare http://ocw.mit.edu.00 Ucertaity i Egieerig Fall 2008 For iformatio about citig these materials or our Terms of Use, visit: http://ocw.mit.edu.terms. .00 - Brief Notes # 9 Poit ad Iterval
More informationST 305: Exam 3 ( ) = P(A)P(B A) ( ) = P(A) + P(B) ( ) = 1 P( A) ( ) = P(A) P(B) σ X 2 = σ a+bx. σ ˆp. σ X +Y. σ X Y. σ X. σ Y. σ n.
ST 305: Exam 3 By hadig i this completed exam, I state that I have either give or received assistace from aother perso durig the exam period. I have used o resources other tha the exam itself ad the basic
More informationIntroduction to Econometrics (3 rd Updated Edition) Solutions to Odd- Numbered End- of- Chapter Exercises: Chapter 4
Itroductio to Ecoometrics (3 rd Updated Editio) by James H. Stock ad Mark W. Watso Solutios to Odd- Numbered Ed- of- Chapter Exercises: Chapter 4 (This versio August 7, 204) 205 Pearso Educatio, Ic. Stock/Watso
More informationUniversity of California, Los Angeles Department of Statistics. Practice problems - simple regression 2 - solutions
Uiversity of Califoria, Los Ageles Departmet of Statistics Statistics 00C Istructor: Nicolas Christou EXERCISE Aswer the followig questios: Practice problems - simple regressio - solutios a Suppose y,
More informationSimulation. Two Rule For Inverting A Distribution Function
Simulatio Two Rule For Ivertig A Distributio Fuctio Rule 1. If F(x) = u is costat o a iterval [x 1, x 2 ), the the uiform value u is mapped oto x 2 through the iversio process. Rule 2. If there is a jump
More informationSolutions to Odd Numbered End of Chapter Exercises: Chapter 4
Itroductio to Ecoometrics (3 rd Updated Editio) by James H. Stock ad Mark W. Watso Solutios to Odd Numbered Ed of Chapter Exercises: Chapter 4 (This versio July 2, 24) Stock/Watso - Itroductio to Ecoometrics
More informationSummary. Recap ... Last Lecture. Summary. Theorem
Last Lecture Biostatistics 602 - Statistical Iferece Lecture 23 Hyu Mi Kag April 11th, 2013 What is p-value? What is the advatage of p-value compared to hypothesis testig procedure with size α? How ca
More informationBig Picture. 5. Data, Estimates, and Models: quantifying the accuracy of estimates.
5. Data, Estimates, ad Models: quatifyig the accuracy of estimates. 5. Estimatig a Normal Mea 5.2 The Distributio of the Normal Sample Mea 5.3 Normal data, cofidece iterval for, kow 5.4 Normal data, cofidece
More informationChapters 5 and 13: REGRESSION AND CORRELATION. Univariate data: x, Bivariate data (x,y).
Chapters 5 ad 13: REGREION AND CORRELATION (ectios 5.5 ad 13.5 are omitted) Uivariate data: x, Bivariate data (x,y). Example: x: umber of years studets studied paish y: score o a proficiecy test For each
More informationSince X n /n P p, we know that X n (n. Xn (n X n ) Using the asymptotic result above to obtain an approximation for fixed n, we obtain
Assigmet 9 Exercise 5.5 Let X biomial, p, where p 0, 1 is ukow. Obtai cofidece itervals for p i two differet ways: a Sice X / p d N0, p1 p], the variace of the limitig distributio depeds oly o p. Use the
More informationFirst Year Quantitative Comp Exam Spring, Part I - 203A. f X (x) = 0 otherwise
First Year Quatitative Comp Exam Sprig, 2012 Istructio: There are three parts. Aswer every questio i every part. Questio I-1 Part I - 203A A radom variable X is distributed with the margial desity: >
More informationLecture 2: Monte Carlo Simulation
STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: Ye-Chi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?
More informationRegression, Inference, and Model Building
Regressio, Iferece, ad Model Buildig Scatter Plots ad Correlatio Correlatio coefficiet, r -1 r 1 If r is positive, the the scatter plot has a positive slope ad variables are said to have a positive relatioship
More informationEcon 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1.
Eco 325/327 Notes o Sample Mea, Sample Proportio, Cetral Limit Theorem, Chi-square Distributio, Studet s t distributio 1 Sample Mea By Hiro Kasahara We cosider a radom sample from a populatio. Defiitio
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS
MASSACHUSTTS INSTITUT OF TCHNOLOGY 6.436J/5.085J Fall 2008 Lecture 9 /7/2008 LAWS OF LARG NUMBRS II Cotets. The strog law of large umbers 2. The Cheroff boud TH STRONG LAW OF LARG NUMBRS While the weak
More informationEcon 325 Notes on Point Estimator and Confidence Interval 1 By Hiro Kasahara
Poit Estimator Eco 325 Notes o Poit Estimator ad Cofidece Iterval 1 By Hiro Kasahara Parameter, Estimator, ad Estimate The ormal probability desity fuctio is fully characterized by two costats: populatio
More informationECE 8527: Introduction to Machine Learning and Pattern Recognition Midterm # 1. Vaishali Amin Fall, 2015
ECE 8527: Itroductio to Machie Learig ad Patter Recogitio Midterm # 1 Vaishali Ami Fall, 2015 tue39624@temple.edu Problem No. 1: Cosider a two-class discrete distributio problem: ω 1 :{[0,0], [2,0], [2,2],
More informationStat 319 Theory of Statistics (2) Exercises
Kig Saud Uiversity College of Sciece Statistics ad Operatios Research Departmet Stat 39 Theory of Statistics () Exercises Refereces:. Itroductio to Mathematical Statistics, Sixth Editio, by R. Hogg, J.
More informationDepartment of Civil Engineering-I.I.T. Delhi CEL 899: Environmental Risk Assessment HW5 Solution
Departmet of Civil Egieerig-I.I.T. Delhi CEL 899: Evirometal Risk Assessmet HW5 Solutio Note: Assume missig data (if ay) ad metio the same. Q. Suppose X has a ormal distributio defied as N (mea=5, variace=
More informationMath 152. Rumbos Fall Solutions to Review Problems for Exam #2. Number of Heads Frequency
Math 152. Rumbos Fall 2009 1 Solutios to Review Problems for Exam #2 1. I the book Experimetatio ad Measuremet, by W. J. Youde ad published by the by the Natioal Sciece Teachers Associatio i 1962, the
More informationAAEC/ECON 5126 FINAL EXAM: SOLUTIONS
AAEC/ECON 5126 FINAL EXAM: SOLUTIONS SPRING 2015 / INSTRUCTOR: KLAUS MOELTNER This exam is ope-book, ope-otes, but please work strictly o your ow. Please make sure your ame is o every sheet you re hadig
More informationResampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.
Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator
More informationLecture 11 and 12: Basic estimation theory
Lecture ad 2: Basic estimatio theory Sprig 202 - EE 94 Networked estimatio ad cotrol Prof. Kha March 2 202 I. MAXIMUM-LIKELIHOOD ESTIMATORS The maximum likelihood priciple is deceptively simple. Louis
More informationSimple Linear Regression
Simple Liear Regressio 1. Model ad Parameter Estimatio (a) Suppose our data cosist of a collectio of pairs (x i, y i ), where x i is a observed value of variable X ad y i is the correspodig observatio
More informationHypothesis Testing. Evaluation of Performance of Learned h. Issues. Trade-off Between Bias and Variance
Hypothesis Testig Empirically evaluatig accuracy of hypotheses: importat activity i ML. Three questios: Give observed accuracy over a sample set, how well does this estimate apply over additioal samples?
More informationFinal Examination Solutions 17/6/2010
The Islamic Uiversity of Gaza Faculty of Commerce epartmet of Ecoomics ad Political Scieces A Itroductio to Statistics Course (ECOE 30) Sprig Semester 009-00 Fial Eamiatio Solutios 7/6/00 Name: I: Istructor:
More informationGood luck! School of Business and Economics. Business Statistics E_BK1_BS / E_IBA1_BS. Date: 25 May, Time: 12:00. Calculator allowed:
School of Busiess ad Ecoomics Exam: Code: Examiator: Co-reader: Busiess Statistics E_BK_BS / E_IBA_BS dr. R. Heijugs dr. G.J. Frax Date: 5 May, 08 Time: :00 Duratio: Calculator allowed: Graphical calculator
More informationPSYCHOLOGICAL RESEARCH (PYC 304-C) Lecture 9
Hypothesis testig PSYCHOLOGICAL RESEARCH (PYC 34-C Lecture 9 Statistical iferece is that brach of Statistics i which oe typically makes a statemet about a populatio based upo the results of a sample. I
More informationFitting an ARIMA Process to Data
Fittig a ARIMA Process to Data Bria Borchers April 6, 1 Now that we uderstad the theoretical behavior of ARIMA processes, we will cosider how to take a actual observed time series ad fit a ARIMA model
More informationbwght = cigs
EEP 118 / IAS 118 Elisabeth Sadoulet ad Daley Kutzma Uiversity of Califoria at Berkeley Fall 013 Itroductory Applied Ecoometrics Midterm examiatio Scores add up to 50 (5 poits for each sub-questio) Your
More informationStatistics 203 Introduction to Regression and Analysis of Variance Assignment #1 Solutions January 20, 2005
Statistics 203 Itroductio to Regressio ad Aalysis of Variace Assigmet #1 Solutios Jauary 20, 2005 Q. 1) (MP 2.7) (a) Let x deote the hydrocarbo percetage, ad let y deote the oxyge purity. The simple liear
More informationENGI 4421 Confidence Intervals (Two Samples) Page 12-01
ENGI 44 Cofidece Itervals (Two Samples) Page -0 Two Sample Cofidece Iterval for a Differece i Populatio Meas [Navidi sectios 5.4-5.7; Devore chapter 9] From the cetral limit theorem, we kow that, for sufficietly
More informationLinear Regression Models
Liear Regressio Models Dr. Joh Mellor-Crummey Departmet of Computer Sciece Rice Uiversity johmc@cs.rice.edu COMP 528 Lecture 9 15 February 2005 Goals for Today Uderstad how to Use scatter diagrams to ispect
More informationECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors
ECONOMETRIC THEORY MODULE XIII Lecture - 34 Asymptotic Theory ad Stochastic Regressors Dr. Shalabh Departmet of Mathematics ad Statistics Idia Istitute of Techology Kapur Asymptotic theory The asymptotic
More informationLecture 3. Properties of Summary Statistics: Sampling Distribution
Lecture 3 Properties of Summary Statistics: Samplig Distributio Mai Theme How ca we use math to justify that our umerical summaries from the sample are good summaries of the populatio? Lecture Summary
More informationSTP 226 EXAMPLE EXAM #1
STP 226 EXAMPLE EXAM #1 Istructor: Hoor Statemet: I have either give or received iformatio regardig this exam, ad I will ot do so util all exams have bee graded ad retured. PRINTED NAME: Siged Date: DIRECTIONS:
More informationChapter 23: Inferences About Means
Chapter 23: Ifereces About Meas Eough Proportios! We ve spet the last two uits workig with proportios (or qualitative variables, at least) ow it s time to tur our attetios to quatitative variables. For
More informationProblem Set 4 Due Oct, 12
EE226: Radom Processes i Systems Lecturer: Jea C. Walrad Problem Set 4 Due Oct, 12 Fall 06 GSI: Assae Gueye This problem set essetially reviews detectio theory ad hypothesis testig ad some basic otios
More informationLast Lecture. Wald Test
Last Lecture Biostatistics 602 - Statistical Iferece Lecture 22 Hyu Mi Kag April 9th, 2013 Is the exact distributio of LRT statistic typically easy to obtai? How about its asymptotic distributio? For testig
More informationDepartment of Mathematics
Departmet of Mathematics Ma 3/103 KC Border Itroductio to Probability ad Statistics Witer 2017 Lecture 19: Estimatio II Relevat textbook passages: Larse Marx [1]: Sectios 5.2 5.7 19.1 The method of momets
More informationLinear Programming and the Simplex Method
Liear Programmig ad the Simplex ethod Abstract This article is a itroductio to Liear Programmig ad usig Simplex method for solvig LP problems i primal form. What is Liear Programmig? Liear Programmig is
More informationMidtermII Review. Sta Fall Office Hours Wednesday 12:30-2:30pm Watch linear regression videos before lab on Thursday
Aoucemets MidtermII Review Sta 101 - Fall 2016 Duke Uiversity, Departmet of Statistical Sciece Office Hours Wedesday 12:30-2:30pm Watch liear regressio videos before lab o Thursday Dr. Abrahamse Slides
More informationReview Questions, Chapters 8, 9. f(y) = 0, elsewhere. F (y) = f Y(1) = n ( e y/θ) n 1 1 θ e y/θ = n θ e yn
Stat 366 Lab 2 Solutios (September 2, 2006) page TA: Yury Petracheko, CAB 484, yuryp@ualberta.ca, http://www.ualberta.ca/ yuryp/ Review Questios, Chapters 8, 9 8.5 Suppose that Y, Y 2,..., Y deote a radom
More informationINSTRUCTIONS (A) 1.22 (B) 0.74 (C) 4.93 (D) 1.18 (E) 2.43
PAPER NO.: 444, 445 PAGE NO.: Page 1 of 1 INSTRUCTIONS I. You have bee provided with: a) the examiatio paper i two parts (PART A ad PART B), b) a multiple choice aswer sheet (for PART A), c) selected formulae
More informationIntroductory statistics
CM9S: Machie Learig for Bioiformatics Lecture - 03/3/06 Itroductory statistics Lecturer: Sriram Sakararama Scribe: Sriram Sakararama We will provide a overview of statistical iferece focussig o the key
More informationEECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1
EECS564 Estimatio, Filterig, ad Detectio Hwk 2 Sols. Witer 25 4. Let Z be a sigle observatio havig desity fuctio where. p (z) = (2z + ), z (a) Assumig that is a oradom parameter, fid ad plot the maximum
More informationmultiplies all measures of center and the standard deviation and range by k, while the variance is multiplied by k 2.
Lesso 3- Lesso 3- Scale Chages of Data Vocabulary scale chage of a data set scale factor scale image BIG IDEA Multiplyig every umber i a data set by k multiplies all measures of ceter ad the stadard deviatio
More information(all terms are scalars).the minimization is clearer in sum notation:
7 Multiple liear regressio: with predictors) Depedet data set: y i i = 1, oe predictad, predictors x i,k i = 1,, k = 1, ' The forecast equatio is ŷ i = b + Use matrix otatio: k =1 b k x ik Y = y 1 y 1
More informationSTAT 350 Handout 19 Sampling Distribution, Central Limit Theorem (6.6)
STAT 350 Hadout 9 Samplig Distributio, Cetral Limit Theorem (6.6) A radom sample is a sequece of radom variables X, X 2,, X that are idepedet ad idetically distributed. o This property is ofte abbreviated
More informationLogit regression Logit regression
Logit regressio Logit regressio models the probability of Y= as the cumulative stadard logistic distributio fuctio, evaluated at z = β 0 + β X: Pr(Y = X) = F(β 0 + β X) F is the cumulative logistic distributio
More informationAssessment and Modeling of Forests. FR 4218 Spring Assignment 1 Solutions
Assessmet ad Modelig of Forests FR 48 Sprig Assigmet Solutios. The first part of the questio asked that you calculate the average, stadard deviatio, coefficiet of variatio, ad 9% cofidece iterval of the
More information