LECTURE 14 NOTES. A sequence of α-level tests {ϕ n (x)} is consistent if
|
|
- Bethanie Caitlin Eaton
- 5 years ago
- Views:
Transcription
1 LECTURE 14 NOTES 1. Asymptotic power of tests. Defiitio 1.1. A sequece of -level tests {ϕ x)} is cosistet if β θ) := E θ [ ϕ x) ] 1 as, for ay θ Θ 1. Just like cosistecy of a sequece of estimators, Defiitio 1.1 is a basic otio of correctess. I fact, most tests are cosistet. I the rest of the sectio, we refrai from presetig mathematically rigorous results because the level of the subject is such that it is difficult to state the eve the assumptios without itroducig additioal techical cocepts. Cosider testig H 0 : θ = θ 0 versus H 1 : θ θ 0 by a Wald test. That is, cosider the test ϕx) = 1 χ p,, ) w ), where w is the Wald test statistic: 1.1) w := V 1 ) ˆθ θ 0 ˆθ is a asymptotically ormal estimator of θ, ad V is a cosistet estimator of its asymptotic variace). The power is βθ) = w χ ) p, At ay θ 1 θ 0, the Wald statistic diverges. Ideed, V 1 ˆθ θ 0 ) = V 1 ) ˆθ θ 1 + V 1 ) θ1 θ 0. We recogize the first term is O P 1) ˆθ is asymptotically ormal), but the secod term diverges. Thus the power teds to oe. It is possible to show that the LR ad score tests are cosistet by similar argumets. Cosistecy esures the power of a test grows to oe as the sample size grows. However, the rate of covergece is uclear. Whe we ecoutered a similar problem whe evaluatig poit estimators, we blew up the error by ad studied the limitig distributio of ˆθ θ ). 1
2 STAT 01B The aalogous trick here is to study the limitig distributio of the Wald statistic uder a sequece of local alteratives: 1.) θ := θ 0 + h. Formally, cosider a triagular array x 1,1 x,1 x,..... x,1 x,... x,....., where x,i i.i.d. F θ. We remark that observatios i differet rows of the array are ot idetically distributed. Let ˆθ be a asymptotically ormal estimator of θ based o observatios {x,i } i []. The Wald statistic is V 1 ) ˆθ θ 0 = V 1 ) ˆθ θ + V 1 h. Ituitively, the first term coverges i distributio to a N 0, I p ) radom variable, ad the secod term coverges to Avar ˆθ ) 1 h. Thus 1.3) V 1 ) d ) 1 ) ˆθ θ 0 N Avar ˆθ h, I p. ad the power fuctio coverges to z ) 1 βθ ) P + Avar ˆθ h ) χ p,, where z N 0, I p ). The precedig limit of the power fuctio is called the asymptotic power of the Wald test. Evidetly, the larger V 1 h is, the higher is the asymptotic power. Thus Wald tests based o efficiet estimators are more powerful. There is a similar story for the LR ad score tests. We remark that z + µ is distributed as a o-cetral χ radom variable: µ is the o-cetrality parameter. Example 1.. test. We kow Let x i i.i.d. Berp). We wish to test H 0 : p = p 0 by a Wald 1. the MLE of p is ˆp = x,. the asymptotic variace of ˆp is p1 p).
3 LECTURE 14 NOTES 3 If p p 0, the power of the Wald test is approximately ) ) βp) = P ˆp p 0 ) p χ p1 p) 1, ) ) = P ˆp p) p + p p0 ) χ p1 p) p1 p) 1, ) P z + p p0 ) χ p1 p) 1, ), where z is a stadard ormal radom variable. The o-cetrality parameter is p p 0) p1 p). To illustrate use of the precedig approximate power fuctio i a cocrete settig, cosider the desig questio: how may samples are required to achieve 0.9 power agaist the alterative H 1 : p 1 = p ? By the properties of the o-cetral χ 1 distributio, to esure P z + µ) χ 1,) 0.90, the o-cetrality parameter µ must be at least Recall the o-cetrality parameter is p 1 p 0 ) p 1 1 p 1 ). We solve for to deduce > 10.51p 11 p 1 ) p 1 p 0 ) = It is possible to rigorously justify 1.1) uder suitable coditios by appeaig to the theory of local asymptotic ormality, much of which was developed by Lucie Le Cam at Berkeley.. Iterval estimatio. I the first part of the course, we cosidered the task of poit estimatio, where the goal is to provide a sigle poit that is a guess for the value of the ukow parameter. The goal of iterval estimatio is to provide a set that cotais the ukow parameter with some prescribed probability. Defiitio.1. Let Cx) Θ be a set-valued radom variable. It is a 1 -cofidece set for a parameter θ if θ Cx)) 1. If Cx) is a iterval o R, we call Cx) a cofidece iterval. We emphasize that the set Cx) ot the parameter θ is the radom quatity i Defiitio.1. Observig [ lx), ux) ] = [l, u] should ot be iterpreted as θ [l, u] with probability at least 1 : θ is a determiistic
4 4 STAT 01B quatity, so it is osese to cosider the probability of θ [l, u]. A correct statemet is θ [lx), ux)] with probability at least 1. As we shall see, formig iterval estimators essetially boil dow to ivertig hypothesis tests. Lemma.. Let Aθ 0 ) X be the acceptace regio of a -level test of H 0 : θ = θ 0. The set A 1 x), where A 1 x) := {θ Θ : x Aθ)} is a 1 cofidece set for θ 0. That is, the set of parameters θ 0 at which a -level test of H 0 : θ = θ 0 accepts is a 1 -cofidece set for θ 0. Proof. By defiitio of A 1 x), the evet {x Aθ 0 )} is equivalet to {θ 0 A 1 x)}. Uder H 0, a -level test accepts with probability at least 1 : 0 x Aθ 0 )). Thus A 1 x) is a 1 cofidece set: 0 θ 0 A 1 x)) = 0 x Aθ 0 )) 1. Lemma. is essetially a tautology: A 1 x) is a 1 -cofidece set because the evet { θ A 1 x) } is equivalet to { x Aθ) }. Sice Aθ) is the acceptace regio of a -level test, 0 x Aθ 0 )) 1. Example.3. Let x N µ, 1). Cosider testig H 0 : µ = µ 0 versus H 1 : µ µ 0. We showed that the -level LRT of H 0 : µ = µ 0 rejects if x µ 0 > z. The acceptace regio Aµ 0 ) is { } x R : x µ 0 z. Thus A 1 x) = { } µ 0 R : x µ 0 z is a 1 -cofidece iterval for µ 0. = [ x z, x + z i.i.d. Example.4. Let x i N µ, σ ), where σ is ukow. Cosider testig H 0 : µ = µ 0 versus H 1 : µ µ 0. We showed that the -level LRT of H 0 : µ = µ 0 rejects if φx) > t, where φx) = x µ0 ) ŝ. ]
5 LECTURE 14 NOTES 5 is the t-statistic. The acceptace regio is { } x R : φx) t. Thus A 1 x) = { } µ 0 R : φx) t = [ x ŝ t, x + ŝ ] t is a 1 -cofidece iterval for µ 0. We remark that Lemma. has a coverse: it is possible to obtai a -level test from a 1 -cofidece set. Lemma.5. Let Cx) is a 1 -cofidece iterval for θ. The test ϕx) = 1 1 Cx) θ 0 ), H 0 : θ = θ 0 versus H 1 : θ θ 0. That is, the test that rejects whe Cx) does ot cotai θ 0 is a -level test. Proof. Sice Cx) is a 1 cofidece iterval for θ 0, P 0 θ0 Cx) ) 1. Thus E 0 [ 1 ϕx) ] = 1 P0 θ0 Cx) ) 1 1 ). A coveiet formalism that highlights the coectio betwee hypothesis testig ad iterval is that of pivot or pivotal quatity. Defiitio.6. A fuctio φx, θ) is a pivot for a parametric model if the its distributio uder x F θ does ot deped o θ. That is, ) φx, θ) C does ot deped o θ. We remark that a pivot is techically ot a statistic because the fuctio depeds o the ukow parameter θ. The caoical example of a pivot is the z-statistic x µ σ. It is a pivot for the ormal locatio-scale model. Give a pivot, it is possible to 1. test the hypothesis H 0 : θ = θ 0. Uder H 0, we kow the distributio of the pivot φx, θ 0 ). Thus comparig the observatio φx, θ 0 ) to the kow distributio is the basis of a test.
6 6 STAT 01B. form a cofidece iterval for θ. As we shall see, ivertig the pivot i its secod argumet leads to a cofidece iterval for θ. Let C φx, θ) be a set of 1 mass uder the distributio of the pivot: φx, θ) C ). If we pi the secod argumet of the pivot at θ 0 lettig φ θ0 x) = φx, θ 0 )) ad ivert the pivot i its first argumet, we obtai φ 1 θ 0 C) := { x X : φx, θ 0 ) C }, which is the acceptace regio of a -level test of H 0 : θ = θ 0. Ideed, 0 x φ 1 θ 0 C) ) = 0 φx, θ0 ) C ) = 1, If we pi the first argumet of the pivot at x lettig φ x θ) = φx, θ 0 )) ad ivert the pivot i its secod argumet, we obtai which is a 1 -cofidece set for θ. φ 1 x C) := { θ Θ : φx, θ) C }, Example.7 Example.3 cotiued). We kow x µ is a pivot for the Gaussia locatio model: if x N µ, 1), φx, µ) := x µ is a pivot. If we pi the secod argumet of the pivot at µ 0, the pre-image of [ z, z ] uder the pivot is φ 1 [ µ 0 z, z ]) { [ = x R : x µ z, z ]}, which is the acceptace regio of the -level LRT of H 0 : µ = µ 0 versus H 1 : µ µ 0. The pre-image of, z ] is φ 1 µ 0, z ]) = { x R : x µ, z ]}, which is the acceptace regio of the -level UMPU test of H 0 : µ = µ 0 versus H 1 : µ > µ 0. Fially, if we pi the first argumet of the pivot at µ 0 ad ivert the pivot i its secod argumet, we obtai φ 1 [ x z, z ]) { [ = µ R : x µ z, z ]}, which is a 1 -cofidece iterval for µ.
7 LECTURE 14 NOTES 7 I practice, it is usually ot possible to derive a exact pivot. However, asymptotic pivots are easier to obtai. Formally, a asymptotic pivot for a parametric model is a fuctio whose asymptotic distributio does ot deped o the parameter. The caoical example of a asymptotic pivot is: V 1 ˆθ θ ) d ) N 0, Ip. Usurprisigly, ivertig asymptotic pivots leads to asymptotically -level tests ad 1 -cofidece itervals..1. Most accurate iterval estimators. Defiitio.8. A 1 cofidece set Cx) is most accurate at θ if θ Cx)) θ C x)) for ay θ θ ad ay other 1 cofidece set C x). It is uifomly most accurate UMA) o Θ if it is most accurate at ay θ Θ. Ituitively, a most accurate 1 cofidece set is least likely amog 1 cofidece sets) to iclude icorrect parameters. A straightforward calculatio shows that a most accurate 1 cofidece set has the smallest expected Lesbegue) volume amog 1 cofidece sets. Ideed, ) [ [ ]] E θ vol Cx) = 1 Cx) θ )dθ f θ x)dx X Θ ) = 1 Cx) θ )f θ x)dx dθ Θ X = θ Cx) ) dθ, which is miimized whe the itegrad is miimized o Θ. Θ Theorem.9. A 1 -UMA cofidece set o Θ is the iverse of - level UMP tests of H 0 : θ = θ versus H 1 : θ Θ \ {θ }. Proof. Let Aθ ) be the acceptace area of a UMP test of H 0 : θ = θ versus H 1 : θ Θ \ {θ }. Sice the test is UMP, x X \ Aθ ) ) x X \ A θ ) ) for ay θ Θ \ {θ } ad ay other the acceptace area of ay other -level test A θ ). Equivaletly, x Aθ ) ) x A θ ) ).
8 8 STAT 01B We ivert the acceptace area to obtai θ A 1 x) ) θ A 1 x) ). We observe that to obtai a most accurate cofidece set at a poit, it is ecessary to ivert a family of most powerful tests. Ideed, by Theorem.9, the most accurate cofidece set at θ is the iverse of -level most powerful tests of H 0 : θ = θ versus H 1 : θ = θ. I hypothesis testig, there is ofte o UMP tests for a prescribed pair of ull ad alterative hypotheses. Similarly, i iterval estimatio, there is usually o UMA cofidece set. To make the otio of most powerful test tractable, we restricted our attetio to ubiased tests ad studied UMPU tests. There is a similar otio of ubiasedess for cofidece sets ad ivertig ubiased tests lead to ubiased cofidece sets. Defiitio.10. A 1 cofidece set is ubiased if θ Cx) ) 1 for ay θ θ. It is a uiformly most accurate ubiased UMAU) cofidece set o Θ if it is uiformly most accurate o Θ amog ubiased cofidece sets. Lemma.11. A 1 -ubiased cofidece set o Θ is the iverse of -level ubiased tests of H 0 : θ = θ versus H 1 : θ Θ \ {θ }. Proof. The lemma is almost a tautology. Let Aθ ) be the acceptace regio of a ubiased test of H 0 : θ = θ versus H 1 : θ Θ \ {θ }: x A 1 θ ) ) 1. We ivert the acceptace regio to obtai the stated coclusio. We combie Lemma.11 ad Theorem.9 to obtai the usurprisig) result that the iverse of the acceptace regio of a UMPU test is a UMAU cofidece set. The proof is very similar to the proof of Theorem.9, ad we skip the details here. Theorem.1. A 1 -UMAU cofidece set o Θ is the iverse of -level UMPU tests of H 0 : θ = θ versus H 1 : θ Θ \ {θ }. Yuekai Su Berkeley, Califoria December, 015
Introductory statistics
CM9S: Machie Learig for Bioiformatics Lecture - 03/3/06 Itroductory statistics Lecturer: Sriram Sakararama Scribe: Sriram Sakararama We will provide a overview of statistical iferece focussig o the key
More informationSummary. Recap ... Last Lecture. Summary. Theorem
Last Lecture Biostatistics 602 - Statistical Iferece Lecture 23 Hyu Mi Kag April 11th, 2013 What is p-value? What is the advatage of p-value compared to hypothesis testig procedure with size α? How ca
More informationEcon 325 Notes on Point Estimator and Confidence Interval 1 By Hiro Kasahara
Poit Estimator Eco 325 Notes o Poit Estimator ad Cofidece Iterval 1 By Hiro Kasahara Parameter, Estimator, ad Estimate The ormal probability desity fuctio is fully characterized by two costats: populatio
More informationAsymptotics. Hypothesis Testing UMP. Asymptotic Tests and p-values
of the secod half Biostatistics 6 - Statistical Iferece Lecture 6 Fial Exam & Practice Problems for the Fial Hyu Mi Kag Apil 3rd, 3 Hyu Mi Kag Biostatistics 6 - Lecture 6 Apil 3rd, 3 / 3 Rao-Blackwell
More informationChapter 3. Strong convergence. 3.1 Definition of almost sure convergence
Chapter 3 Strog covergece As poited out i the Chapter 2, there are multiple ways to defie the otio of covergece of a sequece of radom variables. That chapter defied covergece i probability, covergece i
More informationEfficient GMM LECTURE 12 GMM II
DECEMBER 1 010 LECTURE 1 II Efficiet The estimator depeds o the choice of the weight matrix A. The efficiet estimator is the oe that has the smallest asymptotic variace amog all estimators defied by differet
More informationStatistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.
Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized
More informationLet us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f.
Lecture 5 Let us give oe more example of MLE. Example 3. The uiform distributio U[0, ] o the iterval [0, ] has p.d.f. { 1 f(x =, 0 x, 0, otherwise The likelihood fuctio ϕ( = f(x i = 1 I(X 1,..., X [0,
More informationLecture 6 Simple alternatives and the Neyman-Pearson lemma
STATS 00: Itroductio to Statistical Iferece Autum 06 Lecture 6 Simple alteratives ad the Neyma-Pearso lemma Last lecture, we discussed a umber of ways to costruct test statistics for testig a simple ull
More informationSTATISTICAL INFERENCE
STATISTICAL INFERENCE POPULATION AND SAMPLE Populatio = all elemets of iterest Characterized by a distributio F with some parameter θ Sample = the data X 1,..., X, selected subset of the populatio = sample
More informationECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors
ECONOMETRIC THEORY MODULE XIII Lecture - 34 Asymptotic Theory ad Stochastic Regressors Dr. Shalabh Departmet of Mathematics ad Statistics Idia Istitute of Techology Kapur Asymptotic theory The asymptotic
More informationProperties and Hypothesis Testing
Chapter 3 Properties ad Hypothesis Testig 3.1 Types of data The regressio techiques developed i previous chapters ca be applied to three differet kids of data. 1. Cross-sectioal data. 2. Time series data.
More informationStat 200 -Testing Summary Page 1
Stat 00 -Testig Summary Page 1 Mathematicias are like Frechme; whatever you say to them, they traslate it ito their ow laguage ad forthwith it is somethig etirely differet Goethe 1 Large Sample Cofidece
More informationLast Lecture. Wald Test
Last Lecture Biostatistics 602 - Statistical Iferece Lecture 22 Hyu Mi Kag April 9th, 2013 Is the exact distributio of LRT statistic typically easy to obtai? How about its asymptotic distributio? For testig
More informationThis exam contains 19 pages (including this cover page) and 10 questions. A Formulae sheet is provided with the exam.
Probability ad Statistics FS 07 Secod Sessio Exam 09.0.08 Time Limit: 80 Miutes Name: Studet ID: This exam cotais 9 pages (icludig this cover page) ad 0 questios. A Formulae sheet is provided with the
More informationTests of Hypotheses Based on a Single Sample (Devore Chapter Eight)
Tests of Hypotheses Based o a Sigle Sample Devore Chapter Eight MATH-252-01: Probability ad Statistics II Sprig 2018 Cotets 1 Hypothesis Tests illustrated with z-tests 1 1.1 Overview of Hypothesis Testig..........
More information2 1. The r.s., of size n2, from population 2 will be. 2 and 2. 2) The two populations are independent. This implies that all of the n1 n2
Chapter 8 Comparig Two Treatmets Iferece about Two Populatio Meas We wat to compare the meas of two populatios to see whether they differ. There are two situatios to cosider, as show i the followig examples:
More information1.010 Uncertainty in Engineering Fall 2008
MIT OpeCourseWare http://ocw.mit.edu.00 Ucertaity i Egieerig Fall 2008 For iformatio about citig these materials or our Terms of Use, visit: http://ocw.mit.edu.terms. .00 - Brief Notes # 9 Poit ad Iterval
More informationMATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4
MATH 30: Probability ad Statistics 9. Estimatio ad Testig of Parameters Estimatio ad Testig of Parameters We have bee dealig situatios i which we have full kowledge of the distributio of a radom variable.
More informationLecture 10 October Minimaxity and least favorable prior sequences
STATS 300A: Theory of Statistics Fall 205 Lecture 0 October 22 Lecturer: Lester Mackey Scribe: Brya He, Rahul Makhijai Warig: These otes may cotai factual ad/or typographic errors. 0. Miimaxity ad least
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More informationLecture 19: Convergence
Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may
More informationA statistical method to determine sample size to estimate characteristic value of soil parameters
A statistical method to determie sample size to estimate characteristic value of soil parameters Y. Hojo, B. Setiawa 2 ad M. Suzuki 3 Abstract Sample size is a importat factor to be cosidered i determiig
More information32 estimating the cumulative distribution function
32 estimatig the cumulative distributio fuctio 4.6 types of cofidece itervals/bads Let F be a class of distributio fuctios F ad let θ be some quatity of iterest, such as the mea of F or the whole fuctio
More informationLecture 33: Bootstrap
Lecture 33: ootstrap Motivatio To evaluate ad compare differet estimators, we eed cosistet estimators of variaces or asymptotic variaces of estimators. This is also importat for hypothesis testig ad cofidece
More informationSince X n /n P p, we know that X n (n. Xn (n X n ) Using the asymptotic result above to obtain an approximation for fixed n, we obtain
Assigmet 9 Exercise 5.5 Let X biomial, p, where p 0, 1 is ukow. Obtai cofidece itervals for p i two differet ways: a Sice X / p d N0, p1 p], the variace of the limitig distributio depeds oly o p. Use the
More informationOutput Analysis and Run-Length Control
IEOR E4703: Mote Carlo Simulatio Columbia Uiversity c 2017 by Marti Haugh Output Aalysis ad Ru-Legth Cotrol I these otes we describe how the Cetral Limit Theorem ca be used to costruct approximate (1 α%
More informationLecture Notes 15 Hypothesis Testing (Chapter 10)
1 Itroductio Lecture Notes 15 Hypothesis Testig Chapter 10) Let X 1,..., X p θ x). Suppose we we wat to kow if θ = θ 0 or ot, where θ 0 is a specific value of θ. For example, if we are flippig a coi, we
More informationDirection: This test is worth 250 points. You are required to complete this test within 50 minutes.
Term Test October 3, 003 Name Math 56 Studet Number Directio: This test is worth 50 poits. You are required to complete this test withi 50 miutes. I order to receive full credit, aswer each problem completely
More informationConvergence of random variables. (telegram style notes) P.J.C. Spreij
Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space
More informationA quick activity - Central Limit Theorem and Proportions. Lecture 21: Testing Proportions. Results from the GSS. Statistics and the General Population
A quick activity - Cetral Limit Theorem ad Proportios Lecture 21: Testig Proportios Statistics 10 Coli Rudel Flip a coi 30 times this is goig to get loud! Record the umber of heads you obtaied ad calculate
More informationEcon 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1.
Eco 325/327 Notes o Sample Mea, Sample Proportio, Cetral Limit Theorem, Chi-square Distributio, Studet s t distributio 1 Sample Mea By Hiro Kasahara We cosider a radom sample from a populatio. Defiitio
More informationJanuary 25, 2017 INTRODUCTION TO MATHEMATICAL STATISTICS
Jauary 25, 207 INTRODUCTION TO MATHEMATICAL STATISTICS Abstract. A basic itroductio to statistics assumig kowledge of probability theory.. Probability I a typical udergraduate problem i probability, we
More informationProblem Set 4 Due Oct, 12
EE226: Radom Processes i Systems Lecturer: Jea C. Walrad Problem Set 4 Due Oct, 12 Fall 06 GSI: Assae Gueye This problem set essetially reviews detectio theory ad hypothesis testig ad some basic otios
More informationFrequentist Inference
Frequetist Iferece The topics of the ext three sectios are useful applicatios of the Cetral Limit Theorem. Without kowig aythig about the uderlyig distributio of a sequece of radom variables {X i }, for
More information1 Convergence in Probability and the Weak Law of Large Numbers
36-752 Advaced Probability Overview Sprig 2018 8. Covergece Cocepts: i Probability, i L p ad Almost Surely Istructor: Alessadro Rialdo Associated readig: Sec 2.4, 2.5, ad 4.11 of Ash ad Doléas-Dade; Sec
More informationPoint Estimation: properties of estimators 1 FINITE-SAMPLE PROPERTIES. finite-sample properties (CB 7.3) large-sample properties (CB 10.
Poit Estimatio: properties of estimators fiite-sample properties CB 7.3) large-sample properties CB 10.1) 1 FINITE-SAMPLE PROPERTIES How a estimator performs for fiite umber of observatios. Estimator:
More informationFirst Year Quantitative Comp Exam Spring, Part I - 203A. f X (x) = 0 otherwise
First Year Quatitative Comp Exam Sprig, 2012 Istructio: There are three parts. Aswer every questio i every part. Questio I-1 Part I - 203A A radom variable X is distributed with the margial desity: >
More informationx = Pr ( X (n) βx ) =
Exercise 93 / page 45 The desity of a variable X i i 1 is fx α α a For α kow let say equal to α α > fx α α x α Pr X i x < x < Usig a Pivotal Quatity: x α 1 < x < α > x α 1 ad We solve i a similar way as
More informationResampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.
Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator
More informationRecall the study where we estimated the difference between mean systolic blood pressure levels of users of oral contraceptives and non-users, x - y.
Testig Statistical Hypotheses Recall the study where we estimated the differece betwee mea systolic blood pressure levels of users of oral cotraceptives ad o-users, x - y. Such studies are sometimes viewed
More informationGoodness-of-Fit Tests and Categorical Data Analysis (Devore Chapter Fourteen)
Goodess-of-Fit Tests ad Categorical Data Aalysis (Devore Chapter Fourtee) MATH-252-01: Probability ad Statistics II Sprig 2019 Cotets 1 Chi-Squared Tests with Kow Probabilities 1 1.1 Chi-Squared Testig................
More informationStatistical Inference Based on Extremum Estimators
T. Rotheberg Fall, 2007 Statistical Iferece Based o Extremum Estimators Itroductio Suppose 0, the true value of a p-dimesioal parameter, is kow to lie i some subset S R p : Ofte we choose to estimate 0
More informationApril 18, 2017 CONFIDENCE INTERVALS AND HYPOTHESIS TESTING, UNDERGRADUATE MATH 526 STYLE
April 18, 2017 CONFIDENCE INTERVALS AND HYPOTHESIS TESTING, UNDERGRADUATE MATH 526 STYLE TERRY SOO Abstract These otes are adapted from whe I taught Math 526 ad meat to give a quick itroductio to cofidece
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS
MASSACHUSTTS INSTITUT OF TCHNOLOGY 6.436J/5.085J Fall 2008 Lecture 9 /7/2008 LAWS OF LARG NUMBRS II Cotets. The strog law of large umbers 2. The Cheroff boud TH STRONG LAW OF LARG NUMBRS While the weak
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationKLMED8004 Medical statistics. Part I, autumn Estimation. We have previously learned: Population and sample. New questions
We have previously leared: KLMED8004 Medical statistics Part I, autum 00 How kow probability distributios (e.g. biomial distributio, ormal distributio) with kow populatio parameters (mea, variace) ca give
More informationProbability and Statistics
ICME Refresher Course: robability ad Statistics Staford Uiversity robability ad Statistics Luyag Che September 20, 2016 1 Basic robability Theory 11 robability Spaces A probability space is a triple (Ω,
More informationLast Lecture. Unbiased Test
Last Lecture Biostatistics 6 - Statistical Iferece Lecture Uiformly Most Powerful Test Hyu Mi Kag March 8th, 3 What are the typical steps for costructig a likelihood ratio test? Is LRT statistic based
More informationDS 100: Principles and Techniques of Data Science Date: April 13, Discussion #10
DS 00: Priciples ad Techiques of Data Sciece Date: April 3, 208 Name: Hypothesis Testig Discussio #0. Defie these terms below as they relate to hypothesis testig. a) Data Geeratio Model: Solutio: A set
More information5. Likelihood Ratio Tests
1 of 5 7/29/2009 3:16 PM Virtual Laboratories > 9. Hy pothesis Testig > 1 2 3 4 5 6 7 5. Likelihood Ratio Tests Prelimiaries As usual, our startig poit is a radom experimet with a uderlyig sample space,
More informationRates of Convergence by Moduli of Continuity
Rates of Covergece by Moduli of Cotiuity Joh Duchi: Notes for Statistics 300b March, 017 1 Itroductio I this ote, we give a presetatio showig the importace, ad relatioship betwee, the modulis of cotiuity
More informationFACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures
FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING Lectures MODULE 5 STATISTICS II. Mea ad stadard error of sample data. Biomial distributio. Normal distributio 4. Samplig 5. Cofidece itervals
More informationChapter 6 Principles of Data Reduction
Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a
More information2.2. Central limit theorem.
36.. Cetral limit theorem. The most ideal case of the CLT is that the radom variables are iid with fiite variace. Although it is a special case of the more geeral Lideberg-Feller CLT, it is most stadard
More information1 Review and Overview
DRAFT a fial versio will be posted shortly CS229T/STATS231: Statistical Learig Theory Lecturer: Tegyu Ma Lecture #3 Scribe: Migda Qiao October 1, 2013 1 Review ad Overview I the first half of this course,
More informationAsymptotic Results for the Linear Regression Model
Asymptotic Results for the Liear Regressio Model C. Fli November 29, 2000 1. Asymptotic Results uder Classical Assumptios The followig results apply to the liear regressio model y = Xβ + ε, where X is
More informationLecture 3. Properties of Summary Statistics: Sampling Distribution
Lecture 3 Properties of Summary Statistics: Samplig Distributio Mai Theme How ca we use math to justify that our umerical summaries from the sample are good summaries of the populatio? Lecture Summary
More informationLecture 12: September 27
36-705: Itermediate Statistics Fall 207 Lecturer: Siva Balakrisha Lecture 2: September 27 Today we will discuss sufficiecy i more detail ad the begi to discuss some geeral strategies for costructig estimators.
More informationLECTURE 8: ASYMPTOTICS I
LECTURE 8: ASYMPTOTICS I We are iterested i the properties of estimators as. Cosider a sequece of radom variables {, X 1}. N. M. Kiefer, Corell Uiversity, Ecoomics 60 1 Defiitio: (Weak covergece) A sequece
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationLecture 27: Optimal Estimators and Functional Delta Method
Stat210B: Theoretical Statistics Lecture Date: April 19, 2007 Lecture 27: Optimal Estimators ad Fuctioal Delta Method Lecturer: Michael I. Jorda Scribe: Guilherme V. Rocha 1 Achievig Optimal Estimators
More informationLecture 11 and 12: Basic estimation theory
Lecture ad 2: Basic estimatio theory Sprig 202 - EE 94 Networked estimatio ad cotrol Prof. Kha March 2 202 I. MAXIMUM-LIKELIHOOD ESTIMATORS The maximum likelihood priciple is deceptively simple. Louis
More informationStat 319 Theory of Statistics (2) Exercises
Kig Saud Uiversity College of Sciece Statistics ad Operatios Research Departmet Stat 39 Theory of Statistics () Exercises Refereces:. Itroductio to Mathematical Statistics, Sixth Editio, by R. Hogg, J.
More informationThe variance of a sum of independent variables is the sum of their variances, since covariances are zero. Therefore. V (xi )= n n 2 σ2 = σ2.
SAMPLE STATISTICS A radom sample x 1,x,,x from a distributio f(x) is a set of idepedetly ad idetically variables with x i f(x) for all i Their joit pdf is f(x 1,x,,x )=f(x 1 )f(x ) f(x )= f(x i ) The sample
More informationStatistical inference: example 1. Inferential Statistics
Statistical iferece: example 1 Iferetial Statistics POPULATION SAMPLE A clothig store chai regularly buys from a supplier large quatities of a certai piece of clothig. Each item ca be classified either
More informationFinal Review. Fall 2013 Prof. Yao Xie, H. Milton Stewart School of Industrial Systems & Engineering Georgia Tech
Fial Review Fall 2013 Prof. Yao Xie, yao.xie@isye.gatech.edu H. Milto Stewart School of Idustrial Systems & Egieerig Georgia Tech 1 Radom samplig model radom samples populatio radom samples: x 1,..., x
More informationMA238 Assignment 4 Solutions (part a)
(i) Sigle sample tests. Questio. MA38 Assigmet 4 Solutios (part a) (a) (b) (c) H 0 : = 50 sq. ft H A : < 50 sq. ft H 0 : = 3 mpg H A : > 3 mpg H 0 : = 5 mm H A : 5mm Questio. (i) What are the ull ad alterative
More informationDiscrete Mathematics for CS Spring 2008 David Wagner Note 22
CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 22 I.I.D. Radom Variables Estimatig the bias of a coi Questio: We wat to estimate the proportio p of Democrats i the US populatio, by takig
More informationLecture 2: Monte Carlo Simulation
STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: Ye-Chi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?
More informationAgreement of CI and HT. Lecture 13 - Tests of Proportions. Example - Waiting Times
Sigificace level vs. cofidece level Agreemet of CI ad HT Lecture 13 - Tests of Proportios Sta102 / BME102 Coli Rudel October 15, 2014 Cofidece itervals ad hypothesis tests (almost) always agree, as log
More informationModule 1 Fundamentals in statistics
Normal Distributio Repeated observatios that differ because of experimetal error ofte vary about some cetral value i a roughly symmetrical distributio i which small deviatios occur much more frequetly
More informationStat 421-SP2012 Interval Estimation Section
Stat 41-SP01 Iterval Estimatio Sectio 11.1-11. We ow uderstad (Chapter 10) how to fid poit estimators of a ukow parameter. o However, a poit estimate does ot provide ay iformatio about the ucertaity (possible
More informationAdvanced Stochastic Processes.
Advaced Stochastic Processes. David Gamarik LECTURE 2 Radom variables ad measurable fuctios. Strog Law of Large Numbers (SLLN). Scary stuff cotiued... Outlie of Lecture Radom variables ad measurable fuctios.
More informationOutput Analysis (2, Chapters 10 &11 Law)
B. Maddah ENMG 6 Simulatio Output Aalysis (, Chapters 10 &11 Law) Comparig alterative system cofiguratio Sice the output of a simulatio is radom, the comparig differet systems via simulatio should be doe
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationSTAT431 Review. X = n. n )
STAT43 Review I. Results related to ormal distributio Expected value ad variace. (a) E(aXbY) = aex bey, Var(aXbY) = a VarX b VarY provided X ad Y are idepedet. Normal distributios: (a) Z N(, ) (b) X N(µ,
More informationHypothesis Testing. Evaluation of Performance of Learned h. Issues. Trade-off Between Bias and Variance
Hypothesis Testig Empirically evaluatig accuracy of hypotheses: importat activity i ML. Three questios: Give observed accuracy over a sample set, how well does this estimate apply over additioal samples?
More information1 Introduction to reducing variance in Monte Carlo simulations
Copyright c 010 by Karl Sigma 1 Itroductio to reducig variace i Mote Carlo simulatios 11 Review of cofidece itervals for estimatig a mea I statistics, we estimate a ukow mea µ = E(X) of a distributio by
More informationt distribution [34] : used to test a mean against an hypothesized value (H 0 : µ = µ 0 ) or the difference
EXST30 Backgroud material Page From the textbook The Statistical Sleuth Mea [0]: I your text the word mea deotes a populatio mea (µ) while the work average deotes a sample average ( ). Variace [0]: The
More informationChapter 22. Comparing Two Proportions. Copyright 2010 Pearson Education, Inc.
Chapter 22 Comparig Two Proportios Copyright 2010 Pearso Educatio, Ic. Comparig Two Proportios Comparisos betwee two percetages are much more commo tha questios about isolated percetages. Ad they are more
More informationSample Size Estimation in the Proportional Hazards Model for K-sample or Regression Settings Scott S. Emerson, M.D., Ph.D.
ample ie Estimatio i the Proportioal Haards Model for K-sample or Regressio ettigs cott. Emerso, M.D., Ph.D. ample ie Formula for a Normally Distributed tatistic uppose a statistic is kow to be ormally
More informationEstimation for Complete Data
Estimatio for Complete Data complete data: there is o loss of iformatio durig study. complete idividual complete data= grouped data A complete idividual data is the oe i which the complete iformatio of
More informationChi-Squared Tests Math 6070, Spring 2006
Chi-Squared Tests Math 6070, Sprig 2006 Davar Khoshevisa Uiversity of Utah February XXX, 2006 Cotets MLE for Goodess-of Fit 2 2 The Multiomial Distributio 3 3 Applicatio to Goodess-of-Fit 6 3 Testig for
More informationChapter 22. Comparing Two Proportions. Copyright 2010, 2007, 2004 Pearson Education, Inc.
Chapter 22 Comparig Two Proportios Copyright 2010, 2007, 2004 Pearso Educatio, Ic. Comparig Two Proportios Read the first two paragraphs of pg 504. Comparisos betwee two percetages are much more commo
More informationMOST PEOPLE WOULD RATHER LIVE WITH A PROBLEM THEY CAN'T SOLVE, THAN ACCEPT A SOLUTION THEY CAN'T UNDERSTAND.
XI-1 (1074) MOST PEOPLE WOULD RATHER LIVE WITH A PROBLEM THEY CAN'T SOLVE, THAN ACCEPT A SOLUTION THEY CAN'T UNDERSTAND. R. E. D. WOOLSEY AND H. S. SWANSON XI-2 (1075) STATISTICAL DECISION MAKING Advaced
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit theorems Throughout this sectio we will assume a probability space (Ω, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More informationHYPOTHESIS TESTS FOR ONE POPULATION MEAN WORKSHEET MTH 1210, FALL 2018
HYPOTHESIS TESTS FOR ONE POPULATION MEAN WORKSHEET MTH 1210, FALL 2018 We are resposible for 2 types of hypothesis tests that produce ifereces about the ukow populatio mea, µ, each of which has 3 possible
More informationInterval Estimation (Confidence Interval = C.I.): An interval estimate of some population parameter is an interval of the form (, ),
Cofidece Iterval Estimatio Problems Suppose we have a populatio with some ukow parameter(s). Example: Normal(,) ad are parameters. We eed to draw coclusios (make ifereces) about the ukow parameters. We
More informationThe standard deviation of the mean
Physics 6C Fall 20 The stadard deviatio of the mea These otes provide some clarificatio o the distictio betwee the stadard deviatio ad the stadard deviatio of the mea.. The sample mea ad variace Cosider
More informationLecture 3: August 31
36-705: Itermediate Statistics Fall 018 Lecturer: Siva Balakrisha Lecture 3: August 31 This lecture will be mostly a summary of other useful expoetial tail bouds We will ot prove ay of these i lecture,
More information10. Comparative Tests among Spatial Regression Models. Here we revisit the example in Section 8.1 of estimating the mean of a normal random
Part III. Areal Data Aalysis 0. Comparative Tests amog Spatial Regressio Models While the otio of relative likelihood values for differet models is somewhat difficult to iterpret directly (as metioed above),
More informationLecture 11 October 27
STATS 300A: Theory of Statistics Fall 205 Lecture October 27 Lecturer: Lester Mackey Scribe: Viswajith Veugopal, Vivek Bagaria, Steve Yadlowsky Warig: These otes may cotai factual ad/or typographic errors..
More informationMath 140 Introductory Statistics
8.2 Testig a Proportio Math 1 Itroductory Statistics Professor B. Abrego Lecture 15 Sectios 8.2 People ofte make decisios with data by comparig the results from a sample to some predetermied stadard. These
More informationRandom Variables, Sampling and Estimation
Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig
More informationSTAT Homework 1 - Solutions
STAT-36700 Homework 1 - Solutios Fall 018 September 11, 018 This cotais solutios for Homework 1. Please ote that we have icluded several additioal commets ad approaches to the problems to give you better
More information4. Partial Sums and the Central Limit Theorem
1 of 10 7/16/2009 6:05 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 4. Partial Sums ad the Cetral Limit Theorem The cetral limit theorem ad the law of large umbers are the two fudametal theorems
More informationProduct measures, Tonelli s and Fubini s theorems For use in MAT3400/4400, autumn 2014 Nadia S. Larsen. Version of 13 October 2014.
Product measures, Toelli s ad Fubii s theorems For use i MAT3400/4400, autum 2014 Nadia S. Larse Versio of 13 October 2014. 1. Costructio of the product measure The purpose of these otes is to preset the
More informationLecture 7: Properties of Random Samples
Lecture 7: Properties of Radom Samples 1 Cotiued From Last Class Theorem 1.1. Let X 1, X,...X be a radom sample from a populatio with mea µ ad variace σ
More informationLecture Note 8 Point Estimators and Point Estimation Methods. MIT Spring 2006 Herman Bennett
Lecture Note 8 Poit Estimators ad Poit Estimatio Methods MIT 14.30 Sprig 2006 Herma Beett Give a parameter with ukow value, the goal of poit estimatio is to use a sample to compute a umber that represets
More information