tests 17.1 Simple versus compound
|
|
- Meredith Matthews
- 5 years ago
- Views:
Transcription
1 PAS204: Lecture 17. tests UMP ad asymtotic I this lecture, we will idetify UMP tests, wherever they exist, for comarig a simle ull hyothesis with a comoud alterative. We also look at costructig tests based o the asymtotic distributio of the MLE. Fially, we brie y itroduce geeralised likelihood ratio tests Simle versus comoud Cosider testig H 0 : = 0 versus H 1 : 2 1, where 1 cotais a rage of ossible values for (obviously excludig 0 ). So we have a simle ull hyothesis but a comoud alterative. I Lecture 15, we de ed size ad ower geerally for ay ull ad alterative hyotheses, ad we itroduced the otio of UMP (Uiformly Most Powerful) tests. The fact that the ull hyothesis is simle makes the de itios of size ad UMP tests a little easier. The size of a test C is just = C ( 0 ) = P (X 2 C j = 0 ), the robability of rst kid of error. Remark 17.1 This is the same as i the last lecture, where we cosidered two simle hyotheses, but ow because we have a comoud alterative we do ot have a sigle value to rereset the robability of secod kid of error. C is a UMP test of size if for ay other test C with C ( 0 ) we have C () C (), We ca use the Neyma-Pearso Lemma to tell us exactly whe such a UMP test exists. Theorem 1 (UMP tests) If the LR test of size for H 0 : = 0 versus the simle alterative H 1 : = 1 is the same test for all 1 2 1, the this is the UMP test of size for H 0 : = 0 agaist the comoud alterative H 1 : 2 1. Otherwise o UMP test of these hyotheses of size exists. Proof. The LR test of H 0 : = 0 versus H 1 : = 1 of size maximises the ower fuctio at 1, i.e. it maximises C ( 1 ). If it is the same test for all 1 2 1, the it maximises the ower for all 2 1, ad is clearly UMP. 1
2 Now suose that 1 6= 2 are two di eret elemets of 1. Let the LR test of H 0 : = 0 versus H 1 : = 1 of size have critical regio C 1 ad that with alterative hyothesis that = 2, also of size, have critical regio C 2. Now if C 1 6= C 2, we have di eret tests for these two alteratives. The C 1 has maximal ower at = 1 (ad caot be beate there), but C 2 has maximal ower at = 2 (ad caot be beate there). So either is UMP, but or ca ay other test be UMP. Remark 17.2 So wheever a UMP test exists for a simle H 0 it is a LR test. Examle 17.1 (Normal samle, kow variace) I Examle 16.1 we foud the LR test of H 0 : = 0 versus H 1 : = 1, give a samle from the N(; 2 ) distributio with 2 kow. It has the form C = fx : x k g if 0 > 1 ; C = fx : x k g if 0 < 1 : The i Examle 16.2 we foud that xig the test size leads to k = Z if 0 > 1, i.e. 0 C = x : x 0 o Z if 0 > 1 ; (17.1) ad similarly we had C = o x : x 0 + Z if 0 < 1 : (17.2) We therefore might have, deedig o 1, two di eret LR tests of size, whereas Theorem 1 says we have a UMP test if there is oly oe LR test. Alyig the theorem, we d the followig results The test (17.1) is UMP for H 0 : = 0 agaist H 1 : < 0 (or for ay 1 ( 1; 0 )). The test (17.2) is UMP for H 0 : = 0 agaist H 1 : > 0 (or for ay 1 ( 0 ; 1)). There is o UMP test for H 0 : = 0 agaist H 1 : 6= 0 (or for ay 1 cotaiig some < 0 ad some > 0 ). 2
3 Examle 17.2 (Exoetial samle) I Examle 16.3 we foud the LR test of H 0 : = 0 versus H 1 : = 1 > 0, for a samle from the Ex() distributio. The test of size was foud to be C = x : x 2 2;1 : 2 0 This is the same test for ay 1 > 0, ad so it is UMP agaist H 1 : > Oe-sided ad two-sided tests If we have a ull hyothesis that = 0 ad a alterative that > 0, the we call this a oe-sided alterative. The hyothesis that < 0 is also oe-sided. The geeral two-sided alterative is simly that 6= 0. I both the examles we d that there are UMP tests for oe-sided alteratives. Furthermore, these tests are themselves oe-sided, beig of the form that we reject the ull hyothesis if the relevat test statistic T (x) is o oe side of some boudary. (The test statistic haes to be x i both these cases.) This is commo, ad we ca see that it will arise wheever (x) is a mootoe fuctio of T (x). UMP tests exist for oe-sided alteratives i may simle statistical roblems (ad are oe-sided tests). However, we geerally do ot d UMP tests for two-sided alteratives. Remark 17.3 I Level 1 Statistics, you will have met two-sided tests for two-sided alteratives, ad these ofte have some good roerties but they are ot UMP tests. We do t have time ow to go ito the aroriate criteria for two-sided tests Asymtotic test costructio The rocess of costructig LR tests is, as we saw i Lecture 16, ofte comlicated. If we have a large samle, a simle aroximate test ca be costructed usig the asymtotic distributio of ML estimators. The aroach is like that used i rst year Statistics to costruct tests: we choose a test statistic ad the form of the critical regio (ste 1 of the rocedure i sectio 16.4, Lecture 16) i a ad hoc or ituitive way. We the d the test of size (ste 2) i the usual way. I this case, we are goig to use the MLE as the test statistic i ste 1. We are also goig to 3
4 use the asymtotic distributio of the MLE to do ste 2 i a aroximate way. We will suose that is a scalar arameter. Suose we have the simle ull hyothesis H 0 : = 0. The if the ull hyothesis is true, the asymtotic theory says that the ^ has aroximately the distributio N( 0 ; I( 0 ) 1 ). Now suose we have the oe-sided alterative H 1 : > 0. A sesible test would be oe-sided also, ad reject H 0 if ^ exceeds some value k. So cosider C = fx : ^ > k g. Now assumig that we caot derive the exact distributio of ^ (ad so caot do ste 2 exactly), we ca use its asymtotic distributio to d k aroximately to give a test of size. = P (^(X) > k j = 0 ) = P I(0 )(^(X) 0 ) > I( 0 )(k 0 ) j = 0 De ig Z s N(0; 1), the asymtotic distributio of ^(X) ow imlies that P (Z > I( 0 )(k 0 )) = 1 I(0 )(k 0 ) ; : ad hece the observed sigi cace of the data is P = 1 I(0 )(^ 0 ) : The test of size is give by I(0 )(k 0 ) = Z ; ) k = 0 + Z = I( 0 ) : So a aroximate 100% test is C = fx : ^(X) > 0 + Z = I( 0 )g. We ca similarly costruct the other oe-sided test C = fx : ^(X) < 0 Z = I( 0 )g for H 1 : < 0, or a two-sided test C = fx : j^(x) 0 j > Z =2 = I( 0 )g for H 1 : 6= 0. Examle 17.3 (Cacer trials) I Case Study A, we modelled the cacer trial data as = 70 Beroulli trials, givig the biomial observatio X = umber of atiets survivig, ad X s Bi(70; ), where is the robability of survival with the ew treatmet. We have observed x = 34. We are iterested i whether the ew treatmet has a di eret survival robability tha the curret gure of 0.4. So we wish to test H 0 : = 0:4 versus H 1 : 6= 0:4. Usig the asymtotic aroach, we kow that ^(X) = X= has the asymtotic distributio N(; (1 )=). 4
5 So if H 0 is true its distributio is N(0:4; 0:40:6=70), or N(0:4; 0:003429). We have a two-sided alterative, so we use the two-sided test, which is to reject H 0 if j^ 0 j I( 0 ) > Z =2. We d j^ 0 j I( 0 ) = j :4j= 0: = 1:464. From tables we have Z 0:05 = 1:645, ad our calculated value of does ot exceed this, so the result is ot sigi cat at the = :05% = 10% level. I fact the observed sigi cace is P = 2f1 (1:464)g = 0:143, or 14.3%. We therefore do ot reject H 0. The data rovide isu ciet evidece agaist the ull hyothesis that the ew treatmet has a survival rate equal to the rate of 40% achieved with curret methods. This is a asymtotic, aroximate, test. That meas it is oly aroximately a 10% test. What is its true size? We kow that ^ = X has a biomial distributio, ad with = 70 this should be well aroximated by a ormal distributio, but let us calculate the exact size of the asymtotic 10% test. It rejects H 0 if (multilyig through by 70) jx 28j > 70 0: :645 = 6:7. Thus, it rejects H 0 if X > 34 or if X < 22. (With our actual observed x = 34, we early had sigi cace!) Now if X really has the Bi(70; 0:4) distributio seci ed by H 0, we ca d the robability that X lies i this critical regio. The calculatio is easily erformed by comuter (e.g. usig S-Plus), ad we d the true test size is P (X > 34 j = 0:4) + P (X < 22 j = 0:4) = 0:112, or just over 11%. Examle 17.4 (Normal samle, zero mea) Suose that X 1 ; X 2 ; : : : ; X are ideedetly distributed as N(0; 2 ). We wish to test the ull hyothesis that 2 = 2 0 versus the alterative hyothesis that 2 > 2 0. There is a UMP test for this roblem, as show i exercises, but we will cosider derivig a aroximate test from the asymtotic distributio of the MLE. P I Examle 14.2, we foud that the MLE is ^ 2 = S 0 =, where S 0 = i=1 X2 i, ad its asymtotic distributio is ormal with mea 2 ad variace 2 4 =. We ca ow aly the theory of costructig tests from the asymtotic MLE distributio. We have H 0 : 2 = 2 0 ad H 1 : 2 > 2 0, so we wat the oe-sided test C = fx : ^ > 0 + Z = I( 0 )g = fx : ^ 2 > Z q2 4 0=g = fx : ^ 2 > 2 0(1 + Z 2=)g : (Comare with the LR test for this roblem.) 5
6 17.4 Geeralised LR tests We ed this lecture, ad ed our treatmet of the theory of frequetist hyothesis testig, with a brief look at some more advaced theory. What do we do if we have a simle ull hyothesis but there is o UMP test? What do we do if we have a comoud ull hyothesis? Remark 17.4 The latter is obviously a imortat questio. We have bee lookig at really simle roblems, tyically with just oe arameter, but i the real world of alied statistics we costatly deal with models havig may arameters. I that cotext we ever have a simle ull hyothesis. Our ull hyotheses ofte assert that oe of the arameters takes a seci c value, but such a hyothesis is ot simle, sice that would etail secifyig the values of all the arameters. The stadard geeral method is to costruct the Geeralised Likelihood Ratio (GLR) (x) = max 2 1 [ 0 L(; x) (17.3) max 20 L(; x) ad to use it i the same way as the simle LR. There is some asymtotic theory about the distributio of (X) (which is more useful i this cotext tha the asymtotic theory about the MLE), ad we ca thereby costruct aroximate GLR tests. All of this takes us beyod the remit of this course, but it is useful at least for you to kow of how frequetist theory deals with more comlex situatios tha the oes we ve discussed here. Note, however, that the theory is agai asymtotic, ad we ca rarely d exact tests. A. O Haga Aril
Basics of Inference. Lecture 21: Bayesian Inference. Review - Example - Defective Parts, cont. Review - Example - Defective Parts
Basics of Iferece Lecture 21: Sta230 / Mth230 Coli Rudel Aril 16, 2014 U util this oit i the class you have almost exclusively bee reseted with roblems where we are usig a robability model where the model
More informationSTAT-UB.0103 NOTES for Wednesday 2012.APR.25. Here s a rehash on the p-value notion:
STAT-UB.3 NOTES for Wedesday 22.APR.25 Here s a rehash o the -value otio: The -value is the smallest α at which H would have bee rejected, with these data. The -value is a measure of SHOCK i the data.
More informationHypothesis Testing. H 0 : θ 1 1. H a : θ 1 1 (but > 0... required in distribution) Simple Hypothesis - only checks 1 value
Hyothesis estig ME's are oit estimates of arameters/coefficiets really have a distributio Basic Cocet - develo regio i which we accet the hyothesis ad oe where we reject it H - reresets all ossible values
More informationProblem Set 4 Due Oct, 12
EE226: Radom Processes i Systems Lecturer: Jea C. Walrad Problem Set 4 Due Oct, 12 Fall 06 GSI: Assae Gueye This problem set essetially reviews detectio theory ad hypothesis testig ad some basic otios
More information5. Likelihood Ratio Tests
1 of 5 7/29/2009 3:16 PM Virtual Laboratories > 9. Hy pothesis Testig > 1 2 3 4 5 6 7 5. Likelihood Ratio Tests Prelimiaries As usual, our startig poit is a radom experimet with a uderlyig sample space,
More information( θ. sup θ Θ f X (x θ) = L. sup Pr (Λ (X) < c) = α. x : Λ (x) = sup θ H 0. sup θ Θ f X (x θ) = ) < c. NH : θ 1 = θ 2 against AH : θ 1 θ 2
82 CHAPTER 4. MAXIMUM IKEIHOOD ESTIMATION Defiitio: et X be a radom sample with joit p.m/d.f. f X x θ. The geeralised likelihood ratio test g.l.r.t. of the NH : θ H 0 agaist the alterative AH : θ H 1,
More informationLecture Notes 15 Hypothesis Testing (Chapter 10)
1 Itroductio Lecture Notes 15 Hypothesis Testig Chapter 10) Let X 1,..., X p θ x). Suppose we we wat to kow if θ = θ 0 or ot, where θ 0 is a specific value of θ. For example, if we are flippig a coi, we
More informationp we will use that fact in constructing CI n for population proportion p. The approximation gets better with increasing n.
Estimatig oulatio roortio: We will cosider a dichotomous categorical variable(s) ( classes: A, ot A) i a large oulatio(s). Poulatio(s) should be at least 0 times larger tha the samle(s). We will discuss
More informationTo make comparisons for two populations, consider whether the samples are independent or dependent.
Sociology 54 Testig for differeces betwee two samle meas Cocetually, comarig meas from two differet samles is the same as what we ve doe i oe-samle tests, ecet that ow the hyotheses focus o the arameters
More informationRecall the study where we estimated the difference between mean systolic blood pressure levels of users of oral contraceptives and non-users, x - y.
Testig Statistical Hypotheses Recall the study where we estimated the differece betwee mea systolic blood pressure levels of users of oral cotraceptives ad o-users, x - y. Such studies are sometimes viewed
More informationStat 319 Theory of Statistics (2) Exercises
Kig Saud Uiversity College of Sciece Statistics ad Operatios Research Departmet Stat 39 Theory of Statistics () Exercises Refereces:. Itroductio to Mathematical Statistics, Sixth Editio, by R. Hogg, J.
More informationLecture 6 Simple alternatives and the Neyman-Pearson lemma
STATS 00: Itroductio to Statistical Iferece Autum 06 Lecture 6 Simple alteratives ad the Neyma-Pearso lemma Last lecture, we discussed a umber of ways to costruct test statistics for testig a simple ull
More informationChapter 9, Part B Hypothesis Tests
SlidesPreared by JOHN S.LOUCKS St.Edward suiversity Slide 1 Chater 9, Part B Hyothesis Tests Poulatio Proortio Hyothesis Testig ad Decisio Makig Calculatig the Probability of Tye II Errors Determiig the
More informationFrequentist Inference
Frequetist Iferece The topics of the ext three sectios are useful applicatios of the Cetral Limit Theorem. Without kowig aythig about the uderlyig distributio of a sequece of radom variables {X i }, for
More information( ) = is larger than. the variance of X V
Stat 400, sectio 6. Methods of Poit Estimatio otes by Tim Pilachoski A oit estimate of a arameter is a sigle umber that ca be regarded as a sesible value for The selected statistic is called the oit estimator
More informationA quick activity - Central Limit Theorem and Proportions. Lecture 21: Testing Proportions. Results from the GSS. Statistics and the General Population
A quick activity - Cetral Limit Theorem ad Proportios Lecture 21: Testig Proportios Statistics 10 Coli Rudel Flip a coi 30 times this is goig to get loud! Record the umber of heads you obtaied ad calculate
More informationConfidence Intervals for the Difference Between Two Proportions
PASS Samle Size Software Chater 6 Cofidece Itervals for the Differece Betwee Two Proortios Itroductio This routie calculates the grou samle sizes ecessary to achieve a secified iterval width of the differece
More informationChapter 13: Tests of Hypothesis Section 13.1 Introduction
Chapter 13: Tests of Hypothesis Sectio 13.1 Itroductio RECAP: Chapter 1 discussed the Likelihood Ratio Method as a geeral approach to fid good test procedures. Testig for the Normal Mea Example, discussed
More informationTopic 18: Composite Hypotheses
Toc 18: November, 211 Simple hypotheses limit us to a decisio betwee oe of two possible states of ature. This limitatio does ot allow us, uder the procedures of hypothesis testig to address the basic questio:
More informationL S => logf y i P x i ;S
Three Classical Tests; Wald, LM(core), ad LR tests uose that we hae the desity y; of a model with the ull hyothesis of the form H ; =. Let L be the log-likelihood fuctio of the model ad be the MLE of.
More informationTHE INTEGRAL TEST AND ESTIMATES OF SUMS
THE INTEGRAL TEST AND ESTIMATES OF SUMS. Itroductio Determiig the exact sum of a series is i geeral ot a easy task. I the case of the geometric series ad the telescoig series it was ossible to fid a simle
More informationSample Size Determination (Two or More Samples)
Sample Sie Determiatio (Two or More Samples) STATGRAPHICS Rev. 963 Summary... Data Iput... Aalysis Summary... 5 Power Curve... 5 Calculatios... 6 Summary This procedure determies a suitable sample sie
More information13.1 Shannon lower bound
ECE598: Iformatio-theoretic methods i high-dimesioal statistics Srig 016 Lecture 13: Shao lower boud, Fao s method Lecturer: Yihog Wu Scribe: Daewo Seo, Mar 8, 016 [Ed Mar 11] I the last class, we leared
More informationCS284A: Representations and Algorithms in Molecular Biology
CS284A: Represetatios ad Algorithms i Molecular Biology Scribe Notes o Lectures 3 & 4: Motif Discovery via Eumeratio & Motif Represetatio Usig Positio Weight Matrix Joshua Gervi Based o presetatios by
More informationSDS 321: Introduction to Probability and Statistics
SDS 321: Itroductio to Probability ad Statistics Lecture 23: Cotiuous radom variables- Iequalities, CLT Puramrita Sarkar Departmet of Statistics ad Data Sciece The Uiversity of Texas at Austi www.cs.cmu.edu/
More informationChapter 18: Sampling Distribution Models
Chater 18: Samlig Distributio Models This is the last bit of theory before we get back to real-world methods. Samlig Distributios: The Big Idea Take a samle ad summarize it with a statistic. Now take aother
More information1 Introduction to reducing variance in Monte Carlo simulations
Copyright c 010 by Karl Sigma 1 Itroductio to reducig variace i Mote Carlo simulatios 11 Review of cofidece itervals for estimatig a mea I statistics, we estimate a ukow mea µ = E(X) of a distributio by
More informationConfidence Intervals
Cofidece Itervals Berli Che Deartmet of Comuter Sciece & Iformatio Egieerig Natioal Taiwa Normal Uiversity Referece: 1. W. Navidi. Statistics for Egieerig ad Scietists. Chater 5 & Teachig Material Itroductio
More informationMa 530 Introduction to Power Series
Ma 530 Itroductio to Power Series Please ote that there is material o power series at Visual Calculus. Some of this material was used as part of the presetatio of the topics that follow. What is a Power
More information1 General linear Model Continued..
Geeral liear Model Cotiued.. We have We kow y = X + u X o radom u v N(0; I ) b = (X 0 X) X 0 y E( b ) = V ar( b ) = (X 0 X) We saw that b = (X 0 X) X 0 u so b is a liear fuctio of a ormally distributed
More informationData Analysis and Statistical Methods Statistics 651
Data Aalysis ad Statistical Methods Statistics 651 http://www.stat.tamu.edu/~suhasii/teachig.html Suhasii Subba Rao Review of testig: Example The admistrator of a ursig home wats to do a time ad motio
More informationLet us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f.
Lecture 5 Let us give oe more example of MLE. Example 3. The uiform distributio U[0, ] o the iterval [0, ] has p.d.f. { 1 f(x =, 0 x, 0, otherwise The likelihood fuctio ϕ( = f(x i = 1 I(X 1,..., X [0,
More informationResampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.
Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator
More informationThe Hong Kong University of Science & Technology ISOM551 Introductory Statistics for Business Assignment 3 Suggested Solution
The Hog Kog Uiversity of ciece & Techology IOM55 Itroductory tatistics for Busiess Assigmet 3 uggested olutio Note All values of statistics i Q ad Q4 are obtaied by Excel. Qa. Let be the robability that
More informationApril 18, 2017 CONFIDENCE INTERVALS AND HYPOTHESIS TESTING, UNDERGRADUATE MATH 526 STYLE
April 18, 2017 CONFIDENCE INTERVALS AND HYPOTHESIS TESTING, UNDERGRADUATE MATH 526 STYLE TERRY SOO Abstract These otes are adapted from whe I taught Math 526 ad meat to give a quick itroductio to cofidece
More informationStatistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.
Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized
More informationLecture 2: Monte Carlo Simulation
STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: Ye-Chi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?
More information18. Two-sample problems for population means (σ unknown)
8. Two-samle roblems for oulatio meas (σ ukow) The Practice of Statistics i the Life Scieces Third Editio 04 W.H. Freema ad Comay Objectives (PSLS Chater 8) Comarig two meas (σ ukow) Two-samle situatios
More informationChapter 6 Sampling Distributions
Chapter 6 Samplig Distributios 1 I most experimets, we have more tha oe measuremet for ay give variable, each measuremet beig associated with oe radomly selected a member of a populatio. Hece we eed to
More informationNotes on Hypothesis Testing, Type I and Type II Errors
Joatha Hore PA 818 Fall 6 Notes o Hypothesis Testig, Type I ad Type II Errors Part 1. Hypothesis Testig Suppose that a medical firm develops a ew medicie that it claims will lead to a higher mea cure rate.
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationFACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures
FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING Lectures MODULE 5 STATISTICS II. Mea ad stadard error of sample data. Biomial distributio. Normal distributio 4. Samplig 5. Cofidece itervals
More informationAgreement of CI and HT. Lecture 13 - Tests of Proportions. Example - Waiting Times
Sigificace level vs. cofidece level Agreemet of CI ad HT Lecture 13 - Tests of Proportios Sta102 / BME102 Coli Rudel October 15, 2014 Cofidece itervals ad hypothesis tests (almost) always agree, as log
More information4. Hypothesis testing (Hotelling s T 2 -statistic)
4. Hypothesis testig (Hotellig s T -statistic) Cosider the test of hypothesis H 0 : = 0 H A = 6= 0 4. The Uio-Itersectio Priciple W accept the hypothesis H 0 as valid if ad oly if H 0 (a) : a T = a T 0
More informationENGI 4421 Discrete Probability Distributions Page Discrete Probability Distributions [Navidi sections ; Devore sections
ENGI 441 Discrete Probability Distributios Page 9-01 Discrete Probability Distributios [Navidi sectios 4.1-4.4; Devore sectios 3.4-3.6] Chater 5 itroduced the cocet of robability mass fuctios for discrete
More informationACCESS TO SCIENCE, ENGINEERING AND AGRICULTURE: MATHEMATICS 1 MATH00030 SEMESTER / Statistics
ACCESS TO SCIENCE, ENGINEERING AND AGRICULTURE: MATHEMATICS 1 MATH00030 SEMESTER 1 018/019 DR. ANTHONY BROWN 8. Statistics 8.1. Measures of Cetre: Mea, Media ad Mode. If we have a series of umbers the
More informationConfidence intervals for proportions
Cofidece itervals for roortios Studet Activity 7 8 9 0 2 TI-Nsire Ivestigatio Studet 60 mi Itroductio From revious activity This activity assumes kowledge of the material covered i the activity Distributio
More informationDistribution of Sample Proportions
Distributio of Samle Proortios Probability ad statistics Aswers & Teacher Notes TI-Nsire Ivestigatio Studet 90 mi 7 8 9 10 11 12 Itroductio From revious activity: This activity assumes kowledge of the
More informationLecture 7: Properties of Random Samples
Lecture 7: Properties of Radom Samples 1 Cotiued From Last Class Theorem 1.1. Let X 1, X,...X be a radom sample from a populatio with mea µ ad variace σ
More informationStatistics Definition: The science of assembling, classifying, tabulating, and analyzing data or facts:
8. Statistics Statistics Defiitio: The sciece of assemblig, classifyig, tabulatig, ad aalyzig data or facts: Descritive statistics The collectig, grouig ad resetig data i a way that ca be easily uderstood
More informationNotes on the prime number theorem
Notes o the rime umber theorem Keji Kozai May 2, 24 Statemet We begi with a defiitio. Defiitio.. We say that f(x) ad g(x) are asymtotic as x, writte f g, if lim x f(x) g(x) =. The rime umber theorem tells
More informationIntroduction to Econometrics (3 rd Updated Edition) Solutions to Odd- Numbered End- of- Chapter Exercises: Chapter 3
Itroductio to Ecoometrics (3 rd Updated Editio) by James H. Stock ad Mark W. Watso Solutios to Odd- Numbered Ed- of- Chapter Exercises: Chapter 3 (This versio August 17, 014) 015 Pearso Educatio, Ic. Stock/Watso
More informationEcon 325 Notes on Point Estimator and Confidence Interval 1 By Hiro Kasahara
Poit Estimator Eco 325 Notes o Poit Estimator ad Cofidece Iterval 1 By Hiro Kasahara Parameter, Estimator, ad Estimate The ormal probability desity fuctio is fully characterized by two costats: populatio
More informationSOME THEORY AND PRACTICE OF STATISTICS by Howard G. Tucker
SOME THEORY AND PRACTICE OF STATISTICS by Howard G. Tucker CHAPTER 9. POINT ESTIMATION 9. Covergece i Probability. The bases of poit estimatio have already bee laid out i previous chapters. I chapter 5
More informationChapter 22. Comparing Two Proportions. Copyright 2010, 2007, 2004 Pearson Education, Inc.
Chapter 22 Comparig Two Proportios Copyright 2010, 2007, 2004 Pearso Educatio, Ic. Comparig Two Proportios Read the first two paragraphs of pg 504. Comparisos betwee two percetages are much more commo
More information1. C only. 3. none of them. 4. B only. 5. B and C. 6. all of them. 7. A and C. 8. A and B correct
M408D (54690/54695/54700), Midterm # Solutios Note: Solutios to the multile-choice questios for each sectio are listed below. Due to radomizatio betwee sectios, exlaatios to a versio of each of the multile-choice
More information6 Sample Size Calculations
6 Sample Size Calculatios Oe of the major resposibilities of a cliical trial statisticia is to aid the ivestigators i determiig the sample size required to coduct a study The most commo procedure for determiig
More information1 Constructing and Interpreting a Confidence Interval
Itroductory Applied Ecoometrics EEP/IAS 118 Sprig 2014 WARM UP: Match the terms i the table with the correct formula: Adrew Crae-Droesch Sectio #6 5 March 2014 ˆ Let X be a radom variable with mea µ ad
More informationSTAC51: Categorical data Analysis
STAC51: Categorical data Aalysis Mahida Samarakoo Jauary 28, 2016 Mahida Samarakoo STAC51: Categorical data Aalysis 1 / 35 Table of cotets Iferece for Proportios 1 Iferece for Proportios Mahida Samarakoo
More information3.1. Introduction Assumptions.
Sectio 3. Proofs 3.1. Itroductio. A roof is a carefully reasoed argumet which establishes that a give statemet is true. Logic is a tool for the aalysis of roofs. Each statemet withi a roof is a assumtio,
More informationLecture 12: November 13, 2018
Mathematical Toolkit Autum 2018 Lecturer: Madhur Tulsiai Lecture 12: November 13, 2018 1 Radomized polyomial idetity testig We will use our kowledge of coditioal probability to prove the followig lemma,
More informationProperties and Hypothesis Testing
Chapter 3 Properties ad Hypothesis Testig 3.1 Types of data The regressio techiques developed i previous chapters ca be applied to three differet kids of data. 1. Cross-sectioal data. 2. Time series data.
More informationECE534, Spring 2018: Final Exam
ECE534, Srig 2018: Fial Exam Problem 1 Let X N (0, 1) ad Y N (0, 1) be ideedet radom variables. variables V = X + Y ad W = X 2Y. Defie the radom (a) Are V, W joitly Gaussia? Justify your aswer. (b) Comute
More information= p x (1 p) 1 x. Var (X) =p(1 p) M X (t) =1+p(e t 1).
Prob. fuctio:, =1 () = 1, =0 = (1 ) 1 E(X) = Var (X) =(1 ) M X (t) =1+(e t 1). 1.1.2 Biomial distributio Parameter: 0 1; >0; MGF: M X (t) ={1+(e t 1)}. Cosider a sequece of ideedet Ber() trials. If X =
More information6.3 Testing Series With Positive Terms
6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial
More informationLECTURE 14 NOTES. A sequence of α-level tests {ϕ n (x)} is consistent if
LECTURE 14 NOTES 1. Asymptotic power of tests. Defiitio 1.1. A sequece of -level tests {ϕ x)} is cosistet if β θ) := E θ [ ϕ x) ] 1 as, for ay θ Θ 1. Just like cosistecy of a sequece of estimators, Defiitio
More informationStatistics 3858 : Likelihood Ratio for Multinomial Models
Statistics 3858 : Likelihood Ratio for Multiomial Models Suppose X is multiomial o M categories, that is X Multiomial, p), where p p 1, p 2,..., p M ) A, ad the parameter space is A {p : p j 0, p j 1 }
More information1036: Probability & Statistics
036: Probability & Statistics Lecture 0 Oe- ad Two-Sample Tests of Hypotheses 0- Statistical Hypotheses Decisio based o experimetal evidece whether Coffee drikig icreases the risk of cacer i humas. A perso
More informationEECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1
EECS564 Estimatio, Filterig, ad Detectio Hwk 2 Sols. Witer 25 4. Let Z be a sigle observatio havig desity fuctio where. p (z) = (2z + ), z (a) Assumig that is a oradom parameter, fid ad plot the maximum
More informationTopic 4. Representation and Reasoning with Uncertainty
Toic 4 Reresetatio ad Reasoig with Ucertaity Cotets 4.0 Reresetig Ucertaity 4. Probabilistic methods Bayesia PART III 4.2 Certaity Factors CFs 4.3 Demster-Shafer theory 4.4 Fuzzy Logic 4. Probabilistic
More informationCONSTRUCTING TRUNCATED IRRATIONAL NUMBERS AND DETERMINING THEIR NEIGHBORING PRIMES
CONSTRUCTING TRUNCATED IRRATIONAL NUMBERS AND DETERMINING THEIR NEIGHBORING PRIMES It is well kow that there exist a ifiite set of irratioal umbers icludig, sqrt(), ad e. Such quatities are of ifiite legth
More informationComposite Hypotheses
Composite Hypotheses March 25-27, 28 For a composite hypothesis, the parameter space Θ is divided ito two disjoit regios, Θ ad Θ 1. The test is writte H : Θ versus H 1 : Θ 1 with H is called the ull hypothesis
More informationJanuary 25, 2017 INTRODUCTION TO MATHEMATICAL STATISTICS
Jauary 25, 207 INTRODUCTION TO MATHEMATICAL STATISTICS Abstract. A basic itroductio to statistics assumig kowledge of probability theory.. Probability I a typical udergraduate problem i probability, we
More informationMath 152. Rumbos Fall Solutions to Review Problems for Exam #2. Number of Heads Frequency
Math 152. Rumbos Fall 2009 1 Solutios to Review Problems for Exam #2 1. I the book Experimetatio ad Measuremet, by W. J. Youde ad published by the by the Natioal Sciece Teachers Associatio i 1962, the
More informationDiscrete Mathematics for CS Spring 2005 Clancy/Wagner Notes 21. Some Important Distributions
CS 70 Discrete Mathematics for CS Sprig 2005 Clacy/Wager Notes 21 Some Importat Distributios Questio: A biased coi with Heads probability p is tossed repeatedly util the first Head appears. What is the
More informationSTAT431 Review. X = n. n )
STAT43 Review I. Results related to ormal distributio Expected value ad variace. (a) E(aXbY) = aex bey, Var(aXbY) = a VarX b VarY provided X ad Y are idepedet. Normal distributios: (a) Z N(, ) (b) X N(µ,
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More informationEXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY
EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA, 016 MODULE : Statistical Iferece Time allowed: Three hours Cadidates should aswer FIVE questios. All questios carry equal marks. The umber
More informationBIOS 4110: Introduction to Biostatistics. Breheny. Lab #9
BIOS 4110: Itroductio to Biostatistics Brehey Lab #9 The Cetral Limit Theorem is very importat i the realm of statistics, ad today's lab will explore the applicatio of it i both categorical ad cotiuous
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit theorems Throughout this sectio we will assume a probability space (Ω, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More informationMOST PEOPLE WOULD RATHER LIVE WITH A PROBLEM THEY CAN'T SOLVE, THAN ACCEPT A SOLUTION THEY CAN'T UNDERSTAND.
XI-1 (1074) MOST PEOPLE WOULD RATHER LIVE WITH A PROBLEM THEY CAN'T SOLVE, THAN ACCEPT A SOLUTION THEY CAN'T UNDERSTAND. R. E. D. WOOLSEY AND H. S. SWANSON XI-2 (1075) STATISTICAL DECISION MAKING Advaced
More informationTests of Hypotheses Based on a Single Sample (Devore Chapter Eight)
Tests of Hypotheses Based o a Sigle Sample Devore Chapter Eight MATH-252-01: Probability ad Statistics II Sprig 2018 Cotets 1 Hypothesis Tests illustrated with z-tests 1 1.1 Overview of Hypothesis Testig..........
More informationConfidence Intervals for the Population Proportion p
Cofidece Itervals for the Populatio Proportio p The cocept of cofidece itervals for the populatio proportio p is the same as the oe for, the samplig distributio of the mea, x. The structure is idetical:
More informationChapter 6 Principles of Data Reduction
Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a
More informationBecause it tests for differences between multiple pairs of means in one test, it is called an omnibus test.
Math 308 Sprig 018 Classes 19 ad 0: Aalysis of Variace (ANOVA) Page 1 of 6 Itroductio ANOVA is a statistical procedure for determiig whether three or more sample meas were draw from populatios with equal
More informationDS 100: Principles and Techniques of Data Science Date: April 13, Discussion #10
DS 00: Priciples ad Techiques of Data Sciece Date: April 3, 208 Name: Hypothesis Testig Discussio #0. Defie these terms below as they relate to hypothesis testig. a) Data Geeratio Model: Solutio: A set
More informationIf, for instance, we were required to test whether the population mean μ could be equal to a certain value μ
STATISTICAL INFERENCE INTRODUCTION Statistical iferece is that brach of Statistics i which oe typically makes a statemet about a populatio based upo the results of a sample. I oesample testig, we essetially
More informationChapter 22. Comparing Two Proportions. Copyright 2010 Pearson Education, Inc.
Chapter 22 Comparig Two Proportios Copyright 2010 Pearso Educatio, Ic. Comparig Two Proportios Comparisos betwee two percetages are much more commo tha questios about isolated percetages. Ad they are more
More informationDiscrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 19
CS 70 Discrete Mathematics ad Probability Theory Sprig 2016 Rao ad Walrad Note 19 Some Importat Distributios Recall our basic probabilistic experimet of tossig a biased coi times. This is a very simple
More informationn outcome is (+1,+1, 1,..., 1). Let the r.v. X denote our position (relative to our starting point 0) after n moves. Thus X = X 1 + X 2 + +X n,
CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 9 Variace Questio: At each time step, I flip a fair coi. If it comes up Heads, I walk oe step to the right; if it comes up Tails, I walk oe
More informationSummary. Recap ... Last Lecture. Summary. Theorem
Last Lecture Biostatistics 602 - Statistical Iferece Lecture 23 Hyu Mi Kag April 11th, 2013 What is p-value? What is the advatage of p-value compared to hypothesis testig procedure with size α? How ca
More informationECE534, Spring 2018: Solutions for Problem Set #2
ECE534, Srig 08: s for roblem Set #. Rademacher Radom Variables ad Symmetrizatio a) Let X be a Rademacher radom variable, i.e., X = ±) = /. Show that E e λx e λ /. E e λx = e λ + e λ = + k= k=0 λ k k k!
More informationSTA Learning Objectives. Population Proportions. Module 10 Comparing Two Proportions. Upon completing this module, you should be able to:
STA 2023 Module 10 Comparig Two Proportios Learig Objectives Upo completig this module, you should be able to: 1. Perform large-sample ifereces (hypothesis test ad cofidece itervals) to compare two populatio
More informationSimulation. Two Rule For Inverting A Distribution Function
Simulatio Two Rule For Ivertig A Distributio Fuctio Rule 1. If F(x) = u is costat o a iterval [x 1, x 2 ), the the uiform value u is mapped oto x 2 through the iversio process. Rule 2. If there is a jump
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationOutput Analysis and Run-Length Control
IEOR E4703: Mote Carlo Simulatio Columbia Uiversity c 2017 by Marti Haugh Output Aalysis ad Ru-Legth Cotrol I these otes we describe how the Cetral Limit Theorem ca be used to costruct approximate (1 α%
More informationUniversity of California, Los Angeles Department of Statistics. Hypothesis testing
Uiversity of Califoria, Los Ageles Departmet of Statistics Statistics 100B Elemets of a hypothesis test: Hypothesis testig Istructor: Nicolas Christou 1. Null hypothesis, H 0 (claim about µ, p, σ 2, µ
More informationSample Size Estimation in the Proportional Hazards Model for K-sample or Regression Settings Scott S. Emerson, M.D., Ph.D.
ample ie Estimatio i the Proportioal Haards Model for K-sample or Regressio ettigs cott. Emerso, M.D., Ph.D. ample ie Formula for a Normally Distributed tatistic uppose a statistic is kow to be ormally
More informationFirst Year Quantitative Comp Exam Spring, Part I - 203A. f X (x) = 0 otherwise
First Year Quatitative Comp Exam Sprig, 2012 Istructio: There are three parts. Aswer every questio i every part. Questio I-1 Part I - 203A A radom variable X is distributed with the margial desity: >
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More information