Element sampling: Part 2
|
|
- Brice Jennings
- 6 years ago
- Views:
Transcription
1 Chapter 4 Elemet samplig: Part Itroductio We ow cosider uequal probability samplig desigs which is very popular i practice. I the uequal probability samplig, we ca improve the efficiecy of the resultig poit estimator by properly icorporatig the auxiliary iformatio available i the samplig frame ito the samplig desig. Example 4.1. Cosider the followig artificial example of a fiite populatio of busiess compaies. The total umber of employees is available i the whole populatio but the aual total icome is available oly for the sample. Compay Size (Number of employees) y (Icome) A B C D 1, If we are goig to select oly oe compay, we ca cosider the followig two approaches. 1. Equal probability selectio 1
2 2 CHAPTER 4. ELEMENT SAMPLING: PART 2 2. Uequal probability selectio with the selectio probability proportioal to size. The samplig distributio of the total icome estimator is the give by 11 4 if A is sampled 20 4 if B is sampled Ŷ 24 4 if C is sampled if D is sampled ad so E(Ŷ ) Var(Ŷ ) 154, 488. O the other had, for uequal probability samplig, if A is sampled 20 (16/2) if B is sampled Ŷ 24 (16/3) if C is sampled 245 (16/10) if D is sampled ad so E ( Ŷ ) Var ( Ŷ ) 14,248. Thus, ot surprisigly, the uequal probability selectio usig the umber of employees as the size is more efficiet tha the equal probability samplig mechaism. A compay with may employees is likely to have more icome tha a compay with smaller umber of employees. I geeral, whe the samplig frame cotais a iformatio about the size of the samplig uit, the size iformatio is ofte cosidered i the samplig desig stage such that the selectio probability of a uit is proportioal to the size. We ca classify the uequal probability samplig desigs ito four categories as i the followig table.
3 4.2. POISSON SAMPLING 3 Equal probability samplig Uequal probability samplig Features Beroulli samplig Poisso samplig I i idepedet SRS with replacemet PPS samplig Allows for duplicatio SRS without replacemet πps samplig Without replacemet samplig Systematic samplig Systematic PPS samplig Samplig systematically Stratified samplig is aother popular way of achievig uequal probability samplig ad will be covered i the ext chapter. 4.2 Poisso samplig Poisso samplig is a geeralizatio of Beroulli samplig by allowig for uequal probability selectio. I the Poisso samplig, the sample selectio idicator fuctio I i follows I i i.i.d. Beroulli(π i ), i 1,2,,N. Here, π i is the first order iclusio probability. Poisso samplig is rarely used i practice but it is useful i uderstadig the basic ature of uequal probability samplig. Uder Poisso samplig, the variace of HT estimator is expressed as V ( Ŷ HT ) N ( ) 1 1 y 2 i. (4.1) π i The followig theorem provide a result for the optimal choice of π i uder Poisso samplig. Theorem 4.1. Cosider a Poisso samplig with the first order iclusio probability π i. Give the same (expected) sample size, the variace of HT estimator uder Poisso samplig is miimized whe π i y i. (4.2)
4 4 CHAPTER 4. ELEMENT SAMPLING: PART 2 Proof. Usig the Cauchy-Schwarz iequality, we have ( N y i ) 2 ( N )( y 2 i N ) π i π i ad usig the fact that N π i is a fixed costat, we obtai (4.1) is miimized whe (4.2) holds. Thus, uder Poisso samplig, we have oly to make π i proportioal to y i. However, sice we ever observe y i at the time of samplig desig, we caot use y i but istead use x i i the populatio which is believed to be proportioal to y i. Poisso samplig, as with Beroulli samplig, has the disadvatage that the sample size is radom. I the extreme case, we may have equal to zero. Thus, Poisso samplig has a limited usage i practice but is useful i theory. 4.3 PPS samplig As see i Example 4.1, a samplig desig proportioal to the umber of employs is quite efficiet for estimatig the total icome of the compaies i the populatio. I this case, the total umber of employees serves the role of measure of size (MOS), which is a auxiliary variable to reflect the magitude of y i i the populatio. A samplig that selects elemets with probability proportioal to MOS with replacemet is called probability proportioal to size (PPS) samplig. Sice it is easy to select a sample of size oe with the selectio probability proportioal to MOS, we ca repeat the selectio times idepedetly with replacemet to achieve the PPS samplig of size. PPS samplig is easy to implemet, as it is a with-replacemet samplig, but it may have duplicated sample elemets. Let M i be the value of MOS associated with elemet i i the populatio. I this case, p i M i N M i is the probability of selectig elemet i for a sigle draw of sample selectio. Let a k be the idex of populatio elemet i the k-th draw of the PPS samplig, I
5 4.3. PPS SAMPLING 5 this case, a k is a radom variable with probability P(a k i) p i, for i U. The observed value of y i i the k-th draw is y ak N I(a k i)y i. Note that E(y ak ) N p iy i which is ot ecessarily equal to the populatio mea. If we defie z k y a k p ak N I(a k i) y i p i, k 1,2,,, the z 1,z 2,,z are idepedetly ad idetically distributed with the distributio y 1 /p 1 with probability p 1 y 2 /p 2 with probability p 2 z k. y N /p N with probability p N. Thus, for each k i the sample, we have Thus, we ca use E (z k ) Var (z k ) N y i N ( yi p i Y p i Ŷ PPS 1 k k1z 1 k1 ) 2. y ak p ak (4.3) as a estimator for Y N y i. The estimator i (4.3) is sometimes called Hase- Hurwitz (HH) estimator, as it was first proposed by Hase ad Hurwitz (1943). To discuss variace estimatio of HH estimator, we first prove the followig theorem. Theorem 4.2. Let X 1,X 2,,X be idepedet radom variables with E(X i ) µ ad V (X i ) σi 2. A ubiased estimator for the variace of X 1 X i is give by ˆV ( X ) (X i X ) 2. (4.4)
6 6 CHAPTER 4. ELEMENT SAMPLING: PART 2 Proof. Sice X i s are idepedet, Also, as we ca express ˆV ( X ) 1 1 V ( X ) 1 2 σi 2. 1 { (X i µ) 2 ( X µ) 2 }, by takig the expectatio o both sides of the above term, we obtai E { ˆV ( X ) } { 1 1 } σi σi σi 2, which proves the ubiasedess of ˆV ( X ) i (4.4). By Theorem 4.2, a ubiased variace estimator of HH estimator is give by ˆV PPS 1 S2 z k1 ( ) 2 yak Ŷ PPS. (4.5) p ak I some situatio, y i has a meaig of total value i uit i. For example, y i is the total crop yield i farm i ad M i is the total size of crop acres i form i. I this case, ȳ i is the average crop yield per acre. I this case, we ca express Ŷ PPS ( N M i ) 1 ȳ ak k1 ad ˆV ( Ŷ PPS ) ( N ) 2 M i k1 (ȳ ak ˆȲ PPS ) 2 where ˆȲ PPS 1 k1 ȳa k. If the parameter of iterest is the mea Ȳ N y i N M i N M iȳ i N M, i the the HH estimator is ˆȲ PPS 1 ȳ ak k1
7 4.4. πps SAMPLING 7 ad its variace estimator is ( ) ˆV ˆȲ PPS k1 ( ȳ ak ˆȲ PPS ) 2. That is, i the mea estimatio uder PPS samplig, we ca safely treat ȳ a1,ȳ a2,,ȳ a as a IID sample with E(ȳ ak ) Ȳ ad apply Theorem πps samplig The PPS samplig itroduced i the previous sectio has may advatages: it is very easy to implemet, the estimatio formula is simple. However, sice it is a with-replacemet samplig, it is iefficiet i the sese that it allows for duplicated sample elemets. Let x i be the size measure that we wat to make π i x i as close as possible. πps(π proportioal to size) samplig refers to a set of samplig desigs that satisfies the followig coditios: 1. The samplig desig is a fixed-size samplig desig that does ot allow for duplicatio. 2. The first order iclusio probability π i satisfies π i x i. 3. The secod order iclusio probability satisfies π i j > 0 ad π i j < π i π j (i j). The third coditio guaratees that SYG variace estimator is always oegative. For a fixed-size desig, π k x k ad N π i leads to π k π k N x. i If some x k satisfies x k > (N/) X N, the we have π i > 1. Thus, the exact proportioality π i x i is ot always possible. For 1, the πps samplig is the same as the PPS samplig. There are two approaches of implemetig a PPS samplig of size 1. Oe is cumulative total method ad the other is the Lahiri s method. The cumulative total method is described as follows:
8 8 CHAPTER 4. ELEMENT SAMPLING: PART 2 [Step 1] Set T 0 0 ad compute T k T k 1 + x k, k 1,2,,N. [Step 2] Draw ε Uif(0,1). If ε (T k 1 /T N,T k /T N ), elemet k is selected. The cumulative total method is very popular because it is easy to uderstad. It eeds a list of all x k i the populatio. The other method, developed by Lahiri (1951), ca be described as follows: [Step 0] Choose M > {x 1,x 2,,x N }. Set r 1. [Step 1] Draw k r by SRS from {1,2,,N}. [Step 2] Draw ε r Uif(0,1). [Step 3] If ε r x kr /M, the select elemet k r ad stop. Otherwise, reject k r ad goto Step 1 with r r + 1. Lahiri s method does ot eed a list of all x k i the populatio but it requires the kowledge of the upper boud of x k, deoted by M. Lahiri s method is a disecrete versio of rejectio algorithm due to Vo Neyma. To uderstad the rejectio algorithm for cotiuous radom variable with target desity f, suppose that there exist a desity g ad a costat M such that f (x) Mg(x) (4.6) o the support of f. The rejectio samplig method proceeds as follows: 1. Sample Y g ad U U (0,1), where U(0,1) deotes the uiform (0,1) distributio. 2. Reject Y if U > f (Y ) Mg(Y ). (4.7) I this case, do ot record the value of Y as a elemet i the target radom sample ad retur to step Otherwise, keep the value of Y. Set X Y, ad cosider X to be a elemet of the target radom sample.
9 4.4. πps SAMPLING 9 I the rejectio samplig method, P(X y) { P Y y U f (Y ) } Mg(Y ) y f (x)/mg(x) 0 dug(x)dx f (x)/mg(x) 0 dug(x)dx y f (x)dx f (x)dx. Note that the rejectio samplig method is applicable whe the desity f is kow up to a multiplicative factor, because the above equality still follows eve if f (x) f 1 (x) with f 1 (x) < Mg(x) ad the decisio rule (4.7) uses f 1 (x) istead of f (x). I Lahiri s method, g( ) is the desity for the discrete uiform distributio with support {1,,N} ad f ( ) is the desity for the discrete distributio with probability p i x i /( N j1 x j) for uit i 1,,N. A formal justificatio for Lahiri s method ca be described as follows: Sice ( Pr ε j > x ) k j M π k Pr(k A) r1 r1 r1 Pr(k A,R r) { Pr K r k,ε r < x r 1 k r M, (ε j > x } k j M ) r 1 1 x k N M j1 { Pr ( Pr ε j > x ) k j k M k j k where x U N 1 N x k, we ca obtai π k r1 1 N 1 N M x k x k N x. i j1 ε j > x k j M }. ( Pr(K j k) k ( x k 1 x ) r 1 U M M 1 1 (1 x U /M) 1 x k M ) 1 N 1 x U M,
10 10 CHAPTER 4. ELEMENT SAMPLING: PART 2 We ow discuss πps samplig for 2. Most existig schemes for fixed-size πps samplig with > 2 are quite complicated. The iterested reader is referred to Brewer ad Haif (1983). To discuss πps samplig of size 2, let θ i be the probability of selectig uit i i the first draw of the πps samplig ad let θ j i be the coditioal probability of selectig uit j i the secod draw give that uit i is selected i the first draw. Thus, writig p i x i /( N j1 x j), the problem at had is to fid a set of θ i ad θ j i satisfyig π i 2p i (4.8) ad Sice i θ i θ j i 1. j π i j θ i θ j i + θ j θ i j (4.9) ad, as it is a fixed-size samplig desig, we ca use (2.2) to get j i π i j π i, which implies Thus, costrait (4.8) reduces to Thus, we have may solutios to (4.10). ad Brewer (1963) proposed usig π i θ i + θ j θ i j. j i θ i + θ j θ i j 2p i. (4.10) j i θ i p i (1 p i ) 1 2p i θ j i p j to obtai (4.10), while Durbi (1967) proposed usig θ i p i
11 4.5. SYSTEMATIC πps SAMPLING 11 ad ( 1 θ j i p j + 1 ) 1 2p i 1 2p j to achieve the same goal. Usig (4.9), we ca show that both methods lead to π i j 2p ( ip j ) (4.11) 1 + K 1 2p i 1 2p j where K N (1 2p i) 1 p i. Therefore, we have 4.5 Systematic πps samplig π i π i j 2p i. (4.12) j i Systematic πps samplig is similar to systematic samplig but allows for uequal probability of sample selectio. Let a N x i/ be the samplig iterval for the systematic samplig. Assume x k < a for all k U. (If some of the x k s are greater tha a, the such elemets are selected i advace ad the apply the systematic samplig i the reduced fiite populatio.) Systematic πps samplig ca be described as follows. 1. Choose R Ui f (0,a] 2. Uit k is selected iff L k < R + l a U k for some l 0,1,, 1, where L k k 1 j1 x j with L 0 0 ad U k L k +x k. Example 4.2. For example, cosider the followig artificial fiite populatio of size N 4. ID MOS (x i ) L U
12 12 CHAPTER 4. ELEMENT SAMPLING: PART 2 To obtai a systematic sample of size 2 with the first order iclusio probability proportioal to x i, ote that a 100/2 50. Thus, we first geerate R from a uiform distributio (0,50]. If R belogs to (0,10], we select A {1,3}. If R belogs to (10,30], we select A {2,4}. If R belogs to (30,50], we select {3,4}. The samplig distributio of the resultig sample will be 0.2, if A {1,3} P(A) 0.4, if A {2,4} 0.4, if A {3,4} To compute the first order iclusio probability of uit k, let l be the iteger satisfyig l a L k < U k (l + 1)a. Pr (k A) Pr {L k < R + l a U k } Uk l a 1 L k l a a dt x k/a x k. k U x k The systematic πps samplig is easy to implemet but it does ot allow for desigubiased variace estimator, as is the case with the classical systematic samplig. Referece Brewer, K. R. W. (1963). A model of systematic samplig with uequal probabilities, Australia Joural of Statistics 5, Brewer, K. R. W., ad Haif, M. (1983). Samplig with Uequal Probabilities. New York:Spriger-Verlag. Durbi, J. (1967). Desig of multi-stage surveys for the estimatio of samplig errors. Applied Statistics, 16, Hase, M.H. ad Hurwitz, W.N. (1943). O the theory of samplig from fiite populatios. Aals of Mathematical Statistics, 14, Lahiri, D.B. (1951). A method of sample selectio providig ubiased ratio estimates. Bulleti of the Iteratioal Statistical Istitute 33,
It should be unbiased, or approximately unbiased. Variance of the variance estimator should be small. That is, the variance estimator is stable.
Chapter 10 Variace Estimatio 10.1 Itroductio Variace estimatio is a importat practical problem i survey samplig. Variace estimates are used i two purposes. Oe is the aalytic purpose such as costructig
More informationEstimation for Complete Data
Estimatio for Complete Data complete data: there is o loss of iformatio durig study. complete idividual complete data= grouped data A complete idividual data is the oe i which the complete iformatio of
More informationChapter 6 Principles of Data Reduction
Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a
More information5. Fractional Hot deck Imputation
5. Fractioal Hot deck Imputatio Itroductio Suppose that we are iterested i estimatig θ EY or eve θ 2 P ry < c where y fy x where x is always observed ad y is subject to missigess. Assume MAR i the sese
More informationResampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.
Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator
More informationRandom Variables, Sampling and Estimation
Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig
More informationMATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4
MATH 30: Probability ad Statistics 9. Estimatio ad Testig of Parameters Estimatio ad Testig of Parameters We have bee dealig situatios i which we have full kowledge of the distributio of a radom variable.
More informationLecture 01: the Central Limit Theorem. 1 Central Limit Theorem for i.i.d. random variables
CSCI-B609: A Theorist s Toolkit, Fall 06 Aug 3 Lecture 0: the Cetral Limit Theorem Lecturer: Yua Zhou Scribe: Yua Xie & Yua Zhou Cetral Limit Theorem for iid radom variables Let us say that we wat to aalyze
More information7-1. Chapter 4. Part I. Sampling Distributions and Confidence Intervals
7-1 Chapter 4 Part I. Samplig Distributios ad Cofidece Itervals 1 7- Sectio 1. Samplig Distributio 7-3 Usig Statistics Statistical Iferece: Predict ad forecast values of populatio parameters... Test hypotheses
More informationDiscrete Mathematics for CS Spring 2008 David Wagner Note 22
CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 22 I.I.D. Radom Variables Estimatig the bias of a coi Questio: We wat to estimate the proportio p of Democrats i the US populatio, by takig
More informationSimulation. Two Rule For Inverting A Distribution Function
Simulatio Two Rule For Ivertig A Distributio Fuctio Rule 1. If F(x) = u is costat o a iterval [x 1, x 2 ), the the uiform value u is mapped oto x 2 through the iversio process. Rule 2. If there is a jump
More informationStat 421-SP2012 Interval Estimation Section
Stat 41-SP01 Iterval Estimatio Sectio 11.1-11. We ow uderstad (Chapter 10) how to fid poit estimators of a ukow parameter. o However, a poit estimate does ot provide ay iformatio about the ucertaity (possible
More informationStatistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.
Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized
More information1 Introduction to reducing variance in Monte Carlo simulations
Copyright c 010 by Karl Sigma 1 Itroductio to reducig variace i Mote Carlo simulatios 11 Review of cofidece itervals for estimatig a mea I statistics, we estimate a ukow mea µ = E(X) of a distributio by
More informationLecture 2: Monte Carlo Simulation
STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: Ye-Chi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?
More informationConvergence of random variables. (telegram style notes) P.J.C. Spreij
Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space
More informationEcon 325 Notes on Point Estimator and Confidence Interval 1 By Hiro Kasahara
Poit Estimator Eco 325 Notes o Poit Estimator ad Cofidece Iterval 1 By Hiro Kasahara Parameter, Estimator, ad Estimate The ormal probability desity fuctio is fully characterized by two costats: populatio
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationMonte Carlo Integration
Mote Carlo Itegratio I these otes we first review basic umerical itegratio methods (usig Riema approximatio ad the trapezoidal rule) ad their limitatios for evaluatig multidimesioal itegrals. Next we itroduce
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationUnbiased Estimation. February 7-12, 2008
Ubiased Estimatio February 7-2, 2008 We begi with a sample X = (X,..., X ) of radom variables chose accordig to oe of a family of probabilities P θ where θ is elemet from the parameter space Θ. For radom
More information4.5 Multiple Imputation
45 ultiple Imputatio Itroductio Assume a parametric model: y fy x; θ We are iterested i makig iferece about θ I Bayesia approach, we wat to make iferece about θ from fθ x, y = πθfy x, θ πθfy x, θdθ where
More informationECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors
ECONOMETRIC THEORY MODULE XIII Lecture - 34 Asymptotic Theory ad Stochastic Regressors Dr. Shalabh Departmet of Mathematics ad Statistics Idia Istitute of Techology Kapur Asymptotic theory The asymptotic
More informationInfinite Sequences and Series
Chapter 6 Ifiite Sequeces ad Series 6.1 Ifiite Sequeces 6.1.1 Elemetary Cocepts Simply speakig, a sequece is a ordered list of umbers writte: {a 1, a 2, a 3,...a, a +1,...} where the elemets a i represet
More informationECE 901 Lecture 12: Complexity Regularization and the Squared Loss
ECE 90 Lecture : Complexity Regularizatio ad the Squared Loss R. Nowak 5/7/009 I the previous lectures we made use of the Cheroff/Hoeffdig bouds for our aalysis of classifier errors. Hoeffdig s iequality
More informationSTAT Homework 1 - Solutions
STAT-36700 Homework 1 - Solutios Fall 018 September 11, 018 This cotais solutios for Homework 1. Please ote that we have icluded several additioal commets ad approaches to the problems to give you better
More information1.010 Uncertainty in Engineering Fall 2008
MIT OpeCourseWare http://ocw.mit.edu.00 Ucertaity i Egieerig Fall 2008 For iformatio about citig these materials or our Terms of Use, visit: http://ocw.mit.edu.terms. .00 - Brief Notes # 9 Poit ad Iterval
More informationECE 6980 An Algorithmic and Information-Theoretic Toolbox for Massive Data
ECE 6980 A Algorithmic ad Iformatio-Theoretic Toolbo for Massive Data Istructor: Jayadev Acharya Lecture # Scribe: Huayu Zhag 8th August, 017 1 Recap X =, ε is a accuracy parameter, ad δ is a error parameter.
More informationExpectation and Variance of a random variable
Chapter 11 Expectatio ad Variace of a radom variable The aim of this lecture is to defie ad itroduce mathematical Expectatio ad variace of a fuctio of discrete & cotiuous radom variables ad the distributio
More information32 estimating the cumulative distribution function
32 estimatig the cumulative distributio fuctio 4.6 types of cofidece itervals/bads Let F be a class of distributio fuctios F ad let θ be some quatity of iterest, such as the mea of F or the whole fuctio
More informationLet us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f.
Lecture 5 Let us give oe more example of MLE. Example 3. The uiform distributio U[0, ] o the iterval [0, ] has p.d.f. { 1 f(x =, 0 x, 0, otherwise The likelihood fuctio ϕ( = f(x i = 1 I(X 1,..., X [0,
More informationFrequentist Inference
Frequetist Iferece The topics of the ext three sectios are useful applicatios of the Cetral Limit Theorem. Without kowig aythig about the uderlyig distributio of a sequece of radom variables {X i }, for
More informationLecture 19: Convergence
Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may
More informationMATH 472 / SPRING 2013 ASSIGNMENT 2: DUE FEBRUARY 4 FINALIZED
MATH 47 / SPRING 013 ASSIGNMENT : DUE FEBRUARY 4 FINALIZED Please iclude a cover sheet that provides a complete setece aswer to each the followig three questios: (a) I your opiio, what were the mai ideas
More informationAn Introduction to Randomized Algorithms
A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis
More informationON POINTWISE BINOMIAL APPROXIMATION
Iteratioal Joural of Pure ad Applied Mathematics Volume 71 No. 1 2011, 57-66 ON POINTWISE BINOMIAL APPROXIMATION BY w-functions K. Teerapabolar 1, P. Wogkasem 2 Departmet of Mathematics Faculty of Sciece
More informationProperties and Hypothesis Testing
Chapter 3 Properties ad Hypothesis Testig 3.1 Types of data The regressio techiques developed i previous chapters ca be applied to three differet kids of data. 1. Cross-sectioal data. 2. Time series data.
More informationCS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 5
CS434a/54a: Patter Recogitio Prof. Olga Veksler Lecture 5 Today Itroductio to parameter estimatio Two methods for parameter estimatio Maimum Likelihood Estimatio Bayesia Estimatio Itroducto Bayesia Decisio
More informationEconomics 241B Relation to Method of Moments and Maximum Likelihood OLSE as a Maximum Likelihood Estimator
Ecoomics 24B Relatio to Method of Momets ad Maximum Likelihood OLSE as a Maximum Likelihood Estimator Uder Assumptio 5 we have speci ed the distributio of the error, so we ca estimate the model parameters
More informationStatistical inference: example 1. Inferential Statistics
Statistical iferece: example 1 Iferetial Statistics POPULATION SAMPLE A clothig store chai regularly buys from a supplier large quatities of a certai piece of clothig. Each item ca be classified either
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationReview Questions, Chapters 8, 9. f(y) = 0, elsewhere. F (y) = f Y(1) = n ( e y/θ) n 1 1 θ e y/θ = n θ e yn
Stat 366 Lab 2 Solutios (September 2, 2006) page TA: Yury Petracheko, CAB 484, yuryp@ualberta.ca, http://www.ualberta.ca/ yuryp/ Review Questios, Chapters 8, 9 8.5 Suppose that Y, Y 2,..., Y deote a radom
More informationSDS 321: Introduction to Probability and Statistics
SDS 321: Itroductio to Probability ad Statistics Lecture 23: Cotiuous radom variables- Iequalities, CLT Puramrita Sarkar Departmet of Statistics ad Data Sciece The Uiversity of Texas at Austi www.cs.cmu.edu/
More information5. Likelihood Ratio Tests
1 of 5 7/29/2009 3:16 PM Virtual Laboratories > 9. Hy pothesis Testig > 1 2 3 4 5 6 7 5. Likelihood Ratio Tests Prelimiaries As usual, our startig poit is a radom experimet with a uderlyig sample space,
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More informationStat 319 Theory of Statistics (2) Exercises
Kig Saud Uiversity College of Sciece Statistics ad Operatios Research Departmet Stat 39 Theory of Statistics () Exercises Refereces:. Itroductio to Mathematical Statistics, Sixth Editio, by R. Hogg, J.
More informationChapter 8: STATISTICAL INTERVALS FOR A SINGLE SAMPLE. Part 3: Summary of CI for µ Confidence Interval for a Population Proportion p
Chapter 8: STATISTICAL INTERVALS FOR A SINGLE SAMPLE Part 3: Summary of CI for µ Cofidece Iterval for a Populatio Proportio p Sectio 8-4 Summary for creatig a 100(1-α)% CI for µ: Whe σ 2 is kow ad paret
More informationEcon 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1.
Eco 325/327 Notes o Sample Mea, Sample Proportio, Cetral Limit Theorem, Chi-square Distributio, Studet s t distributio 1 Sample Mea By Hiro Kasahara We cosider a radom sample from a populatio. Defiitio
More informationImproved Class of Ratio -Cum- Product Estimators of Finite Population Mean in two Phase Sampling
Global Joural of Sciece Frotier Research: F Mathematics ad Decisio Scieces Volume 4 Issue 2 Versio.0 Year 204 Type : Double Blid Peer Reviewed Iteratioal Research Joural Publisher: Global Jourals Ic. (USA
More informationJanuary 25, 2017 INTRODUCTION TO MATHEMATICAL STATISTICS
Jauary 25, 207 INTRODUCTION TO MATHEMATICAL STATISTICS Abstract. A basic itroductio to statistics assumig kowledge of probability theory.. Probability I a typical udergraduate problem i probability, we
More informationMachine Learning Brett Bernstein
Machie Learig Brett Berstei Week 2 Lecture: Cocept Check Exercises Starred problems are optioal. Excess Risk Decompositio 1. Let X = Y = {1, 2,..., 10}, A = {1,..., 10, 11} ad suppose the data distributio
More informationOutput Analysis and Run-Length Control
IEOR E4703: Mote Carlo Simulatio Columbia Uiversity c 2017 by Marti Haugh Output Aalysis ad Ru-Legth Cotrol I these otes we describe how the Cetral Limit Theorem ca be used to costruct approximate (1 α%
More informationLecture 12: September 27
36-705: Itermediate Statistics Fall 207 Lecturer: Siva Balakrisha Lecture 2: September 27 Today we will discuss sufficiecy i more detail ad the begi to discuss some geeral strategies for costructig estimators.
More information6. Sufficient, Complete, and Ancillary Statistics
Sufficiet, Complete ad Acillary Statistics http://www.math.uah.edu/stat/poit/sufficiet.xhtml 1 of 7 7/16/2009 6:13 AM Virtual Laboratories > 7. Poit Estimatio > 1 2 3 4 5 6 6. Sufficiet, Complete, ad Acillary
More information0, otherwise. EX = E(X 1 + X n ) = EX j = np and. Var(X j ) = np(1 p). Var(X) = Var(X X n ) =
PROBABILITY MODELS 35 10. Discrete probability distributios I this sectio, we discuss several well-ow discrete probability distributios ad study some of their properties. Some of these distributios, lie
More informationDS 100: Principles and Techniques of Data Science Date: April 13, Discussion #10
DS 00: Priciples ad Techiques of Data Sciece Date: April 3, 208 Name: Hypothesis Testig Discussio #0. Defie these terms below as they relate to hypothesis testig. a) Data Geeratio Model: Solutio: A set
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS
MASSACHUSTTS INSTITUT OF TCHNOLOGY 6.436J/5.085J Fall 2008 Lecture 9 /7/2008 LAWS OF LARG NUMBRS II Cotets. The strog law of large umbers 2. The Cheroff boud TH STRONG LAW OF LARG NUMBRS While the weak
More informationTable 12.1: Contingency table. Feature b. 1 N 11 N 12 N 1b 2 N 21 N 22 N 2b. ... a N a1 N a2 N ab
Sectio 12 Tests of idepedece ad homogeeity I this lecture we will cosider a situatio whe our observatios are classified by two differet features ad we would like to test if these features are idepedet
More informationElements of Statistical Methods Lots of Data or Large Samples (Ch 8)
Elemets of Statistical Methods Lots of Data or Large Samples (Ch 8) Fritz Scholz Sprig Quarter 2010 February 26, 2010 x ad X We itroduced the sample mea x as the average of the observed sample values x
More informationDirection: This test is worth 150 points. You are required to complete this test within 55 minutes.
Term Test 3 (Part A) November 1, 004 Name Math 6 Studet Number Directio: This test is worth 10 poits. You are required to complete this test withi miutes. I order to receive full credit, aswer each problem
More informationThis exam contains 19 pages (including this cover page) and 10 questions. A Formulae sheet is provided with the exam.
Probability ad Statistics FS 07 Secod Sessio Exam 09.0.08 Time Limit: 80 Miutes Name: Studet ID: This exam cotais 9 pages (icludig this cover page) ad 0 questios. A Formulae sheet is provided with the
More informationJournal of Multivariate Analysis. Superefficient estimation of the marginals by exploiting knowledge on the copula
Joural of Multivariate Aalysis 102 (2011) 1315 1319 Cotets lists available at ScieceDirect Joural of Multivariate Aalysis joural homepage: www.elsevier.com/locate/jmva Superefficiet estimatio of the margials
More informationFirst Year Quantitative Comp Exam Spring, Part I - 203A. f X (x) = 0 otherwise
First Year Quatitative Comp Exam Sprig, 2012 Istructio: There are three parts. Aswer every questio i every part. Questio I-1 Part I - 203A A radom variable X is distributed with the margial desity: >
More informationMathematical Statistics - MS
Paper Specific Istructios. The examiatio is of hours duratio. There are a total of 60 questios carryig 00 marks. The etire paper is divided ito three sectios, A, B ad C. All sectios are compulsory. Questios
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 3 9/11/2013. Large deviations Theory. Cramér s Theorem
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/5.070J Fall 203 Lecture 3 9//203 Large deviatios Theory. Cramér s Theorem Cotet.. Cramér s Theorem. 2. Rate fuctio ad properties. 3. Chage of measure techique.
More informationA statistical method to determine sample size to estimate characteristic value of soil parameters
A statistical method to determie sample size to estimate characteristic value of soil parameters Y. Hojo, B. Setiawa 2 ad M. Suzuki 3 Abstract Sample size is a importat factor to be cosidered i determiig
More informationClases 7-8: Métodos de reducción de varianza en Monte Carlo *
Clases 7-8: Métodos de reducció de variaza e Mote Carlo * 9 de septiembre de 27 Ídice. Variace reductio 2. Atithetic variates 2 2.. Example: Uiform radom variables................ 3 2.2. Example: Tail
More informationST5215: Advanced Statistical Theory
ST525: Advaced Statistical Theory Departmet of Statistics & Applied Probability Tuesday, September 7, 2 ST525: Advaced Statistical Theory Lecture : The law of large umbers The Law of Large Numbers The
More informationHypothesis Testing. Evaluation of Performance of Learned h. Issues. Trade-off Between Bias and Variance
Hypothesis Testig Empirically evaluatig accuracy of hypotheses: importat activity i ML. Three questios: Give observed accuracy over a sample set, how well does this estimate apply over additioal samples?
More informationLecture 2: Concentration Bounds
CSE 52: Desig ad Aalysis of Algorithms I Sprig 206 Lecture 2: Cocetratio Bouds Lecturer: Shaya Oveis Ghara March 30th Scribe: Syuzaa Sargsya Disclaimer: These otes have ot bee subjected to the usual scrutiy
More informationTests of Hypotheses Based on a Single Sample (Devore Chapter Eight)
Tests of Hypotheses Based o a Sigle Sample Devore Chapter Eight MATH-252-01: Probability ad Statistics II Sprig 2018 Cotets 1 Hypothesis Tests illustrated with z-tests 1 1.1 Overview of Hypothesis Testig..........
More informationApproximations and more PMFs and PDFs
Approximatios ad more PMFs ad PDFs Saad Meimeh 1 Approximatio of biomial with Poisso Cosider the biomial distributio ( b(k,,p = p k (1 p k, k λ: k Assume that is large, ad p is small, but p λ at the limit.
More informationLinear Regression Demystified
Liear Regressio Demystified Liear regressio is a importat subject i statistics. I elemetary statistics courses, formulae related to liear regressio are ofte stated without derivatio. This ote iteds to
More informationAdvanced Stochastic Processes.
Advaced Stochastic Processes. David Gamarik LECTURE 2 Radom variables ad measurable fuctios. Strog Law of Large Numbers (SLLN). Scary stuff cotiued... Outlie of Lecture Radom variables ad measurable fuctios.
More informationChapter 6 Sampling Distributions
Chapter 6 Samplig Distributios 1 I most experimets, we have more tha oe measuremet for ay give variable, each measuremet beig associated with oe radomly selected a member of a populatio. Hece we eed to
More informationChapter 8: Estimating with Confidence
Chapter 8: Estimatig with Cofidece Sectio 8.2 The Practice of Statistics, 4 th editio For AP* STARNES, YATES, MOORE Chapter 8 Estimatig with Cofidece 8.1 Cofidece Itervals: The Basics 8.2 8.3 Estimatig
More informationLecture 8: Convergence of transformations and law of large numbers
Lecture 8: Covergece of trasformatios ad law of large umbers Trasformatio ad covergece Trasformatio is a importat tool i statistics. If X coverges to X i some sese, we ofte eed to check whether g(x ) coverges
More informationModule 1 Fundamentals in statistics
Normal Distributio Repeated observatios that differ because of experimetal error ofte vary about some cetral value i a roughly symmetrical distributio i which small deviatios occur much more frequetly
More informationProblem Set 4 Due Oct, 12
EE226: Radom Processes i Systems Lecturer: Jea C. Walrad Problem Set 4 Due Oct, 12 Fall 06 GSI: Assae Gueye This problem set essetially reviews detectio theory ad hypothesis testig ad some basic otios
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit theorems Throughout this sectio we will assume a probability space (Ω, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More informationMonte Carlo Methods: Lecture 3 : Importance Sampling
Mote Carlo Methods: Lecture 3 : Importace Samplig Nick Whiteley 16.10.2008 Course material origially by Adam Johase ad Ludger Evers 2007 Overview of this lecture What we have see... Rejectio samplig. This
More informationChapter 5. Inequalities. 5.1 The Markov and Chebyshev inequalities
Chapter 5 Iequalities 5.1 The Markov ad Chebyshev iequalities As you have probably see o today s frot page: every perso i the upper teth percetile ears at least 1 times more tha the average salary. I other
More informationThis section is optional.
4 Momet Geeratig Fuctios* This sectio is optioal. The momet geeratig fuctio g : R R of a radom variable X is defied as g(t) = E[e tx ]. Propositio 1. We have g () (0) = E[X ] for = 1, 2,... Proof. Therefore
More informationNotes 5 : More on the a.s. convergence of sums
Notes 5 : More o the a.s. covergece of sums Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces: Dur0, Sectios.5; Wil9, Sectio 4.7, Shi96, Sectio IV.4, Dur0, Sectio.. Radom series. Three-series
More informationDirection: This test is worth 250 points. You are required to complete this test within 50 minutes.
Term Test October 3, 003 Name Math 56 Studet Number Directio: This test is worth 50 poits. You are required to complete this test withi 50 miutes. I order to receive full credit, aswer each problem completely
More informationTopic 10: Introduction to Estimation
Topic 0: Itroductio to Estimatio Jue, 0 Itroductio I the simplest possible terms, the goal of estimatio theory is to aswer the questio: What is that umber? What is the legth, the reactio rate, the fractio
More informationCastiel, Supernatural, Season 6, Episode 18
13 Differetial Equatios the aswer to your questio ca best be epressed as a series of partial differetial equatios... Castiel, Superatural, Seaso 6, Episode 18 A differetial equatio is a mathematical equatio
More informationStatistics 511 Additional Materials
Cofidece Itervals o mu Statistics 511 Additioal Materials This topic officially moves us from probability to statistics. We begi to discuss makig ifereces about the populatio. Oe way to differetiate probability
More information2 1. The r.s., of size n2, from population 2 will be. 2 and 2. 2) The two populations are independent. This implies that all of the n1 n2
Chapter 8 Comparig Two Treatmets Iferece about Two Populatio Meas We wat to compare the meas of two populatios to see whether they differ. There are two situatios to cosider, as show i the followig examples:
More informationIP Reference guide for integer programming formulations.
IP Referece guide for iteger programmig formulatios. by James B. Orli for 15.053 ad 15.058 This documet is iteded as a compact (or relatively compact) guide to the formulatio of iteger programs. For more
More information1 Inferential Methods for Correlation and Regression Analysis
1 Iferetial Methods for Correlatio ad Regressio Aalysis I the chapter o Correlatio ad Regressio Aalysis tools for describig bivariate cotiuous data were itroduced. The sample Pearso Correlatio Coefficiet
More informationAMS570 Lecture Notes #2
AMS570 Lecture Notes # Review of Probability (cotiued) Probability distributios. () Biomial distributio Biomial Experimet: ) It cosists of trials ) Each trial results i of possible outcomes, S or F 3)
More informationExercise 4.3 Use the Continuity Theorem to prove the Cramér-Wold Theorem, Theorem. (1) φ a X(1).
Assigmet 7 Exercise 4.3 Use the Cotiuity Theorem to prove the Cramér-Wold Theorem, Theorem 4.12. Hit: a X d a X implies that φ a X (1) φ a X(1). Sketch of solutio: As we poited out i class, the oly tricky
More informationDouble Stage Shrinkage Estimator of Two Parameters. Generalized Exponential Distribution
Iteratioal Mathematical Forum, Vol., 3, o. 3, 3-53 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/.9/imf.3.335 Double Stage Shrikage Estimator of Two Parameters Geeralized Expoetial Distributio Alaa M.
More information6.3 Testing Series With Positive Terms
6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial
More informationLecture 33: Bootstrap
Lecture 33: ootstrap Motivatio To evaluate ad compare differet estimators, we eed cosistet estimators of variaces or asymptotic variaces of estimators. This is also importat for hypothesis testig ad cofidece
More informationStatistical and Mathematical Methods DS-GA 1002 December 8, Sample Final Problems Solutions
Statistical ad Mathematical Methods DS-GA 00 December 8, 05. Short questios Sample Fial Problems Solutios a. Ax b has a solutio if b is i the rage of A. The dimesio of the rage of A is because A has liearly-idepedet
More informationPRACTICE PROBLEMS FOR THE FINAL
PRACTICE PROBLEMS FOR THE FINAL Math 36Q Fall 25 Professor Hoh Below is a list of practice questios for the Fial Exam. I would suggest also goig over the practice problems ad exams for Exam ad Exam 2 to
More informationIIT JAM Mathematical Statistics (MS) 2006 SECTION A
IIT JAM Mathematical Statistics (MS) 6 SECTION A. If a > for ad lim a / L >, the which of the followig series is ot coverget? (a) (b) (c) (d) (d) = = a = a = a a + / a lim a a / + = lim a / a / + = lim
More informationAAEC/ECON 5126 FINAL EXAM: SOLUTIONS
AAEC/ECON 5126 FINAL EXAM: SOLUTIONS SPRING 2015 / INSTRUCTOR: KLAUS MOELTNER This exam is ope-book, ope-otes, but please work strictly o your ow. Please make sure your ame is o every sheet you re hadig
More information