# It should be unbiased, or approximately unbiased. Variance of the variance estimator should be small. That is, the variance estimator is stable.

Save this PDF as:

Size: px
Start display at page:

Download "It should be unbiased, or approximately unbiased. Variance of the variance estimator should be small. That is, the variance estimator is stable."

## Transcription

1 Chapter 10 Variace Estimatio 10.1 Itroductio Variace estimatio is a importat practical problem i survey samplig. Variace estimates are used i two purposes. Oe is the aalytic purpose such as costructig cofidece itervals or performig hypothesis testigs. The other is descriptive purposed to evaluate the efficiecy of the survey desigs or estimates for plaig surveys. Desirable variace estimates should satisfy the followig properties: It should be ubiased, or approximately ubiased. Variace of the variace estimator should be small. That is, the variace estimator is stable. It should ot take egative values. The computatio should be simple. The HT variace estimator is ubiased but it ca take egative values. Also, computig the joit iclusio probabilities π i j ca be cumbersome whe the sample size is large. 1

2 2 CHAPTER 10. VARIANCE ESTIMATION Example Cosider a fiite populatio of size N = 3 with y 1 = 16,y 2 = 21 ad y 3 = 18 ad cosider the followig samplig desig. Table 10.1: A samplig desig Sample A Pr A HT estimator HT variace estimator A 1 = {1,2} A 2 = {1,3} A 3 = {2,3} A 4 = {1,2,3} The samplig variace of HT estimator is 85. Note that HT variace estimator has expectatio = 85 but it ca take egative values i some samples. The variace estimator uder PPS samplig is always oegative ad ca be computed without computig the joit iclusio probability. I practice, PPS samplig variace estimator is ofte applied as a alterative variace estimator eve for without-replacemet samplig. The resultig variace estimator ca be writte 1 ˆV 0 = 1 2 yi Ŷ HT = i A p i 1 yi 1 2, 10.1 i A π i ŶHT where p i = π i /. The followig theorem express the bias of the simplified variace estimator i 10.1 as a estimator of the variace of HT estimator. Theorem The simplified variace estimator i 10.1 satisfies where E ˆV 0 Var ŶHT = Var 1 Ŷ PPS = { } Var ŶPPS Var ŶHT 1 N 2 yi p i Y p i 10.2

3 10.1. INTRODUCTION 3 ad p i = π i /. Proof. Note that ˆV 0 satisfies { E = E k A { k A The first term is ad, usig yk Y +Y Ŷ HT p k } 2 yk Y + 2E p k E 2 } { } 2 yk Y k A p k yk Y = k A p k k A { yk Y } { } 2 Y ŶHT + E k A p k Y ŶHT. k A N 2 yk = Y π k p k = 2 Var Ŷ PPS y k π k Y = Ŷ HT Y, the secod term equals to 2Var Ŷ HT ad the last term is equal to Var ŶHT, which proves the result. I may cases, the bias term i 10.2 is positive ad the simplified variace estimator is coservatively estimate the variace. Uder SRS, the relative bias of the simplified variace estimator 10.1 is ˆV 0 Var Ŷ HT Var Ŷ HT = N ad the relative bias is egligible whe /N is egligible The simplified variace estimator ca be directly applicable to multistage samplig desigs. Uder multistage samplig desig, the HT estimator of the total ca be writte Ŷ HT = i A I where Ŷ i is the estimated total for the PSU i. The simplified variace estimator is the give by ˆV 0 = Ŷ i π Ii 1 Ŷi 1 2. i A I π Ii ŶHT

4 4 CHAPTER 10. VARIANCE ESTIMATION Uder stratified multistage cluster samplig, the simplified variace estimator ca be writte ˆV 0 = H h=1 h h 1 h w hi Ŷ hi 1 h where w hi is the samplig weight for cluster i i stratum h. 2 h w h j Ŷ h j 10.4 j= Liearizatio approach to variace estimatio Whe the poit estimator is a oliear estimator such as ratio estimator or regressio estimator, exact variace estimatio for such estimates is very difficult. Istead, we ofte rely o liearizatio methods for estimatig the samplig variace of such estimators. Roughly speakig, if y is a p-dimesioal vector ad whe ȳ = Ȳ N + O p 1/2 holds, the Taylor liearizatio of gȳ ca be writte as gȳ = g Ȳ p g Ȳ + ȳ j Ȳ j + O p 1. j=1 y j Thus, the variace of the liearized term of gȳ ca be writte V {gȳ } =. p p g Ȳ Ȳ g Cov { } ȳ i,ȳ j y i y j ad it is estimated by ˆV {gȳ }. = j=1 p p j=1 gȳ y i gȳ y j Ĉ { ȳ i,ȳ j } I summary, the liearizatio method for variace estimatio ca be described as follows: 1. Apply Taylor liearizatio ad igore the remaider terms. 2. Compute the variace ad covariace terms of each compoet of ȳ usig the stadard variace estimatio formula. 3. Estimate the partial derivative terms g/ y from the sample observatio.

5 10.2. LINEARIZATION APPROACH TO VARIANCE ESTIMATION 5 Example If the parameter of iterest is R = Ȳ / X ad we use ˆR = ȲHT X HT to estimate R, we ca apply the Taylor liearizatio to get ˆR = R + X 1 Ȳ HT R X HT + O p 1 ad the variace estimatio formula i 10.5 reduces to ˆV ˆR. = X 2 HT ˆV Ȳ HT + X 2 HT ˆR 2 ˆV X HT 2 X 2 HT ˆRĈ X HT,Ȳ HT If the variaces ad covariaces of X HT ad Ȳ HT are estimated by HT variace estimatio formula, 10.6 ca be estimated by where e i = y i ˆRx i. ˆV ˆR. = 1 ˆX 2 HT i A j A π i j π i π j π i j e i π i e j π j Usig the result i Example 10.2, the variace of the ratio estimator Ŷ r = X ˆR is estimated by ˆV. X 2 π i j π i π j e i e j Ŷ r = ˆX HT, 10.7 i A j A π i j π i π j which is obtaied by multiplyig ˆX 2 HT X 2 to the variace formula i Recall that the liearized variace estimator of the ratio estimator is give by The variace estimator i 10.7 is asymptotically equivalet to the liearizatio variace estimator i 8.13, but it give more adequate measure of the coditioal variace of the ratio estimator, as advocated by Royall ad Cumberlad More geerally, Särdal, Swesso, ad Wretma 1989 proposed usig ˆV Ŷ GREG = i A j A π i j π i π j π i j g i e i π i g j e j π j 10.8 as the coditioal variace estimator of the GREG estimator of the form Ŷ GREG = i A πi 1 g i y i, where g i = X i A x i x i x i 10.9 π i c i c i

6 6 CHAPTER 10. VARIANCE ESTIMATION ad e i = y i x i i A 1 1 x i x 1 i π i c i x i y i. π i c i i A The g i i 10.9 is the factor to applied to the desig weight to satisfy the calibratio costrait. Example We ow cosider variace estimatio of the poststratificatio estimator i To estimate the variace, the ucoditioal variace estimator is give by ˆV u = N2 1 G g 1 N g=1 1 s2 g where s 2 g = g 1 1 i Ag y i ȳ g 2. O the other had, the coditioal variace estimator i 10.8 is give by ˆV c = 1 N 1 G g=1 N 2 g g g 1 g s 2 g Note that the coditioal variace formula i is very similar to the variace estimatio formula uder the stratified samplig Replicatio approach to variace estimatio We ow cosider a alterative approach to variace estimatio that is based o several replicates of the origial sample estimator. Such replicatio approach does ot use Taylor liearizatio, but istead geerates several resamples ad compute a replicate to each resample. The variability amog the replicates is used to estimate the samplig variace of the poit estimator. Such replicatio approach ofte uses repeated computatio of the replicates usig a computer. Replicatio methods iclude radom group method, jackkife, balaced repeated replicatio, ad bootstrap method. More details of the replicatio methods ca be foud i Wolter 2007.

9 10.3. REPLICATION APPROACH TO VARIANCE ESTIMATION 9 which implies E { ˆV } ˆθ RG = G 2 G V ˆθ i G 2 G 1 1 i j Cov ˆθ i, ˆθ j. Thus, usig 10.15, we have The right side of is the bias of ˆV ˆθ RG as a estimator for the variace of ˆθ RG. Such bias becomes zero if the samplig for radom groups is a withreplacemet samplig. For without-replacemet samplig, the covariace betwee the two differet replicates is egative ad so the bias term becomes positive. The relative amout of the bias is ofte egligible. The followig example compute the amout of the relative bias. Example Cosider a sample of size obtaied from the simple radom samplig from a fiite populatio of size N. Let b = /G be a iteger value which is the size of A g such that A = G g=1 A g. The sample mea of y obtaied from A g is deoted by ȳ g ad the overall mea of y is give by ˆθ = 1 G G g=1 ȳ g. I this case, ȳ 1,,ȳ G are ot idepedet distributed but idetically distributed with the same mea. By 10.15, we have Var ˆθ = 1 G V ȳ Cov ȳ G 1,ȳ 2 ad sice V ȳ 1 = 1 b 1 N S 2, we have Thus, the bias i reduces to Cov ȳ 1,ȳ 2 = 1 N S2. Bias { ˆV ˆθ RG } = Cov ȳ1,ȳ 2 = 1 N S2

10 10 CHAPTER 10. VARIANCE ESTIMATION which is ofte egligible. Thus, the radom group variace estimator ca be safely used to estimate the variace of ȳ i the simple radom samplig. Such radom group method provides a useful computatioal tool for estimatig the variace of the poit estimators. However, the radom group method is applicable oly whe the samplig desig for A g has the same structure as the origial sample A. The partitio A = G g=1 A g that leads to ubiasedess of ˆθ g is ot always possible for complex samplig desigs Jackkife method Jackkife was first itroduced by Queouille 1949 to reduce the bias of ratio estimator ad the was suggested by Tukey 1958 to be used for variace estimatio. Jackkife is very popular i practice as a tool for variace estimatio. To itroduce the idea of Queouille 1949, suppose that idepedet observatios of x i,y i are available that are geerated from a distributio with mea µ x, µ y. If the parameter of iterest is θ = µ y /µ x, the the sample ratio ˆθ = x 1 ȳ has bias of order O 1. That is, we have E ˆθ = θ + C + O 2. If we delete the k-th observatio ad recompute the ratio 1 ˆθ k = x i y i, i k i k we obtai E ˆθ k = θ + C 1 + O 2. Thus, the jackkife pseudo value defied by ˆθ k = ˆθ 1 ˆθ k ca be used to compute ˆθ. = 1 ˆθ k which has bias of order O 2. Thus, the jackkife ca be used to reduce the bias of oliear estimators.

11 10.4. JACKKNIFE METHOD 11 Note that if ˆθ = ȳ the ˆθ k = y k. Tukey 1958 suggested usig ˆθ k as approximate IID observatio to get the followig jackkife variace estimator. ˆV. 1 1 JK ˆθ = 1 = 1 For the special case of ˆθ = ȳ, we obtai ˆV JK = ˆθ k θ. 2 ˆθ k θ. 2 y i ȳ 2 = 1 s2 y ad the jackkife variace estimator is algebraically equivalet to the usual variace estimator of the sample mea uder simple radom samplig igorig the fiite populatio correctio term. If we are iterested i estimatig the variace of ˆθ = f x,ȳ, usig ˆθ k = f x k,ȳ k, we ca costruct ˆV JK ˆθ = 1 2 ˆθ k ˆθ as the jackkife variace estimator of ˆθ. The jackkife replicate ˆθ k is computed by usig the same formula for ˆθ usig the jackkife weight w k i istead of the origial weight w i = 1/, where w k i = { 1 1 if i k 0 if i = k. To discuss the asymptotic property of the jackkife variace estimator i 10.17, we use the followig Taylor expasio, which is ofte called secod-type Taylor expasio. Lemma Let {X,W } be a sequece of radom variables such that X = W + O p r

12 12 CHAPTER 10. VARIANCE ESTIMATION where r 0 as. If gx is a fuctio with s-th cotiuous derivatives i the lie segmet joiig X ad W ad the s-th order partial derivatives are bouded, the s 1 gx = gw + 1 k! gk W X W k + O p r s where g k a is the k-th derivative of gx evaluated at x = a. Now, sice ȳ k ȳ = 1 1 ȳ y k, we have ȳ k ȳ = O p 1. For the case of ˆθ = f x,ȳ, we ca apply the above lemma to get ˆθ k ˆθ = f x x,ȳ x k x + f y x,ȳ ȳ k ȳ + o p 1 so that 1 2 ˆθ k ˆθ { } f 2 = x x,ȳ 1 { }{ } f f 1 +2 x x,ȳ y x,ȳ { 2 f x k x + } 2 y x,ȳ 1 2 ȳ k ȳ x k x ȳ k ȳ + o p 1. Thus, the jackkife variace estimator is asymptotically equivalet to the liearized variace estimator. That is, the secod-type Taylor liearizatio leads to ˆV { } f 2 { } f 2 JK ˆθ = x x,ȳ ˆV x + y x,ȳ ˆV ȳ { }{ } f f +2 x x,ȳ y x,ȳ Ĉ x,ȳ + o p 1. The above jackkife method is costructed uder simple radom samplig. For stratified multistage samplig, jackkife replicates ca be costructed by deletig a cluster for each replicate. Let Ŷ HT = H h h=1 w hi Ŷ hi

13 10.4. JACKKNIFE METHOD 13 be the HT estimator of Y uder the stratified multistage cluster samplig. The jackkife weights are costructed by deletig a cluster sequetially as 0 if h = g ad i = j g j w hi = h 1 1 h w hi if h = g ad i j w hi otherwise ad the jackkife variace estimator is computed by where ˆV JK ŶHT = H h=1 h 1 h h H h g j Ŷ HT = h=1 Ŷ hi HT 1 h h w g j hi j=1 Ŷ hi. 2 h j Ŷ HT The followig theorem presets the algebraic property of the jackkife variace estimator i Theorem The jackkife variace estimator i is algebraically equivalet to the simplified variace estimator i If ˆθ = f ˆX HT,Ŷ HT the the jackkife replicates are costructed as ˆθ g j = g j g j f ˆX. I this case, the jackkife variace estimator is computed as HT,Ŷ HT or, more simply, ˆV JK ˆθ = H h=1 ˆV JK ˆθ = h 1 h H h=1 h h 1 h ˆθ hi 1 h h 2 h ˆθ h j j=1 2 ˆθ hi ˆθ The asymptotic properties of the above jackkife variace estimator uder stratified multistage samplig ca be established. For refereces, see Krewski ad Rao 1981 or Shao ad Tu Example We ow revisit Example 10.3 to estimate the variace of poststratificatio estimator usig the jackkife. For simplicity, assume SRS for the sample.

14 14 CHAPTER 10. VARIANCE ESTIMATION The poststratificatio estimator is computed as Ŷ post = G g=1 N g ȳ g where ȳ g = 1 g i Ag y i. Now, the k-th replicate of Ŷ post is where ȳ k h ad Ŷ k post = h 1 1 h ȳ h y k. Thus, = N g ȳ g + N h ȳ k h g h Ŷ k post Ŷ post = N h ȳ k h ȳ h ˆV JK Ŷpost = 1 = N h h 1 1 ȳ h y k = 1 G g=1 Ŷ k post Ŷ post 2 N 2 g g 1 1 s 2 g, which, igorig /N term, is asymptotically equivalet to the coditioal variace estimator i Other methods Skip Referece Krewski, D. ad Rao, J.N.K Iferece from stratified samples: properties of the liearizatio, jackkife ad balaced repeated replicatio methods. Aals of Statistics 9, Queouille, M. H Notes o bias i estimatio. Biometrika 43,

15 10.5. OTHER METHODS 15 Royall, R. M. ad Cumberlad, W. G A empirical study of the ratio estimator ad estimators of its variace. Joural of the America Statistical Associatio 76, Särdal, C. E., Swesso, B., ad Wretma, J. H The weighted residual techique for estimatio the variace of the geeral regressio estimator of the fiite populatio total, Biometrika 76, Tukey, J. W Bias ad cofidece i ot-quite large samples abstract. Aals of Mathematical Statistics 29, 614. Wolter, K. M Itroductio to Variace Estimatio: Secod Editio. New York: Spriger-Verlag.

### Element sampling: Part 2

Chapter 4 Elemet samplig: Part 2 4.1 Itroductio We ow cosider uequal probability samplig desigs which is very popular i practice. I the uequal probability samplig, we ca improve the efficiecy of the resultig

### DS 100: Principles and Techniques of Data Science Date: April 13, Discussion #10

DS 00: Priciples ad Techiques of Data Sciece Date: April 3, 208 Name: Hypothesis Testig Discussio #0. Defie these terms below as they relate to hypothesis testig. a) Data Geeratio Model: Solutio: A set

### Properties and Hypothesis Testing

Chapter 3 Properties ad Hypothesis Testig 3.1 Types of data The regressio techiques developed i previous chapters ca be applied to three differet kids of data. 1. Cross-sectioal data. 2. Time series data.

### Chapter 11 Output Analysis for a Single Model. Banks, Carson, Nelson & Nicol Discrete-Event System Simulation

Chapter Output Aalysis for a Sigle Model Baks, Carso, Nelso & Nicol Discrete-Evet System Simulatio Error Estimatio If {,, } are ot statistically idepedet, the S / is a biased estimator of the true variace.

### A General Family of Estimators for Estimating Population Variance Using Known Value of Some Population Parameter(s)

Rajesh Sigh, Pakaj Chauha, Nirmala Sawa School of Statistics, DAVV, Idore (M.P.), Idia Floreti Smaradache Uiversity of New Meico, USA A Geeral Family of Estimators for Estimatig Populatio Variace Usig

### First Year Quantitative Comp Exam Spring, Part I - 203A. f X (x) = 0 otherwise

First Year Quatitative Comp Exam Sprig, 2012 Istructio: There are three parts. Aswer every questio i every part. Questio I-1 Part I - 203A A radom variable X is distributed with the margial desity: >

### Section 14. Simple linear regression.

Sectio 14 Simple liear regressio. Let us look at the cigarette dataset from [1] (available to dowload from joural s website) ad []. The cigarette dataset cotais measuremets of tar, icotie, weight ad carbo

### 7-1. Chapter 4. Part I. Sampling Distributions and Confidence Intervals

7-1 Chapter 4 Part I. Samplig Distributios ad Cofidece Itervals 1 7- Sectio 1. Samplig Distributio 7-3 Usig Statistics Statistical Iferece: Predict ad forecast values of populatio parameters... Test hypotheses

### Output Analysis and Run-Length Control

IEOR E4703: Mote Carlo Simulatio Columbia Uiversity c 2017 by Marti Haugh Output Aalysis ad Ru-Legth Cotrol I these otes we describe how the Cetral Limit Theorem ca be used to costruct approximate (1 α%

### Statistical inference: example 1. Inferential Statistics

Statistical iferece: example 1 Iferetial Statistics POPULATION SAMPLE A clothig store chai regularly buys from a supplier large quatities of a certai piece of clothig. Each item ca be classified either

### 1 Inferential Methods for Correlation and Regression Analysis

1 Iferetial Methods for Correlatio ad Regressio Aalysis I the chapter o Correlatio ad Regressio Aalysis tools for describig bivariate cotiuous data were itroduced. The sample Pearso Correlatio Coefficiet

### ECE 901 Lecture 12: Complexity Regularization and the Squared Loss

ECE 90 Lecture : Complexity Regularizatio ad the Squared Loss R. Nowak 5/7/009 I the previous lectures we made use of the Cheroff/Hoeffdig bouds for our aalysis of classifier errors. Hoeffdig s iequality

### Probability and statistics: basic terms

Probability ad statistics: basic terms M. Veeraraghava August 203 A radom variable is a rule that assigs a umerical value to each possible outcome of a experimet. Outcomes of a experimet form the sample

### The variance of a sum of independent variables is the sum of their variances, since covariances are zero. Therefore. V (xi )= n n 2 σ2 = σ2.

SAMPLE STATISTICS A radom sample x 1,x,,x from a distributio f(x) is a set of idepedetly ad idetically variables with x i f(x) for all i Their joit pdf is f(x 1,x,,x )=f(x 1 )f(x ) f(x )= f(x i ) The sample

### Review Questions, Chapters 8, 9. f(y) = 0, elsewhere. F (y) = f Y(1) = n ( e y/θ) n 1 1 θ e y/θ = n θ e yn

Stat 366 Lab 2 Solutios (September 2, 2006) page TA: Yury Petracheko, CAB 484, yuryp@ualberta.ca, http://www.ualberta.ca/ yuryp/ Review Questios, Chapters 8, 9 8.5 Suppose that Y, Y 2,..., Y deote a radom

### o <Xln <X2n <... <X n < o (1.1)

Metrika, Volume 28, 1981, page 257-262. 9 Viea. Estimatio Problems for Rectagular Distributios (Or the Taxi Problem Revisited) By J.S. Rao, Sata Barbara I ) Abstract: The problem of estimatig the ukow

### KLMED8004 Medical statistics. Part I, autumn Estimation. We have previously learned: Population and sample. New questions

We have previously leared: KLMED8004 Medical statistics Part I, autum 00 How kow probability distributios (e.g. biomial distributio, ormal distributio) with kow populatio parameters (mea, variace) ca give

### ESTIMATION AND PREDICTION BASED ON K-RECORD VALUES FROM NORMAL DISTRIBUTION

STATISTICA, ao LXXIII,. 4, 013 ESTIMATION AND PREDICTION BASED ON K-RECORD VALUES FROM NORMAL DISTRIBUTION Maoj Chacko Departmet of Statistics, Uiversity of Kerala, Trivadrum- 695581, Kerala, Idia M. Shy

### Kernel density estimator

Jauary, 07 NONPARAMETRIC ERNEL DENSITY ESTIMATION I this lecture, we discuss kerel estimatio of probability desity fuctios PDF Noparametric desity estimatio is oe of the cetral problems i statistics I

### MOST PEOPLE WOULD RATHER LIVE WITH A PROBLEM THEY CAN'T SOLVE, THAN ACCEPT A SOLUTION THEY CAN'T UNDERSTAND.

XI-1 (1074) MOST PEOPLE WOULD RATHER LIVE WITH A PROBLEM THEY CAN'T SOLVE, THAN ACCEPT A SOLUTION THEY CAN'T UNDERSTAND. R. E. D. WOOLSEY AND H. S. SWANSON XI-2 (1075) STATISTICAL DECISION MAKING Advaced

### Chapter 6 Principles of Data Reduction

Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a

### Stat 200 -Testing Summary Page 1

Stat 00 -Testig Summary Page 1 Mathematicias are like Frechme; whatever you say to them, they traslate it ito their ow laguage ad forthwith it is somethig etirely differet Goethe 1 Large Sample Cofidece

### A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS

J. Japa Statist. Soc. Vol. 41 No. 1 2011 67 73 A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS Yoichi Nishiyama* We cosider k-sample ad chage poit problems for idepedet data i a

### Chapter 3. Strong convergence. 3.1 Definition of almost sure convergence

Chapter 3 Strog covergece As poited out i the Chapter 2, there are multiple ways to defie the otio of covergece of a sequece of radom variables. That chapter defied covergece i probability, covergece i

### The standard deviation of the mean

Physics 6C Fall 20 The stadard deviatio of the mea These otes provide some clarificatio o the distictio betwee the stadard deviatio ad the stadard deviatio of the mea.. The sample mea ad variace Cosider

### Chapter 6 Sampling Distributions

Chapter 6 Samplig Distributios 1 I most experimets, we have more tha oe measuremet for ay give variable, each measuremet beig associated with oe radomly selected a member of a populatio. Hece we eed to

### STATISTICAL INFERENCE

STATISTICAL INFERENCE POPULATION AND SAMPLE Populatio = all elemets of iterest Characterized by a distributio F with some parameter θ Sample = the data X 1,..., X, selected subset of the populatio = sample

### MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS

MASSACHUSTTS INSTITUT OF TCHNOLOGY 6.436J/5.085J Fall 2008 Lecture 9 /7/2008 LAWS OF LARG NUMBRS II Cotets. The strog law of large umbers 2. The Cheroff boud TH STRONG LAW OF LARG NUMBRS While the weak

### G. R. Pasha Department of Statistics Bahauddin Zakariya University Multan, Pakistan

Deviatio of the Variaces of Classical Estimators ad Negative Iteger Momet Estimator from Miimum Variace Boud with Referece to Maxwell Distributio G. R. Pasha Departmet of Statistics Bahauddi Zakariya Uiversity

### Basis for simulation techniques

Basis for simulatio techiques M. Veeraraghava, March 7, 004 Estimatio is based o a collectio of experimetal outcomes, x, x,, x, where each experimetal outcome is a value of a radom variable. x i. Defiitios

### Some Basic Probability Concepts. 2.1 Experiments, Outcomes and Random Variables

Some Basic Probability Cocepts 2. Experimets, Outcomes ad Radom Variables A radom variable is a variable whose value is ukow util it is observed. The value of a radom variable results from a experimet;

### Testing Statistical Hypotheses for Compare. Means with Vague Data

Iteratioal Mathematical Forum 5 o. 3 65-6 Testig Statistical Hypotheses for Compare Meas with Vague Data E. Baloui Jamkhaeh ad A. adi Ghara Departmet of Statistics Islamic Azad iversity Ghaemshahr Brach

### NYU Center for Data Science: DS-GA 1003 Machine Learning and Computational Statistics (Spring 2018)

NYU Ceter for Data Sciece: DS-GA 003 Machie Learig ad Computatioal Statistics (Sprig 208) Brett Berstei, David Roseberg, Be Jakubowski Jauary 20, 208 Istructios: Followig most lab ad lecture sectios, we

### V. Nollau Institute of Mathematical Stochastics, Technical University of Dresden, Germany

PROBABILITY AND STATISTICS Vol. III - Correlatio Aalysis - V. Nollau CORRELATION ANALYSIS V. Nollau Istitute of Mathematical Stochastics, Techical Uiversity of Dresde, Germay Keywords: Radom vector, multivariate

### Estimation of Gumbel Parameters under Ranked Set Sampling

Joural of Moder Applied Statistical Methods Volume 13 Issue 2 Article 11-2014 Estimatio of Gumbel Parameters uder Raked Set Samplig Omar M. Yousef Al Balqa' Applied Uiversity, Zarqa, Jorda, abuyaza_o@yahoo.com

### Matrix Representation of Data in Experiment

Matrix Represetatio of Data i Experimet Cosider a very simple model for resposes y ij : y ij i ij, i 1,; j 1,,..., (ote that for simplicity we are assumig the two () groups are of equal sample size ) Y

### Sampling, Sampling Distribution and Normality

4/17/11 Tools of Busiess Statistics Samplig, Samplig Distributio ad ormality Preseted by: Mahedra Adhi ugroho, M.Sc Descriptive statistics Collectig, presetig, ad describig data Iferetial statistics Drawig

### Comparing Four Bootstrap Methods for Stratified Three-Stage Sampling

Joural of Official Statistics, Vol. 26, No. 1, 2010, pp. 193 207 Comparig Four Bootstrap Methods for Stratified Three-Stage Samplig Hiroshi Saigo 1 For a stratified three-stage samplig desig with simple

### Topics Machine learning: lecture 2. Review: the learning problem. Hypotheses and estimation. Estimation criterion cont d. Estimation criterion

.87 Machie learig: lecture Tommi S. Jaakkola MIT CSAIL tommi@csail.mit.edu Topics The learig problem hypothesis class, estimatio algorithm loss ad estimatio criterio samplig, empirical ad epected losses

### This is an introductory course in Analysis of Variance and Design of Experiments.

1 Notes for M 384E, Wedesday, Jauary 21, 2009 (Please ote: I will ot pass out hard-copy class otes i future classes. If there are writte class otes, they will be posted o the web by the ight before class

### General IxJ Contingency Tables

page1 Geeral x Cotigecy Tables We ow geeralize our previous results from the prospective, retrospective ad cross-sectioal studies ad the Poisso samplig case to x cotigecy tables. For such tables, the test

### Monte Carlo Integration

Mote Carlo Itegratio I these otes we first review basic umerical itegratio methods (usig Riema approximatio ad the trapezoidal rule) ad their limitatios for evaluatig multidimesioal itegrals. Next we itroduce

### w (1) ˆx w (1) x (1) /ρ and w (2) ˆx w (2) x (2) /ρ.

2 5. Weighted umber of late jobs 5.1. Release dates ad due dates: maximimizig the weight of o-time jobs Oce we add release dates, miimizig the umber of late jobs becomes a sigificatly harder problem. For

### EDGEWORTH SIZE CORRECTED W, LR AND LM TESTS IN THE FORMATION OF THE PRELIMINARY TEST ESTIMATOR

Joural of Statistical Research 26, Vol. 37, No. 2, pp. 43-55 Bagladesh ISSN 256-422 X EDGEORTH SIZE CORRECTED, AND TESTS IN THE FORMATION OF THE PRELIMINARY TEST ESTIMATOR Zahirul Hoque Departmet of Statistics

### Econ 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1.

Eco 325/327 Notes o Sample Mea, Sample Proportio, Cetral Limit Theorem, Chi-square Distributio, Studet s t distributio 1 Sample Mea By Hiro Kasahara We cosider a radom sample from a populatio. Defiitio

### Parameter, Statistic and Random Samples

Parameter, Statistic ad Radom Samples A parameter is a umber that describes the populatio. It is a fixed umber, but i practice we do ot kow its value. A statistic is a fuctio of the sample data, i.e.,

### Asymptotic Results for the Linear Regression Model

Asymptotic Results for the Liear Regressio Model C. Fli November 29, 2000 1. Asymptotic Results uder Classical Assumptios The followig results apply to the liear regressio model y = Xβ + ε, where X is

### STA Learning Objectives. Population Proportions. Module 10 Comparing Two Proportions. Upon completing this module, you should be able to:

STA 2023 Module 10 Comparig Two Proportios Learig Objectives Upo completig this module, you should be able to: 1. Perform large-sample ifereces (hypothesis test ad cofidece itervals) to compare two populatio

### Joint Probability Distributions and Random Samples. Jointly Distributed Random Variables. Chapter { }

UCLA STAT A Applied Probability & Statistics for Egieers Istructor: Ivo Diov, Asst. Prof. I Statistics ad Neurology Teachig Assistat: Neda Farziia, UCLA Statistics Uiversity of Califoria, Los Ageles, Sprig

### Goodness-Of-Fit For The Generalized Exponential Distribution. Abstract

Goodess-Of-Fit For The Geeralized Expoetial Distributio By Amal S. Hassa stitute of Statistical Studies & Research Cairo Uiversity Abstract Recetly a ew distributio called geeralized expoetial or expoetiated

### MAT1026 Calculus II Basic Convergence Tests for Series

MAT026 Calculus II Basic Covergece Tests for Series Egi MERMUT 202.03.08 Dokuz Eylül Uiversity Faculty of Sciece Departmet of Mathematics İzmir/TURKEY Cotets Mootoe Covergece Theorem 2 2 Series of Real

### Binomial Distribution

0.0 0.5 1.0 1.5 2.0 2.5 3.0 0 1 2 3 4 5 6 7 0.0 0.5 1.0 1.5 2.0 2.5 3.0 Overview Example: coi tossed three times Defiitio Formula Recall that a r.v. is discrete if there are either a fiite umber of possible

### Dimension-free PAC-Bayesian bounds for the estimation of the mean of a random vector

Dimesio-free PAC-Bayesia bouds for the estimatio of the mea of a radom vector Olivier Catoi CREST CNRS UMR 9194 Uiversité Paris Saclay olivier.catoi@esae.fr Ilaria Giulii Laboratoire de Probabilités et

### B Supplemental Notes 2 Hypergeometric, Binomial, Poisson and Multinomial Random Variables and Borel Sets

B671-672 Supplemetal otes 2 Hypergeometric, Biomial, Poisso ad Multiomial Radom Variables ad Borel Sets 1 Biomial Approximatio to the Hypergeometric Recall that the Hypergeometric istributio is fx = x

### Probability and Statistics

ICME Refresher Course: robability ad Statistics Staford Uiversity robability ad Statistics Luyag Che September 20, 2016 1 Basic robability Theory 11 robability Spaces A probability space is a triple (Ω,

### Infinite Sequences and Series

Chapter 6 Ifiite Sequeces ad Series 6.1 Ifiite Sequeces 6.1.1 Elemetary Cocepts Simply speakig, a sequece is a ordered list of umbers writte: {a 1, a 2, a 3,...a, a +1,...} where the elemets a i represet

### (all terms are scalars).the minimization is clearer in sum notation:

7 Multiple liear regressio: with predictors) Depedet data set: y i i = 1, oe predictad, predictors x i,k i = 1,, k = 1, ' The forecast equatio is ŷ i = b + Use matrix otatio: k =1 b k x ik Y = y 1 y 1

### Commutativity in Permutation Groups

Commutativity i Permutatio Groups Richard Wito, PhD Abstract I the group Sym(S) of permutatios o a oempty set S, fixed poits ad trasiet poits are defied Prelimiary results o fixed ad trasiet poits are

### ECE 901 Lecture 4: Estimation of Lipschitz smooth functions

ECE 9 Lecture 4: Estiatio of Lipschitz sooth fuctios R. Nowak 5/7/29 Cosider the followig settig. Let Y f (X) + W, where X is a rado variable (r.v.) o X [, ], W is a r.v. o Y R, idepedet of X ad satisfyig

### BOOTSTRAP BIAS CORRECTION IN SEMIPARAMETRIC ESTIMATION METHODS FOR ARFIMA MODELS

A pesquisa Operacioal e os Recursos Reováveis 4 a 7 de ovembro de 2003, Natal-RN BOOTSTRAP BIAS CORRECTION IN SEMIPARAMETRIC ESTIMATION METHODS FOR ARFIMA MODELS Glaura C. Fraco Depto. Estatística UFMG

### Simple Linear Regression

Simple Liear Regressio 1. Model ad Parameter Estimatio (a) Suppose our data cosist of a collectio of pairs (x i, y i ), where x i is a observed value of variable X ad y i is the correspodig observatio

### Bootstrap Intervals of the Parameters of Lognormal Distribution Using Power Rule Model and Accelerated Life Tests

Joural of Moder Applied Statistical Methods Volume 5 Issue Article --5 Bootstrap Itervals of the Parameters of Logormal Distributio Usig Power Rule Model ad Accelerated Life Tests Mohammed Al-Ha Ebrahem

### The Random Walk For Dummies

The Radom Walk For Dummies Richard A Mote Abstract We look at the priciples goverig the oe-dimesioal discrete radom walk First we review five basic cocepts of probability theory The we cosider the Beroulli

### Statistical Intervals for a Single Sample

3/5/06 Applied Statistics ad Probability for Egieers Sixth Editio Douglas C. Motgomery George C. Ruger Chapter 8 Statistical Itervals for a Sigle Sample 8 CHAPTER OUTLINE 8- Cofidece Iterval o the Mea

### ON POINTWISE BINOMIAL APPROXIMATION

Iteratioal Joural of Pure ad Applied Mathematics Volume 71 No. 1 2011, 57-66 ON POINTWISE BINOMIAL APPROXIMATION BY w-functions K. Teerapabolar 1, P. Wogkasem 2 Departmet of Mathematics Faculty of Sciece

### New Ratio Estimators Using Correlation Coefficient

New atio Estimators Usig Correlatio Coefficiet Cem Kadilar ad Hula Cigi Hacettepe Uiversit, Departmet of tatistics, Betepe, 06800, Akara, Turke. e-mails : kadilar@hacettepe.edu.tr ; hcigi@hacettepe.edu.tr

### 5. Likelihood Ratio Tests

1 of 5 7/29/2009 3:16 PM Virtual Laboratories > 9. Hy pothesis Testig > 1 2 3 4 5 6 7 5. Likelihood Ratio Tests Prelimiaries As usual, our startig poit is a radom experimet with a uderlyig sample space,

### 4 Conditional Distribution Estimation

4 Coditioal Distributio Estimatio 4. Estimators Te coditioal distributio (CDF) of y i give X i = x is F (y j x) = P (y i y j X i = x) = E ( (y i y) j X i = x) : Tis is te coditioal mea of te radom variable

### IIT JAM Mathematical Statistics (MS) 2006 SECTION A

IIT JAM Mathematical Statistics (MS) 6 SECTION A. If a > for ad lim a / L >, the which of the followig series is ot coverget? (a) (b) (c) (d) (d) = = a = a = a a + / a lim a a / + = lim a / a / + = lim

### Varanasi , India. Corresponding author

A Geeral Family of Estimators for Estimatig Populatio Mea i Systematic Samplig Usig Auxiliary Iformatio i the Presece of Missig Observatios Maoj K. Chaudhary, Sachi Malik, Jayat Sigh ad Rajesh Sigh Departmet

### Lecture 01: the Central Limit Theorem. 1 Central Limit Theorem for i.i.d. random variables

CSCI-B609: A Theorist s Toolkit, Fall 06 Aug 3 Lecture 0: the Cetral Limit Theorem Lecturer: Yua Zhou Scribe: Yua Xie & Yua Zhou Cetral Limit Theorem for iid radom variables Let us say that we wat to aalyze

### Linear Regression Models

Liear Regressio Models Dr. Joh Mellor-Crummey Departmet of Computer Sciece Rice Uiversity johmc@cs.rice.edu COMP 528 Lecture 9 15 February 2005 Goals for Today Uderstad how to Use scatter diagrams to ispect

### Linear chord diagrams with long chords

Liear chord diagrams with log chords Everett Sulliva Departmet of Mathematics Dartmouth College Haover New Hampshire, U.S.A. everett..sulliva@dartmouth.edu Submitted: Feb 7, 2017; Accepted: Oct 7, 2017;

### Table 12.1: Contingency table. Feature b. 1 N 11 N 12 N 1b 2 N 21 N 22 N 2b. ... a N a1 N a2 N ab

Sectio 12 Tests of idepedece ad homogeeity I this lecture we will cosider a situatio whe our observatios are classified by two differet features ad we would like to test if these features are idepedet

### Final Examination Solutions 17/6/2010

The Islamic Uiversity of Gaza Faculty of Commerce epartmet of Ecoomics ad Political Scieces A Itroductio to Statistics Course (ECOE 30) Sprig Semester 009-00 Fial Eamiatio Solutios 7/6/00 Name: I: Istructor:

### A goodness-of-fit test based on the empirical characteristic function and a comparison of tests for normality

A goodess-of-fit test based o the empirical characteristic fuctio ad a compariso of tests for ormality J. Marti va Zyl Departmet of Mathematical Statistics ad Actuarial Sciece, Uiversity of the Free State,

### K. Grill Institut für Statistik und Wahrscheinlichkeitstheorie, TU Wien, Austria

MARKOV PROCESSES K. Grill Istitut für Statistik ud Wahrscheilichkeitstheorie, TU Wie, Austria Keywords: Markov process, Markov chai, Markov property, stoppig times, strog Markov property, trasitio matrix,

### R. van Zyl 1, A.J. van der Merwe 2. Quintiles International, University of the Free State

Bayesia Cotrol Charts for the Two-parameter Expoetial Distributio if the Locatio Parameter Ca Take o Ay Value Betwee Mius Iity ad Plus Iity R. va Zyl, A.J. va der Merwe 2 Quitiles Iteratioal, ruaavz@gmail.com

### Some Properties of the Exact and Score Methods for Binomial Proportion and Sample Size Calculation

Some Properties of the Exact ad Score Methods for Biomial Proportio ad Sample Size Calculatio K. KRISHNAMOORTHY AND JIE PENG Departmet of Mathematics, Uiversity of Louisiaa at Lafayette Lafayette, LA 70504-1010,

### Recursive Algorithm for Generating Partitions of an Integer. 1 Preliminary

Recursive Algorithm for Geeratig Partitios of a Iteger Sug-Hyuk Cha Computer Sciece Departmet, Pace Uiversity 1 Pace Plaza, New York, NY 10038 USA scha@pace.edu Abstract. This article first reviews the

### Singular Continuous Measures by Michael Pejic 5/14/10

Sigular Cotiuous Measures by Michael Peic 5/4/0 Prelimiaries Give a set X, a σ-algebra o X is a collectio of subsets of X that cotais X ad ad is closed uder complemetatio ad coutable uios hece, coutable

### Modified Lilliefors Test

Joural of Moder Applied Statistical Methods Volume 14 Issue 1 Article 9 5-1-2015 Modified Lilliefors Test Achut Adhikari Uiversity of Norther Colorado, adhi2939@gmail.com Jay Schaffer Uiversity of Norther

### ARIMA Models. Dan Saunders. y t = φy t 1 + ɛ t

ARIMA Models Da Sauders I will discuss models with a depedet variable y t, a potetially edogeous error term ɛ t, ad a exogeous error term η t, each with a subscript t deotig time. With just these three

### Chapter 1 (Definitions)

FINAL EXAM REVIEW Chapter 1 (Defiitios) Qualitative: Nomial: Ordial: Quatitative: Ordial: Iterval: Ratio: Observatioal Study: Desiged Experimet: Samplig: Cluster: Stratified: Systematic: Coveiece: Simple

### The Sampling Distribution of the Maximum. Likelihood Estimators for the Parameters of. Beta-Binomial Distribution

Iteratioal Mathematical Forum, Vol. 8, 2013, o. 26, 1263-1277 HIKARI Ltd, www.m-hikari.com http://d.doi.org/10.12988/imf.2013.3475 The Samplig Distributio of the Maimum Likelihood Estimators for the Parameters

### CHAPTER 5. Theory and Solution Using Matrix Techniques

A SERIES OF CLASS NOTES FOR 2005-2006 TO INTRODUCE LINEAR AND NONLINEAR PROBLEMS TO ENGINEERS, SCIENTISTS, AND APPLIED MATHEMATICIANS DE CLASS NOTES 3 A COLLECTION OF HANDOUTS ON SYSTEMS OF ORDINARY DIFFERENTIAL

### A note on self-normalized Dickey-Fuller test for unit root in autoregressive time series with GARCH errors

Appl. Math. J. Chiese Uiv. 008, 3(): 97-0 A ote o self-ormalized Dickey-Fuller test for uit root i autoregressive time series with GARCH errors YANG Xiao-rog ZHANG Li-xi Abstract. I this article, the uit

### Sample questions. 8. Let X denote a continuous random variable with probability density function f(x) = 4x 3 /15 for

Sample questios Suppose that humas ca have oe of three bloodtypes: A, B, O Assume that 40% of the populatio has Type A, 50% has type B, ad 0% has Type O If a perso has type A, the probability that they

### Solution. 1 Solutions of Homework 1. Sangchul Lee. October 27, Problem 1.1

Solutio Sagchul Lee October 7, 017 1 Solutios of Homework 1 Problem 1.1 Let Ω,F,P) be a probability space. Show that if {A : N} F such that A := lim A exists, the PA) = lim PA ). Proof. Usig the cotiuity

### Unbiased Estimation. February 7-12, 2008

Ubiased Estimatio February 7-2, 2008 We begi with a sample X = (X,..., X ) of radom variables chose accordig to oe of a family of probabilities P θ where θ is elemet from the parameter space Θ. For radom

### LECTURE 11 LINEAR PROCESSES III: ASYMPTOTIC RESULTS

PRIL 7, 9 where LECTURE LINER PROCESSES III: SYMPTOTIC RESULTS (Phillips ad Solo (99) ad Phillips Lecture Notes o Statioary ad Nostatioary Time Series) I this lecture, we discuss the LLN ad CLT for a liear

### Lecture 6 Chi Square Distribution (χ 2 ) and Least Squares Fitting

Lecture 6 Chi Square Distributio (χ ) ad Least Squares Fittig Chi Square Distributio (χ ) Suppose: We have a set of measuremets {x 1, x, x }. We kow the true value of each x i (x t1, x t, x t ). We would

### SAMPLING LIPSCHITZ CONTINUOUS DENSITIES. 1. Introduction

SAMPLING LIPSCHITZ CONTINUOUS DENSITIES OLIVIER BINETTE Abstract. A simple ad efficiet algorithm for geeratig radom variates from the class of Lipschitz cotiuous desities is described. A MatLab implemetatio

### Recall the study where we estimated the difference between mean systolic blood pressure levels of users of oral contraceptives and non-users, x - y.

Testig Statistical Hypotheses Recall the study where we estimated the differece betwee mea systolic blood pressure levels of users of oral cotraceptives ad o-users, x - y. Such studies are sometimes viewed

### Session 5. (1) Principal component analysis and Karhunen-Loève transformation

200 Autum semester Patter Iformatio Processig Topic 2 Image compressio by orthogoal trasformatio Sessio 5 () Pricipal compoet aalysis ad Karhue-Loève trasformatio Topic 2 of this course explais the image

### MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 6 9/23/2013. Brownian motion. Introduction

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/5.070J Fall 203 Lecture 6 9/23/203 Browia motio. Itroductio Cotet.. A heuristic costructio of a Browia motio from a radom walk. 2. Defiitio ad basic properties

### Modified Ratio Estimators Using Known Median and Co-Efficent of Kurtosis

America Joural of Mathematics ad Statistics 01, (4): 95-100 DOI: 10.593/j.ajms.01004.05 Modified Ratio s Usig Kow Media ad Co-Efficet of Kurtosis J.Subramai *, G.Kumarapadiya Departmet of Statistics, Podicherry

### 62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +

62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of