Nonparametric Methods II
|
|
- Sheila Bond
- 5 years ago
- Views:
Transcription
1 Nonparametric Methods II Henry Horng-Shing Lu Institute of Statistics National Chiao Tung University 1
2 PART 3: Statistical Inference by Bootstrap Methods References Pros and Cons Bootstrap Confidence Intervals Bootstrap Tests 2
3 References Efron, B. (1979). "Bootstrap Methods: Another Look at the Jackknife". The Annals of Statistics 7 (1): Efron, B.; Tibshirani, R. (1993). An Introduction to the Bootstrap. Chapman & Hall/CRC. Chernick, M. R. (1999). Bootstrap Methods, A practitioner's guide. Wiley Series in Probability and Statistics. 3
4 Pros (1) In statistics, bootstrapping is a modern, computer-intensive, general purpose approach to statistical inference, falling within a broader class of re-sampling methods. 4
5 Pros (2) The advantage of bootstrapping over analytical method is its great simplicity - it is straightforward to apply the bootstrap to derive estimates of standard errors and confidence intervals for complex estimators of complex parameters of the distribution, such as percentile points, proportions, odds ratio, and correlation coefficients. 5
6 Cons The disadvantage of bootstrapping is that while (under some conditions) it is asymptotically consistent, it does not provide general finite sample guarantees, and has a tendency to be overly optimistic. 6
7 How many bootstrap samples is enough? As a general guideline, 1000 samples is often enough for a first look. However, if the results really matter, as many samples as is reasonable given available computing power and time should be used. 7
8 Bootstrap Confidence Intervals 1. A Simple Method 2. Transformation Methods 2.1. The Percentile Method 2.2. The BC Percentile Method 2.3. The BCa Percentile Method 2.4. The ABC Method (See the book: An Introduction to the Bootstrap.) 8
9 1. A Simple Method Methodology Flowchart R codes C codes 9
10 Normal Distributions iid 2 2 1, 2,..., n ~ ( μ, σ ), σ is known. X X X N 2 ˆ ˆ σ θ θ θ = X ~ N( θ, ), Z = ~ N(0, 1). n σ / n ˆ θ θ P z z where Z σ / n P( ˆ θ z ˆ α/2 σ / n θ θ + zα/2σ / n) = 1 α. 1 ( α/2 α/2 ) = 1 α, α /2 =Φ (1 /2) LCL UCL α 10
11 Asymptotic C. I. for The MLE More generally, X, X,..., X ~ F ( x). 1 2 iid Let ˆ θ = MLE, then Pivot n θ ˆ θ θ = N(0, 1)...( ˆ n se θ ) ˆ θ θ n P( z z ) 1 α. α/2 α/2 σ ˆ θ P( ˆ θ z σ θ ˆ θ + z σ ) 1 α α/2 ˆ θ α/2 ˆ θ 11
12 Bootstrap Confidence Intervals When n is not large, we can construct more precise confidence intervals by bootstrap methods for many statistics including the MLE and others. 12
13 Simple Methods Theorem in Gill (1989): Under regular conditions, n( ˆ o θ θ( F)) dθ( F) B F, n ˆ θ ˆ θ X X dθ F B F o n ( ) 1,..., n ( ). n ( θ UCL) Want P LCL 1 α. ˆ ˆ ˆ ˆ ˆ ˆ Note that 1 α P θ α θ θ θ θ α θ ( ) (1 ) 2 2 ˆ ˆ ˆ ˆ ˆ P θ α θ θ θ θ α θ ( ) (1 ) 2 2 = P 2 ˆ θ ˆ θ θ 2 ˆ θ ˆ θ α α (1 ) ( ) 2 2 ( θ UCL) = P LCL. 13
14 An Example by The Simple Method (1) 1 1 X1, X2,..., X101 ~ N( θ, 1), θ= median= F ( ). 2 ˆ 1 1 X(1) X(2)... X(101), θ = Fn ( ) = X(51). 2 Resampling with replacement from,,...,. X X... X. (1) (2) (101) ˆ 1 1 θ = Fn ( ) = X(51). 2 Repeat B = 1000 times, we can get ˆ θ ˆ θ... ˆ θ. (1) (2) (1000) { X X X }
15 An Example by The Simple Method (2) 95% θˆ (1) θˆ (25) { } P ˆ θ ˆ θ ˆ θ 1 α = 95% (25) (975) { ˆ θ ˆ θ ˆ θ ˆ θ ˆ θ ˆ θ} = P (25) (975) θˆ (975) { ˆ θ ˆ ˆ ˆ ˆ} (25) θ θ θ θ(975) θ P { ˆ θ ˆ θ ˆ ˆ } (975) θ θ θ(25) = P 2 2. θˆ (1000) [ LCL = 2 ˆ θ ˆ θ, UCL = 2 ˆ θ ˆ θ ] (975) (25) is an approximate (1- α) confidence interval for θ. 15
16 Flowchart of The Simple Method data x= ( x, x,..., x ) ˆ θ = s( x) 1 2 n resample B times x 1 x 2 x B θ = ˆ get resample statistics b ( b) and then sort them s x θˆ (1) θˆ (2) (2) θˆ ( B ) v = [( B+ 1) α / 2], v = [( B+ 1)(1 α / 2)] (1 α)% confidence interval LCL = 2 ˆ θ ˆ θ, UCL = 2ˆ θ ˆ θ ( v ) ( v )
17 The Simple Method by R 17
18 18
19 The Simple Method by C (1) resample B times: x b ˆ b mean( xb) θ = a= ˆ θ = s( x) = mean( x) 19
20 The Simple Method by C (2) calculate v1, v2 100(1 α)% confidence interval 20
21 21
22 22
23 23
24 2. Transformation Methods 2.1. The Percentile Method 2.2. The BC Percentile Method 2.3. The BCa Percentile Method 24
25 2.1. The Percentile Method Methodology Flowchart R codes C codes 25
26 The Percentile Method (1) The interval between the 2.5% and 97.5% percentiles of the bootstrap distribution of a statistic is a 95% bootstrap percentile confidence interval for the corresponding parameter. Use this method when the bootstrap estimate of bias is small. 26
27 The Percentile Method (2) Suppose Y = ˆ θ θ ~ H( i). Then HY ( ) ~ U. Φ HY ( ) ~ Φ ( U)~ N(0, 1). ( ) 1 1 Assume that there exists an unbiased and (monotonly) increasing function g( i) such that g( ˆ θ) g( θ) N(0, 1). 27
28 The Percentile Method (3) If g( ˆ θ) g( θ) N(0, 1), then ( ) ( ) (0, 1). g ˆ θ g ˆ θ N ( ˆ ˆ ) α P g( θ ) g( θ) z 1 α = P ˆ θ g ( g( ˆ θ) + z )) and ˆ ξ = ˆ θ ξα 1 α α ([( B+ 1)(1 α)]) ( ( ˆ θ ) ( θ ) ) α P g g z ( 1 θ ˆ θ ) = P g ( g( ) z )) (Note: z = z for N(0, 1).) α α 1 α 1 = P θ g ( g( ˆ θ) + z ˆ ˆ 1 α)) and ξ1 α = θ ([( B+ 1) α]). ξ1 α 28
29 The Percentile Method (4) ( ˆ ) ([( B+ 1)(1 α )]) Similarly, P θ θ 1 α and P ( ) ([( B+ 1) α/2]) ([( B+ 1)(1 α/2)]) ˆ θ θ ˆ θ 1 α. Summary of the percentile method: P P P ( ) ([( B+ 1) α ]) θ ˆ θ 1 α, ( ) ([( B+ 1)(1 α )]) θ ˆ θ 1 α, ( ) ([( B+ 1) α/2]) ([( B+ 1)(1 α/2)]) ˆ θ θ ˆ θ 1 α. 29
30 Flowchart of The Percentile Method data x= ( x, x,..., x ) ˆ θ = s( x) 1 2 n resample B times x 1 x 2 x B ˆ get resample statistics θ b = s( xb) and then sort them θˆ (1) θˆ (2) (2) θˆ ( B ) v = [( B+ 1) α / 2], v = [( B+ 1)(1 α / 2)] (1 α)% confidence interval LCL = ˆ θ, UCL = ˆ θ ( v ) ( v )
31 The Percentile Method by R 31
32 32
33 The Percentile Method by C resample B times: ˆ b mean( xb) θ = x b calculate v1, v2 100(1 α)% confidence interval 33
34 34
35 35
36 36
37 2.2. The BC Percentile Method Methodology Flowchart R code 37
38 The BC Percentile Method Stands for the bias-corrected percentile method. This is a special case of the BCa percentile method which will be explained more later. 38
39 Flowchart of The BC Percentile Method data x= ( x, x,..., x ) ˆ θ = s( x) 1 2 n resample B times x 1 x 2 x B θ = ˆ get resample statistics b ( b) and then sort them s x ˆ θˆ θ (1) (2) (2) θˆ ( B ) LCL estimate z 0 v = Φ(2 z z ) α /2 v =Φ(2 z z ) 2 0 α /2 = ˆ θ, UCL = ˆ θ (( B+ 1) v ) (( B+ 1) v ) 1 2 B 1 1 ˆ estimate z ˆ 0 by Φ 1 B b= 1 Φ 1 ( α) = z α { θ } b θ 100(1 α)% confidence interval 39
40 The BC Percentile Method by R 40
41 41
42 2.3. The BCa Percentile Method Methodology Flowchart R code C code 42
43 The BCa Percentile Method (1) The bootstrap bias-corrected accelerated (BCa) interval is a modification of the percentile method that adjusts the percentiles to correct for bias and skewness. 43
44 The BCa Percentile Method (2) g( ˆ θ ) g( ˆ θ) P U = + z0 zα 1 α 1 a g( ˆ + θ ) ( ˆ 1 ˆ ˆ ) ( ˆ θ θ θ ) α θ ξα = P g ( g( ) + (1 + a g( ))( z z ) ) = P. 0 g( ˆ θ) g( θ) P U = + z0 zα 1 α 1 + a g( θ ) ˆ 1 g( θ ) ( zα z0) = P θ g ( ) 1 + a ( zα z0) = ˆ + + ˆ z ) ) = P θ ξ. ( ) 0 ( β ) 1 P θ g ( g( θ) (1 a g( θ))( zβ ˆ ξ = ˆ θ. β ([( B+ 1) (1 β )]) 1 1 Similarly, P( θ ˆ θ ) 1 α ([( B+ 1) (1 β )]) and P( ˆ θ θ ˆ θ ) 1 2 α. ([( B+ 1) (1 β )]) ([( B+ 1) (1 β )])
45 The BCa Percentile Method (3) β =? 1 β = 1 PZ ( ) 1 β 1 g( ˆ θ ) ( zα z0) and = g( ˆ θ) + (1 + a g( ˆ θ)( zβ z 1 0)) 1 + a ( z z ) α 0 z z z z zβ = z + and β = 1 P( Z z + ) 1 1 ( ) 1 ( ) α 0 α a zα z0 a zα z0 z z = PZ z + α 0 Similarly, β2 1 ( 0 ). 1 a ( zα z0) 45
46 The BCa Percentile Method (4) z 0 =? ( ) P( ˆ θ ˆ θ) = P g( ˆ θ ) g( ˆ θ) ( P ˆ θ ˆ θ ) 1 0 ˆ ˆ ˆ ˆ g( θ ) g( θ) g( θ) g( θ) = P + z + z 1 a g( ˆ θ) 1 a g( ˆ + + θ) =Φ( z ) z =Φ ( ) and ˆ ˆ B 1 { zˆ } 0 =Φ 1 θb θ. B b= 1 46
47 The BCa Percentile Method (5) a =? n 3 ( ˆ θ ˆ () i θ() i ) i= 1 ˆ Jack =, n ˆ ˆ 2 3/2 6 ( ( θ() i θ() i ) ) i= 1 a where ˆ θ = θ( F ) = θ({ X,..., X and () i n 1, i 1 i n ˆ 1 θ = ˆ θ. () i () i n i= 1,..., X }) n 47
48 Flowchart of The BCa Percentile Method data x= ( x, x,..., x ) ˆ θ = s( x) 1 2 n resample B times x 1 x 2 x B θ = ˆ get resample statistics b ( b) and then sort them s x ˆ θˆ θ (1) (2) (2) θˆ ( B ) estimate z0, a { θb θ} 1 ˆ ˆ B 1 estimate z0 by Φ 1 and a by Jackknife B b= 1 1 ( z z ), 1 ( z z β = Φ z + β = Φ z + ) 1 ( ) 1 ( ) α/2 0 1 α/ azα/2 z0 az1 α /2 z0 Φ 1 ( α) = z α LCL = ˆ θ, UCL = ˆ θ (( B+ 1) (1 β )) (( B+ 1) (1 β )) (1 α)% confidence interval
49 Step 1: Install the library of bootstrap in R. Step 2: If you want to check BCa, type?bcanon. 49
50 50
51 The BCa Percentile Method by R 51
52 52
53 The BCa Percentile Method by C 53
54 54
55 55
56 56
57 57
58 58
59 Exercises Write your own programs similar to those examples presented in this talk. Write programs for those examples mentioned at the reference web pages. Write programs for the other examples that you know. Prove those theoretical statements in this talk. 59
Better Bootstrap Confidence Intervals
by Bradley Efron University of Washington, Department of Statistics April 12, 2012 An example Suppose we wish to make inference on some parameter θ T (F ) (e.g. θ = E F X ), based on data We might suppose
More informationStatistics - Lecture One. Outline. Charlotte Wickham 1. Basic ideas about estimation
Statistics - Lecture One Charlotte Wickham wickham@stat.berkeley.edu http://www.stat.berkeley.edu/~wickham/ Outline 1. Basic ideas about estimation 2. Method of Moments 3. Maximum Likelihood 4. Confidence
More informationBootstrap Confidence Intervals
Bootstrap Confidence Intervals Patrick Breheny September 18 Patrick Breheny STA 621: Nonparametric Statistics 1/22 Introduction Bootstrap confidence intervals So far, we have discussed the idea behind
More information11. Bootstrap Methods
11. Bootstrap Methods c A. Colin Cameron & Pravin K. Trivedi 2006 These transparencies were prepared in 20043. They can be used as an adjunct to Chapter 11 of our subsequent book Microeconometrics: Methods
More informationCharacterizing Forecast Uncertainty Prediction Intervals. The estimated AR (and VAR) models generate point forecasts of y t+s, y ˆ
Characterizing Forecast Uncertainty Prediction Intervals The estimated AR (and VAR) models generate point forecasts of y t+s, y ˆ t + s, t. Under our assumptions the point forecasts are asymtotically unbiased
More informationConfidence Intervals in Ridge Regression using Jackknife and Bootstrap Methods
Chapter 4 Confidence Intervals in Ridge Regression using Jackknife and Bootstrap Methods 4.1 Introduction It is now explicable that ridge regression estimator (here we take ordinary ridge estimator (ORE)
More information4 Resampling Methods: The Bootstrap
4 Resampling Methods: The Bootstrap Situation: Let x 1, x 2,..., x n be a SRS of size n taken from a distribution that is unknown. Let θ be a parameter of interest associated with this distribution and
More informationUnit 14: Nonparametric Statistical Methods
Unit 14: Nonparametric Statistical Methods Statistics 571: Statistical Methods Ramón V. León 8/8/2003 Unit 14 - Stat 571 - Ramón V. León 1 Introductory Remarks Most methods studied so far have been based
More informationSupplemental material to accompany Preacher and Hayes (2008)
Supplemental material to accompany Preacher and Hayes (2008) Kristopher J. Preacher University of Kansas Andrew F. Hayes The Ohio State University The multivariate delta method for deriving the asymptotic
More informationThe Nonparametric Bootstrap
The Nonparametric Bootstrap The nonparametric bootstrap may involve inferences about a parameter, but we use a nonparametric procedure in approximating the parametric distribution using the ECDF. We use
More informationEXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY
EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA, 00 MODULE : Statistical Inference Time Allowed: Three Hours Candidates should answer FIVE questions. All questions carry equal marks. The
More informationChapter 7. Data Partitioning. 7.1 Introduction
Chapter 7 Data Partitioning 7.1 Introduction In this book, data partitioning refers to procedures where some observations from the sample are removed as part of the analysis. These techniques are used
More informationThe bootstrap. Patrick Breheny. December 6. The empirical distribution function The bootstrap
Patrick Breheny December 6 Patrick Breheny BST 764: Applied Statistical Modeling 1/21 The empirical distribution function Suppose X F, where F (x) = Pr(X x) is a distribution function, and we wish to estimate
More informationPreliminaries The bootstrap Bias reduction Hypothesis tests Regression Confidence intervals Time series Final remark. Bootstrap inference
1 / 171 Bootstrap inference Francisco Cribari-Neto Departamento de Estatística Universidade Federal de Pernambuco Recife / PE, Brazil email: cribari@gmail.com October 2013 2 / 171 Unpaid advertisement
More informationPreliminaries The bootstrap Bias reduction Hypothesis tests Regression Confidence intervals Time series Final remark. Bootstrap inference
1 / 172 Bootstrap inference Francisco Cribari-Neto Departamento de Estatística Universidade Federal de Pernambuco Recife / PE, Brazil email: cribari@gmail.com October 2014 2 / 172 Unpaid advertisement
More informationConfidence Intervals for Process Capability Indices Using Bootstrap Calibration and Satterthwaite s Approximation Method
CHAPTER 4 Confidence Intervals for Process Capability Indices Using Bootstrap Calibration and Satterthwaite s Approximation Method 4.1 Introduction In chapters and 3, we addressed the problem of comparing
More informationA Resampling Method on Pivotal Estimating Functions
A Resampling Method on Pivotal Estimating Functions Kun Nie Biostat 277,Winter 2004 March 17, 2004 Outline Introduction A General Resampling Method Examples - Quantile Regression -Rank Regression -Simulation
More informationDouble Bootstrap Confidence Interval Estimates with Censored and Truncated Data
Journal of Modern Applied Statistical Methods Volume 13 Issue 2 Article 22 11-2014 Double Bootstrap Confidence Interval Estimates with Censored and Truncated Data Jayanthi Arasan University Putra Malaysia,
More informationBootstrapping Australian inbound tourism
19th International Congress on Modelling and Simulation, Perth, Australia, 12 16 December 2011 http://mssanz.org.au/modsim2011 Bootstrapping Australian inbound tourism Y.H. Cheunga and G. Yapa a School
More informationBootstrap Confidence Intervals for the Correlation Coefficient
Bootstrap Confidence Intervals for the Correlation Coefficient Homer S. White 12 November, 1993 1 Introduction We will discuss the general principles of the bootstrap, and describe two applications of
More informationON THE NUMBER OF BOOTSTRAP REPETITIONS FOR BC a CONFIDENCE INTERVALS. DONALD W. K. ANDREWS and MOSHE BUCHINSKY COWLES FOUNDATION PAPER NO.
ON THE NUMBER OF BOOTSTRAP REPETITIONS FOR BC a CONFIDENCE INTERVALS BY DONALD W. K. ANDREWS and MOSHE BUCHINSKY COWLES FOUNDATION PAPER NO. 1069 COWLES FOUNDATION FOR RESEARCH IN ECONOMICS YALE UNIVERSITY
More informationFinite Population Correction Methods
Finite Population Correction Methods Moses Obiri May 5, 2017 Contents 1 Introduction 1 2 Normal-based Confidence Interval 2 3 Bootstrap Confidence Interval 3 4 Finite Population Bootstrap Sampling 5 4.1
More informationBootstrap confidence levels for phylogenetic trees B. Efron, E. Halloran, and S. Holmes, 1996
Bootstrap confidence levels for phylogenetic trees B. Efron, E. Halloran, and S. Holmes, 1996 Following Confidence limits on phylogenies: an approach using the bootstrap, J. Felsenstein, 1985 1 I. Short
More informationOne-Sample Numerical Data
One-Sample Numerical Data quantiles, boxplot, histogram, bootstrap confidence intervals, goodness-of-fit tests University of California, San Diego Instructor: Ery Arias-Castro http://math.ucsd.edu/~eariasca/teaching.html
More informationFinding a Better Confidence Interval for a Single Regression Changepoint Using Different Bootstrap Confidence Interval Procedures
Georgia Southern University Digital Commons@Georgia Southern Electronic Theses & Dissertations COGS- Jack N. Averitt College of Graduate Studies Fall 2012 Finding a Better Confidence Interval for a Single
More informationA comparison of four different block bootstrap methods
Croatian Operational Research Review 189 CRORR 5(014), 189 0 A comparison of four different block bootstrap methods Boris Radovanov 1, and Aleksandra Marcikić 1 1 Faculty of Economics Subotica, University
More informationUNIVERSITÄT POTSDAM Institut für Mathematik
UNIVERSITÄT POTSDAM Institut für Mathematik Testing the Acceleration Function in Life Time Models Hannelore Liero Matthias Liero Mathematische Statistik und Wahrscheinlichkeitstheorie Universität Potsdam
More informationBOOTSTRAP CONFIDENCE INTERVALS FOR PREDICTED RAINFALL QUANTILES
INTERNATIONAL JOURNAL OF CLIMATOLOGY Int. J. Climatol. 21: 89 94 (2001) BOOTSTRAP CONFIDENCE INTERVALS FOR PREDICTED RAINFALL QUANTILES PETER K. DUNN* Department of Mathematics and Computing, Uni ersity
More informationExact Inference for the Two-Parameter Exponential Distribution Under Type-II Hybrid Censoring
Exact Inference for the Two-Parameter Exponential Distribution Under Type-II Hybrid Censoring A. Ganguly, S. Mitra, D. Samanta, D. Kundu,2 Abstract Epstein [9] introduced the Type-I hybrid censoring scheme
More informationComparison of Re-sampling Methods to Generalized Linear Models and Transformations in Factorial and Fractional Factorial Designs
Journal of Modern Applied Statistical Methods Volume 11 Issue 1 Article 8 5-1-2012 Comparison of Re-sampling Methods to Generalized Linear Models and Transformations in Factorial and Fractional Factorial
More informationThe exact bootstrap method shown on the example of the mean and variance estimation
Comput Stat (2013) 28:1061 1077 DOI 10.1007/s00180-012-0350-0 ORIGINAL PAPER The exact bootstrap method shown on the example of the mean and variance estimation Joanna Kisielinska Received: 21 May 2011
More informationA Simulation Comparison Study for Estimating the Process Capability Index C pm with Asymmetric Tolerances
Available online at ijims.ms.tku.edu.tw/list.asp International Journal of Information and Management Sciences 20 (2009), 243-253 A Simulation Comparison Study for Estimating the Process Capability Index
More informationThis produces (edited) ORDINARY NONPARAMETRIC BOOTSTRAP Call: boot(data = aircondit, statistic = function(x, i) { 1/mean(x[i, ]) }, R = B)
STAT 675 Statistical Computing Solutions to Homework Exercises Chapter 7 Note that some outputs may differ, depending on machine settings, generating seeds, random variate generation, etc. 7.1. For the
More informationMaximum Likelihood Large Sample Theory
Maximum Likelihood Large Sample Theory MIT 18.443 Dr. Kempthorne Spring 2015 1 Outline 1 Large Sample Theory of Maximum Likelihood Estimates 2 Asymptotic Results: Overview Asymptotic Framework Data Model
More informationBootstrap (Part 3) Christof Seiler. Stanford University, Spring 2016, Stats 205
Bootstrap (Part 3) Christof Seiler Stanford University, Spring 2016, Stats 205 Overview So far we used three different bootstraps: Nonparametric bootstrap on the rows (e.g. regression, PCA with random
More informationBootstrapping Spring 2014
Bootstrapping 18.05 Spring 2014 Agenda Bootstrap terminology Bootstrap principle Empirical bootstrap Parametric bootstrap January 1, 2017 2 / 16 Empirical distribution of data Data: x 1, x 2,..., x n (independent)
More informationUncertainty Quantification for Inverse Problems. November 7, 2011
Uncertainty Quantification for Inverse Problems November 7, 2011 Outline UQ and inverse problems Review: least-squares Review: Gaussian Bayesian linear model Parametric reductions for IP Bias, variance
More informationThe Prediction of Monthly Inflation Rate in Romania 1
Economic Insights Trends and Challenges Vol.III (LXVI) No. 2/2014 75-84 The Prediction of Monthly Inflation Rate in Romania 1 Mihaela Simionescu Institute for Economic Forecasting of the Romanian Academy,
More informationITERATED BOOTSTRAP PREDICTION INTERVALS
Statistica Sinica 8(1998), 489-504 ITERATED BOOTSTRAP PREDICTION INTERVALS Majid Mojirsheibani Carleton University Abstract: In this article we study the effects of bootstrap iteration as a method to improve
More informationOverview of statistical methods used in analyses with your group between 2000 and 2013
Department of Epidemiology and Public Health Unit of Biostatistics Overview of statistical methods used in analyses with your group between 2000 and 2013 January 21st, 2014 PD Dr C Schindler Swiss Tropical
More informationEstimation of Parameters
CHAPTER Probability, Statistics, and Reliability for Engineers and Scientists FUNDAMENTALS OF STATISTICAL ANALYSIS Second Edition A. J. Clark School of Engineering Department of Civil and Environmental
More informationA union of Bayesian, frequentist and fiducial inferences by confidence distribution and artificial data sampling
A union of Bayesian, frequentist and fiducial inferences by confidence distribution and artificial data sampling Min-ge Xie Department of Statistics, Rutgers University Workshop on Higher-Order Asymptotics
More informationChapter 2: Resampling Maarten Jansen
Chapter 2: Resampling Maarten Jansen Randomization tests Randomized experiment random assignment of sample subjects to groups Example: medical experiment with control group n 1 subjects for true medicine,
More informationThe Bootstrap Suppose we draw aniid sample Y 1 ;:::;Y B from a distribution G. Bythe law of large numbers, Y n = 1 B BX j=1 Y j P! Z ydg(y) =E
9 The Bootstrap The bootstrap is a nonparametric method for estimating standard errors and computing confidence intervals. Let T n = g(x 1 ;:::;X n ) be a statistic, that is, any function of the data.
More informationSpring 2012 Math 541B Exam 1
Spring 2012 Math 541B Exam 1 1. A sample of size n is drawn without replacement from an urn containing N balls, m of which are red and N m are black; the balls are otherwise indistinguishable. Let X denote
More informationBootstrap metody II Kernelové Odhady Hustot
Bootstrap metody II Kernelové Odhady Hustot Mgr. Rudolf B. Blažek, Ph.D. prof. RNDr. Roman Kotecký, DrSc. Katedra počítačových systémů Katedra teoretické informatiky Fakulta informačních technologií České
More informationSTAT 135 Lab 5 Bootstrapping and Hypothesis Testing
STAT 135 Lab 5 Bootstrapping and Hypothesis Testing Rebecca Barter March 2, 2015 The Bootstrap Bootstrap Suppose that we are interested in estimating a parameter θ from some population with members x 1,...,
More informationData Mining Chapter 4: Data Analysis and Uncertainty Fall 2011 Ming Li Department of Computer Science and Technology Nanjing University
Data Mining Chapter 4: Data Analysis and Uncertainty Fall 2011 Ming Li Department of Computer Science and Technology Nanjing University Why uncertainty? Why should data mining care about uncertainty? We
More informationinferences on stress-strength reliability from lindley distributions
inferences on stress-strength reliability from lindley distributions D.K. Al-Mutairi, M.E. Ghitany & Debasis Kundu Abstract This paper deals with the estimation of the stress-strength parameter R = P (Y
More informationLecture 28: Asymptotic confidence sets
Lecture 28: Asymptotic confidence sets 1 α asymptotic confidence sets Similar to testing hypotheses, in many situations it is difficult to find a confidence set with a given confidence coefficient or level
More informationBias-corrected Estimators of Scalar Skew Normal
Bias-corrected Estimators of Scalar Skew Normal Guoyi Zhang and Rong Liu Abstract One problem of skew normal model is the difficulty in estimating the shape parameter, for which the maximum likelihood
More informationResampling and the Bootstrap
Resampling and the Bootstrap Axel Benner Biostatistics, German Cancer Research Center INF 280, D-69120 Heidelberg benner@dkfz.de Resampling and the Bootstrap 2 Topics Estimation and Statistical Testing
More informationSampling: A Brief Review. Workshop on Respondent-driven Sampling Analyst Software
Sampling: A Brief Review Workshop on Respondent-driven Sampling Analyst Software 201 1 Purpose To review some of the influences on estimates in design-based inference in classic survey sampling methods
More informationBootstrapping the Confidence Intervals of R 2 MAD for Samples from Contaminated Standard Logistic Distribution
Pertanika J. Sci. & Technol. 18 (1): 209 221 (2010) ISSN: 0128-7680 Universiti Putra Malaysia Press Bootstrapping the Confidence Intervals of R 2 MAD for Samples from Contaminated Standard Logistic Distribution
More informationDouble Bootstrap Confidence Intervals in the Two Stage DEA approach. Essex Business School University of Essex
Double Bootstrap Confidence Intervals in the Two Stage DEA approach D.K. Chronopoulos, C. Girardone and J.C. Nankervis Essex Business School University of Essex 1 Determinants of efficiency DEA can be
More informationTHE EFFECTS OF NONNORMAL DISTRIBUTIONS ON CONFIDENCE INTERVALS AROUND THE STANDARDIZED MEAN DIFFERENCE: BOOTSTRAP AND PARAMETRIC CONFIDENCE INTERVALS
EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT 10.1177/0013164404264850 KELLEY THE EFFECTS OF NONNORMAL DISTRIBUTIONS ON CONFIDENCE INTERVALS AROUND THE STANDARDIZED MEAN DIFFERENCE: BOOTSTRAP AND PARAMETRIC
More informationTests for Assessment of Agreement Using Probability Criteria
Tests for Assessment of Agreement Using Probability Criteria Pankaj K. Choudhary Department of Mathematical Sciences, University of Texas at Dallas Richardson, TX 75083-0688; pankaj@utdallas.edu H. N.
More informationA Classroom Approach to Illustrate Transformation and Bootstrap Confidence Interval Techniques Using the Poisson Distribution
International Journal of Statistics and Probability; Vol. 6, No. 2; March 2017 ISSN 1927-7032 E-ISSN 1927-7040 Published by Canadian Center of Science and Education A Classroom Approach to Illustrate Transformation
More informationModel Selection, Estimation, and Bootstrap Smoothing. Bradley Efron Stanford University
Model Selection, Estimation, and Bootstrap Smoothing Bradley Efron Stanford University Estimation After Model Selection Usually: (a) look at data (b) choose model (linear, quad, cubic...?) (c) fit estimates
More informationA better way to bootstrap pairs
A better way to bootstrap pairs Emmanuel Flachaire GREQAM - Université de la Méditerranée CORE - Université Catholique de Louvain April 999 Abstract In this paper we are interested in heteroskedastic regression
More informationA Comparison of Alternative Bias-Corrections in the Bias-Corrected Bootstrap Test of Mediation
University of Nebraska - Lincoln DigitalCommons@University of Nebraska - Lincoln Public Access Theses and Dissertations from the College of Education and Human Sciences Education and Human Sciences, College
More informationFULL LIKELIHOOD INFERENCES IN THE COX MODEL
October 20, 2007 FULL LIKELIHOOD INFERENCES IN THE COX MODEL BY JIAN-JIAN REN 1 AND MAI ZHOU 2 University of Central Florida and University of Kentucky Abstract We use the empirical likelihood approach
More informationBootstrap inference for the finite population total under complex sampling designs
Bootstrap inference for the finite population total under complex sampling designs Zhonglei Wang (Joint work with Dr. Jae Kwang Kim) Center for Survey Statistics and Methodology Iowa State University Jan.
More informationEmpirical Likelihood
Empirical Likelihood Patrick Breheny September 20 Patrick Breheny STA 621: Nonparametric Statistics 1/15 Introduction Empirical likelihood We will discuss one final approach to constructing confidence
More informationA Signed-Rank Test Based on the Score Function
Applied Mathematical Sciences, Vol. 10, 2016, no. 51, 2517-2527 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/10.12988/ams.2016.66189 A Signed-Rank Test Based on the Score Function Hyo-Il Park Department
More informationNonparametric Inference via Bootstrapping the Debiased Estimator
Nonparametric Inference via Bootstrapping the Debiased Estimator Yen-Chi Chen Department of Statistics, University of Washington ICSA-Canada Chapter Symposium 2017 1 / 21 Problem Setup Let X 1,, X n be
More informationBootstrap Method for Dependent Data Structure and Measure of Statistical Precision
Journal of Mathematics and Statistics 6 (): 84-88, 00 ISSN 549-3644 00 Science Publications ootstrap Method for Dependent Data Structure and Measure of Statistical Precision T.O. Olatayo, G.N. Amahia and
More informationConfidence Measure Estimation in Dynamical Systems Model Input Set Selection
Confidence Measure Estimation in Dynamical Systems Model Input Set Selection Paul B. Deignan, Jr. Galen B. King Peter H. Meckl School of Mechanical Engineering Purdue University West Lafayette, IN 4797-88
More informationOn Modifications to Linking Variance Estimators in the Fay-Herriot Model that Induce Robustness
Statistics and Applications {ISSN 2452-7395 (online)} Volume 16 No. 1, 2018 (New Series), pp 289-303 On Modifications to Linking Variance Estimators in the Fay-Herriot Model that Induce Robustness Snigdhansu
More informationEstimation of Stress-Strength Reliability Using Record Ranked Set Sampling Scheme from the Exponential Distribution
Filomat 9:5 015, 1149 116 DOI 10.98/FIL1505149S Published by Faculty of Sciences and Mathematics, University of Niš, Serbia Available at: http://www.pmf.ni.ac.rs/filomat Estimation of Stress-Strength eliability
More informationBootstrap Approach to Comparison of Alternative Methods of Parameter Estimation of a Simultaneous Equation Model
Bootstrap Approach to Comparison of Alternative Methods of Parameter Estimation of a Simultaneous Equation Model Olubusoye, O. E., J. O. Olaomi, and O. O. Odetunde Abstract A bootstrap simulation approach
More informationInternational Journal of Education & Applied Sciences Research, Vol.3, Issue 06, Aug-Oct- 2016, pp EISSN: , ISSN: (Print)
GENERALIZED PROCESS CAPABILITY INDEX APPLIED TO POISSON PROCESS DISTRIBUTION www.arseam.com Abstract Mahendra Saha Assistant Professor Department of statistics Central University of Rajasthan Bandarsindri,
More informationOn robust and efficient estimation of the center of. Symmetry.
On robust and efficient estimation of the center of symmetry Howard D. Bondell Department of Statistics, North Carolina State University Raleigh, NC 27695-8203, U.S.A (email: bondell@stat.ncsu.edu) Abstract
More informationAnalytical Bootstrap Methods for Censored Data
JOURNAL OF APPLIED MATHEMATICS AND DECISION SCIENCES, 6(2, 129 141 Copyright c 2002, Lawrence Erlbaum Associates, Inc. Analytical Bootstrap Methods for Censored Data ALAN D. HUTSON Division of Biostatistics,
More informationIntroduction to statistics
Introduction to statistics Literature Raj Jain: The Art of Computer Systems Performance Analysis, John Wiley Schickinger, Steger: Diskrete Strukturen Band 2, Springer David Lilja: Measuring Computer Performance:
More informationBOOTSTRAPPING-BASED FIXED-WIDTH CONFIDENCE INTERVALS FOR RANKING AND SELECTION. John W. Fowler
Proceedings of the 2010 Winter Simulation Conference B. Johansson, S. Jain, J. Montoya-Torres, J. Hugan, and E. Yücesan, eds. BOOTSTRAPPING-BASED FIXED-WIDTH CONFIDENCE INTERVALS FOR RANKING AND SELECTION
More informationModel Assisted Survey Sampling
Carl-Erik Sarndal Jan Wretman Bengt Swensson Model Assisted Survey Sampling Springer Preface v PARTI Principles of Estimation for Finite Populations and Important Sampling Designs CHAPTER 1 Survey Sampling
More informationTwo-Sided Generalized Confidence Intervals for C pk
CHAPTER 4 Two-Sided Generalized Confidence Intervals for C pk 4.1 Introduction 9 4. Existing Methods 93 4.3 Two-Sided Generalized Confidence Intervals for C pk 96 4.4 Simulation Results 98 4.5 An Illustration
More informationEXPLICIT NONPARAMETRIC CONFIDENCE INTERVALS FOR THE VARIANCE WITH GUARANTEED COVERAGE
EXPLICIT NONPARAMETRIC CONFIDENCE INTERVALS FOR THE VARIANCE WITH GUARANTEED COVERAGE Joseph P. Romano Department of Statistics Stanford University Stanford, California 94305 romano@stat.stanford.edu Michael
More informationZ score indicates how far a raw score deviates from the sample mean in SD units. score Mean % Lower Bound
1 EDUR 8131 Chat 3 Notes 2 Normal Distribution and Standard Scores Questions Standard Scores: Z score Z = (X M) / SD Z = deviation score divided by standard deviation Z score indicates how far a raw score
More informationApplication of Bootstrap Techniques for the Estimation of Target Decomposition Parameters in RADAR Polarimetry
Application of Bootstrap Techniques for the Estimation of Target Decomposition Parameters in RADAR Polarimetry Samuel Foucher Research & Development Dept Computer Research Institute of Montreal Montreal,
More informationPoint and Interval Estimation II Bios 662
Point and Interval Estimation II Bios 662 Michael G. Hudgens, Ph.D. mhudgens@bios.unc.edu http://www.bios.unc.edu/ mhudgens 2006-09-13 17:17 BIOS 662 1 Point and Interval Estimation II Nonparametric CI
More informationMA30118: MANAGEMENT STATISTICS Assessed Coursework: Quality Control. x ji and r j = max(x ji ) min(x ji ).
1. (a) For each j, Hence, MA0118: MANAGEMENT STATISTICS Assessed Coursework: Quality Control x j = 1 i=1 x ji and r j = max(x ji ) min(x ji ). i i x 21 = 170.9744 = 4.19488, r 21 = 4.2240 4.1760 = 0.0480,
More informationEstimation with Inequality Constraints on Parameters and Truncation of the Sampling Distribution
Estimation with Inequality Constraints on Parameters and Truncation of the Sampling Distribution William A. Barnett, University of Kansas Ousmane Seck, California State University at Fullerton March 18,
More informationNew Bayesian methods for model comparison
Back to the future New Bayesian methods for model comparison Murray Aitkin murray.aitkin@unimelb.edu.au Department of Mathematics and Statistics The University of Melbourne Australia Bayesian Model Comparison
More informationThe assumptions are needed to give us... valid standard errors valid confidence intervals valid hypothesis tests and p-values
Statistical Consulting Topics The Bootstrap... The bootstrap is a computer-based method for assigning measures of accuracy to statistical estimates. (Efron and Tibshrani, 1998.) What do we do when our
More informationBootstrap Testing in Econometrics
Presented May 29, 1999 at the CEA Annual Meeting Bootstrap Testing in Econometrics James G MacKinnon Queen s University at Kingston Introduction: Economists routinely compute test statistics of which the
More informationEstimation of Parameters and Variance
Estimation of Parameters and Variance Dr. A.C. Kulshreshtha U.N. Statistical Institute for Asia and the Pacific (SIAP) Second RAP Regional Workshop on Building Training Resources for Improving Agricultural
More informationAppendix D INTRODUCTION TO BOOTSTRAP ESTIMATION D.1 INTRODUCTION
Appendix D INTRODUCTION TO BOOTSTRAP ESTIMATION D.1 INTRODUCTION Bootstrapping is a general, distribution-free method that is used to estimate parameters ofinterest from data collected from studies or
More informationIntroduction to Statistical Inference
Introduction to Statistical Inference Dr. Fatima Sanchez-Cabo f.sanchezcabo@tugraz.at http://www.genome.tugraz.at Institute for Genomics and Bioinformatics, Graz University of Technology, Austria Introduction
More informationGeneral Regression Model
Scott S. Emerson, M.D., Ph.D. Department of Biostatistics, University of Washington, Seattle, WA 98195, USA January 5, 2015 Abstract Regression analysis can be viewed as an extension of two sample statistical
More informationNONINFORMATIVE NONPARAMETRIC BAYESIAN ESTIMATION OF QUANTILES
NONINFORMATIVE NONPARAMETRIC BAYESIAN ESTIMATION OF QUANTILES Glen Meeden School of Statistics University of Minnesota Minneapolis, MN 55455 Appeared in Statistics & Probability Letters Volume 16 (1993)
More informationA Practitioner s Guide to Cluster-Robust Inference
A Practitioner s Guide to Cluster-Robust Inference A. C. Cameron and D. L. Miller presented by Federico Curci March 4, 2015 Cameron Miller Cluster Clinic II March 4, 2015 1 / 20 In the previous episode
More informationBootstrapping Dependent Data in Ecology
Bootstrapping Dependent Data in Ecology Mark L Taper Department of Ecology 310 Lewis Hall Montana State University/ Bozeman Bozeman, MT 59717 < taper@ rapid.msu.montana.edu> Introduction I have two goals
More informationBOOTSTRAP CONFIDENCE INTERVALS FOR VARIANCE COMPONENTS IN THE UNBALANCED RANDOM ONE WAY MODEL M.A.T. ElshahaT 1 and E.H.
BOOTSTRAP CONFIDENCE INTERVALS FOR VARIANCE COMPONENTS IN THE UNBALANCED RANDOM ONE WAY MODEL MAT ElshahaT 1 and EH Abd El-Sattar 2 1 Faculty of Business, University of Jeddah, Kingdom of Saudi Arabia
More informationEstimation of Operational Risk Capital Charge under Parameter Uncertainty
Estimation of Operational Risk Capital Charge under Parameter Uncertainty Pavel V. Shevchenko Principal Research Scientist, CSIRO Mathematical and Information Sciences, Sydney, Locked Bag 17, North Ryde,
More informationGraphical Presentation of a Nonparametric Regression with Bootstrapped Confidence Intervals
Graphical Presentation of a Nonparametric Regression with Bootstrapped Confidence Intervals Mark Nicolich & Gail Jorgensen Exxon Biomedical Science, Inc., East Millstone, NJ INTRODUCTION Parametric regression
More informationA Simulation Study on Confidence Interval Procedures of Some Mean Cumulative Function Estimators
Statistics Preprints Statistics -00 A Simulation Study on Confidence Interval Procedures of Some Mean Cumulative Function Estimators Jianying Zuo Iowa State University, jiyizu@iastate.edu William Q. Meeker
More informationAN EMPIRICAL COMPARISON OF BLOCK BOOTSTRAP METHODS: TRADITIONAL AND NEWER ONES
Journal of Data Science 14(2016), 641-656 AN EMPIRICAL COMPARISON OF BLOCK BOOTSTRAP METHODS: TRADITIONAL AND NEWER ONES Beste H. Beyaztas a,b, Esin Firuzan b* a Department of Statistics, Istanbul Medeniyet
More information