Finite Population Sampling and Inference

Transcription

1 Finite Population Sampling and Inference A Prediction Approach RICHARD VALLIANT ALAN H. DORFMAN RICHARD M. ROYALL A Wiley-Interscience Publication JOHN WILEY & SONS, INC. New York Chichester Weinheim Brisbane Singapore Toronto

2 Contents Preface 1. Introduction to Prediction Theory 1.1 Sampling Theory and the Rest of Statistics, Prediction Theory, Probability Sampling Theory, Techniques Used in Probability Sampling, Some Mathematical Details, Which Approach to Use?, Why Use Random Sampling?, 19 Exercises, Prediction Theory Under the General Linear Model 2.1 Definitions and a Simple Example, General Prediction Theorem, ÄLC/Predictor Under Some Simple Models, Unit Weights, * Asymptotic Normality of the BLU Predictor, Ignorable and Nonignorable Sample Selection Methods, Examples, * Formal Definition of Ignorable Selection, * Comparisons with Design-Based Regression Estimation, 40 Exercises, Bias-Robustness 3.1 Design and Bias, Polynomial Framework and Balanced Samples, 53

3 VÜi CONTENTS Expansion Estimator and Balanced Samples, * Order of the Bias of the Expansion Estimator, Ratio Estimator and Balanced Samples, Bias-Robust Strategies, Simulation Study to Illustrate Conditional Biases and Mean Squared Errors, Balance and Multiple Y Variables, Weighted Balance, Elementary Estimators Unbiased Under Weighted Balance, BLU Estimators and Weighted Balance, Methods of Selecting Balanced Samples, Simple Random Sampling, Systematic Equal Probability Sampling, Stratification Based on the Auxiliary, Restricted Random Sampling, Sampling for Weighted Balance, Restricted pps Sampling, Partial Balancing, Simulation Study of Weighted Balance, Results Using the Hospitals Population, Interaction of Model Specification with Sample Configuration, Summary, Robustness and Design-Based Inference, 85 Exercises, Robustness and Efficiency Introduction, General Linear Model, BLU Predictor Under the General Linear Model with Diagonal Variance Matrix, Examples of Minimal Models, Comparisons Using an Artificial Population, Results for Probability Proportional to x Sampling and x-balance, Results for Probability Proportional to x 1/2 Sampling and x 1/2 -Balance, Results for Equal Probability Systematic Sampling and Simple Balance, 110

4 4.4 Sample Size Determination, Summary and Perspective, * Remarks on Design-Based Inference, 119 Exercises, 122 Variance Estimation 5.1 Examples of Robust Variance Estimation, Homoscedastic Through the Origin Model, Variance Estimators for the Ratio Estimator, Variance Estimation of a Linear Function of the Parameter, 5.3 Sandwich Estimator of Variance, Consistency of v R, Some Comments on the Requirements for Consistency of the Sandwich Estimator, Variants on the Basic Robust Variance Estimator, Internal and External Adjustments to the Sandwich Estimator, Jackknife Variance Estimator, Variance Estimation for Totais, Some Simple Examples, Effect of a Large Sampling Fraction, Misspecification of the Regression Component, Hidden Regression Components, Some Artificial Examples, Counties 70 Population, Lurking Discrete Skewed Variables, Comparisons with Design-Based Variance Estimation, 161 Exercises, 164 Stratified Populations 6.1 Stratification with Homogeneous Subpopulations, Stratified Linear Model and Weighted Balanced Samples, Optimal Allocation for Stratified Balanced Sampling, Case of a Single Model for the Population, Case of a Single Auxiliary Variable, Sampling Fractions Greater Than 1, Allocation to Strata in More Complicated Cases, Contrasts Between Strata, More Than One Target Variable, 184

5 X CONTENTS 6.5 Two Traditional Topics, Efficiency of the Separate Ratio Estimator, Formation of Strata, Some Empirical Results on Strata Formation, Variance Estimation in Stratified Populations, Stratification in Design-Based Theory, 200 Exercises, Models with Qualitative Auxiliaries Simple Example, Factors, Levels, and Effects, Generalized Inverses, Estimating Linear Combinations of the Y's, One-Way Classification, Two-Way Nested Classification, Two-Way Classification Without Interaction, Two-Way Classification With Interaction, Combining Qualitative and Quantitative Auxiliaries, General Covariance Model, One-Way Classification with a Single Covariate, Examples, Variance Estimation, Basic Robust Alternatives, Jackknife Variance Estimator, 240 Exercises, Clustered Populations Intracluster Correlation Model for a Clustered Population, Discussion of the Common Mean Model, Simple Sample Designs, Class of Unbiased Estimators Under the Common Mean Model, One-Stage Cluster Sampling, BLU Predictor, Variance Component Model, Estimation of Parameters in the Constant Parameter Model, ANOVA Estimators, * Maximum Likelihood Estimators, 258

6 CONTENTS xi 8.3.3* Lower Bound on the Intracluster Correlation, Simulation Study for the Common Mean Model, Biases of Common Mean Estimators Under a More General Model, Estimation Under a More General Regression Model, * Robustness and Optimality, Efficient Design for the Common Mean Model, Choosing the Set of Sample Clusters for the BLU Estimator, Choosing the Set of Sample Clusters for the Unbiased Estimators, Optimal Allocation of Second-Stage Units Given a Fixed Set of First-Stage Sample Units, Optimal First and Second-Stage Allocation Considering Costs, * Estimation When Cluster Sizes Are Unknown, Two-Stage Sampling in Design-Based Practice, 287 Exercises, Robust Variance Estimation in Two-Stage Cluster Sampling Common Mean Model and a General Class of Variance Estimators, * Other Variance Estimators, * Non-Robust ANOVA Estimator, * Alternative Robust Variance Estimators, Examples of the Variance Estimators, Ratio Estimator, Mean of Ratios Estimator, Numerical Illustrations, * Variance Estimation for an Estimated Total Unknown Cluster Sizes, Regression Estimator, Sandwich Variance Estimator, Adjustments to the Sandwich Estimator, Jackknife Estimator, Comparisons of Variance Estimators in a Simulation Study, 318 Exercises, Alternative Variance Estimation Methods Estimating the Variance of Estimators of Nonlinear

7 CONTENTS xi 8.3.3* Lower Bound on the Intracluster Correlation, Simulation Study for the Common Mean Model, Biases of Common Mean Estimators Under a More General Model, Estimation Under a More General Regression Model, * Robustness and Optimality, Efficient Design for the Common Mean Model, Choosing the Set of Sample Clusters for the 2?L /Estimator, Choosing the Set of Sample Clusters for the Unbiased Estimators, Optimal Allocation of Second-Stage Units Given a Fixed Set of First-Stage Sample Units, Optimal First and Second-Stage Allocation Considering Costs, * Estimation When Cluster Sizes Are Unknown, Two-Stage Sampling in Design-Based Practice, 287 Exercises, Robust Variance Estimation in Two-Stage Cluster Sampling Common Mean Model and a General Class of Variance Estimators, * Other Variance Estimators, * Non-Robust ANOVA Estimator, * Alternative Robust Variance Estimators, Examples of the Variance Estimators, Ratio Estimator, Mean of Ratios Estimator, Numerical Ulustrations, * Variance Estimation for an Estimated Total Unknown Cluster Sizes, Regression Estimator, Sandwich Variance Estimator, Adjustments to the Sandwich Estimator, Jackknife Estimator, Comparisons of Variance Estimators in a Simulation Study, 318 Exercises, Alternative Variance Estimation Methods Estimating the Variance of Estimators of Nonlinear

8 Functions, Variance Estimation for a Ratio of Estimated Totais, Jackknife and Nonlinear Functions, Balanced Half-Sample Variance Estimation, Application to the Stratified Expansion Estimator, Orthogonal Arrays, Extension to Nonlinear Functions, Two-Stage Sampling, Other Forms of the BHS Variance Estimator, Partially Balanced Half-Sampling, Design-based Properties, Generalized Variance Functions, Some Theory for GVFs, Estimation of GVF Parameters, 347 Exercises, 348 CONTENTS Special Topics and Open Questions Estimation in the Presence of Outliers, Gross Error Model, Simple Regression Model, Areas for Research, Nonlinear Models, Model for Bernoulli Random Variables, Areas for Research, Nonparametric Estimation of Totais, Nonparametric Regression for Totais, Nonparametric Calibration Estimation, Distribution Function and Quantile Estimation, Estimation Under Homogeneous and Stratified Models, Estimation off^-) Under a Regression Model, Large Sample Properties, The Effect of Model Misspecification, Design-Based Approaches, Nonparametric Regression-Based Estimators, Some Open Questions, Small Area Estimation, 394

9 CONTENTS xüi Estimation When Cell Means Are Unrelated, Cell Means Determined by Class but Uncorrelated, Synthetic and Composite Estimators, Using Auxiliary Data, Auxiliary Data at the Cell Level, Need for a Small Area Estimation Canon, 406 Exercises, 407 Appendix A. Some Basic Tools 413 A.l Orders of Magnitude, 0( ) and o( ), 413 A.2 Convergence in Probability and in Distribution, 413 A.3 Probabilistic Orders of Magnitude, O p () and o p (-), 414 A.4 Chebyshev's Inequality, 414 A.5 Cauchy-Schwarz Inequality, 414 A.6 Slutsky's Theorem, 414 A.7 Taylor's Theorem, 415 A.7.1 Univariate Version, 415 A.7.2 Multivariate Version, 415 A.8 Central Limit Theorems for Independent, not Identically Distributed Random Variables, 415 A.9 Central Limit Theorem for Simple Random Sampling, 416 A.10 Generalized Inverse of a Matrix, 417 Appendix B. Datasets 420 B.l Cancer Population, 422 B.2 Hospitals Population, 424 B.3 Counties 60 Population, 428 B.4 Counties 70 Population, 431 B.5 Labor Force Population, 434 B.6 Third Grade Population, 444 Appendix C. S-PLUS Functions 446 Bibliography 460 Answers to Select Exercises 474 Author Index 484 Subject Index 488