Investigation of Partially Conditional RP Model with Response Error. Ed Stanek

Similar documents
CHAPTER 4 RADICAL EXPRESSIONS

STATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS. x, where. = y - ˆ " 1

{ }{ ( )} (, ) = ( ) ( ) ( ) Chapter 14 Exercises in Sampling Theory. Exercise 1 (Simple random sampling): Solution:

ESS Line Fitting

Econometric Methods. Review of Estimation

Simple Linear Regression

STK4011 and STK9011 Autumn 2016

TESTS BASED ON MAXIMUM LIKELIHOOD

Objectives of Multiple Regression

Class 13,14 June 17, 19, 2015

Chapter 5 Properties of a Random Sample

Lecture 7. Confidence Intervals and Hypothesis Tests in the Simple CLR Model

Ordinary Least Squares Regression. Simple Regression. Algebra and Assumptions.

X X X E[ ] E X E X. is the ()m n where the ( i,)th. j element is the mean of the ( i,)th., then

Point Estimation: definition of estimators

ENGI 4421 Propagation of Error Page 8-01

Econ 388 R. Butler 2016 rev Lecture 5 Multivariate 2 I. Partitioned Regression and Partial Regression Table 1: Projections everywhere

Chapter 4 Multiple Random Variables

THE ROYAL STATISTICAL SOCIETY 2016 EXAMINATIONS SOLUTIONS HIGHER CERTIFICATE MODULE 5

Wu-Hausman Test: But if X and ε are independent, βˆ. ECON 324 Page 1

MOLECULAR VIBRATIONS

Rademacher Complexity. Examples

Lecture Notes 2. The ability to manipulate matrices is critical in economics.

Collapsing to Sample and Remainder Means. Ed Stanek. In order to collapse the expanded random variables to weighted sample and remainder

CHAPTER VI Statistical Analysis of Experimental Data

Lecture 3. Sampling, sampling distributions, and parameter estimation

LECTURE - 4 SIMPLE RANDOM SAMPLING DR. SHALABH DEPARTMENT OF MATHEMATICS AND STATISTICS INDIAN INSTITUTE OF TECHNOLOGY KANPUR

Chapter 3 Sampling For Proportions and Percentages

Chapter 13, Part A Analysis of Variance and Experimental Design. Introduction to Analysis of Variance. Introduction to Analysis of Variance

X ε ) = 0, or equivalently, lim

ECON 482 / WH Hong The Simple Regression Model 1. Definition of the Simple Regression Model

9 U-STATISTICS. Eh =(m!) 1 Eh(X (1),..., X (m ) ) i.i.d

Functions of Random Variables

means the first term, a2 means the term, etc. Infinite Sequences: follow the same pattern forever.

ρ < 1 be five real numbers. The

12.2 Estimating Model parameters Assumptions: ox and y are related according to the simple linear regression model

( ) = ( ) ( ) Chapter 13 Asymptotic Theory and Stochastic Regressors. Stochastic regressors model

Lecture Notes Forecasting the process of estimating or predicting unknown situations

Multiple Regression. More than 2 variables! Grade on Final. Multiple Regression 11/21/2012. Exam 2 Grades. Exam 2 Re-grades


1. The weight of six Golden Retrievers is 66, 61, 70, 67, 92 and 66 pounds. The weight of six Labrador Retrievers is 54, 60, 72, 78, 84 and 67.

ENGI 4421 Joint Probability Distributions Page Joint Probability Distributions [Navidi sections 2.5 and 2.6; Devore sections

2SLS Estimates ECON In this case, begin with the assumption that E[ i

To use adaptive cluster sampling we must first make some definitions of the sampling universe:

STA302/1001-Fall 2008 Midterm Test October 21, 2008

For combinatorial problems we might need to generate all permutations, combinations, or subsets of a set.

Lecture 8: Linear Regression

1 Solution to Problem 6.40

Derivation of 3-Point Block Method Formula for Solving First Order Stiff Ordinary Differential Equations

A Combination of Adaptive and Line Intercept Sampling Applicable in Agricultural and Environmental Studies

Sampling Theory MODULE X LECTURE - 35 TWO STAGE SAMPLING (SUB SAMPLING)

Special Instructions / Useful Data

Example: Multiple linear regression. Least squares regression. Repetition: Simple linear regression. Tron Anders Moger

Chapter 2 Supplemental Text Material

Lecture 2: The Simple Regression Model

Lecture 1: Introduction to Regression

7.0 Equality Contraints: Lagrange Multipliers

Summary of the lecture in Biostatistics

Mu Sequences/Series Solutions National Convention 2014

Chapter 14 Logistic Regression Models

Part 4b Asymptotic Results for MRR2 using PRESS. Recall that the PRESS statistic is a special type of cross validation procedure (see Allen (1971))

Discrete Mathematics and Probability Theory Fall 2016 Seshia and Walrand DIS 10b

ENGI 3423 Simple Linear Regression Page 12-01

Assignment 5/MATH 247/Winter Due: Friday, February 19 in class (!) (answers will be posted right after class)

2/20/2013. Topics. Power Flow Part 1 Text: Power Transmission. Power Transmission. Power Transmission. Power Transmission

18.413: Error Correcting Codes Lab March 2, Lecture 8

hp calculators HP 30S Statistics Averages and Standard Deviations Average and Standard Deviation Practice Finding Averages and Standard Deviations

Chapter -2 Simple Random Sampling

Multivariate Transformation of Variables and Maximum Likelihood Estimation

Bayes (Naïve or not) Classifiers: Generative Approach

Chapter -2 Simple Random Sampling

2.28 The Wall Street Journal is probably referring to the average number of cubes used per glass measured for some population that they have chosen.

Lecture 2: Linear Least Squares Regression

Handout #8. X\Y f(x) 0 1/16 1/ / /16 3/ / /16 3/16 0 3/ /16 1/16 1/8 g(y) 1/16 1/4 3/8 1/4 1/16 1

Lecture 3 Probability review (cont d)

Chapter 11 Systematic Sampling

(b) By independence, the probability that the string 1011 is received correctly is

MATH 247/Winter Notes on the adjoint and on normal operators.

Feature Selection: Part 2. 1 Greedy Algorithms (continued from the last lecture)

CIS 800/002 The Algorithmic Foundations of Data Privacy October 13, Lecture 9. Database Update Algorithms: Multiplicative Weights

Midterm Exam 1, section 1 (Solution) Thursday, February hour, 15 minutes

Lecture Note to Rice Chapter 8

Introduction to Matrices and Matrix Approach to Simple Linear Regression

Simple Linear Regression and Correlation.

CS286.2 Lecture 4: Dinur s Proof of the PCP Theorem

Chapter Two. An Introduction to Regression ( )

Lecture 1: Introduction to Regression

Solving Constrained Flow-Shop Scheduling. Problems with Three Machines

Descriptive Statistics

Chapter 4 Multiple Random Variables

Mean is only appropriate for interval or ratio scales, not ordinal or nominal.

UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS

ECON 5360 Class Notes GMM

Bounds on the expected entropy and KL-divergence of sampled multinomial distributions. Brandon C. Roy

The Mathematics of Portfolio Theory

A Primer on Summation Notation George H Olson, Ph. D. Doctoral Program in Educational Leadership Appalachian State University Spring 2010

The number of observed cases The number of parameters. ith case of the dichotomous dependent variable. the ith case of the jth parameter

The equation is sometimes presented in form Y = a + b x. This is reasonable, but it s not the notation we use.

ε. Therefore, the estimate

The Mathematical Appendix

Transcription:

Partally Codtoal Radom Permutato Model 7- vestgato of Partally Codtoal RP Model wth Respose Error TRODUCTO Ed Staek We explore the predctor that wll result a smple radom sample wth respose error whe a dfferet model s postulated We call ths model a partally codtoal model The results ths documet were developed c06ed06doc The prcpal dfferece s that we mage that whe addg respose error, we cosder the model W Uy uw stead of the model * * W Uy UW A smple example llustrates that the model for μ U β uw s meagful, eve though the model cludes both U ad ts realzato, u For example, let X represet a radom varable wth equally lkely realzatos, x j j, for j,,, ad Z represet a secod radom varable wth equally lkely realzatos, zj j, for j,, Wthout ambguty, we ca express Z X x, x s a realzato of X the model for, the dcator radom varables U correspod to X EXAMPLE OF ALTERATVE PREDCTOR WTH RESPOSE ERROR Settg: Expected Respose: y s s,, Respose: sk ys Wsk k,, r s dex of order of measure 3, u,, dex for possble values of respose error equally lkely Assumptos: EW sk 0 for all s,,, k,, r s var Wsk s for all s,,, k,, r s var Wsk, W s* k* 0 for all s,, ; s*,, ; k,, r s k* k,, r s Parameters: μ ys, βs ys μ, y s μ, e se s s ; s 3 FTE POPULATO otato ad termology C07ed63doc /9/008 6:33 PM

Partally Codtoal Radom Permutato Model 7- Expected Respose: y s s,, Respose: sk ys Wsk k,, r s dex of order of measure Assumptos: EW sk 0 for all s,,, k,, r s W var sk se for all s,,, k,, r s var Wsk, W s* k* 0 for all s,, ; s*,, ; k,, r s k* k,, r s Assume r s for all s,, so that k measure of respose Parameters: μ ys, βs ys μ, ys μ, e se s s s Addtoal otato: U U U U, Defe y y y y, sk k k k Uy, R sk k k k W W W W W ad U U U U U u u u u u W uw uw s sk s k Uy uw W yu Wu vec y vec U W vec u 4 DEFE THE EXPADED MODEL Let sk Us ys uswsk s Wsk s Us ys ad W sk uswsk Defe ; C07ed63doc /9/008 6:33 PM

Partally Codtoal Radom Permutato Model 7-3 ys U y Uy Uy U s W Wsk u Wk uwk uwk u s Wk Wk Wk W U y u W U y u W U y u W k k k Defe the expaded radom varables as Uy Uy Uy uw k uwk uw k Uy Uy Uy uwk uwk uw k vec vec or Uy Uy Uy uwk uwk uwk W uw k uw k uw k uw k uw k uw k vec W, uwk uwk uwk vec 5 EXPECTED VALUE AD VARACE Deote expected value wth respect to samplg va a subscrpt, ad expected value wth respect to respose error va a subscrpt R E y W 0 so that E R E y R Expected Value: C07ed63doc /9/008 6:33 PM 3

Partally Codtoal Radom Permutato Model 7-4 Varace: varr E varr var ER E varr W var ow, uw k uw k uw k uw k uw k uw k varr vec W uwk uwk uwk Du W Du W Du W var R vec D D D D D D D D D D D D D D D D D D Du D D w u D u D D D D D u w u u w u u w u u w u u w u u w u w u u w u u 0 0 0 u 0 D u ad 0 0 u We express ths as var R W Dvec u D D w vec u D w e 0 0 0 e 0 0 0 e Usg ths expresso, or var D D D P Δ vec u w vec u R var P Δ Δ y s P y s, ad s s 6 COLLAPSG TO THE USUAL RADOM VARABLES We collapse the expaded radom varables to a vector of the usual radom varables To do so, we pre-multply by The C07ed63doc /9/008 6:33 PM 4

Partally Codtoal Radom Permutato Model 7-5 s s s s s s s sk s sk s sk s s s s s s vec U y U y U y vec u W u W u W k k k vec vec W W W W W ad var k uswsk s Also, we fd that E R vec vec u u D D D P Δ R w ow vec u We defe D u ad Δ As a result, var R u D w u P e ud u w us se s ud u w μ P Ths defto makes use of a assumpto that oly oe elemet of u s s oe, ad all others are zero t would be possble to make other assumptos about the elemets, u s for,, ad s,, The k e P var R e e k 7 PARTTOG TO THE SAMPLE AD REMADER C07ed63doc /9/008 6:33 PM 5

Partally Codtoal Radom Permutato Model 7-6 We defe sample ad remader radom varables by parttog usg 0 L L, resultg L 0 L x k k k k ad X The, E R μ ad var X k var R k k k k k R V V, V, V 8 TARGET PARAMETERS, RADOM VARABLES, AD TERMOLOG We assume that there s a terest a target that ca be defed as a lear combato of the expected value over respose error of the collapsed radom varables We use the sample data to estmate/predct the target f the target s a fxed costat, the we use the sample data to estmate the target f the target s a radom varable, the we use the sample data to predct the target We oly cosder ferece for a sgle target ot jot targets We represet collapsed radom varables by E R L ad partto g represetg We defe a target as P g P g g g g g so that 9 DEVELOPG THE BEST LEAR UBASED PREDCTOR BLUP 976: We defe the BLUP of P as P, P satsfes the followg crtera see Royall, Lear the sample: P g Ubased: E 0 R P P Mmum MSE: var R P P a s mmzed C07ed63doc /9/008 6:33 PM 6

Partally Codtoal Radom Permutato Model 7-7 order to develop the BLUP of P, we frst preset expressos for P P ad ts varace Frst, ote that P P g a g g V V, We represet var The V, V V V V, var R V V V, V, V, V Recall that V k ad V Let us defe k VR k so that V V V R The 0 VR 0 0 V V, 0 var R 0, 0 0 0 0 0 0 V V 0 0 0 The Ubased Costrat: We ca expad the ubased costrat: X E P P a g γ, such that X E P P ax g X γ order for ths expresso to equal zero for ay value of γ, the ubased costrat wll be always be satsfed whe ax g X 0 Ths s troduced as a costrat usg Lagraga multplers whe mmzg the MSE Fdg the Mmum MSE: otce that V V V, g a var R P P g a g g V V V, g, or,, V V V g V V, a var R P P a g g a VR g a V, V g C07ed63doc /9/008 6:33 PM 7

Partally Codtoal Radom Permutato Model 7-8 Expadg ths expresso, var P P, av a g V g V a g V g g V g R R cludg the costrat va a Lagraga multpler, we seek to fd the value of a that wll mmze f a, λ av a g VR g V, a ax g X λ g Vg gvr g Dfferetatg wth respect to a ad λ, f a, λ Va V Rg V, g Xλ ad a f a, λ Xa Xg λ f a, λ, we set these dervatves to zero smultaeously, To fd the value of a that mmzes ad solve for a The estmatg equatos are gve by f a, λ a V X a VR g V, g 0 f, a λ X 0 λ Xg 0 λ V X a VR g V, g or equvaletly, by The soluto to ths equato s gve X 0 λ Xg by a, V V X X V X X V V g V g V X X V X X g We ca ow express the best lear ubased predctor Recall that P g g, P g a, the best predctor replaces a by â Let us defe R ad we predct P by α X V X X V The a g VR g V, V V X X V X X V α α, α g X X V X X V g VR V X g X V V X As a result, the best lear ubased predctor s gve by P g, R α α α V V X g X V V X We ca express the predctor a slghtly dfferet maer by substtutg VR V V, resultg C07ed63doc /9/008 6:33 PM 8

Partally Codtoal Radom Permutato Model 7-9 Example Target:, P g α α α α X V V X g X V V X Collapsg: usual radom varables otce that V k The The R su R ur s R sur Let R The R k Also, let k u ad s The k ur s k fk k k The ur s Also, R s k k fk k k k k k, ad ur k k The these results, V k k kk fk ow α X V X X V ad X The X V X kk fk k k fk k k k fk k k so that fk fk X V X The, k R sur kk Usg C07ed63doc /9/008 6:33 PM 9

Partally Codtoal Radom Permutato Model 7-0 α fk X V X X V k kk k fk fk k k fk k fk k fk k k k ext, we smplfy the expresso for V V k kk fk k kk fk k kk k fk kk fk k k kk k fk fk fk k kk k fk fk k kk k fk fk k k k fk or V V k k k Fally, we use these expressos to evaluate fk P, α g α α α X V V X g X V V X whe g e ad g 0 The C07ed63doc /9/008 6:33 PM 0

Partally Codtoal Radom Permutato Model 7- α P g α X V V X e k k k k k fk k k k k k e e k k fk k k k 0 k 0 k k k fk k k We smplfy ths further otce that 0 k 0 k k P k k k k k fk k k 0 k 0 k k k k k k k k fk k k k 0 k 0 k k k We re-express ths equato so as to form a devato the secod part As a result, k P k 0 k 0 k k k k k 0 0 k k k k k k k k Thus, whe, P μ k μ μ k, k k e e e e ud u w us se otce that the weghts are gve by w s e e Ths predctor s dfferet from the predctor developed the earler settg whch was gve by * * * P e ad C07ed63doc /9/008 6:33 PM