Estimation: Part 2. Chapter GREG estimation
|
|
- Verity Wilson
- 5 years ago
- Views:
Transcription
1 Chapter 9 Estmaton: Part 2 9. GREG estmaton In Chapter 8, we have seen that the regresson estmator s an effcent estmator when there s a lnear relatonshp between y and x. In ths chapter, we generalzed the concept of regresson estmaton to a more general class of models for developng model-asssted estmaton. To motvate the proposed estmator, we frst ntroduce dfferent estmator. Suppose that a proxy value of y, denoted by y 0), throughout the populaton. The dfferent estmator of Y = y usng y 0) Ŷ dff =,,y0) s defned as y 0 + y y 0 ). 9.) The dfference estmator s unbased regardless of the choce of y 0). The varance of the dfference estmator s Var ) ) d Ŷ dff = Var where d = y y 0. Under SRS, the varance s 2 n n ) d d ) 2.
2 2 CHAPTER 9. ESTIMATIO: PART 2 Thus, the dfference estmator s unbased regardless of y 0) but ts varances are dfferent for dfferent choce of y 0). If y 0) s close to the true value of y, then the varance wll be small. In practce, we do not know y 0). Instead, we use auxlary varable x to construct a model for y and develop y 0) from the model. That s, we assume that the fnte populaton s a random sample from a superpopulaton model that has generated the current fnte populaton. One of the commonly used superpopulaton model s E ζ y ) = x β 9.2) Cov ζ y,y j ) = c σ 2 f = j 0 f j 9.3) where c = cx ) s a known functon of x and β are σ 2 are unknown parameters. Model 9.3) s often called the generalzed regresson GREG) model. Under the GREG model n 9.3), the model-based estmator s defned to be the sum of the predcted values n the GREG model. That s, we defne Ŷ GREG = ŷ 9.4) where ŷ = x ˆβ and ˆβ = ) x x c x y. 9.5) c ote that ˆβ converges to the followng fnte populaton quantty B = x x ) c x y, 9.6) c whch s the best estmator of β under Census. The model-based estmator n 9.4) s developed under the GERG model n 9.3). Thus, t s often called GREG estmator. The followng lemma shows that the GREG estmator n 9.4) s asymptotcally equvalent to the dfference estmator n 9.).
3 9.. GREG ESTIMATIO 3 Lemma 9.. Under some regularty condtons, f c satsfes c = λ x for some λ, the GREG estmator n 9.4) satsfes where B s defned n 9.5). Ŷ GREG = x B + Proof. If c = λ x holds for some λ, and we can wrte Ŷ GREG = ŷ = λ x x c ˆβ = λ x y c y x π B) 9.7) = λ x y = c y x ˆβ + y x ˆβ ) = Ŷ HT + X ˆX HT ) ˆβ = Ŷ HT + X ˆX HT ) B + X ˆX HT ) ˆβ B ) and the last term s neglgble under some regularty condtons. and By 9.7), we can establsh that E Ŷ GREG ) = Y 9.8) Var ) Ŷ GREG = Var π y x B ). 9.9) If E = y x B were observed, the varance 9.9) would be estmated by Var Ŷ GREG ) = j A j j E E j.
4 4 CHAPTER 9. ESTIMATIO: PART 2 If we use e = y x ˆβ nstead of E, a consstent varance estmator s computed by ˆV GREG = j A Example 9.. Rakng rato estmaton) j j e e j. 9.0) Suppose that we have I J groups or cells. Cell counts j are not known. Margnal counts = J j= j and j = I j are known. In ths case, we may consder the followng two-way addtve model E ζ Y k ) = α + β j V ζ Y k ) = σ 2 where α, β j, and σ 2 are unknown parameters. Defne δ jk = f k U j 0 otherwse. Unfortunately, we do not observe δ jk n the populaton. Let x k = δ,k,δ 2 k,,δ I k,δ k,δ 2k,,δ Jk ) and we know k= x k. The GREG estmator n ths case can be wrtten as Ŷ GREG = g A)y where g A) = + x k k= k A x k π k ) k A ) x k x k x. π k Unfortunately, we cannot compute the nverse of k A π k x k x k because ts rank s I + J, whch s not full rank. Thus, there s no unque soluton ˆB to π x x ˆB = π x y.
5 9.2. OPTIMAL ESTIMATIO 5 The goal s to fnd g ka = g k A) such that g ka δ,k = k A π k g ka δ jk = k A π k δ k, =,2,,I 9.) k= δ jk, j =,2,,J. 9.2) k= One way to obtan the soluton to 9.) and 9.2) s to solve the equatons teratvely as follows:. Start wth g 0) ka =. 2. For δ k =, g t+) ka = g t) k= δ k ka k A g t) ka δ. k/π k It satsfes 9.), but not necessarly satsfy 9.2). 3. For δ jk =, g t+2) ka = g t+) ka k= δ jk k A g t+) ka δ jk /π k. It satsfes 9.2), but not necessarly satsfy 9.). 4. Set t t + 2 and go to Step 2. Contnue untl convergence. Such computaton method s called rakng rato estmaton and was frst consdered by Demng and Stephan 940) n the Census applcaton. See also Devlle, et al. 993). 9.2 Optmal Estmaton So far, we have dscussed a class of model-asssted estmators that mprove the effcency of the HT estmator by ncorporatng the auxlary nformaton. In ths secton, we dscuss some optmalty of the GREG estmator under some class of estmators. We frst show the nonexstence of the UMVUE Unformly Mnmum
6 6 CHAPTER 9. ESTIMATIO: PART 2 Varance Unbased Estmator) n a strctly desgn-based sense, whch was orgnally dscussed by Godambe and Josh 965) and then also proved by Basu 97) wth a smpler proof. Theorem 9.. Let any noncensus desgn wth π k > 0 k =,2,,) be gven. Then no unformly mnmum varance estmator exsts n the class of all unbased estmators of Y = y. Proof. For gven value y = y,y 2,,y ), consder the followng dfference estmator Ŷ dff = y + y y ) 9.3) whch s unbased regardless of y = y,y 2,,y ) and ts varance s zero when y = y. ow, n order for an unbased estmator Ŷ to be an UMVUE, t should satsfy Var Ŷ ) Var Ŷ dff ), y. ow, snce Var ) Ŷ dff = 0 for y = y, t means Var Ŷ ) = 0 for y = y. Snce we can choose any arbtrary y, t means that Var Ŷ ) = 0 for all y, whch holds only for the census. The above theorem shows that t s mpossble to fnd the best estmator among the class of unbased estmator n the sense of mnmzng the desgn varance. To overcome ths problem, we relax the objectve functon for comparng the effcency of the estmators by allowng for the superpopulaton model nto consderaton. Specfcally, we wll consder the expected value of the desgn varance under the superpopulaton model. Such varance s called antcpated varance and s formally defned as follows. Defnton 9.. Antcpated varance of ˆθ s defned by AV ˆθ ) = E ζ Var ) p ˆθ, where subscrpt ζ denotes the dstrbuton wth respect to the superpopulaton model and subscrpt p denotes the dstrbuton generated by the samplng mechansm.
7 9.2. OPTIMAL ESTIMATIO 7 Lemma 9.2. Let ˆθ be desgn-unbased for θ. The antcpated varance of ˆθ can be wrtten as AV ˆθ ) = E ) p Varζ ˆθ +Var ) p Eζ ˆθ Var ζ θ ). 9.4) Proof. Snce ˆθ s desgn-unbased for θ, we can wrte AV ˆθ ) = E ζ Var ) ) 2 p ˆθ = E ζ E p ˆθ θ. Thus, AV ˆθ ) = ) 2 E p E ζ ˆθ θ = 2 E p E ζ ˆθ E ζ ˆθ) + E ζ ˆθ) E ζ θ ) + E ζ θ ) θ and AV ˆθ ) = E p E ζ ˆθ E ζ ˆθ) 2 + Ep Eζ ˆθ) E ζ θ ) Ep Eζ θ ) θ +2E p ˆθ E ζ ˆθ) ) ) E ζ θ ) θ and the remanng cross product terms are zero. Snce E p ˆθ E ζ ˆθ) ) = ) E ζ θ ) θ and 2E p ˆθ E ζ ˆθ) ) ) E ζ θ ) θ = ) 2 Eζ θ ) θ Ep ˆθ E ζ ˆθ) ) = 2 ) 2 E ζ θ ) θ, we obtan AV ˆθ ) = E p E ζ ˆθ E ζ ˆθ) 2 + Ep Eζ ˆθ) E ζ θ ) 2 2 Eζ θ ) θ whch proves 9.4). The followng theorem presents the lower bound of the antcpated varance for a desgn unbased estmator.
8 8 CHAPTER 9. ESTIMATIO: PART 2 Theorem 9.2. Let y be ndependently dstrbuted n the superpopulaton model. The antcpate varance of any desgn-unbased estmator of Y satsfes E ζ Var Ŷ ) ) Var π ζ y ). 9.5) Proof. Wrte Ŷ as Ŷ = Ŷ HT + R where Ŷ HT s the HT estmator of Y. Snce Ŷ s desgn unbased, we have E R) = 0 and, for fxed j U, ow, snce 0 = E R) = pa)ra) A A = A A ; j A pa)ra) + A A ; j / A pa)ra). V ζ Ŷ ) = Vζ ŶHT ) +Vζ R) + 2Cov ζ ŶHT,R ), we obtan E p Covζ ŶHT,R ) = E p [ Eζ ŶHT E ζ ŶHT )) R ] = E p [ j U y j E ζ y j ) ) I j E ζ R ] y j E ζ y j ) ) = E ζ E I j A)RA) j U y j E ζ y j ) ) = E ζ j U RA) pa) = j U = 0, E ζ y j E ζ y j ) ) A A ; j A A A ; j / A RA) pa) where the last equalty follows because A A ; j / A RA) pa) does not depend on
9 9.2. OPTIMAL ESTIMATIO 9 y j. Thus, E p Vζ Ŷ ) = Ep Vζ ŶHT ) + Ep Vζ R) ) E p Vζ ŶHT ) y I = E p = E p V ζ σ 2I π 2 = σ 2 and we have AV Ŷ ) = E p V ζ Ŷ ) +Vp E ζ Ŷ ) Vζ Y ) E p V ζ Ŷ ) Vζ Y ) σ 2 U σ 2. The lower bound n 9.5) s the lower bound of the antcpated varance of any unbased estmator. The lower bound was frst dscovered by Godambe and Josh 965) and s often called Godambe-Josh lower bound. For a fx-ed sze probablty samplng desgn, the Godambe-Josh lower bound s mnmzed when Var ζ y ) /2. 9.6) To show ths, we mnmze Var ζ y )/ subject to = n. The soluton can be obtaned by applyng Cauchy -Schwarz nequalty to get σ 2 wth equalty when 9.6) holds. / ) σ 2 The followng theorem, whch was frst proved by Isak and Fuller 982), shows that the GREG estmator acheves the Godambe-Josh lower bound asymptotcally.
10 0 CHAPTER 9. ESTIMATIO: PART 2 Theorem 9.3. Suppose that ζ s a superpopulaton model wth y s ndependent and E ζ y ) = x β and V ζ y ) = c σ 2. Then, the antcpated varance of the GREG estmator n 9.4) asymptotcally attans the Godambe-Josh lower bound f c = λ x for some λ. Proof. By Lemma 9., when c = λ x for some λ, the GREG estmator s asymptotcally equvalent to the dfference estmator n 9.7). Thus, E ζ Var ŶGREG ). = Eζ. = E ζ = j= j= j ) y x B y j x j B j ) y x β y j x j β ) c σ 2 whch s equal to the Gobambe-Josh lower bound under the superpopulaton model. Reference Basu, D. 97). An essay on the logcal foundatons of survey samplng, part one. In V.P. Godambe and D.A. Sprott, Eds., Foundatons of Statstcal Inference. Toronto: Holt, Rnehart & Wnston, Demng, W. E. and Stephan, F. F. 940). On a least squares adjustment of a sampled frequency table when the expected margnal totals are known. The Annals of Mathematcal Statstcs,, Devlle, J.C., Särndal, C.E., and Sautory, O. 993). Generalzed rakng procedure n survey samplng, Journal of the Amercan Statstcal Assocaton 88, Godambe, V.P. and Josh, V.M. 965). Admssblty and Bayes estmaton n samplng fnte populatons,. Annals of Mathematcal Statstcs 36,
11 9.2. OPTIMAL ESTIMATIO Isak, C. and Fuller, W.A. 982). Survey desgn under the regresson superpopulaton model. Journal of the Amercan Statstcal Assocaton 78, 7-23.
Efficient nonresponse weighting adjustment using estimated response probability
Effcent nonresponse weghtng adjustment usng estmated response probablty Jae Kwang Km Department of Appled Statstcs, Yonse Unversty, Seoul, 120-749, KOREA Key Words: Regresson estmator, Propensty score,
More informationThe Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction
ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analyss of Varance and Desgn of Exerments-I MODULE III LECTURE - 2 EXPERIMENTAL DESIGN MODELS Dr. Shalabh Deartment of Mathematcs and Statstcs Indan Insttute of Technology Kanur 2 We consder the models
More informationEcon Statistical Properties of the OLS estimator. Sanjaya DeSilva
Econ 39 - Statstcal Propertes of the OLS estmator Sanjaya DeSlva September, 008 1 Overvew Recall that the true regresson model s Y = β 0 + β 1 X + u (1) Applyng the OLS method to a sample of data, we estmate
More informationConditional and unconditional models in modelassisted estimation of finite population totals
Unversty of Wollongong Research Onlne Faculty of Informatcs - Papers Archve) Faculty of Engneerng and Informaton Scences 2011 Condtonal and uncondtonal models n modelasssted estmaton of fnte populaton
More informationEconomics 130. Lecture 4 Simple Linear Regression Continued
Economcs 130 Lecture 4 Contnued Readngs for Week 4 Text, Chapter and 3. We contnue wth addressng our second ssue + add n how we evaluate these relatonshps: Where do we get data to do ths analyss? How do
More informationChapter 2 - The Simple Linear Regression Model S =0. e i is a random error. S β2 β. This is a minimization problem. Solution is a calculus exercise.
Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where y + = β + β e for =,..., y and are observable varables e s a random error How can an estmaton rule be constructed for the
More informatione i is a random error
Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where + β + β e for,..., and are observable varables e s a random error How can an estmaton rule be constructed for the unknown
More informationMatrix Approximation via Sampling, Subspace Embedding. 1 Solving Linear Systems Using SVD
Matrx Approxmaton va Samplng, Subspace Embeddng Lecturer: Anup Rao Scrbe: Rashth Sharma, Peng Zhang 0/01/016 1 Solvng Lnear Systems Usng SVD Two applcatons of SVD have been covered so far. Today we loo
More informationEcon107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)
I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes
More informationECONOMICS 351*-A Mid-Term Exam -- Fall Term 2000 Page 1 of 13 pages. QUEEN'S UNIVERSITY AT KINGSTON Department of Economics
ECOOMICS 35*-A Md-Term Exam -- Fall Term 000 Page of 3 pages QUEE'S UIVERSITY AT KIGSTO Department of Economcs ECOOMICS 35* - Secton A Introductory Econometrcs Fall Term 000 MID-TERM EAM ASWERS MG Abbott
More informationChapter 7 Generalized and Weighted Least Squares Estimation. In this method, the deviation between the observed and expected values of
Chapter 7 Generalzed and Weghted Least Squares Estmaton The usual lnear regresson model assumes that all the random error components are dentcally and ndependently dstrbuted wth constant varance. When
More information2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification
E395 - Pattern Recognton Solutons to Introducton to Pattern Recognton, Chapter : Bayesan pattern classfcaton Preface Ths document s a soluton manual for selected exercses from Introducton to Pattern Recognton
More informationGeneralized Linear Methods
Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set
More informationLecture Notes on Linear Regression
Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume
More informationSmall Area Interval Estimation
.. Small Area Interval Estmaton Partha Lahr Jont Program n Survey Methodology Unversty of Maryland, College Park (Based on jont work wth Masayo Yoshmor, Former JPSM Vstng PhD Student and Research Fellow
More informationComposite Hypotheses testing
Composte ypotheses testng In many hypothess testng problems there are many possble dstrbutons that can occur under each of the hypotheses. The output of the source s a set of parameters (ponts n a parameter
More informationLectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix
Lectures - Week 4 Matrx norms, Condtonng, Vector Spaces, Lnear Independence, Spannng sets and Bass, Null space and Range of a Matrx Matrx Norms Now we turn to assocatng a number to each matrx. We could
More informationLecture 3 Stat102, Spring 2007
Lecture 3 Stat0, Sprng 007 Chapter 3. 3.: Introducton to regresson analyss Lnear regresson as a descrptve technque The least-squares equatons Chapter 3.3 Samplng dstrbuton of b 0, b. Contnued n net lecture
More informationUsing T.O.M to Estimate Parameter of distributions that have not Single Exponential Family
IOSR Journal of Mathematcs IOSR-JM) ISSN: 2278-5728. Volume 3, Issue 3 Sep-Oct. 202), PP 44-48 www.osrjournals.org Usng T.O.M to Estmate Parameter of dstrbutons that have not Sngle Exponental Famly Jubran
More informationExplaining the Stein Paradox
Explanng the Sten Paradox Kwong Hu Yung 1999/06/10 Abstract Ths report offers several ratonale for the Sten paradox. Sectons 1 and defnes the multvarate normal mean estmaton problem and ntroduces Sten
More informationModule 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur
Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:
More informationParametric fractional imputation for missing data analysis. Jae Kwang Kim Survey Working Group Seminar March 29, 2010
Parametrc fractonal mputaton for mssng data analyss Jae Kwang Km Survey Workng Group Semnar March 29, 2010 1 Outlne Introducton Proposed method Fractonal mputaton Approxmaton Varance estmaton Multple mputaton
More informationA note on regression estimation with unknown population size
Statstcs Publcatons Statstcs 6-016 A note on regresson estmaton wth unknown populaton sze Mchael A. Hdroglou Statstcs Canada Jae Kwang Km Iowa State Unversty jkm@astate.edu Chrstan Olver Nambeu Statstcs
More informationMMA and GCMMA two methods for nonlinear optimization
MMA and GCMMA two methods for nonlnear optmzaton Krster Svanberg Optmzaton and Systems Theory, KTH, Stockholm, Sweden. krlle@math.kth.se Ths note descrbes the algorthms used n the author s 2007 mplementatons
More information3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X
Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number
More informationHowever, since P is a symmetric idempotent matrix, of P are either 0 or 1 [Eigen-values
Fall 007 Soluton to Mdterm Examnaton STAT 7 Dr. Goel. [0 ponts] For the general lnear model = X + ε, wth uncorrelated errors havng mean zero and varance σ, suppose that the desgn matrx X s not necessarly
More informationParametric fractional imputation for missing data analysis
Secton on Survey Research Methods JSM 2008 Parametrc fractonal mputaton for mssng data analyss Jae Kwang Km Wayne Fuller Abstract Under a parametrc model for mssng data, the EM algorthm s a popular tool
More informationImproved Class of Ratio Estimators for Finite Population Variance
Global Journal of Scence Fronter Research: F Mathematcs and Decson Scences Volume 6 Issue Verson.0 Year 06 Tpe : Double lnd Peer Revewed Internatonal Research Journal Publsher: Global Journals Inc. (USA)
More informationSolutions Homework 4 March 5, 2018
1 Solutons Homework 4 March 5, 018 Soluton to Exercse 5.1.8: Let a IR be a translaton and c > 0 be a re-scalng. ˆb1 (cx + a) cx n + a (cx 1 + a) c x n x 1 cˆb 1 (x), whch shows ˆb 1 s locaton nvarant and
More informationLinear Approximation with Regularization and Moving Least Squares
Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...
More informationNonparametric model calibration estimation in survey sampling
Ames February 18, 004 Nonparametrc model calbraton estmaton n survey samplng M. Govanna Ranall Department of Statstcs, Colorado State Unversty (Jont work wth G.E. Montanar, Dpartmento d Scenze Statstche,
More informationAPPENDIX A Some Linear Algebra
APPENDIX A Some Lnear Algebra The collecton of m, n matrces A.1 Matrces a 1,1,..., a 1,n A = a m,1,..., a m,n wth real elements a,j s denoted by R m,n. If n = 1 then A s called a column vector. Smlarly,
More informationLecture 4 Hypothesis Testing
Lecture 4 Hypothess Testng We may wsh to test pror hypotheses about the coeffcents we estmate. We can use the estmates to test whether the data rejects our hypothess. An example mght be that we wsh to
More informationMATH 281A: Homework #6
MATH 28A: Homework #6 Jongha Ryu Due date: November 8, 206 Problem. (Problem 2..2. Soluton. If X,..., X n Bern(p, then T = X s a complete suffcent statstc. Our target s g(p = p, and the nave guess suggested
More information1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands
Content. Inference on Regresson Parameters a. Fndng Mean, s.d and covarance amongst estmates.. Confdence Intervals and Workng Hotellng Bands 3. Cochran s Theorem 4. General Lnear Testng 5. Measures of
More informationANOMALIES OF THE MAGNITUDE OF THE BIAS OF THE MAXIMUM LIKELIHOOD ESTIMATOR OF THE REGRESSION SLOPE
P a g e ANOMALIES OF THE MAGNITUDE OF THE BIAS OF THE MAXIMUM LIKELIHOOD ESTIMATOR OF THE REGRESSION SLOPE Darmud O Drscoll ¹, Donald E. Ramrez ² ¹ Head of Department of Mathematcs and Computer Studes
More informationExam. Econometrics - Exam 1
Econometrcs - Exam 1 Exam Problem 1: (15 ponts) Suppose that the classcal regresson model apples but that the true value of the constant s zero. In order to answer the followng questons assume just one
More informationFirst Year Examination Department of Statistics, University of Florida
Frst Year Examnaton Department of Statstcs, Unversty of Florda May 7, 010, 8:00 am - 1:00 noon Instructons: 1. You have four hours to answer questons n ths examnaton.. You must show your work to receve
More informationn α j x j = 0 j=1 has a nontrivial solution. Here A is the n k matrix whose jth column is the vector for all t j=0
MODULE 2 Topcs: Lnear ndependence, bass and dmenson We have seen that f n a set of vectors one vector s a lnear combnaton of the remanng vectors n the set then the span of the set s unchanged f that vector
More informationGoodness of fit and Wilks theorem
DRAFT 0.0 Glen Cowan 3 June, 2013 Goodness of ft and Wlks theorem Suppose we model data y wth a lkelhood L(µ) that depends on a set of N parameters µ = (µ 1,...,µ N ). Defne the statstc t µ ln L(µ) L(ˆµ),
More informationANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U)
Econ 413 Exam 13 H ANSWERS Settet er nndelt 9 deloppgaver, A,B,C, som alle anbefales å telle lkt for å gøre det ltt lettere å stå. Svar er gtt . Unfortunately, there s a prntng error n the hnt of
More informationComputation of Higher Order Moments from Two Multinomial Overdispersion Likelihood Models
Computaton of Hgher Order Moments from Two Multnomal Overdsperson Lkelhood Models BY J. T. NEWCOMER, N. K. NEERCHAL Department of Mathematcs and Statstcs, Unversty of Maryland, Baltmore County, Baltmore,
More informationLINEAR REGRESSION ANALYSIS. MODULE VIII Lecture Indicator Variables
LINEAR REGRESSION ANALYSIS MODULE VIII Lecture - 7 Indcator Varables Dr. Shalabh Department of Maematcs and Statstcs Indan Insttute of Technology Kanpur Indcator varables versus quanttatve explanatory
More informationON A DETERMINATION OF THE INITIAL FUNCTIONS FROM THE OBSERVED VALUES OF THE BOUNDARY FUNCTIONS FOR THE SECOND-ORDER HYPERBOLIC EQUATION
Advanced Mathematcal Models & Applcatons Vol.3, No.3, 2018, pp.215-222 ON A DETERMINATION OF THE INITIAL FUNCTIONS FROM THE OBSERVED VALUES OF THE BOUNDARY FUNCTIONS FOR THE SECOND-ORDER HYPERBOLIC EUATION
More informationInner Product. Euclidean Space. Orthonormal Basis. Orthogonal
Inner Product Defnton 1 () A Eucldean space s a fnte-dmensonal vector space over the reals R, wth an nner product,. Defnton 2 (Inner Product) An nner product, on a real vector space X s a symmetrc, blnear,
More informationNonparametric Regression Estimation. of Finite Population Totals. under Two-Stage Sampling
Nonparametrc Regresson Estmaton of Fnte Populaton Totals under Two-Stage Samplng J-Yeon Km Iowa State Unversty F. Jay Bredt Colorado State Unversty Jean D. Opsomer Iowa State Unversty ay 21, 2003 Abstract
More informationLINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity
LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 30 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 2 Remedes for multcollnearty Varous technques have
More information4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA
4 Analyss of Varance (ANOVA) 5 ANOVA 51 Introducton ANOVA ANOVA s a way to estmate and test the means of multple populatons We wll start wth one-way ANOVA If the populatons ncluded n the study are selected
More informationAsymptotics of the Solution of a Boundary Value. Problem for One-Characteristic Differential. Equation Degenerating into a Parabolic Equation
Nonl. Analyss and Dfferental Equatons, ol., 4, no., 5 - HIKARI Ltd, www.m-har.com http://dx.do.org/.988/nade.4.456 Asymptotcs of the Soluton of a Boundary alue Problem for One-Characterstc Dfferental Equaton
More informationprinceton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg
prnceton unv. F 17 cos 521: Advanced Algorthm Desgn Lecture 7: LP Dualty Lecturer: Matt Wenberg Scrbe: LP Dualty s an extremely useful tool for analyzng structural propertes of lnear programs. Whle there
More informationSTAT 3008 Applied Regression Analysis
STAT 3008 Appled Regresson Analyss Tutoral : Smple Lnear Regresson LAI Chun He Department of Statstcs, The Chnese Unversty of Hong Kong 1 Model Assumpton To quantfy the relatonshp between two factors,
More informationChapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems
Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons
More informationSystems of Equations (SUR, GMM, and 3SLS)
Lecture otes on Advanced Econometrcs Takash Yamano Fall Semester 4 Lecture 4: Sstems of Equatons (SUR, MM, and 3SLS) Seemngl Unrelated Regresson (SUR) Model Consder a set of lnear equatons: $ + ɛ $ + ɛ
More informationx i1 =1 for all i (the constant ).
Chapter 5 The Multple Regresson Model Consder an economc model where the dependent varable s a functon of K explanatory varables. The economc model has the form: y = f ( x,x,..., ) xk Approxmate ths by
More informationLecture 4: Universal Hash Functions/Streaming Cont d
CSE 5: Desgn and Analyss of Algorthms I Sprng 06 Lecture 4: Unversal Hash Functons/Streamng Cont d Lecturer: Shayan Oves Gharan Aprl 6th Scrbe: Jacob Schreber Dsclamer: These notes have not been subjected
More informationAppendix for Causal Interaction in Factorial Experiments: Application to Conjoint Analysis
A Appendx for Causal Interacton n Factoral Experments: Applcaton to Conjont Analyss Mathematcal Appendx: Proofs of Theorems A. Lemmas Below, we descrbe all the lemmas, whch are used to prove the man theorems
More informationInterval Estimation in the Classical Normal Linear Regression Model. 1. Introduction
ECONOMICS 35* -- NOTE 7 ECON 35* -- NOTE 7 Interval Estmaton n the Classcal Normal Lnear Regresson Model Ths note outlnes the basc elements of nterval estmaton n the Classcal Normal Lnear Regresson Model
More informationCIS526: Machine Learning Lecture 3 (Sept 16, 2003) Linear Regression. Preparation help: Xiaoying Huang. x 1 θ 1 output... θ M x M
CIS56: achne Learnng Lecture 3 (Sept 6, 003) Preparaton help: Xaoyng Huang Lnear Regresson Lnear regresson can be represented by a functonal form: f(; θ) = θ 0 0 +θ + + θ = θ = 0 ote: 0 s a dummy attrbute
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analyss of Varance and Desgn of Experment-I MODULE VII LECTURE - 3 ANALYSIS OF COVARIANCE Dr Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur Any scentfc experment s performed
More informationLossy Compression. Compromise accuracy of reconstruction for increased compression.
Lossy Compresson Compromse accuracy of reconstructon for ncreased compresson. The reconstructon s usually vsbly ndstngushable from the orgnal mage. Typcally, one can get up to 0:1 compresson wth almost
More information18.1 Introduction and Recap
CS787: Advanced Algorthms Scrbe: Pryananda Shenoy and Shjn Kong Lecturer: Shuch Chawla Topc: Streamng Algorthmscontnued) Date: 0/26/2007 We contnue talng about streamng algorthms n ths lecture, ncludng
More informationUSE OF DOUBLE SAMPLING SCHEME IN ESTIMATING THE MEAN OF STRATIFIED POPULATION UNDER NON-RESPONSE
STATISTICA, anno LXXV, n. 4, 015 USE OF DOUBLE SAMPLING SCHEME IN ESTIMATING THE MEAN OF STRATIFIED POPULATION UNDER NON-RESPONSE Manoj K. Chaudhary 1 Department of Statstcs, Banaras Hndu Unversty, Varanas,
More informationMaximum Likelihood Estimation of Binary Dependent Variables Models: Probit and Logit. 1. General Formulation of Binary Dependent Variables Models
ECO 452 -- OE 4: Probt and Logt Models ECO 452 -- OE 4 Mamum Lkelhood Estmaton of Bnary Dependent Varables Models: Probt and Logt hs note demonstrates how to formulate bnary dependent varables models for
More informationEconometrics of Panel Data
Econometrcs of Panel Data Jakub Mućk Meetng # 8 Jakub Mućk Econometrcs of Panel Data Meetng # 8 1 / 17 Outlne 1 Heterogenety n the slope coeffcents 2 Seemngly Unrelated Regresson (SUR) 3 Swamy s random
More informationwhere I = (n x n) diagonal identity matrix with diagonal elements = 1 and off-diagonal elements = 0; and σ 2 e = variance of (Y X).
11.4.1 Estmaton of Multple Regresson Coeffcents In multple lnear regresson, we essentally solve n equatons for the p unnown parameters. hus n must e equal to or greater than p and n practce n should e
More informationBias-correction under a semi-parametric model for small area estimation
Bas-correcton under a sem-parametrc model for small area estmaton Laura Dumtrescu, Vctora Unversty of Wellngton jont work wth J. N. K. Rao, Carleton Unversty ICORS 2017 Workshop on Robust Inference for
More informationSolutions to exam in SF1811 Optimization, Jan 14, 2015
Solutons to exam n SF8 Optmzaton, Jan 4, 25 3 3 O------O -4 \ / \ / The network: \/ where all lnks go from left to rght. /\ / \ / \ 6 O------O -5 2 4.(a) Let x = ( x 3, x 4, x 23, x 24 ) T, where the varable
More informationRandom Partitions of Samples
Random Parttons of Samples Klaus Th. Hess Insttut für Mathematsche Stochastk Technsche Unverstät Dresden Abstract In the present paper we construct a decomposton of a sample nto a fnte number of subsamples
More informationA general class of estimators for the population mean using multi-phase sampling with the non-respondents
Hacettepe Journal of Mathematcs Statstcs Volume 43 3 014 511 57 A general class of estmators for the populaton mean usng mult-phase samplng wth the non-respondents Saba Raz Gancarlo Dana Javd Shabbr Abstract
More informationMaximum Likelihood Estimation of Binary Dependent Variables Models: Probit and Logit. 1. General Formulation of Binary Dependent Variables Models
ECO 452 -- OE 4: Probt and Logt Models ECO 452 -- OE 4 Maxmum Lkelhood Estmaton of Bnary Dependent Varables Models: Probt and Logt hs note demonstrates how to formulate bnary dependent varables models
More informationREPLICATION VARIANCE ESTIMATION UNDER TWO-PHASE SAMPLING IN THE PRESENCE OF NON-RESPONSE
STATISTICA, anno LXXIV, n. 3, 2014 REPLICATION VARIANCE ESTIMATION UNDER TWO-PHASE SAMPLING IN THE PRESENCE OF NON-RESPONSE Muqaddas Javed 1 Natonal College of Busness Admnstraton and Economcs, Lahore,
More informationJoint Statistical Meetings - Biopharmaceutical Section
Iteratve Ch-Square Test for Equvalence of Multple Treatment Groups Te-Hua Ng*, U.S. Food and Drug Admnstraton 1401 Rockvlle Pke, #200S, HFM-217, Rockvlle, MD 20852-1448 Key Words: Equvalence Testng; Actve
More information8/25/17. Data Modeling. Data Modeling. Data Modeling. Patrice Koehl Department of Biological Sciences National University of Singapore
8/5/17 Data Modelng Patrce Koehl Department of Bologcal Scences atonal Unversty of Sngapore http://www.cs.ucdavs.edu/~koehl/teachng/bl59 koehl@cs.ucdavs.edu Data Modelng Ø Data Modelng: least squares Ø
More informationConvergence of random processes
DS-GA 12 Lecture notes 6 Fall 216 Convergence of random processes 1 Introducton In these notes we study convergence of dscrete random processes. Ths allows to characterze phenomena such as the law of large
More informationStat 642, Lecture notes for 01/27/ d i = 1 t. n i t nj. n j
Stat 642, Lecture notes for 01/27/05 18 Rate Standardzaton Contnued: Note that f T n t where T s the cumulatve follow-up tme and n s the number of subjects at rsk at the mdpont or nterval, and d s the
More informationCSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography
CSc 6974 and ECSE 6966 Math. Tech. for Vson, Graphcs and Robotcs Lecture 21, Aprl 17, 2006 Estmatng A Plane Homography Overvew We contnue wth a dscusson of the major ssues, usng estmaton of plane projectve
More informationSupplementary material: Margin based PU Learning. Matrix Concentration Inequalities
Supplementary materal: Margn based PU Learnng We gve the complete proofs of Theorem and n Secton We frst ntroduce the well-known concentraton nequalty, so the covarance estmator can be bounded Then we
More informationLecture 21: Numerical methods for pricing American type derivatives
Lecture 21: Numercal methods for prcng Amercan type dervatves Xaoguang Wang STAT 598W Aprl 10th, 2014 (STAT 598W) Lecture 21 1 / 26 Outlne 1 Fnte Dfference Method Explct Method Penalty Method (STAT 598W)
More informationA Note on Test of Homogeneity Against Umbrella Scale Alternative Based on U-Statistics
J Stat Appl Pro No 3 93- () 93 NSP Journal of Statstcs Applcatons & Probablty --- An Internatonal Journal @ NSP Natural Scences Publshng Cor A Note on Test of Homogenety Aganst Umbrella Scale Alternatve
More informationSIO 224. m(r) =(ρ(r),k s (r),µ(r))
SIO 224 1. A bref look at resoluton analyss Here s some background for the Masters and Gubbns resoluton paper. Global Earth models are usually found teratvely by assumng a startng model and fndng small
More informationLINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity
LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 31 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 6. Rdge regresson The OLSE s the best lnear unbased
More informationClassification as a Regression Problem
Target varable y C C, C,, ; Classfcaton as a Regresson Problem { }, 3 L C K To treat classfcaton as a regresson problem we should transform the target y nto numercal values; The choce of numercal class
More informationChapter 4: Regression With One Regressor
Chapter 4: Regresson Wth One Regressor Copyrght 2011 Pearson Addson-Wesley. All rghts reserved. 1-1 Outlne 1. Fttng a lne to data 2. The ordnary least squares (OLS) lne/regresson 3. Measures of ft 4. Populaton
More informationLecture 10: May 6, 2013
TTIC/CMSC 31150 Mathematcal Toolkt Sprng 013 Madhur Tulsan Lecture 10: May 6, 013 Scrbe: Wenje Luo In today s lecture, we manly talked about random walk on graphs and ntroduce the concept of graph expander,
More informationSome modelling aspects for the Matlab implementation of MMA
Some modellng aspects for the Matlab mplementaton of MMA Krster Svanberg krlle@math.kth.se Optmzaton and Systems Theory Department of Mathematcs KTH, SE 10044 Stockholm September 2004 1. Consdered optmzaton
More informationChapter 8 Indicator Variables
Chapter 8 Indcator Varables In general, e explanatory varables n any regresson analyss are assumed to be quanttatve n nature. For example, e varables lke temperature, dstance, age etc. are quanttatve n
More informationErrors for Linear Systems
Errors for Lnear Systems When we solve a lnear system Ax b we often do not know A and b exactly, but have only approxmatons  and ˆb avalable. Then the best thng we can do s to solve ˆx ˆb exactly whch
More informationPHYS 705: Classical Mechanics. Calculus of Variations II
1 PHYS 705: Classcal Mechancs Calculus of Varatons II 2 Calculus of Varatons: Generalzaton (no constrant yet) Suppose now that F depends on several dependent varables : We need to fnd such that has a statonary
More informationStatistics for Managers Using Microsoft Excel/SPSS Chapter 13 The Simple Linear Regression Model and Correlation
Statstcs for Managers Usng Mcrosoft Excel/SPSS Chapter 13 The Smple Lnear Regresson Model and Correlaton 1999 Prentce-Hall, Inc. Chap. 13-1 Chapter Topcs Types of Regresson Models Determnng the Smple Lnear
More informationIntroduction to Algorithms
Introducton to Algorthms 6.046J/8.40J Lecture 7 Prof. Potr Indyk Data Structures Role of data structures: Encapsulate data Support certan operatons (e.g., INSERT, DELETE, SEARCH) Our focus: effcency of
More informationChapter 11: Simple Linear Regression and Correlation
Chapter 11: Smple Lnear Regresson and Correlaton 11-1 Emprcal Models 11-2 Smple Lnear Regresson 11-3 Propertes of the Least Squares Estmators 11-4 Hypothess Test n Smple Lnear Regresson 11-4.1 Use of t-tests
More informationprinceton univ. F 13 cos 521: Advanced Algorithm Design Lecture 3: Large deviations bounds and applications Lecturer: Sanjeev Arora
prnceton unv. F 13 cos 521: Advanced Algorthm Desgn Lecture 3: Large devatons bounds and applcatons Lecturer: Sanjeev Arora Scrbe: Today s topc s devaton bounds: what s the probablty that a random varable
More informationChapter 3 Describing Data Using Numerical Measures
Chapter 3 Student Lecture Notes 3-1 Chapter 3 Descrbng Data Usng Numercal Measures Fall 2006 Fundamentals of Busness Statstcs 1 Chapter Goals To establsh the usefulness of summary measures of data. The
More informationj) = 1 (note sigma notation) ii. Continuous random variable (e.g. Normal distribution) 1. density function: f ( x) 0 and f ( x) dx = 1
Random varables Measure of central tendences and varablty (means and varances) Jont densty functons and ndependence Measures of assocaton (covarance and correlaton) Interestng result Condtonal dstrbutons
More informationImprovement in Estimating the Population Mean Using Exponential Estimator in Simple Random Sampling
Bulletn of Statstcs & Economcs Autumn 009; Volume 3; Number A09; Bull. Stat. Econ. ISSN 0973-70; Copyrght 009 by BSE CESER Improvement n Estmatng the Populaton Mean Usng Eponental Estmator n Smple Random
More informationU.C. Berkeley CS294: Spectral Methods and Expanders Handout 8 Luca Trevisan February 17, 2016
U.C. Berkeley CS94: Spectral Methods and Expanders Handout 8 Luca Trevsan February 7, 06 Lecture 8: Spectral Algorthms Wrap-up In whch we talk about even more generalzatons of Cheeger s nequaltes, and
More informationStatistics II Final Exam 26/6/18
Statstcs II Fnal Exam 26/6/18 Academc Year 2017/18 Solutons Exam duraton: 2 h 30 mn 1. (3 ponts) A town hall s conductng a study to determne the amount of leftover food produced by the restaurants n the
More informationLecture 2: Prelude to the big shrink
Lecture 2: Prelude to the bg shrnk Last tme A slght detour wth vsualzaton tools (hey, t was the frst day... why not start out wth somethng pretty to look at?) Then, we consdered a smple 120a-style regresson
More informationEstimation of the Mean of Truncated Exponential Distribution
Journal of Mathematcs and Statstcs 4 (4): 84-88, 008 ISSN 549-644 008 Scence Publcatons Estmaton of the Mean of Truncated Exponental Dstrbuton Fars Muslm Al-Athar Department of Mathematcs, Faculty of Scence,
More information