Discussion of Extensions of the Gauss-Markov Theorem to the Case of Stochastic Regression Coefficients Ed Stanek
|
|
- Helena Moore
- 5 years ago
- Views:
Transcription
1 Dscusson of Extensons of the Gauss-arkov Theorem to the Case of Stochastc Regresson Coeffcents Ed Stanek Introducton Pfeffermann (984 dscusses extensons to the Gauss-arkov Theorem n settngs where regresson coeffcents are stochastc. In the process, he comments on errors n prevously publshed developments of theorems, partcularly on Porter s (973 paper that deals wth estmaton of cluster means n a two stage sample settng. Pfeffermann (984, p42 suggests that estmators of the type dscussed by Porter do not exst, and attrbutes the error to not recognzng the stochastc nature of the regresson coeffcents. We dscuss these results relatve to predctors of realzed random effects n fnte balanced populatons wth clustered samples by Stanek and Snger (es02ed3v6.doc. Comment by the Revewer The context s a two stage cluster sample, where we assume that the observatons on a selected unt n a selected cluster ncludes response error. In ths context, the revewer s dscusson s as follows: Porter s paper and Pfeffermann s dscusson of t may be especally pertnent to the present manuscrpt. In partcular, the 2 nd paragraph on page 42 of Pfeffermann s (984 work seems to suggest thtat a SLUE of the latent cluster means may not exst, unless one makes an nference condtonal on the realzed PSUs and SSUs. Revew of odels and otaton for Pfeffermann and Stanek and Snger We revew the model and notaton used by Pfeffermann (984 and Stanek and Snger (2003. Frst, we present the model and assumptons gven by Pfeffermann. We refer to equatons n the models usng the equaton numbers gven by Pfeffermann (or Stanek and Snger, precedng the equaton numbers by P or S to desgnate the authors. We use the notaton used by each author to make the correspondence of ths dscusson to ther papers transparent. Pfeffermann s odel Pfeffermann assumes a lnear model of the form Y = X β + ε (P2. k k where X s a fxed desgn matrx, and β s a vector of random coeffcents such that E ( β = A γ, E ( β Aγ ( β Aγ =, E k l ( εβ = 0, E ( ε = 0, and var ε = Σ. C03ed6.doc 6/2/2003 0:2 A
2 Pfeffermann descrbes ths model as a model for =,..., domans, where the model for the th doman s gven by Y = X β + ε. (P2.7 k easures are made on all domans. There s no fnte populaton samplng. We can express ths model n a slghtly dfferent manner. Usng E ( β = Aγ, we can express equaton (P2. as Y = XAγ+ X( β Aγ + ε = XAγ +µ (P3. X A + E = 0 var µ = X X + Σ = Λ. where µ= ( β γ ε. For equaton (P3., ( µ and Three nterpretatons are gven to the model (whch we do not dscuss n detal. The nterpretatons correspond to a random coeffcent model, a statonary stochastc process model, and a arkovan Kalman flter model. Pfeffermann focuses on the problem of predctng lnear functons gven by w ( γ,β = w γ + w2β by lnear unbased estmators of the form T( Y = t0 + t Y that mnmze the SE. The unbased requrement s defned by Eξ T( Y w( γ,β = 0. (P2.5 The SE s gven by E T w 2 ξ Y γ,β. (P2.6 If we defne the WLS estmator as γ ˆ = ( XA Λ ( XA ( XA Λ Y (P3.3 (the WLS estmate, then (referencng Harvlle (976, the best lnear unbased predctor s gven by ŵ( γ,β = w ˆ ˆ γ + w 2Aγ + w2 XΛ Y ( XA γ ˆ. (P5.2 Pfeffermann dscusses ths predctor relatve to the rank of A, ndcatng that ths s mportant. We postpone further dscusson of ths pont, but note that Pfeffermann relates ths dscusson to papers by Duncan and Horn (972, and Chpman (964 and Rao (965. We also note that Pfeffermann also develops an extenson of ths theorem that appears to be related to what we have done, but that we don t explore further here. Porter s odel (as descrbed by Pfeffermann Pfeffermann dscusses Porter s (973 model and concludes that there s a problem wth Porter s development of a predctor. Porter s problem s predcton n the context of a model for a sngle stage sample. Snce the problem addressed by Stanek and Snger also consders samplng, the problem noted by Pfeffermann wth Porter s results s relevant to the results of Stanek and Snger. We recount Pfeffermann s summary of Porter s problem. Smlar to equaton (P2.7, Pfeffermann descrbes Porter s model for a sample of =,..., unts (.e. clusters, where the model for the th unt s gven by C03ed6.doc 6/2/2003 0:2 A 2
3 Y = Xβ + ε. In ths model, the coeffcents β are random as s the desgn matrx, Pfeffermann dstngushes these coeffcents from the fxed coeffcents for a partcular unt by denotng the coeffcents for a gven unt by β and the desgn matrx for a partcular unt by X. Over samplng, E ( β = β, and hence the model can be expressed as Y = X β + X ( β β + ε, = X β+µ µ = X β β + ε. where Suppose we defne X = X. m X, and concatenate the vectors for response, and error = for the unts. Then smlar to Pfeffermann s model (P3., Y = Xβ + X( β β + ε. = Xβ+µ j Assumng X X the matrx X s stochastc. Pfeffermann notes that for ths reason, the usual Gauss-arkov theorem can not be appled to the model. Pfeffermann concludes that n order to apply the Gauss-arkov theorem, t s necessary to condton j on X. Wth the further assumpton that β β for j, ( k E = Xk ( βk β Thus, f one condtons on X, then ( X Xk Ε µ X = X = X β β + ε X = X k. 0 Ε µ = 0 whch volates the assumpton of the model. For ths reason, Pfeffermann concludes that Porter s results are not vald. Pfeffermann s odel for Random Coeffcents We consder Pfeffermann s model, as he dscusses t for random coeffcents (on page 40, snce the model s closely related to Porter s model. The purpose of the dscusson s to see why Pfeffermann clams that hs model does not suffer from the same problem as Porter s model. The stochastc regresson model gven by Pfeffermann s composed of dstnct regresson models gven by Y = X β + ε. (P2.7 K0 K0 whch get concatenated to form the model Y = X β + ε (P2. k k where Pfeffermann states that X = X s a known explanatory varable matrx, and 2 = β = β β β s a vector of unobservable stochastc coeffcents. It appears that as stated, the matrx X defned by Pfeffermann suffers from the same problem as Porter s desgn matrx snce f β s stochastc, the accompanyng X s also stochastc. C03ed6.doc 6/2/2003 0:2 A 3
4 The specal cases consdered by Pfeffermann, however, smplfy ths problem. The frst model, referred to as a random coeffcent model, assumes that A = I. K 0 Wth ths assumpton, E ( β = Aγ = ( IK 0 γ. Then XA = X ( I K or = 0 K0 XA = X X 2 X, whch stll s stochastc, snce t depends on the K0 2 K0 K0 orderng of the selectons of. In two specal cases, ths matrx wll not be stochastc. One case corresponds to the settng where X =. A second case correspond to the settng where for all =,...,, = 0 and X = X 0. We also note that other settngs are possble where X s non-stochastc, and yet β s stochastc. Consder for example a populaton of schools, where response s the proporton of students n a school that pass a test on a year. Suppose the schools are lsted n order, and that certan schools are measured, but that a randomly selected year s th selected. Introducng the random varable U that ndcates when the k selected year s year t, we can represent β β U β, where the subscrpt k s dropped when kt k kt t t= T = = the range s smply k=, β k s stochastc, and β t s non-stochastc. It seems that ths settng would correspond to the settng descrbed by Pfeffermann. The key to ths nterpretaton s an addtonal dmenson (tme for the stochastc regresson coeffcents n Pfeffermann s model. Stanek and Snger s odel Stanek and Snger develop a model for a clustered populaton wth equal sze clusters. As an example, they represent the non-stochastc response for unt t n cluster s as y st = µ + βs + εst or y = µ + β + ε whch we summarze for the populaton as s s s y = Xµ + Zβ + ε, (S2.4 where X = and Z = I. ote that all terms n ths equaton are non-stochastc. A stochastc model s ntroduced by ncludng samplng of clusters and unts n clusters, and addng response error. The resultng model s gven by Y * = Xµ + ZB+ ( E+ W * (S2.3 where B= Uβ. (S2.2 In the model (S2.3, the matrces X and Z are fxed. C03ed6.doc 6/2/2003 0:2 A 4
5 The process of ntroducng the random varables that result n model (S2.3 from model (S2.4 nvolve ntroducng samplng, and addng response error. Snce the addton of response error does not mpact the matrces X and Z, we consder the smpler model gven by Y = Xµ + ZB+ E. ovng from model (S2.4 to ths model nvolves pre-multplyng the terms n the model (S2.4 by the samplng ndcator matrces, such that Y= ( U I U y. (S2.9 Pfeffermann s crtcsm of Porter s results apples smlarly n Stanek and Snger s settng. The queston smplfes to whether the expressons ( U I U X and ( U I U Z are stochastc, or non-stochastc. For the problem consder by Stanek and Snger, snce ( U I U X= X, the frst term s non-stochastc. The second term smplfes to ( U I U Z= U = ZU where Z s non-stochastc, but U s stochastc. Usng (S2.2, the random porton of ths product s assocated wth the random coeffcents, llustratng that Z remans non-stochastc. Thus, Pfeffermann s crtcsm of Porter s results does not apply to the results of Stanek and Snger. Extenson of Stanek and Snger s odel We brefly consder an nterestng extenson of Stanek and Snger s model. Suppose that y = Z β + ε s s s s where all terms n ths model are non-stochastc. Assemblng all clusters, we express the non-stochastc model as y = Zs β + ε ( where β= ( β β β 2 = s β. Ths model s more general than model (S2.4. We now add samplng to the model by pre-multplyng terms n the model by ( U I U. We focus our attenton on the expresson U I U Z, expand ths ( s s expresson, and consder settngs where t can be parttoned smlarly to model (S2.3. Frst, note that C03ed6.doc 6/2/2003 0:2 A 5
6 s ( s U I U Z = U I U Z ( ( 2 ( UU Z U2U Z2 U U Z ( ( 2 ( U U Z U U Z U U Z U ( U Z U ( 2 U Z U ( U Z = 22 2 s Suppose that Zs = zs for all s =,...,. Then snce U =, zu zu 2 2 zu ( zu zu z U U I U Zs = zu zu 2 22 zu = UD z z z2 0 where D z =. We can express ths equvalently as 0 0 z U I U Zs = I UD = Z UD z z where Z = I. Usng ths result, we can ntroduce samplng n model ( to result n Y = Z( UDz β + E. Let * * * * β = D z β where elements of β are zsβ s, and B = Uβ. Then the samplng model * s equvalent to Y = ZB + E. We wsh to express ths model as a mxed model. To do so, let us defne zsβs * β = and let X =. The model s then gven by ( β Y = Xβ * + ZB * X * + E. As a second applcaton, suppose that Z s has dmenson K0 for all s =,...,. Also, suppose that there s only one stage of samplng. Ths s equvalent to ( s settng U = I for all s =,...,. Wth these assumptons, and expressng β= β we can express s. C03ed6.doc 6/2/2003 0:2 A 6
7 s s ( s s U I U Z β= β = U I Z β. ow note that (( ( 2 2 Zsβs = Z β Z β Zβ s s s U 2sZsβs sβs U I Z = express U U U Z β Z β s s s. Then, or equvalently. Fnally, note that we can ( Z ( Z vec vec. Then vec( Z 2 szsβs = U sβs I Usβ s I vec ( Z U2sβ s vec 2 I Z sβ s U I Z = whch s equvalent to vec ( Z U sβs I Usβ s vec ( Z U2s s vec( 2 ( β Z U I Zsβs = I. vec ( Z U s s β Usng ths result n the samplng model that arses from y = Z β + ε, for s =,...,, whch we summarze by ( as y = Zs β + ε, whch we express as s s s s K0 ( U I y = ( U I Z β + ( U I s ε C03ed6.doc 6/2/2003 0:2 A 7
8 Usβ s vec( Z U2sβ s vec( Z2 Y = I + E. vec( Z U s s β Ths model s lke a mxed model where the random effects can once agan be separated from the random effects. C03ed6.doc 6/2/2003 0:2 A 8
9 References Chpman, J.S. (964. On tleast squares wth nsuffcent observatons, Journal of the Amercan Statstcal Assocaton, 59:078-. Duncan, D.B. and Horn, S.D. (972. Lnear dynamc recursve estmaton from the vewpont of regresson analyss, Journal of the Amercan Statstcal Assocaton, 67: Harvlle, D. (976. Extenson of the Gauss arkov theorem to nclude the estmaton of random effects, Annals of Statstcs, 4: Pfeffermann, D. (984. On extensons of the Gauss-arkov Theorem to the case of stochastc regresson coeffcents, Journal of the Royal Statstcal Socety B, 46, o.: Porter, R.. (973. On the use of survey sample weghts n the lnear model, Annals of Economc and Socal easurement, 2:4-58. Rao, C.R. (965. The theory of least squares when the parameters are stochastc and ts applcaton to the analyss of growth curves, Bometrka, 52: C03ed6.doc 6/2/2003 0:2 A 9
The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction
ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also
More informationEcon107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)
I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes
More informationChapter 2 - The Simple Linear Regression Model S =0. e i is a random error. S β2 β. This is a minimization problem. Solution is a calculus exercise.
Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where y + = β + β e for =,..., y and are observable varables e s a random error How can an estmaton rule be constructed for the
More informatione i is a random error
Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where + β + β e for,..., and are observable varables e s a random error How can an estmaton rule be constructed for the unknown
More informationx i1 =1 for all i (the constant ).
Chapter 5 The Multple Regresson Model Consder an economc model where the dependent varable s a functon of K explanatory varables. The economc model has the form: y = f ( x,x,..., ) xk Approxmate ths by
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analyss of Varance and Desgn of Exerments-I MODULE III LECTURE - 2 EXPERIMENTAL DESIGN MODELS Dr. Shalabh Deartment of Mathematcs and Statstcs Indan Insttute of Technology Kanur 2 We consder the models
More informationLINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity
LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 30 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 2 Remedes for multcollnearty Varous technques have
More informationDepartment of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6
Department of Quanttatve Methods & Informaton Systems Tme Seres and Ther Components QMIS 30 Chapter 6 Fall 00 Dr. Mohammad Zanal These sldes were modfed from ther orgnal source for educatonal purpose only.
More informationChapter 8 Indicator Variables
Chapter 8 Indcator Varables In general, e explanatory varables n any regresson analyss are assumed to be quanttatve n nature. For example, e varables lke temperature, dstance, age etc. are quanttatve n
More informationTHE SUMMATION NOTATION Ʃ
Sngle Subscrpt otaton THE SUMMATIO OTATIO Ʃ Most of the calculatons we perform n statstcs are repettve operatons on lsts of numbers. For example, we compute the sum of a set of numbers, or the sum of the
More informationStatistics for Economics & Business
Statstcs for Economcs & Busness Smple Lnear Regresson Learnng Objectves In ths chapter, you learn: How to use regresson analyss to predct the value of a dependent varable based on an ndependent varable
More informationThe Ordinary Least Squares (OLS) Estimator
The Ordnary Least Squares (OLS) Estmator 1 Regresson Analyss Regresson Analyss: a statstcal technque for nvestgatng and modelng the relatonshp between varables. Applcatons: Engneerng, the physcal and chemcal
More information1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands
Content. Inference on Regresson Parameters a. Fndng Mean, s.d and covarance amongst estmates.. Confdence Intervals and Workng Hotellng Bands 3. Cochran s Theorem 4. General Lnear Testng 5. Measures of
More informationPsychology 282 Lecture #24 Outline Regression Diagnostics: Outliers
Psychology 282 Lecture #24 Outlne Regresson Dagnostcs: Outlers In an earler lecture we studed the statstcal assumptons underlyng the regresson model, ncludng the followng ponts: Formal statement of assumptons.
More information4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA
4 Analyss of Varance (ANOVA) 5 ANOVA 51 Introducton ANOVA ANOVA s a way to estmate and test the means of multple populatons We wll start wth one-way ANOVA If the populatons ncluded n the study are selected
More informationTime-Varying Systems and Computations Lecture 6
Tme-Varyng Systems and Computatons Lecture 6 Klaus Depold 14. Januar 2014 The Kalman Flter The Kalman estmaton flter attempts to estmate the actual state of an unknown dscrete dynamcal system, gven nosy
More informationBasically, if you have a dummy dependent variable you will be estimating a probability.
ECON 497: Lecture Notes 13 Page 1 of 1 Metropoltan State Unversty ECON 497: Research and Forecastng Lecture Notes 13 Dummy Dependent Varable Technques Studenmund Chapter 13 Bascally, f you have a dummy
More informationChapter 13: Multiple Regression
Chapter 13: Multple Regresson 13.1 Developng the multple-regresson Model The general model can be descrbed as: It smplfes for two ndependent varables: The sample ft parameter b 0, b 1, and b are used to
More informationEconometrics of Panel Data
Econometrcs of Panel Data Jakub Mućk Meetng # 8 Jakub Mućk Econometrcs of Panel Data Meetng # 8 1 / 17 Outlne 1 Heterogenety n the slope coeffcents 2 Seemngly Unrelated Regresson (SUR) 3 Swamy s random
More informationSalmon: Lectures on partial differential equations. Consider the general linear, second-order PDE in the form. ,x 2
Salmon: Lectures on partal dfferental equatons 5. Classfcaton of second-order equatons There are general methods for classfyng hgher-order partal dfferental equatons. One s very general (applyng even to
More informationLinear Approximation with Regularization and Moving Least Squares
Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...
More informationEconomics 130. Lecture 4 Simple Linear Regression Continued
Economcs 130 Lecture 4 Contnued Readngs for Week 4 Text, Chapter and 3. We contnue wth addressng our second ssue + add n how we evaluate these relatonshps: Where do we get data to do ths analyss? How do
More informationEcon Statistical Properties of the OLS estimator. Sanjaya DeSilva
Econ 39 - Statstcal Propertes of the OLS estmator Sanjaya DeSlva September, 008 1 Overvew Recall that the true regresson model s Y = β 0 + β 1 X + u (1) Applyng the OLS method to a sample of data, we estmate
More informationLECTURE 9 CANONICAL CORRELATION ANALYSIS
LECURE 9 CANONICAL CORRELAION ANALYSIS Introducton he concept of canoncal correlaton arses when we want to quantfy the assocatons between two sets of varables. For example, suppose that the frst set of
More informationStatistics for Business and Economics
Statstcs for Busness and Economcs Chapter 11 Smple Regresson Copyrght 010 Pearson Educaton, Inc. Publshng as Prentce Hall Ch. 11-1 11.1 Overvew of Lnear Models n An equaton can be ft to show the best lnear
More informationECONOMICS 351*-A Mid-Term Exam -- Fall Term 2000 Page 1 of 13 pages. QUEEN'S UNIVERSITY AT KINGSTON Department of Economics
ECOOMICS 35*-A Md-Term Exam -- Fall Term 000 Page of 3 pages QUEE'S UIVERSITY AT KIGSTO Department of Economcs ECOOMICS 35* - Secton A Introductory Econometrcs Fall Term 000 MID-TERM EAM ASWERS MG Abbott
More informationLecture 3 Stat102, Spring 2007
Lecture 3 Stat0, Sprng 007 Chapter 3. 3.: Introducton to regresson analyss Lnear regresson as a descrptve technque The least-squares equatons Chapter 3.3 Samplng dstrbuton of b 0, b. Contnued n net lecture
More informationChapter 3. Two-Variable Regression Model: The Problem of Estimation
Chapter 3. Two-Varable Regresson Model: The Problem of Estmaton Ordnary Least Squares Method (OLS) Recall that, PRF: Y = β 1 + β X + u Thus, snce PRF s not drectly observable, t s estmated by SRF; that
More informationEcon107 Applied Econometrics Topic 9: Heteroskedasticity (Studenmund, Chapter 10)
I. Defnton and Problems Econ7 Appled Econometrcs Topc 9: Heteroskedastcty (Studenmund, Chapter ) We now relax another classcal assumpton. Ths s a problem that arses often wth cross sectons of ndvduals,
More informationLecture 9: Linear regression: centering, hypothesis testing, multiple covariates, and confounding
Recall: man dea of lnear regresson Lecture 9: Lnear regresson: centerng, hypothess testng, multple covarates, and confoundng Sandy Eckel seckel@jhsph.edu 6 May 8 Lnear regresson can be used to study an
More informationLecture 9: Linear regression: centering, hypothesis testing, multiple covariates, and confounding
Lecture 9: Lnear regresson: centerng, hypothess testng, multple covarates, and confoundng Sandy Eckel seckel@jhsph.edu 6 May 008 Recall: man dea of lnear regresson Lnear regresson can be used to study
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analyss of Varance and Desgn of Experment-I MODULE VII LECTURE - 3 ANALYSIS OF COVARIANCE Dr Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur Any scentfc experment s performed
More informationChapter 11: Simple Linear Regression and Correlation
Chapter 11: Smple Lnear Regresson and Correlaton 11-1 Emprcal Models 11-2 Smple Lnear Regresson 11-3 Propertes of the Least Squares Estmators 11-4 Hypothess Test n Smple Lnear Regresson 11-4.1 Use of t-tests
More information2016 Wiley. Study Session 2: Ethical and Professional Standards Application
6 Wley Study Sesson : Ethcal and Professonal Standards Applcaton LESSON : CORRECTION ANALYSIS Readng 9: Correlaton and Regresson LOS 9a: Calculate and nterpret a sample covarance and a sample correlaton
More informationLecture 6: Introduction to Linear Regression
Lecture 6: Introducton to Lnear Regresson An Manchakul amancha@jhsph.edu 24 Aprl 27 Lnear regresson: man dea Lnear regresson can be used to study an outcome as a lnear functon of a predctor Example: 6
More informationNotes on Frequency Estimation in Data Streams
Notes on Frequency Estmaton n Data Streams In (one of) the data streamng model(s), the data s a sequence of arrvals a 1, a 2,..., a m of the form a j = (, v) where s the dentty of the tem and belongs to
More informationAn (almost) unbiased estimator for the S-Gini index
An (almost unbased estmator for the S-Gn ndex Thomas Demuynck February 25, 2009 Abstract Ths note provdes an unbased estmator for the absolute S-Gn and an almost unbased estmator for the relatve S-Gn for
More informationComputation of Higher Order Moments from Two Multinomial Overdispersion Likelihood Models
Computaton of Hgher Order Moments from Two Multnomal Overdsperson Lkelhood Models BY J. T. NEWCOMER, N. K. NEERCHAL Department of Mathematcs and Statstcs, Unversty of Maryland, Baltmore County, Baltmore,
More informationChapter 7 Generalized and Weighted Least Squares Estimation. In this method, the deviation between the observed and expected values of
Chapter 7 Generalzed and Weghted Least Squares Estmaton The usual lnear regresson model assumes that all the random error components are dentcally and ndependently dstrbuted wth constant varance. When
More informationNegative Binomial Regression
STATGRAPHICS Rev. 9/16/2013 Negatve Bnomal Regresson Summary... 1 Data Input... 3 Statstcal Model... 3 Analyss Summary... 4 Analyss Optons... 7 Plot of Ftted Model... 8 Observed Versus Predcted... 10 Predctons...
More information18.1 Introduction and Recap
CS787: Advanced Algorthms Scrbe: Pryananda Shenoy and Shjn Kong Lecturer: Shuch Chawla Topc: Streamng Algorthmscontnued) Date: 0/26/2007 We contnue talng about streamng algorthms n ths lecture, ncludng
More informationTracking with Kalman Filter
Trackng wth Kalman Flter Scott T. Acton Vrgna Image and Vdeo Analyss (VIVA), Charles L. Brown Department of Electrcal and Computer Engneerng Department of Bomedcal Engneerng Unversty of Vrgna, Charlottesvlle,
More informationLINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity
LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 31 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 6. Rdge regresson The OLSE s the best lnear unbased
More informationEstimation: Part 2. Chapter GREG estimation
Chapter 9 Estmaton: Part 2 9. GREG estmaton In Chapter 8, we have seen that the regresson estmator s an effcent estmator when there s a lnear relatonshp between y and x. In ths chapter, we generalzed the
More informationInner Product. Euclidean Space. Orthonormal Basis. Orthogonal
Inner Product Defnton 1 () A Eucldean space s a fnte-dmensonal vector space over the reals R, wth an nner product,. Defnton 2 (Inner Product) An nner product, on a real vector space X s a symmetrc, blnear,
More information= z 20 z n. (k 20) + 4 z k = 4
Problem Set #7 solutons 7.2.. (a Fnd the coeffcent of z k n (z + z 5 + z 6 + z 7 + 5, k 20. We use the known seres expanson ( n+l ( z l l z n below: (z + z 5 + z 6 + z 7 + 5 (z 5 ( + z + z 2 + z + 5 5
More informationLecture 2: Prelude to the big shrink
Lecture 2: Prelude to the bg shrnk Last tme A slght detour wth vsualzaton tools (hey, t was the frst day... why not start out wth somethng pretty to look at?) Then, we consdered a smple 120a-style regresson
More informationInterval Estimation in the Classical Normal Linear Regression Model. 1. Introduction
ECONOMICS 35* -- NOTE 7 ECON 35* -- NOTE 7 Interval Estmaton n the Classcal Normal Lnear Regresson Model Ths note outlnes the basc elements of nterval estmaton n the Classcal Normal Lnear Regresson Model
More informationChapter 5 Multilevel Models
Chapter 5 Multlevel Models 5.1 Cross-sectonal multlevel models 5.1.1 Two-level models 5.1.2 Multple level models 5.1.3 Multple level modelng n other felds 5.2 Longtudnal multlevel models 5.2.1 Two-level
More informationCIS526: Machine Learning Lecture 3 (Sept 16, 2003) Linear Regression. Preparation help: Xiaoying Huang. x 1 θ 1 output... θ M x M
CIS56: achne Learnng Lecture 3 (Sept 6, 003) Preparaton help: Xaoyng Huang Lnear Regresson Lnear regresson can be represented by a functonal form: f(; θ) = θ 0 0 +θ + + θ = θ = 0 ote: 0 s a dummy attrbute
More informationFall 2012 Analysis of Experimental Measurements B. Eisenstein/rev. S. Errede
Fall 0 Analyss of Expermental easurements B. Esensten/rev. S. Errede We now reformulate the lnear Least Squares ethod n more general terms, sutable for (eventually extendng to the non-lnear case, and also
More informationLecture 4 Hypothesis Testing
Lecture 4 Hypothess Testng We may wsh to test pror hypotheses about the coeffcents we estmate. We can use the estmates to test whether the data rejects our hypothess. An example mght be that we wsh to
More informationBasic Business Statistics, 10/e
Chapter 13 13-1 Basc Busness Statstcs 11 th Edton Chapter 13 Smple Lnear Regresson Basc Busness Statstcs, 11e 009 Prentce-Hall, Inc. Chap 13-1 Learnng Objectves In ths chapter, you learn: How to use regresson
More informationNUMERICAL DIFFERENTIATION
NUMERICAL DIFFERENTIATION 1 Introducton Dfferentaton s a method to compute the rate at whch a dependent output y changes wth respect to the change n the ndependent nput x. Ths rate of change s called the
More informationLecture Notes on Linear Regression
Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume
More informationIII. Econometric Methodology Regression Analysis
Page Econ07 Appled Econometrcs Topc : An Overvew of Regresson Analyss (Studenmund, Chapter ) I. The Nature and Scope of Econometrcs. Lot s of defntons of econometrcs. Nobel Prze Commttee Paul Samuelson,
More informationTesting for seasonal unit roots in heterogeneous panels
Testng for seasonal unt roots n heterogeneous panels Jesus Otero * Facultad de Economía Unversdad del Rosaro, Colomba Jeremy Smth Department of Economcs Unversty of arwck Monca Gulett Aston Busness School
More informationKernel Methods and SVMs Extension
Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general
More informationComparison of Regression Lines
STATGRAPHICS Rev. 9/13/2013 Comparson of Regresson Lnes Summary... 1 Data Input... 3 Analyss Summary... 4 Plot of Ftted Model... 6 Condtonal Sums of Squares... 6 Analyss Optons... 7 Forecasts... 8 Confdence
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analyss of Varance and Desgn of Experment-I MODULE VIII LECTURE - 34 ANALYSIS OF VARIANCE IN RANDOM-EFFECTS MODEL AND MIXED-EFFECTS EFFECTS MODEL Dr Shalabh Department of Mathematcs and Statstcs Indan
More informationLectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix
Lectures - Week 4 Matrx norms, Condtonng, Vector Spaces, Lnear Independence, Spannng sets and Bass, Null space and Range of a Matrx Matrx Norms Now we turn to assocatng a number to each matrx. We could
More informationDepartment of Statistics University of Toronto STA305H1S / 1004 HS Design and Analysis of Experiments Term Test - Winter Solution
Department of Statstcs Unversty of Toronto STA35HS / HS Desgn and Analyss of Experments Term Test - Wnter - Soluton February, Last Name: Frst Name: Student Number: Instructons: Tme: hours. Ads: a non-programmable
More informationDifference Equations
Dfference Equatons c Jan Vrbk 1 Bascs Suppose a sequence of numbers, say a 0,a 1,a,a 3,... s defned by a certan general relatonshp between, say, three consecutve values of the sequence, e.g. a + +3a +1
More informationβ0 + β1xi and want to estimate the unknown
SLR Models Estmaton Those OLS Estmates Estmators (e ante) v. estmates (e post) The Smple Lnear Regresson (SLR) Condtons -4 An Asde: The Populaton Regresson Functon B and B are Lnear Estmators (condtonal
More informationSTAT 3008 Applied Regression Analysis
STAT 3008 Appled Regresson Analyss Tutoral : Smple Lnear Regresson LAI Chun He Department of Statstcs, The Chnese Unversty of Hong Kong 1 Model Assumpton To quantfy the relatonshp between two factors,
More informationx = , so that calculated
Stat 4, secton Sngle Factor ANOVA notes by Tm Plachowsk n chapter 8 we conducted hypothess tests n whch we compared a sngle sample s mean or proporton to some hypotheszed value Chapter 9 expanded ths to
More informationIntroduction to Dummy Variable Regressors. 1. An Example of Dummy Variable Regressors
ECONOMICS 5* -- Introducton to Dummy Varable Regressors ECON 5* -- Introducton to NOTE Introducton to Dummy Varable Regressors. An Example of Dummy Varable Regressors A model of North Amercan car prces
More information3.1 ML and Empirical Distribution
67577 Intro. to Machne Learnng Fall semester, 2008/9 Lecture 3: Maxmum Lkelhood/ Maxmum Entropy Dualty Lecturer: Amnon Shashua Scrbe: Amnon Shashua 1 In the prevous lecture we defned the prncple of Maxmum
More informationComposite Hypotheses testing
Composte ypotheses testng In many hypothess testng problems there are many possble dstrbutons that can occur under each of the hypotheses. The output of the source s a set of parameters (ponts n a parameter
More informationLINEAR REGRESSION ANALYSIS. MODULE VIII Lecture Indicator Variables
LINEAR REGRESSION ANALYSIS MODULE VIII Lecture - 7 Indcator Varables Dr. Shalabh Department of Maematcs and Statstcs Indan Insttute of Technology Kanpur Indcator varables versus quanttatve explanatory
More informationISSN: ISO 9001:2008 Certified International Journal of Engineering and Innovative Technology (IJEIT) Volume 3, Issue 1, July 2013
ISSN: 2277-375 Constructon of Trend Free Run Orders for Orthogonal rrays Usng Codes bstract: Sometmes when the expermental runs are carred out n a tme order sequence, the response can depend on the run
More informationMathematical Preparations
1 Introducton Mathematcal Preparatons The theory of relatvty was developed to explan experments whch studed the propagaton of electromagnetc radaton n movng coordnate systems. Wthn expermental error the
More informationCHAPTER III Neural Networks as Associative Memory
CHAPTER III Neural Networs as Assocatve Memory Introducton One of the prmary functons of the bran s assocatve memory. We assocate the faces wth names, letters wth sounds, or we can recognze the people
More information1 Convex Optimization
Convex Optmzaton We wll consder convex optmzaton problems. Namely, mnmzaton problems where the objectve s convex (we assume no constrants for now). Such problems often arse n machne learnng. For example,
More informationNow we relax this assumption and allow that the error variance depends on the independent variables, i.e., heteroskedasticity
ECON 48 / WH Hong Heteroskedastcty. Consequences of Heteroskedastcty for OLS Assumpton MLR. 5: Homoskedastcty var ( u x ) = σ Now we relax ths assumpton and allow that the error varance depends on the
More informationPhysics 5153 Classical Mechanics. D Alembert s Principle and The Lagrangian-1
P. Guterrez Physcs 5153 Classcal Mechancs D Alembert s Prncple and The Lagrangan 1 Introducton The prncple of vrtual work provdes a method of solvng problems of statc equlbrum wthout havng to consder the
More informationLecture 10 Support Vector Machines II
Lecture 10 Support Vector Machnes II 22 February 2016 Taylor B. Arnold Yale Statstcs STAT 365/665 1/28 Notes: Problem 3 s posted and due ths upcomng Frday There was an early bug n the fake-test data; fxed
More informationStatistics for Managers Using Microsoft Excel/SPSS Chapter 13 The Simple Linear Regression Model and Correlation
Statstcs for Managers Usng Mcrosoft Excel/SPSS Chapter 13 The Smple Lnear Regresson Model and Correlaton 1999 Prentce-Hall, Inc. Chap. 13-1 Chapter Topcs Types of Regresson Models Determnng the Smple Lnear
More informationA Robust Method for Calculating the Correlation Coefficient
A Robust Method for Calculatng the Correlaton Coeffcent E.B. Nven and C. V. Deutsch Relatonshps between prmary and secondary data are frequently quantfed usng the correlaton coeffcent; however, the tradtonal
More informationParametric fractional imputation for missing data analysis. Jae Kwang Kim Survey Working Group Seminar March 29, 2010
Parametrc fractonal mputaton for mssng data analyss Jae Kwang Km Survey Workng Group Semnar March 29, 2010 1 Outlne Introducton Proposed method Fractonal mputaton Approxmaton Varance estmaton Multple mputaton
More informationPolynomial Regression Models
LINEAR REGRESSION ANALYSIS MODULE XII Lecture - 6 Polynomal Regresson Models Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur Test of sgnfcance To test the sgnfcance
More informationBayesian predictive Configural Frequency Analysis
Psychologcal Test and Assessment Modelng, Volume 54, 2012 (3), 285-292 Bayesan predctve Confgural Frequency Analyss Eduardo Gutérrez-Peña 1 Abstract Confgural Frequency Analyss s a method for cell-wse
More informationChapter 9: Statistical Inference and the Relationship between Two Variables
Chapter 9: Statstcal Inference and the Relatonshp between Two Varables Key Words The Regresson Model The Sample Regresson Equaton The Pearson Correlaton Coeffcent Learnng Outcomes After studyng ths chapter,
More informationLinear Regression Analysis: Terminology and Notation
ECON 35* -- Secton : Basc Concepts of Regresson Analyss (Page ) Lnear Regresson Analyss: Termnology and Notaton Consder the generc verson of the smple (two-varable) lnear regresson model. It s represented
More informationJanuary Examinations 2015
24/5 Canddates Only January Examnatons 25 DO NOT OPEN THE QUESTION PAPER UNTIL INSTRUCTED TO DO SO BY THE CHIEF INVIGILATOR STUDENT CANDIDATE NO.. Department Module Code Module Ttle Exam Duraton (n words)
More informationStructure and Drive Paul A. Jensen Copyright July 20, 2003
Structure and Drve Paul A. Jensen Copyrght July 20, 2003 A system s made up of several operatons wth flow passng between them. The structure of the system descrbes the flow paths from nputs to outputs.
More informationInterpreting Slope Coefficients in Multiple Linear Regression Models: An Example
CONOMICS 5* -- Introducton to NOT CON 5* -- Introducton to NOT : Multple Lnear Regresson Models Interpretng Slope Coeffcents n Multple Lnear Regresson Models: An xample Consder the followng smple lnear
More information28. SIMPLE LINEAR REGRESSION III
8. SIMPLE LINEAR REGRESSION III Ftted Values and Resduals US Domestc Beers: Calores vs. % Alcohol To each observed x, there corresponds a y-value on the ftted lne, y ˆ = βˆ + βˆ x. The are called ftted
More informationUsing T.O.M to Estimate Parameter of distributions that have not Single Exponential Family
IOSR Journal of Mathematcs IOSR-JM) ISSN: 2278-5728. Volume 3, Issue 3 Sep-Oct. 202), PP 44-48 www.osrjournals.org Usng T.O.M to Estmate Parameter of dstrbutons that have not Sngle Exponental Famly Jubran
More informationThe Geometry of Logit and Probit
The Geometry of Logt and Probt Ths short note s meant as a supplement to Chapters and 3 of Spatal Models of Parlamentary Votng and the notaton and reference to fgures n the text below s to those two chapters.
More informationChapter 14 Simple Linear Regression
Chapter 4 Smple Lnear Regresson Chapter 4 - Smple Lnear Regresson Manageral decsons often are based on the relatonshp between two or more varables. Regresson analss can be used to develop an equaton showng
More informationMaximum Likelihood Estimation of Binary Dependent Variables Models: Probit and Logit. 1. General Formulation of Binary Dependent Variables Models
ECO 452 -- OE 4: Probt and Logt Models ECO 452 -- OE 4 Maxmum Lkelhood Estmaton of Bnary Dependent Varables Models: Probt and Logt hs note demonstrates how to formulate bnary dependent varables models
More informationAn Introduction to Censoring, Truncation and Sample Selection Problems
An Introducton to Censorng, Truncaton and Sample Selecton Problems Thomas Crossley SPIDA June 2003 1 A. Introducton A.1 Basc Ideas Most of the statstcal technques we study are for estmatng (populaton)
More informationLecture 12: Discrete Laplacian
Lecture 12: Dscrete Laplacan Scrbe: Tanye Lu Our goal s to come up wth a dscrete verson of Laplacan operator for trangulated surfaces, so that we can use t n practce to solve related problems We are mostly
More informationThis column is a continuation of our previous column
Comparson of Goodness of Ft Statstcs for Lnear Regresson, Part II The authors contnue ther dscusson of the correlaton coeffcent n developng a calbraton for quanttatve analyss. Jerome Workman Jr. and Howard
More informationSystems of Equations (SUR, GMM, and 3SLS)
Lecture otes on Advanced Econometrcs Takash Yamano Fall Semester 4 Lecture 4: Sstems of Equatons (SUR, MM, and 3SLS) Seemngl Unrelated Regresson (SUR) Model Consder a set of lnear equatons: $ + ɛ $ + ɛ
More informationCOS 521: Advanced Algorithms Game Theory and Linear Programming
COS 521: Advanced Algorthms Game Theory and Lnear Programmng Moses Charkar February 27, 2013 In these notes, we ntroduce some basc concepts n game theory and lnear programmng (LP). We show a connecton
More informationLecture 17 : Stochastic Processes II
: Stochastc Processes II 1 Contnuous-tme stochastc process So far we have studed dscrete-tme stochastc processes. We studed the concept of Makov chans and martngales, tme seres analyss, and regresson analyss
More informationSmall Area Estimation for Business Surveys
ASA Secton on Survey Research Methods Small Area Estmaton for Busness Surveys Hukum Chandra Southampton Statstcal Scences Research Insttute, Unversty of Southampton Hghfeld, Southampton-SO17 1BJ, U.K.
More informationClassification as a Regression Problem
Target varable y C C, C,, ; Classfcaton as a Regresson Problem { }, 3 L C K To treat classfcaton as a regresson problem we should transform the target y nto numercal values; The choce of numercal class
More information