Unbiased prediction in linear regression models with equi-correlated responses
|
|
- Deirdre Webb
- 6 years ago
- Views:
Transcription
1 ') -t CAA\..-ll' ~ j... "1-' V'~ /'. uuo. ;). I ''''- ~ ( \ '.. /' I ~, Unbiased prediction in linear regression models with equi-correlated responses Shalabh Received: May 13, 1996; revised version: December 11, 1996 This paper considers problem of predicting actual and mean values of response variable in a linear regression model with equi-correlated responses. Two such predictors are presented and ir efficiency properties are studied w:l.threspect to criterion of covariance matrix. 1. Introduction: In many applications,we come across linear regression models with equi-correlated responses. For example, when observations are taken on some characteristic on members of a family in familial studies, y exhibit generally- high correlation, see, e.g., Srivastava (1984). Similarly. correlated responses are recorded when measurements are taken on two eyes or hands of individuals for studies in medical sciences, see, e.g., Munoz, Rosner and Carey (1986) and Rosner (1984). IJ.ikewise in survey sampling when cluster
2 238 sampling procedure is adopted, fairly high values of intra-cluster correlation is found, see, e.g., Holt and Scott (198!) and King and Evans (1986). Estimation of parameters in linear regression models with equi-correlated responses has received considerable attention in literature but such is not case with problem of prediction of some future vaiues of response variable given a set of value for explanatory variables. This has inspired present investigations. The plan of this article is as follows. In Section 2, we describe model and present two unbiased predictors. Their efficiency properties are also analyzed. Finally some remarks are made. 2. Model Specification And Predictions: Let us consider regression model: (1) y = ~ + au following linear where y is a nx1 vector of n observations on response variable, X is an nxp full column rank matrix of n observations on p explanatory variables, ~ is a column vector of associated regression coefficients, a is a scalar and u is a column vector of disturbances. Next, we assume that a set of m fixed values of explanatory variables in form of a mxp matrix Xf is given corresponding to which m values of response variable are to be predicted. Thus we have (2) Yf = Xf!1 + auf where Yf denotes column vector of m values of response variable and uf is vector of disturbances. It is assumed that values of response 239 variable are equi-correlated disturbances have an intra-class 50 that structure. Thus disturbances are correlation be identically distributed with assumed to write variances 1 and covariances p So mean, that ~e can E(u) = 0, E(uf) = 0, E(uu') (3) = (1 - p)i n + pjnj n ' = W (say) E(u f U f ') = (1 - p)i m + pj m J m ' E(uuf') = PJnJm' = Hf (say) elements where J unity. denotes a column vector with all Finally, we assume for sake of simplicity in exposition that observations in X are taken as deviations from ir corresponding means and model contains no intercept term so that X'J n is a null matrix. For predicting future values of response variable in a generalized linear regression model, Bibby and Toutenburg (1978) and Rao and Toutenburg (1995) have considered a variety of predictors and have presented a comprehensive discussion of ir properties under a general framework, see also Chandrasekar and Prabakaran (1994). He, however, restrict our attention to two unbiased predictors, viz., classical predictor and optimal homogeneous are defined as predictor obtained by GOldberger (1962). They (4) Pc = Xfb (5) where. -1 PH = Xfb + Wf W (y - Xb) (6) b = (X'X)-lX'y is least squares estimator which can be seen result to be identical with generalized least squares estimator of ~ from (1) employing '---,
3 P 1 - P n 1 + (n - l)p n n ' ('1) W-l = ( ) [ r - J J,] see also Mc ElroY (1961) who has obtained a necessary and sufficient condition for equivalence of least Squares and generalized least squares estimators when disturbances are equi-correlated. The vector quantities (4) and (5) are generally used to find predictions eir for actual responses (Yf) or mean responses (Xf~) but not for both simultaneously. Practical situations may often arise where we are required to predict both actual values and mean values, see, e.g., Zellner (1994) and Shalabh (1995) for some illustrative examples. In order to handle this problem, let us define following target function (8) T = kyf + (1 - ~)E(Y~) = kyf + (1 - k)x~ where ~ is a nonstochastic scalar lying between o and 1; see Shalabh (1995) for details. The choice of k is a matter of practitioner's preference related to weightage assigned to prediction of actual responses in relation to prediction of mean responses. (9) (10) It is easy to see that E(PC - T) = OElXf(X'X)-lX'U - ~uf] = 0 E(PH - T) = OE(Kf(X'X)-lX'u - AUf = 0 + ~.,: - 1\p JmJn'u] whence follows unbiasedness of both predictors wher y are used for responses or actual responses or both. It can be easily covariance matrices of seen that predictors are. mean variance (11) (12) Vk(PC) = E(PC - T)(PC - T)' =02[(1 - P)(XfSXf' + ~21m) Vk(PH) = E(PH - T)(PH - T)' where S = (X'X)-l. (13) + A2pJ J, mm J =02[0 - P)(XfSXf' + ~21m) + p [\. 2 (1-2A)nP + J J. 1 + (n - 1 )p) m m ] From (11) and (12), we observe that (1-2A)np2 VA(PH) - Vk(PC) = 1 + (n - l)p JmJm' Thus both predictors are equally efficient when p = 0 and/or A = 0.5. The first case (p = 0) is not very interesting because n model loses its specification of equi-correlated responses. The second case (A = 0.5) is of course interesting. It implies that both predictors have identical performance properties when y are used in a situation in which prediction of actual performance and prediction of mean responses are equally important and thus receive equal weightage. When A is less than 0.5, i.e., prediction of mean responses is to be given higher weightage in comparison to prediction of actual responses, classical predictor remains unbeaten by optimal homogeneous predictor. Just reverse holds true when A exceeds 0.5. In or words, for situations assigning higher weightage to prediction of actual responses in, comparison to prediction of mean responses, optimal homogeneous predictor is superior to classical predictor with respect to criterion of variance covariance matrix. The aforesaid observations match, finding of Rao and Toutenburg (1995, p. 172) who have remarked that classical predictor is more
4 efficient than optimal homogeneous predictor for mean responses Rhile opposite is true when aim is to predict actual,responses.. Next, let us consider expression (11). It is seen that it is an increasing function of A in sense that as we increase value of ~ from 0 to 1, variability in Pc increases. This implies that variability of predictions arising from classical predictor has an upward. trend as ~ moves from 0 to 1. In or words, predictions have smaller dispersion Rhen y are used for mean values of response variable. Their performance declines as more and more weightage is given to prediction of actual values. 3. Some Remarks: We have considered problem of predicting future values of response variable in a linear regression model having an equi-correlated covariance structure and have studied efficiency properties of tro unbiased predictors with respect to criterion of variance covariance matrix. Our analysis has brought out some interesting findings that may prove useful to practitioners. It may be remarked that our investigations have assumed parameter p characterizing covariance structure to be known. When it is unknown, we may employ its estimate suggested by, for instance, Fuller and Battese (1973) and Srivastava (1984). Substituting such an estimate for p in Wf and W in (5), we can derive a feasible version of optimal predictor. Such a substitution will, however, disturb optimal property of predictor (5). It would be interesting to analyze performance of such feasible predictors and would be a subject matter of future work. REFRRENCES Bibby, J. and Toutenburg, H.(1978) Prediction And Improved Estimation In Linear Models, John Wiley, New York. Chandrasekar, B. and Prabakaran, T.E. (1994). A note on optimal vector unbiased predictor. Stat. Papers, 35, Fuller, W.A. pnd Battese, G.E. (1973). Transformations for estimation of linear models with nested - error structure. J. Amer. Statist. Assoc., 68, Goldberger, A.S. (1962). Best linear unbiased prediction in generalized linear regression 57, model. J. Amer. Statist. Assoc., Holt, D. and Scott, A.J. (1981). Regression analysis using survey data. The Statistician, 30, King, M.L. and Evans, M.A. (1986). Testing for block effects in' regression models based on SUrvey data. J. Amer. Statist. Assoc., 81, Me Elroy, F.W. (1967). A sufficient condition that squares estimator be best J. Amer. Statist. Assoc., necessary and ordinary least linear unbiased. 62, Munoz, A., Rosner, B. and Carey, V.(1986). Regression Analysis in Presence of heterogeneous intraclass Correlations. Biometrics, 42, Rao, C.R. and Toutenburg, H. (1995) Linear Springer. Models, Least Squares And Alternatives, 243 Rosner, B. (1984). Multivariate methods in OPhthalmology with appli.cations to or
5 . ~ - L44 paired-data situations. Biometrics, 40. Shalabh (1995). Performance of Stein-rule procedure for simultaneous prediction of actual and average values of study variable in linear regression model. Proceed. Fiftieth Session Int. Stat. Inst., Srivastava, M.S. (1984). intraclass correlation in Biometrika, 71, Estimation familial of data. Zellner, A. (1994). Bayesjan and Non-Bayesian estimation using balanced loss functions (in Statistical Decision Theory And Related Topics V, eds. S.S. Gupta and J.O. Berger), Springer-Verlag, New York. Shalabh Department of Statistics University of Jammu Jammu , India
of Restricted and Mixed Regression Estimators
Biom. J. 38 (1996) 8, 951-959 Akademie Verlag \ Predictive Performance of the Methods of Restricted and Mixed Regression Estimators H. TOUTENBURG Institut fur Statistik Universitat Miinchen Germany SHALABH
More informationBayesian Estimation of Regression Coefficients Under Extended Balanced Loss Function
Communications in Statistics Theory and Methods, 43: 4253 4264, 2014 Copyright Taylor & Francis Group, LLC ISSN: 0361-0926 print / 1532-415X online DOI: 10.1080/03610926.2012.725498 Bayesian Estimation
More informationStein-Rule Estimation under an Extended Balanced Loss Function
Shalabh & Helge Toutenburg & Christian Heumann Stein-Rule Estimation under an Extended Balanced Loss Function Technical Report Number 7, 7 Department of Statistics University of Munich http://www.stat.uni-muenchen.de
More informationSociedad de Estadística e Investigación Operativa
Sociedad de Estadística e Investigación Operativa Test Volume 14, Number 2. December 2005 Estimation of Regression Coefficients Subject to Exact Linear Restrictions when Some Observations are Missing and
More informationProjektpartner. Sonderforschungsbereich 386, Paper 163 (1999) Online unter:
Toutenburg, Shalabh: Estimation of Regression Coefficients Subject to Exact Linear Restrictions when some Observations are Missing and Balanced Loss Function is Used Sonderforschungsbereich 386, Paper
More informationON EFFICIENT FORECASTING IN LINEAR REGRESSION MODELS
Journal of Quantitative Economics, Vol. 13, No.2 (July 1997 133-140 ON EFFICIENT FORECASTING IN LINEAR REGRESSION MODELS SHALABH Department of Statistics, University of Jammu, Jammu-180004, India In this
More informationPseudo-minimax linear and mixed regression estimation of regression coecients when prior estimates are available
Statistics & Probability Letters 63 003 35 39 Pseudo-minimax linear and mixed regression estimation of regression coecients when prior estimates are available H. Shalabh a, H. Toutenburg b; a Department
More informationMean squared error matrix comparison of least aquares and Stein-rule estimators for regression coefficients under non-normal disturbances
METRON - International Journal of Statistics 2008, vol. LXVI, n. 3, pp. 285-298 SHALABH HELGE TOUTENBURG CHRISTIAN HEUMANN Mean squared error matrix comparison of least aquares and Stein-rule estimators
More information304 A^VÇÚO 1n ò while the commonly employed loss function for the precision of estimation is squared error loss function ( β β) ( β β) (1.3) or weight
A^VÇÚO 1n ò 1nÏ 2014c6 Chinese Journal of Applied Probability and Statistics Vol.30 No.3 Jun. 2014 The Best Linear Unbiased Estimation of Regression Coefficient under Weighted Balanced Loss Function Fang
More informationInverse of a Square Matrix. For an N N square matrix A, the inverse of A, 1
Inverse of a Square Matrix For an N N square matrix A, the inverse of A, 1 A, exists if and only if A is of full rank, i.e., if and only if no column of A is a linear combination 1 of the others. A is
More information1. Introduction Over the last three decades a number of model selection criteria have been proposed, including AIC (Akaike, 1973), AICC (Hurvich & Tsa
On the Use of Marginal Likelihood in Model Selection Peide Shi Department of Probability and Statistics Peking University, Beijing 100871 P. R. China Chih-Ling Tsai Graduate School of Management University
More informationMarcia Gumpertz and Sastry G. Pantula Department of Statistics North Carolina State University Raleigh, NC
A Simple Approach to Inference in Random Coefficient Models March 8, 1988 Marcia Gumpertz and Sastry G. Pantula Department of Statistics North Carolina State University Raleigh, NC 27695-8203 Key Words
More informationImproved Multivariate Prediction in a General Linear Model with an Unknown Error Covariance Matrix
Journal of Multivariate Analysis 83, 166 182 (2002) doi:10.1006/jmva.2001.2042 Improved Multivariate Prediction in a General Linear Model with an Unknown Error Covariance Matrix Anoop Chaturvedi University
More informationChapter 14 Stein-Rule Estimation
Chapter 14 Stein-Rule Estimation The ordinary least squares estimation of regression coefficients in linear regression model provides the estimators having minimum variance in the class of linear and unbiased
More informationCOLLABORATION OF STATISTICAL METHODS IN SELECTING THE CORRECT MULTIPLE LINEAR REGRESSIONS
American Journal of Biostatistics 4 (2): 29-33, 2014 ISSN: 1948-9889 2014 A.H. Al-Marshadi, This open access article is distributed under a Creative Commons Attribution (CC-BY) 3.0 license doi:10.3844/ajbssp.2014.29.33
More informationEconometric textbooks usually discuss the procedures to be adopted
Economic and Social Review Vol. 9 No. 4 Substituting Means for Missing Observations in Regression D. CONNIFFE An Foras Taluntais I INTRODUCTION Econometric textbooks usually discuss the procedures to be
More informationLarge Sample Properties of Estimators in the Classical Linear Regression Model
Large Sample Properties of Estimators in the Classical Linear Regression Model 7 October 004 A. Statement of the classical linear regression model The classical linear regression model can be written in
More informationCost analysis of alternative modes of delivery by lognormal regression model
2016; 2(9): 215-219 ISSN Print: 2394-7500 ISSN Online: 2394-5869 Impact Factor: 5.2 IJAR 2016; 2(9): 215-219 www.allresearchjournal.com Received: 02-07-2016 Accepted: 03-08-2016 Vice Principal MVP Samaj
More informationA note on the equality of the BLUPs for new observations under two linear models
ACTA ET COMMENTATIONES UNIVERSITATIS TARTUENSIS DE MATHEMATICA Volume 14, 2010 A note on the equality of the BLUPs for new observations under two linear models Stephen J Haslett and Simo Puntanen Abstract
More informationTesting Some Covariance Structures under a Growth Curve Model in High Dimension
Department of Mathematics Testing Some Covariance Structures under a Growth Curve Model in High Dimension Muni S. Srivastava and Martin Singull LiTH-MAT-R--2015/03--SE Department of Mathematics Linköping
More informationECONOMETRIC THEORY. MODULE VI Lecture 19 Regression Analysis Under Linear Restrictions
ECONOMETRIC THEORY MODULE VI Lecture 9 Regression Analysis Under Linear Restrictions Dr Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur One of the basic objectives
More informationIntroduction to Within-Person Analysis and RM ANOVA
Introduction to Within-Person Analysis and RM ANOVA Today s Class: From between-person to within-person ANOVAs for longitudinal data Variance model comparisons using 2 LL CLP 944: Lecture 3 1 The Two Sides
More informationSmall area estimation with missing data using a multivariate linear random effects model
Department of Mathematics Small area estimation with missing data using a multivariate linear random effects model Innocent Ngaruye, Dietrich von Rosen and Martin Singull LiTH-MAT-R--2017/07--SE Department
More informationCharles E. McCulloch Biometrics Unit and Statistics Center Cornell University
A SURVEY OF VARIANCE COMPONENTS ESTIMATION FROM BINARY DATA by Charles E. McCulloch Biometrics Unit and Statistics Center Cornell University BU-1211-M May 1993 ABSTRACT The basic problem of variance components
More informationy it = α i + β 0 ix it + ε it (0.1) The panel data estimators for the linear model are all standard, either the application of OLS or GLS.
0.1. Panel Data. Suppose we have a panel of data for groups (e.g. people, countries or regions) i =1, 2,..., N over time periods t =1, 2,..., T on a dependent variable y it and a kx1 vector of independent
More informationMARGINAL HOMOGENEITY MODEL FOR ORDERED CATEGORIES WITH OPEN ENDS IN SQUARE CONTINGENCY TABLES
REVSTAT Statistical Journal Volume 13, Number 3, November 2015, 233 243 MARGINAL HOMOGENEITY MODEL FOR ORDERED CATEGORIES WITH OPEN ENDS IN SQUARE CONTINGENCY TABLES Authors: Serpil Aktas Department of
More informationPREDICTION IN RESTRICTED REGRESSION MODELS
JOURNAL OF COMBINATORlCS, INFORMATION & SYSTEM SCIENCES Vol. 29, Nos. 1-4, 229-238. 2002 PREDICTION IN RESTRICTED REGRESSION MODELS SHALABH Department of Mathematics Indian Institute of Technology Kanpur.
More informationComparison of prediction quality of the best linear unbiased predictors in time series linear regression models
1 Comparison of prediction quality of the best linear unbiased predictors in time series linear regression models Martina Hančová Institute of Mathematics, P. J. Šafárik University in Košice Jesenná 5,
More informationNext is material on matrix rank. Please see the handout
B90.330 / C.005 NOTES for Wednesday 0.APR.7 Suppose that the model is β + ε, but ε does not have the desired variance matrix. Say that ε is normal, but Var(ε) σ W. The form of W is W w 0 0 0 0 0 0 w 0
More informationREPLICATION VARIANCE ESTIMATION FOR TWO-PHASE SAMPLES
Statistica Sinica 8(1998), 1153-1164 REPLICATION VARIANCE ESTIMATION FOR TWO-PHASE SAMPLES Wayne A. Fuller Iowa State University Abstract: The estimation of the variance of the regression estimator for
More informationOn the Efficiencies of Several Generalized Least Squares Estimators in a Seemingly Unrelated Regression Model and a Heteroscedastic Model
Journal of Multivariate Analysis 70, 8694 (1999) Article ID jmva.1999.1817, available online at http:www.idealibrary.com on On the Efficiencies of Several Generalized Least Squares Estimators in a Seemingly
More informationTesting Statistical Hypotheses
E.L. Lehmann Joseph P. Romano Testing Statistical Hypotheses Third Edition 4y Springer Preface vii I Small-Sample Theory 1 1 The General Decision Problem 3 1.1 Statistical Inference and Statistical Decisions
More informationIntroductory Econometrics
Based on the textbook by Wooldridge: : A Modern Approach Robert M. Kunst robert.kunst@univie.ac.at University of Vienna and Institute for Advanced Studies Vienna December 11, 2012 Outline Heteroskedasticity
More informationJournal of Multivariate Analysis. Use of prior information in the consistent estimation of regression coefficients in measurement error models
Journal of Multivariate Analysis 00 (2009) 498 520 Contents lists available at ScienceDirect Journal of Multivariate Analysis journal homepage: www.elsevier.com/locate/jmva Use of prior information in
More informationINTRODUCTORY ECONOMETRICS
INTRODUCTORY ECONOMETRICS Lesson 2b Dr Javier Fernández etpfemaj@ehu.es Dpt. of Econometrics & Statistics UPV EHU c J Fernández (EA3-UPV/EHU), February 21, 2009 Introductory Econometrics - p. 1/192 GLRM:
More informationRestricted Maximum Likelihood in Linear Regression and Linear Mixed-Effects Model
Restricted Maximum Likelihood in Linear Regression and Linear Mixed-Effects Model Xiuming Zhang zhangxiuming@u.nus.edu A*STAR-NUS Clinical Imaging Research Center October, 015 Summary This report derives
More informationStochastic Design Criteria in Linear Models
AUSTRIAN JOURNAL OF STATISTICS Volume 34 (2005), Number 2, 211 223 Stochastic Design Criteria in Linear Models Alexander Zaigraev N. Copernicus University, Toruń, Poland Abstract: Within the framework
More informationApproximate analysis of covariance in trials in rare diseases, in particular rare cancers
Approximate analysis of covariance in trials in rare diseases, in particular rare cancers Stephen Senn (c) Stephen Senn 1 Acknowledgements This work is partly supported by the European Union s 7th Framework
More informationSpecification errors in linear regression models
Specification errors in linear regression models Jean-Marie Dufour McGill University First version: February 2002 Revised: December 2011 This version: December 2011 Compiled: December 9, 2011, 22:34 This
More informationTesting Simple Hypotheses R.L. Wolpert Institute of Statistics and Decision Sciences Duke University, Box Durham, NC 27708, USA
Testing Simple Hypotheses R.L. Wolpert Institute of Statistics and Decision Sciences Duke University, Box 90251 Durham, NC 27708, USA Summary: Pre-experimental Frequentist error probabilities do not summarize
More informationResearchers often record several characters in their research experiments where each character has a special significance to the experimenter.
Dimension reduction in multivariate analysis using maximum entropy criterion B. K. Hooda Department of Mathematics and Statistics CCS Haryana Agricultural University Hisar 125 004 India D. S. Hooda Jaypee
More informationCanonical Correlation Analysis of Longitudinal Data
Biometrics Section JSM 2008 Canonical Correlation Analysis of Longitudinal Data Jayesh Srivastava Dayanand N Naik Abstract Studying the relationship between two sets of variables is an important multivariate
More informationReview of Classical Least Squares. James L. Powell Department of Economics University of California, Berkeley
Review of Classical Least Squares James L. Powell Department of Economics University of California, Berkeley The Classical Linear Model The object of least squares regression methods is to model and estimate
More informationLINEAR REGRESSION ANALYSIS. MODULE XVI Lecture Exercises
LINEAR REGRESSION ANALYSIS MODULE XVI Lecture - 44 Exercises Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur Exercise 1 The following data has been obtained on
More informationAnalysis of the AIC Statistic for Optimal Detection of Small Changes in Dynamic Systems
Analysis of the AIC Statistic for Optimal Detection of Small Changes in Dynamic Systems Jeremy S. Conner and Dale E. Seborg Department of Chemical Engineering University of California, Santa Barbara, CA
More informationLinear Regression. In this problem sheet, we consider the problem of linear regression with p predictors and one intercept,
Linear Regression In this problem sheet, we consider the problem of linear regression with p predictors and one intercept, y = Xβ + ɛ, where y t = (y 1,..., y n ) is the column vector of target values,
More informationFinancial Econometrics
Material : solution Class : Teacher(s) : zacharias psaradakis, marian vavra Example 1.1: Consider the linear regression model y Xβ + u, (1) where y is a (n 1) vector of observations on the dependent variable,
More informationProblem Set #6: OLS. Economics 835: Econometrics. Fall 2012
Problem Set #6: OLS Economics 835: Econometrics Fall 202 A preliminary result Suppose we have a random sample of size n on the scalar random variables (x, y) with finite means, variances, and covariance.
More informationMultivariate Regression
Multivariate Regression The so-called supervised learning problem is the following: we want to approximate the random variable Y with an appropriate function of the random variables X 1,..., X p with the
More informationBootstrap Simulation Procedure Applied to the Selection of the Multiple Linear Regressions
JKAU: Sci., Vol. 21 No. 2, pp: 197-212 (2009 A.D. / 1430 A.H.); DOI: 10.4197 / Sci. 21-2.2 Bootstrap Simulation Procedure Applied to the Selection of the Multiple Linear Regressions Ali Hussein Al-Marshadi
More informationData Mining and Data Warehousing. Henryk Maciejewski. Data Mining Predictive modelling: regression
Data Mining and Data Warehousing Henryk Maciejewski Data Mining Predictive modelling: regression Algorithms for Predictive Modelling Contents Regression Classification Auxiliary topics: Estimation of prediction
More informationCOMPREHENSIVE WRITTEN EXAMINATION, PAPER III FRIDAY AUGUST 26, 2005, 9:00 A.M. 1:00 P.M. STATISTICS 174 QUESTION
COMPREHENSIVE WRITTEN EXAMINATION, PAPER III FRIDAY AUGUST 26, 2005, 9:00 A.M. 1:00 P.M. STATISTICS 174 QUESTION Answer all parts. Closed book, calculators allowed. It is important to show all working,
More information14 Multiple Linear Regression
B.Sc./Cert./M.Sc. Qualif. - Statistics: Theory and Practice 14 Multiple Linear Regression 14.1 The multiple linear regression model In simple linear regression, the response variable y is expressed in
More informationA predictive density approach to predicting a future observable in multilevel models
Journal of Statistical Planning and Inference 128 (2005) 149 164 www.elsevier.com/locate/jspi A predictive density approach to predicting a future observable in multilevel models David Afshartous a;, Jan
More informationA discussion on multiple regression models
A discussion on multiple regression models In our previous discussion of simple linear regression, we focused on a model in which one independent or explanatory variable X was used to predict the value
More informationA new algebraic analysis to linear mixed models
A new algebraic analysis to linear mixed models Yongge Tian China Economics and Management Academy, Central University of Finance and Economics, Beijing 100081, China Abstract. This article presents a
More informationThe Simple Regression Model. Part II. The Simple Regression Model
Part II The Simple Regression Model As of Sep 22, 2015 Definition 1 The Simple Regression Model Definition Estimation of the model, OLS OLS Statistics Algebraic properties Goodness-of-Fit, the R-square
More informationLinear Model Under General Variance
Linear Model Under General Variance We have a sample of T random variables y 1, y 2,, y T, satisfying the linear model Y = X β + e, where Y = (y 1,, y T )' is a (T 1) vector of random variables, X = (T
More informationPoisson Regression. Ryan Godwin. ECON University of Manitoba
Poisson Regression Ryan Godwin ECON 7010 - University of Manitoba Abstract. These lecture notes introduce Maximum Likelihood Estimation (MLE) of a Poisson regression model. 1 Motivating the Poisson Regression
More informationLeast Squares Estimation-Finite-Sample Properties
Least Squares Estimation-Finite-Sample Properties Ping Yu School of Economics and Finance The University of Hong Kong Ping Yu (HKU) Finite-Sample 1 / 29 Terminology and Assumptions 1 Terminology and Assumptions
More informationRegression Models - Introduction
Regression Models - Introduction In regression models there are two types of variables that are studied: A dependent variable, Y, also called response variable. It is modeled as random. An independent
More informationA Covariance Regression Model
A Covariance Regression Model Peter D. Hoff 1 and Xiaoyue Niu 2 December 8, 2009 Abstract Classical regression analysis relates the expectation of a response variable to a linear combination of explanatory
More informationRegression Analysis. y t = β 1 x t1 + β 2 x t2 + β k x tk + ϵ t, t = 1,..., T,
Regression Analysis The multiple linear regression model with k explanatory variables assumes that the tth observation of the dependent or endogenous variable y t is described by the linear relationship
More informationPart 8: GLMs and Hierarchical LMs and GLMs
Part 8: GLMs and Hierarchical LMs and GLMs 1 Example: Song sparrow reproductive success Arcese et al., (1992) provide data on a sample from a population of 52 female song sparrows studied over the course
More informationLECTURE 2 LINEAR REGRESSION MODEL AND OLS
SEPTEMBER 29, 2014 LECTURE 2 LINEAR REGRESSION MODEL AND OLS Definitions A common question in econometrics is to study the effect of one group of variables X i, usually called the regressors, on another
More informationGeneralized, Linear, and Mixed Models
Generalized, Linear, and Mixed Models CHARLES E. McCULLOCH SHAYLER.SEARLE Departments of Statistical Science and Biometrics Cornell University A WILEY-INTERSCIENCE PUBLICATION JOHN WILEY & SONS, INC. New
More informationA MODEL-BASED EVALUATION OF SEVERAL WELL-KNOWN VARIANCE ESTIMATORS FOR THE COMBINED RATIO ESTIMATOR
Statistica Sinica 8(1998), 1165-1173 A MODEL-BASED EVALUATION OF SEVERAL WELL-KNOWN VARIANCE ESTIMATORS FOR THE COMBINED RATIO ESTIMATOR Phillip S. Kott National Agricultural Statistics Service Abstract:
More informationIntroduction to Simple Linear Regression
Introduction to Simple Linear Regression Yang Feng http://www.stat.columbia.edu/~yangfeng Yang Feng (Columbia University) Introduction to Simple Linear Regression 1 / 68 About me Faculty in the Department
More informationJournal of Asian Scientific Research COMBINED PARAMETERS ESTIMATION METHODS OF LINEAR REGRESSION MODEL WITH MULTICOLLINEARITY AND AUTOCORRELATION
Journal of Asian Scientific Research ISSN(e): 3-1331/ISSN(p): 6-574 journal homepage: http://www.aessweb.com/journals/5003 COMBINED PARAMETERS ESTIMATION METHODS OF LINEAR REGRESSION MODEL WITH MULTICOLLINEARITY
More informationOn Efficiency of Midzuno-Sen Strategy under Two-phase Sampling
International Journal of Statistics and Analysis. ISSN 2248-9959 Volume 7, Number 1 (2017), pp. 19-26 Research India Publications http://www.ripublication.com On Efficiency of Midzuno-Sen Strategy under
More informationEmpirical likelihood inference for regression parameters when modelling hierarchical complex survey data
Empirical likelihood inference for regression parameters when modelling hierarchical complex survey data Melike Oguz-Alper Yves G. Berger Abstract The data used in social, behavioural, health or biological
More informationOn Selecting Tests for Equality of Two Normal Mean Vectors
MULTIVARIATE BEHAVIORAL RESEARCH, 41(4), 533 548 Copyright 006, Lawrence Erlbaum Associates, Inc. On Selecting Tests for Equality of Two Normal Mean Vectors K. Krishnamoorthy and Yanping Xia Department
More informationRECENT DEVELOPMENTS IN VARIANCE COMPONENT ESTIMATION
Libraries Conference on Applied Statistics in Agriculture 1989-1st Annual Conference Proceedings RECENT DEVELOPMENTS IN VARIANCE COMPONENT ESTIMATION R. R. Hocking Follow this and additional works at:
More informationThe Multiple Regression Model
Multiple Regression The Multiple Regression Model Idea: Examine the linear relationship between 1 dependent (Y) & or more independent variables (X i ) Multiple Regression Model with k Independent Variables:
More informationBIAS-ROBUSTNESS AND EFFICIENCY OF MODEL-BASED INFERENCE IN SURVEY SAMPLING
Statistica Sinica 22 (2012), 777-794 doi:http://dx.doi.org/10.5705/ss.2010.238 BIAS-ROBUSTNESS AND EFFICIENCY OF MODEL-BASED INFERENCE IN SURVEY SAMPLING Desislava Nedyalova and Yves Tillé University of
More informationTrends in Human Development Index of European Union
Trends in Human Development Index of European Union Department of Statistics, Hacettepe University, Beytepe, Ankara, Turkey spxl@hacettepe.edu.tr, deryacal@hacettepe.edu.tr Abstract: The Human Development
More informationGauss Markov & Predictive Distributions
Gauss Markov & Predictive Distributions Merlise Clyde STA721 Linear Models Duke University September 14, 2017 Outline Topics Gauss-Markov Theorem Estimability and Prediction Readings: Christensen Chapter
More informationVariable Selection and Model Building
LINEAR REGRESSION ANALYSIS MODULE XIII Lecture - 37 Variable Selection and Model Building Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur The complete regression
More informationResearch Article Ratio Type Exponential Estimator for the Estimation of Finite Population Variance under Two-stage Sampling
Research Journal of Applied Sciences, Engineering and Technology 7(19): 4095-4099, 2014 DOI:10.19026/rjaset.7.772 ISSN: 2040-7459; e-issn: 2040-7467 2014 Maxwell Scientific Publication Corp. Submitted:
More informationHISTORICAL PERSPECTIVE OF SURVEY SAMPLING
HISTORICAL PERSPECTIVE OF SURVEY SAMPLING A.K. Srivastava Former Joint Director, I.A.S.R.I., New Delhi -110012 1. Introduction The purpose of this article is to provide an overview of developments in sampling
More informationBayesian Estimation of a Possibly Mis-Specified Linear Regression Model
Econometrics Working Paper EWP14 ISSN 1485-6441 Department of Economics Bayesian Estimation of a Possibly Mis-Specified Linear Regression Model David E. Giles Department of Economics, University of Victoria
More informationTesting Statistical Hypotheses
E.L. Lehmann Joseph P. Romano, 02LEu1 ttd ~Lt~S Testing Statistical Hypotheses Third Edition With 6 Illustrations ~Springer 2 The Probability Background 28 2.1 Probability and Measure 28 2.2 Integration.........
More informationA Test of Homogeneity Against Umbrella Scale Alternative Based on Gini s Mean Difference
J. Stat. Appl. Pro. 2, No. 2, 145-154 (2013) 145 Journal of Statistics Applications & Probability An International Journal http://dx.doi.org/10.12785/jsap/020207 A Test of Homogeneity Against Umbrella
More informationSTAT 540: Data Analysis and Regression
STAT 540: Data Analysis and Regression Wen Zhou http://www.stat.colostate.edu/~riczw/ Email: riczw@stat.colostate.edu Department of Statistics Colorado State University Fall 205 W. Zhou (Colorado State
More informationMulticollinearity and A Ridge Parameter Estimation Approach
Journal of Modern Applied Statistical Methods Volume 15 Issue Article 5 11-1-016 Multicollinearity and A Ridge Parameter Estimation Approach Ghadban Khalaf King Khalid University, albadran50@yahoo.com
More informationConsistent Bivariate Distribution
A Characterization of the Normal Conditional Distributions MATSUNO 79 Therefore, the function ( ) = G( : a/(1 b2)) = N(0, a/(1 b2)) is a solu- tion for the integral equation (10). The constant times of
More informationSmall Area Estimates of Poverty Incidence in the State of Uttar Pradesh in India
Small Area Estimates of Poverty Incidence in the State of Uttar Pradesh in India Hukum Chandra Indian Agricultural Statistics Research Institute, New Delhi Email: hchandra@iasri.res.in Acknowledgments
More informationTightening Durbin-Watson Bounds
The Economic and Social Review, Vol. 28, No. 4, October, 1997, pp. 351-356 Tightening Durbin-Watson Bounds DENIS CONNIFFE* The Economic and Social Research Institute Abstract: The null distribution of
More informationChapter 5 Matrix Approach to Simple Linear Regression
STAT 525 SPRING 2018 Chapter 5 Matrix Approach to Simple Linear Regression Professor Min Zhang Matrix Collection of elements arranged in rows and columns Elements will be numbers or symbols For example:
More informationSample size calculations for logistic and Poisson regression models
Biometrika (2), 88, 4, pp. 93 99 2 Biometrika Trust Printed in Great Britain Sample size calculations for logistic and Poisson regression models BY GWOWEN SHIEH Department of Management Science, National
More information114 A^VÇÚO 1n ò where y is an n 1 random vector of observations, X is a known n p matrix of full column rank, ε is an n 1 unobservable random vector,
A^VÇÚO 1n ò 1Ï 2015c4 Chinese Journal of Applied Probability and Statistics Vol.31 No.2 Apr. 2015 Optimal Estimator of Regression Coefficient in a General Gauss-Markov Model under a Balanced Loss Function
More informationAnalysis of variance, multivariate (MANOVA)
Analysis of variance, multivariate (MANOVA) Abstract: A designed experiment is set up in which the system studied is under the control of an investigator. The individuals, the treatments, the variables
More informationPanel Data Models. James L. Powell Department of Economics University of California, Berkeley
Panel Data Models James L. Powell Department of Economics University of California, Berkeley Overview Like Zellner s seemingly unrelated regression models, the dependent and explanatory variables for panel
More informationAnalysis of Microtubules using. for Growth Curve modeling.
Analysis of Microtubules using Growth Curve Modeling Md. Aleemuddin Siddiqi S. Rao Jammalamadaka Statistics and Applied Probability, University of California, Santa Barbara March 1, 2006 1 Introduction
More informationGeneralized Linear Models (GLZ)
Generalized Linear Models (GLZ) Generalized Linear Models (GLZ) are an extension of the linear modeling process that allows models to be fit to data that follow probability distributions other than the
More informationRegression. ECO 312 Fall 2013 Chris Sims. January 12, 2014
ECO 312 Fall 2013 Chris Sims Regression January 12, 2014 c 2014 by Christopher A. Sims. This document is licensed under the Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported License What
More informationExperimental Design and Data Analysis for Biologists
Experimental Design and Data Analysis for Biologists Gerry P. Quinn Monash University Michael J. Keough University of Melbourne CAMBRIDGE UNIVERSITY PRESS Contents Preface page xv I I Introduction 1 1.1
More informationAn Unbiased C p Criterion for Multivariate Ridge Regression
An Unbiased C p Criterion for Multivariate Ridge Regression (Last Modified: March 7, 2008) Hirokazu Yanagihara 1 and Kenichi Satoh 2 1 Department of Mathematics, Graduate School of Science, Hiroshima University
More informationLesson 17: Vector AutoRegressive Models
Dipartimento di Ingegneria e Scienze dell Informazione e Matematica Università dell Aquila, umberto.triacca@ec.univaq.it Vector AutoRegressive models The extension of ARMA models into a multivariate framework
More informationSTAT Chapter 11: Regression
STAT 515 -- Chapter 11: Regression Mostly we have studied the behavior of a single random variable. Often, however, we gather data on two random variables. We wish to determine: Is there a relationship
More information