Your use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at
|
|
- Kelley Osborne
- 5 years ago
- Views:
Transcription
1 Regression Analysis when there is Prior Information about Supplementary Variables Author(s): D. R. Cox Source: Journal of the Royal Statistical Society. Series B (Methodological), Vol. 22, No. 1 (1960), pp Published by: Wiley for the Royal Statistical Society Stable URL: Accessed: :46 UTC JSTOR is a not-for-profit service that helps scholars, researchers, and students discover, use, and build upon a wide range of content in a trusted digital archive. We use information technology and tools to increase productivity and facilitate new forms of scholarship. For more information about JSTOR, please contact support@jstor.org. Your use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at Royal Statistical Society, Wiley are collaborating with JSTOR to digitize, preserve and extend access to Journal of the Royal Statistical Society. Series B (Methodological)
2 172 [No. 1, Regression Analysis when there is Prior Information about Supplementary Variables By D. R. Cox Birkbeck College, University of London [Received September, 1959] SUMMARY In estimating the regression coefficient of y on x, we can sometimes increase precision by using supplementary observations, u. We need to have prior information about the form of the relations among y, x, and u. An implication for experimental design is noted. CONSIDER a linear regression of the form 1. INTRODUCTION Yj= a+xi+ei (i= 1,...,n), (1) where the E's are uncorrelated random quantities with zero mean and constant variance cu2, and suppose that we wish to estimate /. More generally we may have a multiple regression of the form Yi=?+glxli+... (i=l,..., n) (2) and may wish to estimate 91, g..., p Suppose further that we have observations not only on y and x, but also on a supplementary variable u, or more generally on a set of supplementary variables ul,...,ur. If we can make prior assumptions about the form of the relationship between y, x and u, we may be able to use the observations u to obtain an estimate of / more precise than the straightforward sample regression coefficie y on x. A very familiar example is analysis of covariance, using a concomitant variable u to increase the precision of treatment comparisons. In the simplest case of a completely randomized design comparing p treatments, Xki = 1 if the ith observation received treatment k and Xki = 0 otherwise. The parameters 9..., / p are treatment effects, and the straightforward regression coefficients of y on x are the unadjusted sample means. The assumptions necessary to make use of u can be put in various ways. The simplest mathematically is to require that the term 0c+ Ei in (2) is of the form x' + yui + ei, where ei is a random quantity of zero mean and constant variance a2, different e's being uncorrelated with one another and with the values of x. Thus (2) becomes Yi = a-' + 9, xii + *** + 9p xpi + )'ui + ei (3) and the least-squares estimates of l,..., /3 p are the usual treatment estimates adjuste for regression on u. The prior assumption that ui is independent of the x's is of cours
3 1960] Cox - Regression Analysis with Prior Information of Variables 173 crucial; without it, even if the regression (3) were linear, the /'s in (3) would not be the same as those in (2). In this paper we consider situations where the prior information about y, x and u takes a rather different form. Some of what follows is similar to work on linear relations in econometrics, in particular to the study of instrumental variables. The object in this paper, however, is to obtain increased precision, not to secure identifiability. 2. A SIMPLE SPECIAL CASE Consider an industrial process with two stages. Suppose that in the ith run, xi i a measurement on the raw material before the first stage of processing, or the level of a factor governing the first stage of processing. For the same run, let yi measure a property of the final product, and let ui measure a property of the output from the first stage. Suppose that we are interested in the total regression coefficient of y on x, i.e. in the regression ignoring u. Sometimes it may be reasonable to postulate from general knowledge of the process that xi may affect u*, but that xi can only affect y, through the value of u*, i.e. that given ui, yi is independent of xi. For linear relationships, this can be expressed in the equations ui = A+ 8Uxi +,qi, (4) Yi = 0 + Oui + Ci, (5) where A. ju, 0, Q are unknown parameters and of zero mean and variances Ca"Gr,. Equations (4) and (5) lead to Yi = 0+ OA + Otxi + -i + (i = cx+3xi +,i, (6) say. Here / = OA2 and Ei cr2 = o 2 + a2? In equations (4) and (5) yi and ui are observed values of random vari the xi also are random we argue conditionally on the observed values. Th of / from (6) is the sample regression coefficient P* of y on x and o2 V(/*) = (7) css (x) or 2 u bu a2(8 (8) css (x) where css (x) is the corrected sum of squares of the x*, Z(x* -)2. If we assume that i and G in (4) and (5) are independently normally distributed, the log-likelihood is - n log (2us - A -u X)2 (y2-o-u)2 (9) It follows that the maximum likelihood estimate of /3 = u is 0-2A, where $ respectively the simple regression coefficients of y on u and of u on x. Further it
4 174 Cox - Regression Analysis with Prior Information of Variables [No. 1, follows, for example from the information matrix, that $ and p: are asymptotically independent with U2 V($)= ( _ (10) css (u) at;, ~~~~~~~~(11) yu2css (x) +nu2 V(H)=. (12) css (x) Thus V(P3), 2 V( P)+ 2 V(H) (13) 2 CSS (X) (U2+ 02 r2q) + n02 ag (14) (14) CSS (X) [[k2 C The estimate 3 is exactly unbiased; a more detailed study of its properties is facilitated by assuming that the xi are independently normally distributed. In the analysis of data we estimate V($), V(,a) by the usual formulae for the sampling variance of regression coefficients, and then substitute directly in (13). To compare theoretically the precision of the two estimates * and /, we have from (8) and (14) that ( V(/*) c k2css (x)+ + nn 2? (15) V() p2 CSS (X +n2[02 C2/( S2)]. Therefore the asymptotic variance of 3 is always less than the variance of /3*. An alternative form of (15) is obtained by defining Py,u and p,u by p2y [CS()71a7 (16) p _ 02 [112 css x)+ nur2] 2 nag css _P2U (x) /I l (17) (16) and (17) are, from (4) and (5), ratios of and hence the p's can be considered as c V(f*) P - PYu -Pu P18 V( 2 u+ p2 X-2p2 up2 u18 This ratio greatly exceeds one when both p2u and P2u are small, and approaches one when either or both of p 2u and pu are near one. This expresses the qualitatively obvious fact that appreciable additional precision can be obtained by introducing u only when u contains much information not already available in y and x. The distinction between /* and 3 can be seen by considering, in the usual notation for total and partial regression coefficients, the formula gvx= 9Y.u+Fgu.X9uX; (19) under our special assumption 9YX = 0, 9U z = /,g vz = ]ugux. (20) The estimate 3 corresponds to formula (20), the estimate ignoring u to the general formula (19).
5 1960] Cox - Regression Analysis with Prior Information of Variables A NUMERICAL EXAMPLE To illustrate these formulae the artificial data in Table 1 were constructed using tables of random normal deviates. The estimate /* ignoring u, i.e. the sample regression coefficient of y on x, is 0 74 with an estimated standard error of The estimate / is obtained as the product of the regression coefficient of y on u times that of u on x and is x = The variances of the factors in this product are as estimated by the usual formulae and are combined by (13) to give an approximate standard error for of In this example / is appreciably nearer than 6* to the true value: -=; the approximate efficiency of A* relative to 1 is (0-197/0-233)2 = The prior assumption underlying the use of /B is that the partial regression coefficient of y on x given u is zero. It will, in practice, always be advisable to check that the data are consistent with the assumption. In the present example the sample partial regression coefficient is with an estimated standard error of TABLE 1. Artificial data for dependent variable y, independent variable x and supplementary variable u. y x U y x U y x In equations (4), (5) the following values have been taken: A = 0 = 0, y = i, q = 1, with xi, -i, i normally distributed with means 5, 0 and 0 and unit variance. 4. GENERALIZATIONS The situation of section 2 can be generalized in several ways of which the following are examples. We may have the multiple regression (2) on several x variables; this includes as a special case the specification in a standard lay-out of observations in terms of treatment effects and row, column, etc., effects. With a single supplementary variab u, the equations analogous to (4) and (5) would be u* = A + tt xli + * * + Mp xpi + qt(21) y*= 0 +O?ui+ si, (22) leading to / t = b1i. The estimatio multiple regression of u on the x's, a likelihood estimate of gi is then $,&. enter into (22), for example the x's representing row and column effects in a Latin square; the estimate A is then a residual regression coefficient.
6 176 Cox - Regression Analysis with Prior Information of Variables [No. 1, If there are several supplementary variables u1,...,ut, the aim should be to set up, if appropriate, linear relations, with independent errors, for the random variables y,u1,..., ur. The equations should involve the x's linearly and should express the special prior knowledge about the system that is assumed to be available. Separate analyses of these equations yield maximum likelihood estimates of the parameters in the equations. The true regression coefficients 91,,fP of y on xi,..., xp can obtained as functions of the parameters in the starting relations, and hence maximum likelihood estimates of the P's are obtained. The whole procedure is an immediat generalization of that of section 2 and will not be discussed in detail here. It is possible to express in matrix form the conditions that have to be satisfied for the resulting estimate to be different from, and to have smaller variance than, the sample regression coefficients of y on xl,... xp ignoring ul,..., u,. An example would be the analysis of a randomized block experiment with a pair of supplementary variables of the type considered above and in addition a concomitant variable. 5. APPLICATION TO EXPERIMENTAL DESIGN Suppose that we are designing an experiment to compare a number of alternative treatments, the final observation in terms of which the treatments are to be compared being y. The results above show that the precision of the treatment comparisons can be improved by recording a supplementary variable u, possibly of no practical importance in itself, measuring the state of the experimental unit after the treatments have exerted their full effect, but before y can be measured. That is, there is to be a single regression relation between y and u, the same for all treatments. The purpose of such a supplementary variable is to remove the effect of random variation entering the system after the treatments have exerted their effect. As such it is to be contrasted with analysis of covariance using a concomitant variable, which aims at removing variation associated with the experimental units before the allocation of treatments. The correctness of the prior assumption underlying the covariance analysis is ensured by first measuring the concomitant variable and then applying the treatments in a random way, independently of the concomitant variable. The correctness of the assumption underlying the method proposed here cannot be ensured in a similar way, and remains a prior assumption requiring critical thought. Cases where the assumption can properly be made probably do not arise very frequently. If the assumption is satisfied, there should not be an appreciable variation between treatments in y after regression on u has been eliminated; this should always be checked, but it would, of course, be quite wrong to use u in the way described simply because the mean square of y between treatments adjusting for regression on u is insignificant. A more general use of "intermediate" variables is not for increasing precision but for "explaining" treatment effects on the principal variable y. I am grateful to members of the Operational Research Department, Steel Company of Wales, for asking some questions that led to this investigation.
Your use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at
A Note on the Efficiency of Least-Squares Estimates Author(s): D. R. Cox and D. V. Hinkley Source: Journal of the Royal Statistical Society. Series B (Methodological), Vol. 30, No. 2 (1968), pp. 284-289
More informationYour use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at
Biometrika Trust Robust Regression via Discriminant Analysis Author(s): A. C. Atkinson and D. R. Cox Source: Biometrika, Vol. 64, No. 1 (Apr., 1977), pp. 15-19 Published by: Oxford University Press on
More informationYour use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at
On the Estimation of the Intensity Function of a Stationary Point Process Author(s): D. R. Cox Source: Journal of the Royal Statistical Society. Series B (Methodological), Vol. 27, No. 2 (1965), pp. 332-337
More informationThe Econometric Society is collaborating with JSTOR to digitize, preserve and extend access to Econometrica.
A Set of Independent Necessary and Sufficient Conditions for Simple Majority Decision Author(s): Kenneth O. May Source: Econometrica, Vol. 20, No. 4 (Oct., 1952), pp. 680-684 Published by: The Econometric
More informationYour use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at
Biometrika Trust Some Remarks on Overdispersion Author(s): D. R. Cox Source: Biometrika, Vol. 70, No. 1 (Apr., 1983), pp. 269-274 Published by: Oxford University Press on behalf of Biometrika Trust Stable
More informationEach copy of any part of a JSTOR transmission must contain the same copyright notice that appears on the screen or printed page of such transmission.
The Variance of the Product of Random Variables Author(s): Leo A. Goodman Source: Journal of the American Statistical Association, Vol. 57, No. 297 (Mar., 1962), pp. 54-60 Published by: American Statistical
More informationYour use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at
Biometrika Trust Some Simple Approximate Tests for Poisson Variates Author(s): D. R. Cox Source: Biometrika, Vol. 40, No. 3/4 (Dec., 1953), pp. 354-360 Published by: Oxford University Press on behalf of
More informationEach copy of any part of a JSTOR transmission must contain the same copyright notice that appears on the screen or printed page of such transmission.
On the Bound for a Pair of Consecutive Quartic Residues of a Prime Author(s): R. G. Bierstedt and W. H. Mills Source: Proceedings of the American Mathematical Society, Vol. 14, No. 4 (Aug., 1963), pp.
More informationYour use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at
The Analysis of Multivariate Binary Data Author(s): D. R. Cox Source: Journal of the Royal Statistical Society. Series C (Applied Statistics), Vol. 21, No. 2 (1972), pp. 113-120 Published by: Wiley for
More informationThe Periodogram and its Optical Analogy.
The Periodogram and Its Optical Analogy Author(s): Arthur Schuster Reviewed work(s): Source: Proceedings of the Royal Society of London. Series A, Containing Papers of a Mathematical and Physical Character,
More informationYour use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at
Some Applications of Exponential Ordered Scores Author(s): D. R. Cox Source: Journal of the Royal Statistical Society. Series B (Methodological), Vol. 26, No. 1 (1964), pp. 103-110 Published by: Wiley
More informationYour use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at
Biometrika Trust The Use of a Concomitant Variable in Selecting an Experimental Design Author(s): D. R. Cox Source: Biometrika, Vol. 44, No. 1/2 (Jun., 1957), pp. 150-158 Published by: Oxford University
More informationEach copy of any part of a JSTOR transmission must contain the same copyright notice that appears on the screen or printed page of such transmission.
On Runs of Residues Author(s): D. H. Lehmer and Emma Lehmer Source: Proceedings of the American Mathematical Society, Vol. 13, No. 1 (Feb., 1962), pp. 102-106 Published by: American Mathematical Society
More informationYour use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at
American Society for Quality A Note on the Graphical Analysis of Multidimensional Contingency Tables Author(s): D. R. Cox and Elizabeth Lauh Source: Technometrics, Vol. 9, No. 3 (Aug., 1967), pp. 481-488
More informationBiometrika Trust. Biometrika Trust is collaborating with JSTOR to digitize, preserve and extend access to Biometrika.
Biometrika Trust An Improved Bonferroni Procedure for Multiple Tests of Significance Author(s): R. J. Simes Source: Biometrika, Vol. 73, No. 3 (Dec., 1986), pp. 751-754 Published by: Biometrika Trust Stable
More informationYour use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at
The Interpretation of Interaction in Contingency Tables Author(s): E. H. Simpson Source: Journal of the Royal Statistical Society. Series B (Methodological), Vol. 13, No. 2 (1951), pp. 238-241 Published
More informationInternational Biometric Society is collaborating with JSTOR to digitize, preserve and extend access to Biometrics.
400: A Method for Combining Non-Independent, One-Sided Tests of Significance Author(s): Morton B. Brown Reviewed work(s): Source: Biometrics, Vol. 31, No. 4 (Dec., 1975), pp. 987-992 Published by: International
More informationThe Review of Economic Studies, Ltd.
The Review of Economic Studies, Ltd. Oxford University Press http://www.jstor.org/stable/2297086. Your use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at.
More informationDetection of Influential Observation in Linear Regression. R. Dennis Cook. Technometrics, Vol. 19, No. 1. (Feb., 1977), pp
Detection of Influential Observation in Linear Regression R. Dennis Cook Technometrics, Vol. 19, No. 1. (Feb., 1977), pp. 15-18. Stable URL: http://links.jstor.org/sici?sici=0040-1706%28197702%2919%3a1%3c15%3adoioil%3e2.0.co%3b2-8
More informationMind Association. Oxford University Press and Mind Association are collaborating with JSTOR to digitize, preserve and extend access to Mind.
Mind Association Response to Colyvan Author(s): Joseph Melia Source: Mind, New Series, Vol. 111, No. 441 (Jan., 2002), pp. 75-79 Published by: Oxford University Press on behalf of the Mind Association
More information11] Index Number Which Shall Meet Certain of Fisher's Tests 397
Necessary and Sufficient Conditions Regarding the Form of an Index Number which Shall Meet Certain of Fisher's Tests Author(s): Ragnar Frisch Reviewed work(s): Source: Journal of the American Statistical
More informationYour use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at
A Look at Some Data on the Old Faithful Geyser Author(s): A. Azzalini and A. W. Bowman Source: Journal of the Royal Statistical Society. Series C (Applied Statistics), Vol. 39, No. 3 (1990), pp. 357-365
More informationBiometrika Trust. Biometrika Trust is collaborating with JSTOR to digitize, preserve and extend access to Biometrika.
Biometrika Trust A Stagewise Rejective Multiple Test Procedure Based on a Modified Bonferroni Test Author(s): G. Hommel Source: Biometrika, Vol. 75, No. 2 (Jun., 1988), pp. 383-386 Published by: Biometrika
More informationThe Econometric Society is collaborating with JSTOR to digitize, preserve and extend access to Econometrica.
On the Optimal Character of the (s, S) Policy in Inventory Theory Author(s): A. Dvoretzky, J. Kiefer, J. Wolfowitz Reviewed work(s): Source: Econometrica, Vol. 21, No. 4 (Oct., 1953), pp. 586-596 Published
More informationBiometrika Trust. Biometrika Trust is collaborating with JSTOR to digitize, preserve and extend access to Biometrika.
Biometrika Trust Discrete Sequential Boundaries for Clinical Trials Author(s): K. K. Gordon Lan and David L. DeMets Reviewed work(s): Source: Biometrika, Vol. 70, No. 3 (Dec., 1983), pp. 659-663 Published
More informationYour use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at
Queues with Time-Dependent Arrival Rates: II. The Maximum Queue and the Return to Equilibrium Author(s): G. F. Newell Source: Journal of Applied Probability, Vol. 5, No. 3 (Dec., 1968), pp. 579-590 Published
More informationEach copy of any part of a JSTOR transmission must contain the same copyright notice that appears on the screen or printed page of such transmission.
Uncountably Many Inequivalent Analytic Actions of a Compact Group on Rn Author(s): R. S. Palais and R. W. Richardson, Jr. Source: Proceedings of the American Mathematical Society, Vol. 14, No. 3 (Jun.,
More informationLECTURE 2 LINEAR REGRESSION MODEL AND OLS
SEPTEMBER 29, 2014 LECTURE 2 LINEAR REGRESSION MODEL AND OLS Definitions A common question in econometrics is to study the effect of one group of variables X i, usually called the regressors, on another
More informationYour use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at
A Note on Weighted Randomization Author(s): D. R. Cox Source: The Annals of Mathematical Statistics, Vol. 27, No. 4 (Dec., 1956), pp. 1144-1151 Published by: Institute of Mathematical Statistics Stable
More informationEach copy of any part of a JSTOR transmission must contain the same copyright notice that appears on the screen or printed page of such transmission.
Modalities in Ackermann's "Rigorous Implication" Author(s): Alan Ross Anderson and Nuel D. Belnap, Jr. Source: The Journal of Symbolic Logic, Vol. 24, No. 2 (Jun., 1959), pp. 107-111 Published by: Association
More informationEach copy of any part of a JSTOR transmission must contain the same copyright notice that appears on the screen or printed page of such transmission.
Selecting the Better Bernoulli Treatment Using a Matched Samples Design Author(s): Ajit C. Tamhane Source: Journal of the Royal Statistical Society. Series B (Methodological), Vol. 42, No. 1 (1980), pp.
More informationEach copy of any part of a JSTOR transmission must contain the same copyright notice that appears on the screen or printed page of such transmission.
On the Probability of Covering the Circle by Rom Arcs Author(s): F. W. Huffer L. A. Shepp Source: Journal of Applied Probability, Vol. 24, No. 2 (Jun., 1987), pp. 422-429 Published by: Applied Probability
More informationINFORMS is collaborating with JSTOR to digitize, preserve and extend access to Management Science.
On the Translocation of Masses Author(s): L. Kantorovitch Source: Management Science, Vol. 5, No. 1 (Oct., 1958), pp. 1-4 Published by: INFORMS Stable URL: http://www.jstor.org/stable/2626967. Accessed:
More informationINFORMS is collaborating with JSTOR to digitize, preserve and extend access to Mathematics of Operations Research.
New Finite Pivoting Rules for the Simplex Method Author(s): Robert G. Bland Reviewed work(s): Source: Mathematics of Operations Research, Vol. 2, No. 2 (May, 1977), pp. 103-107 Published by: INFORMS Stable
More informationEach copy of any part of a JSTOR transmission must contain the same copyright notice that appears on the screen or printed page of such transmission.
Merging of Opinions with Increasing Information Author(s): David Blackwell and Lester Dubins Source: The Annals of Mathematical Statistics, Vol. 33, No. 3 (Sep., 1962), pp. 882-886 Published by: Institute
More informationMathematical Association of America is collaborating with JSTOR to digitize, preserve and extend access to The American Mathematical Monthly.
A Proof of Weierstrass's Theorem Author(s): Dunham Jackson Reviewed work(s): Source: The American Mathematical Monthly, Vol. 41, No. 5 (May, 1934), pp. 309-312 Published by: Mathematical Association of
More informationAnnals of Mathematics
Annals of Mathematics The Clifford-Klein Space Forms of Indefinite Metric Author(s): Joseph A. Wolf Reviewed work(s): Source: The Annals of Mathematics, Second Series, Vol. 75, No. 1 (Jan., 1962), pp.
More informationTesting Linear Restrictions: cont.
Testing Linear Restrictions: cont. The F-statistic is closely connected with the R of the regression. In fact, if we are testing q linear restriction, can write the F-stastic as F = (R u R r)=q ( R u)=(n
More informationRegression Models - Introduction
Regression Models - Introduction In regression models, two types of variables that are studied: A dependent variable, Y, also called response variable. It is modeled as random. An independent variable,
More information1. The Multivariate Classical Linear Regression Model
Business School, Brunel University MSc. EC550/5509 Modelling Financial Decisions and Markets/Introduction to Quantitative Methods Prof. Menelaos Karanasos (Room SS69, Tel. 08956584) Lecture Notes 5. The
More informationEconometric textbooks usually discuss the procedures to be adopted
Economic and Social Review Vol. 9 No. 4 Substituting Means for Missing Observations in Regression D. CONNIFFE An Foras Taluntais I INTRODUCTION Econometric textbooks usually discuss the procedures to be
More informationE. DROR, W. G. DWYER AND D. M. KAN
Self Homotopy Equivalences of Postnikov Conjugates Author(s): E. Dror, W. G. Dwyer, D. M. Kan Reviewed work(s): Source: Proceedings of the American Mathematical Society, Vol. 74, No. 1 (Apr., 1979), pp.
More informationEcological Society of America is collaborating with JSTOR to digitize, preserve and extend access to Ecology.
Measures of the Amount of Ecologic Association Between Species Author(s): Lee R. Dice Reviewed work(s): Source: Ecology, Vol. 26, No. 3 (Jul., 1945), pp. 297-302 Published by: Ecological Society of America
More informationEach copy of any part of a JSTOR transmission must contain the same copyright notice that appears on the screen or printed page of such transmission.
Measuring the Speed and Altitude of an Aircraft Using Similar Triangles Author(s): Hassan Sedaghat Source: SIAM Review, Vol. 33, No. 4 (Dec., 1991), pp. 650-654 Published by: Society for Industrial and
More informationEach copy of any part of a JSTOR transmission must contain the same copyright notice that appears on the screen or printed page of such transmission.
A Generic Property of the Bounded Syzygy Solutions Author(s): Florin N. Diacu Source: Proceedings of the American Mathematical Society, Vol. 116, No. 3 (Nov., 1992), pp. 809-812 Published by: American
More informationECONOMETRICS FIELD EXAM Michigan State University August 21, 2009
ECONOMETRICS FIELD EXAM Michigan State University August 21, 2009 Instructions: Answer all four (4) questions. Point totals for each question are given in parentheses; there are 100 points possible. Within
More informationEach copy of any part of a JSTOR transmission must contain the same copyright notice that appears on the screen or printed page of such transmission.
Fermat's Little Theorem: Proofs That Fermat Might Have Used Author(s): Bob Burn Source: The Mathematical Gazette, Vol. 86, No. 507 (Nov., 2002), pp. 415-422 Published by: The Mathematical Association Stable
More informationYour use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at
A Quincuncial Projection of the Sphere Author(s): C. S. Peirce Source: American Journal of Mathematics, Vol. 2, No. 4 (Dec., 1879), pp. 394-396 Published by: The Johns Hopkins University Press Stable URL:
More informationCORRELATIONS ~ PARTIAL REGRESSION COEFFICIENTS (GROWTH STUDY PAPER #29) and. Charles E. Werts
RB-69-6 ASSUMPTIONS IN MAKING CAUSAL INFERENCES FROM PART CORRELATIONS ~ PARTIAL CORRELATIONS AND PARTIAL REGRESSION COEFFICIENTS (GROWTH STUDY PAPER #29) Robert L. Linn and Charles E. Werts This Bulletin
More informationYour use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at
A Renewal Problem with Bulk Ordering of Components Author(s): D. R. Cox Source: Journal of the Royal Statistical Society. Series B (Methodological), Vol. 21, No. 1 (1959), pp. 180-189 Published by: Wiley
More informationGeoffrey Woodhouse; Min Yang; Harvey Goldstein; Jon Rasbash
Adjusting for Measurement Error in Multilevel Analysis Geoffrey Woodhouse; Min Yang; Harvey Goldstein; Jon Rasbash Journal of the Royal Statistical Society. Series A (Statistics in Society), Vol. 159,
More informationESS 265 Spring Quarter 2005 Time Series Analysis: Linear Regression
ESS 265 Spring Quarter 2005 Time Series Analysis: Linear Regression Lecture 11 May 10, 2005 Multivariant Regression A multi-variant relation between a dependent variable y and several independent variables
More informationBiometrika Trust. Biometrika Trust is collaborating with JSTOR to digitize, preserve and extend access to Biometrika.
Biometrika Trust Inference Based on Regression Estimator in Double Sampling Author(s): Ajit C. Tamhane Source: Biometrika, Vol. 65, No. 2 (Aug., 1978), pp. 419-427 Published by: Biometrika Trust Stable
More informationPhilosophy of Science Association
Philosophy of Science Association Why Bohm's Theory Solves the Measurement Problem Author(s): Tim Maudlin Source: Philosophy of Science, Vol. 62, No. 3 (Sep., 1995), pp. 479-483 Published by: The University
More informationTwo-Variable Regression Model: The Problem of Estimation
Two-Variable Regression Model: The Problem of Estimation Introducing the Ordinary Least Squares Estimator Jamie Monogan University of Georgia Intermediate Political Methodology Jamie Monogan (UGA) Two-Variable
More informationStatistics, Data Analysis, and Simulation SS 2015
Statistics, Data Analysis, and Simulation SS 2015 08.128.730 Statistik, Datenanalyse und Simulation Dr. Michael O. Distler Mainz, June 2, 2015 Dr. Michael O. Distler
More informationMathematics of Operations Research, Vol. 2, No. 2. (May, 1977), pp
New Finite Pivoting Rules for the Simplex Method Robert G. Bland Mathematics of Operations Research, Vol. 2, No. 2. (May, 1977), pp. 103-107. Stable URL: http://links.jstor.org/sici?sici=0364-765x%28197705%292%3a2%3c103%3anfprft%3e2.0.co%3b2-t
More informationRegression Models - Introduction
Regression Models - Introduction In regression models there are two types of variables that are studied: A dependent variable, Y, also called response variable. It is modeled as random. An independent
More informationAmerican Society for Quality
American Society for Quality The 2k-p Fractional Factorial Designs Part I Author(s): G. E. P. Box and J. S. Hunter Source: Technometrics, Vol. 3, No. 3 (Aug., 1961), pp. 311-351 Published by: American
More information(a) (3 points) Construct a 95% confidence interval for β 2 in Equation 1.
Problem 1 (21 points) An economist runs the regression y i = β 0 + x 1i β 1 + x 2i β 2 + x 3i β 3 + ε i (1) The results are summarized in the following table: Equation 1. Variable Coefficient Std. Error
More informationDimensionality Reduction Techniques (DRT)
Dimensionality Reduction Techniques (DRT) Introduction: Sometimes we have lot of variables in the data for analysis which create multidimensional matrix. To simplify calculation and to get appropriate,
More informationON THE DISTRIBUTION OF RESIDUALS IN FITTED PARAMETRIC MODELS. C. P. Quesenberry and Charles Quesenberry, Jr.
.- ON THE DISTRIBUTION OF RESIDUALS IN FITTED PARAMETRIC MODELS C. P. Quesenberry and Charles Quesenberry, Jr. Results of a simulation study of the fit of data to an estimated parametric model are reported.
More informationEach copy of any part of a JSTOR transmission must contain the same copyright notice that appears on the screen or printed page of such transmission.
6625 Author(s): Nicholas Strauss, Jeffrey Shallit, Don Zagier Source: The American Mathematical Monthly, Vol. 99, No. 1 (Jan., 1992), pp. 66-69 Published by: Mathematical Association of America Stable
More information2 Prediction and Analysis of Variance
2 Prediction and Analysis of Variance Reading: Chapters and 2 of Kennedy A Guide to Econometrics Achen, Christopher H. Interpreting and Using Regression (London: Sage, 982). Chapter 4 of Andy Field, Discovering
More informationECON Program Evaluation, Binary Dependent Variable, Misc.
ECON 351 - Program Evaluation, Binary Dependent Variable, Misc. Maggie Jones () 1 / 17 Readings Chapter 13: Section 13.2 on difference in differences Chapter 7: Section on binary dependent variables Chapter
More informationEconometrics A. Simple linear model (2) Keio University, Faculty of Economics. Simon Clinet (Keio University) Econometrics A October 16, / 11
Econometrics A Keio University, Faculty of Economics Simple linear model (2) Simon Clinet (Keio University) Econometrics A October 16, 2018 1 / 11 Estimation of the noise variance σ 2 In practice σ 2 too
More informationImputation for Missing Data under PPSWR Sampling
July 5, 2010 Beijing Imputation for Missing Data under PPSWR Sampling Guohua Zou Academy of Mathematics and Systems Science Chinese Academy of Sciences 1 23 () Outline () Imputation method under PPSWR
More informationMath 423/533: The Main Theoretical Topics
Math 423/533: The Main Theoretical Topics Notation sample size n, data index i number of predictors, p (p = 2 for simple linear regression) y i : response for individual i x i = (x i1,..., x ip ) (1 p)
More informationSimple Linear Regression: The Model
Simple Linear Regression: The Model task: quantifying the effect of change X in X on Y, with some constant β 1 : Y = β 1 X, linear relationship between X and Y, however, relationship subject to a random
More informationEach copy of any part of a JSTOR transmission must contain the same copyright notice that appears on the screen or printed page of such transmission.
A Primal Method for the Assignment and Transportation Problems Author(s): M. L. Balinski and R. E. Gomory Source: Management Science, Vol. 10, No. 3 (Apr., 1964), pp. 578-593 Published by: INFORMS Stable
More information7. Variable extraction and dimensionality reduction
7. Variable extraction and dimensionality reduction The goal of the variable selection in the preceding chapter was to find least useful variables so that it would be possible to reduce the dimensionality
More informationLikelihood and p-value functions in the composite likelihood context
Likelihood and p-value functions in the composite likelihood context D.A.S. Fraser and N. Reid Department of Statistical Sciences University of Toronto November 19, 2016 Abstract The need for combining
More informationJournal of Applied Probability, Vol. 13, No. 3. (Sep., 1976), pp
Buffon's Problem with a Long Needle Persi Diaconis Journal of Applied Probability, Vol. 13, No. 3. (Sep., 1976), pp. 614-618. Stable URL: http://links.jstor.org/sici?sici=0021-9002%28197609%2913%3a3%3c614%3abpwaln%3e2.0.co%3b2-p
More informationLinear Models in Econometrics
Linear Models in Econometrics Nicky Grant At the most fundamental level econometrics is the development of statistical techniques suited primarily to answering economic questions and testing economic theories.
More information1 Introduction. 2 A regression model
Regression Analysis of Compositional Data When Both the Dependent Variable and Independent Variable Are Components LA van der Ark 1 1 Tilburg University, The Netherlands; avdark@uvtnl Abstract It is well
More informationIntroduction to Machine Learning
10-701 Introduction to Machine Learning PCA Slides based on 18-661 Fall 2018 PCA Raw data can be Complex, High-dimensional To understand a phenomenon we measure various related quantities If we knew what
More informationEach copy of any part of a JSTOR transmission must contain the same copyright notice that appears on the screen or printed page of such transmission.
On the Hahn-Banach Extension Property Author(s): Jonathan M. Borwein Source: Proceedings of the American Mathematical Society, Vol. 86, No. 1, (Sep., 1982), pp. 42-46 Published by: American Mathematical
More informationThis content downloaded from on Thu, 3 Oct :28:06 AM All use subject to JSTOR Terms and Conditions
Hempel and Oppenheim on Explanation Author(s): Rolf Eberle, David Kaplan and Richard Montague Source: Philosophy of Science, Vol. 28, No. 4 (Oct., 1961), pp. 418-428 Published by: The University of Chicago
More informationFinite Population Sampling and Inference
Finite Population Sampling and Inference A Prediction Approach RICHARD VALLIANT ALAN H. DORFMAN RICHARD M. ROYALL A Wiley-Interscience Publication JOHN WILEY & SONS, INC. New York Chichester Weinheim Brisbane
More informationYour use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at
A Simple Non-Desarguesian Plane Geometry Author(s): Forest Ray Moulton Source: Transactions of the American Mathematical Society, Vol. 3, No. 2 (Apr., 1902), pp. 192-195 Published by: American Mathematical
More informationThe Econometric Society is collaborating with JSTOR to digitize, preserve and extend access to Econometrica.
Sample Selection Bias as a Specification Error Author(s): James J. Heckman Source: Econometrica, Vol. 47, No. 1 (Jan., 1979), pp. 153-161 Published by: The Econometric Society Stable URL: http://www.jstor.org/stable/1912352
More informationECO 310: Empirical Industrial Organization Lecture 2 - Estimation of Demand and Supply
ECO 310: Empirical Industrial Organization Lecture 2 - Estimation of Demand and Supply Dimitri Dimitropoulos Fall 2014 UToronto 1 / 55 References RW Section 3. Wooldridge, J. (2008). Introductory Econometrics:
More informationEach copy of any part of a JSTOR transmission must contain the same copyright notice that appears on the screen or printed page of such transmission.
!"#$%%&"%&"'()"*+,&%$-,./',%+"0()%$)-"&%$"!$1,'$/$2"#3/+)"4%-/,+5!6'(%$7589":6;/3"
More informationThe American Mathematical Monthly, Vol. 100, No. 8. (Oct., 1993), pp
A Visual Explanation of Jensen's Inequality Tristan Needham The American Mathematical Monthly, Vol. 100, No. 8. (Oct., 1993), pp. 768-771. Stable URL: http://links.jstor.org/sici?sici=0002-9890%28199310%29100%3a8%3c768%3aaveoji%3e2.0.co%3b2-8
More informationIENG581 Design and Analysis of Experiments INTRODUCTION
Experimental Design IENG581 Design and Analysis of Experiments INTRODUCTION Experiments are performed by investigators in virtually all fields of inquiry, usually to discover something about a particular
More informationECON The Simple Regression Model
ECON 351 - The Simple Regression Model Maggie Jones 1 / 41 The Simple Regression Model Our starting point will be the simple regression model where we look at the relationship between two variables In
More informationP a g e 5 1 of R e p o r t P B 4 / 0 9
P a g e 5 1 of R e p o r t P B 4 / 0 9 J A R T a l s o c o n c l u d e d t h a t a l t h o u g h t h e i n t e n t o f N e l s o n s r e h a b i l i t a t i o n p l a n i s t o e n h a n c e c o n n e
More informationThe Econometric Society is collaborating with JSTOR to digitize, preserve and extend access to Econometrica.
The Probability of a Cyclical Majority Author(s): Frank DeMeyer and Charles R. Plott Source: Econometrica, Vol. 38, No. 2 (Mar., 1970), pp. 345-354 Published by: The Econometric Society Stable URL: http://www.jstor.org/stable/1913015.
More informationKey Algebraic Results in Linear Regression
Key Algebraic Results in Linear Regression James H. Steiger Department of Psychology and Human Development Vanderbilt University James H. Steiger (Vanderbilt University) 1 / 30 Key Algebraic Results in
More informationMaking sense of Econometrics: Basics
Making sense of Econometrics: Basics Lecture 2: Simple Regression Egypt Scholars Economic Society Happy Eid Eid present! enter classroom at http://b.socrative.com/login/student/ room name c28efb78 Outline
More informationREGRESSION WITH CORRELATED ERRORS C.A. GLASBEY
41 REGRESSION WITH CORRELATED ERRORS C.A. GLASBEY SYSTEMATIC RESIDUALS When data exhibit systematic departures from a fitted regression line (see for example Figs 1 and 2), either the regression function
More informationOn the relation between initial value and slope
Biostatistics (2005), 6, 3, pp. 395 403 doi:10.1093/biostatistics/kxi017 Advance Access publication on April 14, 2005 On the relation between initial value and slope K. BYTH NHMRC Clinical Trials Centre,
More informationThe College Mathematics Journal, Vol. 24, No. 4. (Sep., 1993), pp
Taylor Polynomial Approximations in Polar Coordinates Sheldon P. Gordon The College Mathematics Journal, Vol. 24, No. 4. (Sep., 1993), pp. 325-330. Stable URL: http://links.jstor.org/sici?sici=0746-8342%28199309%2924%3a4%3c325%3atpaipc%3e2.0.co%3b2-m
More informationMathematical Association of America is collaborating with JSTOR to digitize, preserve and extend access to The American Mathematical Monthly.
Recounting the Rationals Author(s): Neil Calkin and Herbert S. Wilf Source: The American Mathematical Monthly, Vol. 107, No. 4 (Apr., 2000), pp. 360-363 Published by: Mathematical Association of America
More informationA MODEL-BASED EVALUATION OF SEVERAL WELL-KNOWN VARIANCE ESTIMATORS FOR THE COMBINED RATIO ESTIMATOR
Statistica Sinica 8(1998), 1165-1173 A MODEL-BASED EVALUATION OF SEVERAL WELL-KNOWN VARIANCE ESTIMATORS FOR THE COMBINED RATIO ESTIMATOR Phillip S. Kott National Agricultural Statistics Service Abstract:
More informationNo is the Easiest Answer: Using Calibration to Assess Nonignorable Nonresponse in the 2002 Census of Agriculture
No is the Easiest Answer: Using Calibration to Assess Nonignorable Nonresponse in the 2002 Census of Agriculture Phillip S. Kott National Agricultural Statistics Service Key words: Weighting class, Calibration,
More informationEconometrics of Panel Data
Econometrics of Panel Data Jakub Mućk Meeting # 6 Jakub Mućk Econometrics of Panel Data Meeting # 6 1 / 36 Outline 1 The First-Difference (FD) estimator 2 Dynamic panel data models 3 The Anderson and Hsiao
More informationL2: Two-variable regression model
L2: Two-variable regression model Feng Li feng.li@cufe.edu.cn School of Statistics and Mathematics Central University of Finance and Economics Revision: September 4, 2014 What we have learned last time...
More informationHeteroskedasticity. Part VII. Heteroskedasticity
Part VII Heteroskedasticity As of Oct 15, 2015 1 Heteroskedasticity Consequences Heteroskedasticity-robust inference Testing for Heteroskedasticity Weighted Least Squares (WLS) Feasible generalized Least
More informationMathematical Association of America
Mathematical Association of America http://www.jstor.org/stable/2975232. Your use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at. http://www.jstor.org/page/info/about/policies/terms.jsp
More information