Use of Transformations and the Repeated Statement in PROC GLM in SAS Ed Stanek
|
|
- Elmer Lewis
- 6 years ago
- Views:
Transcription
1 Use of Transformations and the Reeated Statement in PROC GLM in SAS Ed Stanek Introduction We describe how the Reeated Statement in PROC GLM in SAS transforms the data to rovide tests of hyotheses of interest. A good reference for multivariate methods is Timm (975). We use the SAS manual as a reference for the reeated statement. First, we briefly review notation and the context for multivariate data. The Poulation, Samle, and Context Consider a simle random samle of n subjects from a very large oulation. Assume that there are measures of resonse made on each selected subject. The measures may corresond to measures of different characteristics of the subjects (such as age, height, weight, systolic blood ressure, etc), or reeated measures of the same variable (total cholesterol) at different times or conditions. With these assumtions, we reresent the vector of resonses for the i th selected subject as Y = Y Y Y. We will assume that selections of subjects is indeendent, but ( 2 ) i i i i that measures on a selected subject may be correlated, reresenting var be740-trans-reeatedsas.doc /25/2006 Y = Σ. In exerimental settings, Factor level may be assigned to subjects (blocks) or to occasions within a subject (lots). Factors assigned to subjects are modeled with a design matrix such that Y= Xβ + E Y 2 where Y Y =, X is a design matrix reresenting the levels of the factor assigned to n n k Yn β β2 β selected subject, β β β β = is a matrix of arameters, with rows k βk βk2 β k corresonding to a level of factor A, and columns corresonding to the measures, or var vec = var vec Y = Σ I. occasions. With these assumtions, ( Y ) I Σ, or Estimation under a General Linear Multivariate Model n Estimates of the arameters corresonding to least squares estimates can be obtained similar to estimates in univariate models. The estimates are given by i n
2 ( XX) β ˆ = XY. k Since vec( ABC) = ( C A) vec( B ), then exressing β ˆ = [ ] ( I XX X ) vec( Y) k ( vec( ˆ )) which simlifies to var ( vec ( ˆ )) = ( XX ) that vec ˆ so that var vec ( ˆ ) β =, and hence be740-trans-reeatedsas.doc /25/ k ( I XX X )( I ) I X( XX ) XX X Y I, we find var = n = ˆ ( XX ) β Σ. β Σ, β Σ. The variance matrix is estimated by ( ˆ Y Xβ) ( Y Xβˆ) Σ= ˆ, n k Hyotheses under A General Linear Multivariate Normal Model Traditionally, hyotheses have been secified for a general linear multivariate β β2 β model that are linear combinations of rows and columns of β β β β =. k βk βk2 β k Such hyotheses are exressed as L β M = 0, where L and M are matrices of g k u g k k u constants. For examle, the hyothesis of whether or not the average of the arameters in the first row equals the average of the arameters in the second row is secified by setting L = ( 0 0 0) and M =. It should be clear that there k are limitations in defining hyotheses in terms of L β M = 0. With such a structure, it is g k k u not ossible to define L and M test the hyothesis that β + β2 = β + β2. Using g k u mixed models, any linear hyothesis concerning the elements of β can be tested. When u = and M is of full rank, then M is a square matrix that can be viewed as a transformation matrix. The standard multivariate model can be written as a model on a set of transformed random variables. This is the idea behind the Reeated Statement in PROC GLM. A Model for A Transformed Set of Random Variables We transform the random variables in a multivariate model by ost-multilying by
3 the non-singular matrix M. The model is given by which we exress as YM = Xβ M + EM Y = Xβ + E where Y = YM, β = β M, and vec = vec = vec E = EM. Note that ( Y ) ( YM) ( M In ) ( Y ) while vec ( ) = vec ( ) = ( n ) vec ( ) ( β ) = ( βm) = ( M In ) ( β ). Then in the transformed model, E ( Y ) = vec vec vec where ( vec( Y )) = ( I M )( I Σ )( I M) var n n n = I M Σ M n = I Σ n Y MY I M Y and Xβ and Σ = M Σ M. Thus, all the analysis tools used for the usual multivariate model can be alied to the transformed multivariate model. Examle: Secial Case For A Simle Resonse Error Model Suose that indeendent measures are made on each selected subject in a th simle random samle of n subjects from a large oulation. Let the model for the k measure on the i th selected subject be given by Y ik = + E ik 2 2 where σ σ var i e 2 N 2 e σ s N s= Y = I + J = Σ, with σ = reresenting the average resonse N 2 error in the oulation, and σ = ( ) 2 s reresenting the variance between N s= subjects. Consider a transformation matrix M = M ( ) where we assume that M = 0. Thus, the column sace sanned by the remaining columns is orthogonal to the column sace of a one vector. Using this transformation matrix, Y = X E E Y = X var vec Y = I Σ where Σ = M Σ M. Using β +, β, and be740-trans-reeatedsas.doc /25/ n
4 the definitions of these terms, Σ = M Σ M 2 2 = ( σe + σ ) M I J M ( ) ( σei + σ J) ( σei + σ J) M. = M ( σei + σ J) M ( σei + σ J) M 2 2 ( σe + σ ) 0 = 2 σ e 0 M M Frequently, we will require the columns of the second art of the transformation matrix to be orthogonal, and normal (such that the inner roduct of the column vectors is ). 2 2 ( σ ) e + σ 0 When this is true, then M M = I ( ), and hence Σ = 2. Notice 0 σ e I( ) that with this choice of a transformation, the columns of the transformed random variables are indeendent. Thus, univariate methods can be used to test hyotheses concerning the transformed random variables. Using the Reeated Statement in PROC GLM in SAS In reeated measures studies, the same variable is measured under different conditions. Often, there are simle functions of the measures that are of interest. For examle, if there are 2 measures on each selected subject corresonding to a retest and osttest measure, then the difference between the two measures is of interest. This difference is secified in terms of an M matrix. If there is a factorial structure on the reeated measures, the main effects, and interactions can be secified in terms of linear combinations. We consider two examles as illustrations. First, suose that = 6 measures were made on each subject under each of the factor levels in a two factor study where Factor A had 2 levels, and Factor B had 3 levels. Let the resonses be organized as follows: Level of Factor A A A A A2 A2 A2 Level of Factor B B B2 B3 B B2 B3. Y Y Y Y Y Y Y i i i2 i3 i2 i22 i23 th Suose an aroriate model for the m measure on subject s under level j of Factor A and level k of Factor B is given by Y = + E m m be740-trans-reeatedsas.doc /25/2006 4
5 2 where E( Y m ) =, and ( Y ) σ var m =. Let us define arameters corresonding to the average exected resonse under level j of Factor A and level k of Factor B by N jk =, and re-arameterize these averages such that N s= α 2 β 3 =. 0 0 β αβ 22 αβ 2 23 With this arameterization, we can exress 2 2 α β 3 = (see bem032.sas). We summarize this by β αβ αβ 2 23 exressing = + α + β+ β2 + αβ+ αβ2. Finally, let us define a b s s ab j= k= jk = + δ =, where N a b =. Then Nab s= j= k= = jk + jk. = jk s + s + jk The first term is the subject by treatment interaction. This term is a difference in the subject effect under a secific treatment from the average subject effect. If a treatment affects subjects differently, this term will be non-zero. If the subject by treatment interaction is zero, the model simlifies. The mean structure is given by = + jk jk = s + jk. = + α + β + β + αβ + αβ + δ 2 2 s be740-trans-reeatedsas.doc /25/2006 5
6 Post-multilying Y i by M given by Z = Y M i i M = will results in ( ) ( ) Y Y Y Y =. The columns of this vector corresond to function that reresent main effects and interactions of the two factors. For examle, simly by testing the hyothesis that a b b b a a a a i i3 i2 i3 Yijk Yi k Yi2k Yij Yij3 Yij2 Yij3 j= k= k= k= i= i= i= i= Yi2 Yi23 Yi22 Yi23 E Z i2 = 0 will test for a main effect for Factor A. In such settings, some of the univariate tests on the transformed data will be interretable. be740-trans-reeatedsas.doc /25/2006 6
7 Polynomial Regression Polynomial regression oses no secial roblems for analysis of data. Polynomial functions of x i (i.e. x i 2, x i 3, etc) can be treated simly as different regression variables. There are two ecularities in analysis, however, that deserves secial discussion with resect to olynomial regression, or olynomial trends. The first relates to a comuting roblem. The second relates to testing contrasts in ANOVA alications that reresent olynomial trends. We discuss these two issues here. Examle: Cubic Polynomial model Suose heart rate is measured at P=6 walking seeds, corresonding to x i =, 2, 3, 4, 5 and 6 mh, for i=,...,6=p. Let y ij = heart rate at walking seed "i" on j th measure. If we assume that heart rate is a cubic function of walking seed, then y ij = β 0 + β x i + β 2 x i 2 + β 3 x i 3 + e ij is a cubic olyonmial model. When considering olynomial models, it is customary to include all lower order olynomial terms along with the highest olynomial term in the model. We will always follow this convention. We can estimate regression coefficients in the usual manner with a design matrix corresonding to 2 3 x x x 2 3 x 2 x2 x2 2 3 X= x3 x3 x x P xp xp Polynomial Models as Simle Transformation of Cell Mean Model. If a olynomial model is of degree (P-) for i=,...,p times, then there will be as many olynomial arameters as time oints. For examle, with P=6 walking seeds, a 5th degree olynomial model will have 6 arameters. In such cases, the olynomial arameters are simly a re-arameterization of the cell mean resonse at each time. The ideas can be illustrated with a simle examle with P=4. Suose that mean resonse at four doses are recorded, where the doses are, 2, 3, and 4. The four means can be reresented as their individual means. Alternatively, the four means be740-trans-reeatedsas.doc /25/2006 7
8 can be reresented by four regression arameters corresonding to a constant, linear, quadratic, and cubic arameter. The cell mean arameters can be transformed to form the regression arameters. The transformation is a re-arameterization. The connection between the arameters can be seen by considering the relationshi i = β 0 + β x i + β 2 x i 2 + β 3 x i 3 Using matrix notation, β β β 3 =X β= β or β = X -. This is a simle transformation of the means. If we had n measures at each dose, we could first estimate the oulation mean resonse based on the samle mean. We could then transform these mean resonses to regression coefficients. Estimate of regression coefficients in a model with n measures er dose can be fit directly using a design matrix, where the design matrix can be exressed as a set of individual design matrices (like the one given above). X 0 = X X... Then X 0 X 0 = n (X X). As a result, when the same number of measures are made at each dose level (or time oint), the X X matrix is a function of the olynomial matrix for a single set of measures. Problems With Polynomial Design Matrices: Examle With 0 Times; Suose a child is measured at P=0 times. Let the times be given by,2,3,4,5,6,7,8,9,0, where the measures corresond to the weight of at each of 0 ages. Suose a 8th order (x 8 i ) regression model is to be fit to these data. To fit this, we need to invert the design matrix, X X. This turns out to be a difficult comuting roblem. For examle, in PROC REG, the rogram will not form the regression coefficients. In PROC IML, a check of (X X) - (X X) results in a matrix that is not an identify matrix. Orthogonal olynomials enable tests to be constructed for regression coefficients be740-trans-reeatedsas.doc /25/2006 8
9 in this roblem by rearameterizing the regression arameters, and thereby avoiding inverting a an ill conditionned matrix. The test results avoid the inaccuracies that may be introduced by matrix inversion. Although tests can be constructed based on orthogonal olynomials (as well as redicted values), the matrix inversion is necessary to estimate regression arameters on the original metric. For this reason, this re-arameterization is often not done. Choleski Decomosition of Symmetric Full Rank Matrix and its Relationshi to Orthogonal Polynomials Orthogonal olynomials were introduced as a way of making tests more recise and not deendent on the inversion of X X. While their use imroves accuracy of the tests, it transforms arameters into quantities that are not easily interretable. We illustrate orthogonal olynomials in the context of a olynomial regression with P time oints, where a olynomial of degree (P-) (having P arameters) is fit. We assume that the matrix X is a P x P square square olynomial matrix. When X reresents a matrix of olynomials, the matrix X X will be ositive definite (of full rank) and symmetrical. In such cases, it is ossible to factor the matrix using a Cholesky decomosition (see Timm, (975), 73-75). Cholesky factoring of a matrix A results in an uer triangular matrix T such that A = T T In PROC IML, the Cholesky decomositon is secified via the ROOT function, and results in the matrix T =ROOT(A). Of course, the question is how does this factorization hel in estimating sums of squares for regression roblems. To answer this question, we consider a transformation of the original X matrix that will result in a T matrix. First, note that X X = TT Both the matrices X and T are P x P matrices. Let us indictate the relationshi between X and T via a matrix P such that Then since X=PT, or P=X T - be740-trans-reeatedsas.doc /25/2006 9
10 which imlies that X X = TT = T P P T, P P=I Simle Examle with P=3. (x=,2,3); X X X (X X) T T (TT ) P Column Scale Factors: The coefficients in the matrix P are orthogonal olynomial coefficients. Aside: Note that the solution we have given for P requires inversion of the matrix T. If the design matrix is ill conditionned, then the matrix T will also be ill conditionned. Hence, it may be questionnable as to how much the roblem of inverting the matrix has been resolved. Another fucntion, ORPOL, in SAS will generate orthogonal olynomials without inverting T. This function using a slightly different algorithm, but does not aear to be better than simle use of the Choleski decomosition. Summary of Transformations of Regression Coefficients with Orthogonal Polynomials To summarize, if the model is Y = X β + e where X = P T, we can transform the model such that Y = P T β + e be740-trans-reeatedsas.doc /25/2006 0
11 = P β + e where β = T β. The model with transformed arameters will fit idential to the original model. It is easy to fit this model, since the design matrix is orthogonal, (P P=I) and hence, Also, ˆ β =P y ˆ )=IP 2 var( β σ where σ 2 is estimated via the MSE. [ Aside: It is this transformation that is used in the SAS Proceedure PROC GLM with a REPEATED POLYNOMIAL otion.] Note that the diagonal form of the variance of the transformed arameters indicates the indeendence of the arameters. be740-trans-reeatedsas.doc /25/2006
12 A similar analysis can be made when measures are made over time. Suose three measures of ulse rate are made on each selected subject immediately following exercise, minute following exercise, and 2 minutes following exercise. We may consider a transformation matrix similar to a olynomial matrix given by 0 0 M = 2 4 where columns corresond to a mean, a linear, and a quadratic trend. The transformation used in SAS is a normalized orthogonal olyonimal matrix, not the olynomial matrix given above. A normalized matrix means that the sum of the squared values of the coefficients in any column add u to. Orthogonal means that the inner roduct of any two columns of the matrix is zero. The orthonormal olynomial matrix is formed by taking the Choleski decomosition of the olynomial matrix (see Timm, (975) 73-75). The decomosition results in M = TT, where T is an uer triangular matrix. All elements of T below the diagonal are zero. In PROC IML, this can be obtained by the command T A ;. With this transformation, = ROOT References Timm, N.H. (975). Multivariate Analysis with Alications in Education and Psychology, Wadsworth Publishing Comany, Belmont, California. be740-trans-reeatedsas.doc /25/2006 2
General Linear Model Introduction, Classes of Linear models and Estimation
Stat 740 General Linear Model Introduction, Classes of Linear models and Estimation An aim of scientific enquiry: To describe or to discover relationshis among events (variables) in the controlled (laboratory)
More informationHotelling s Two- Sample T 2
Chater 600 Hotelling s Two- Samle T Introduction This module calculates ower for the Hotelling s two-grou, T-squared (T) test statistic. Hotelling s T is an extension of the univariate two-samle t-test
More informationNumerical Linear Algebra
Numerical Linear Algebra Numerous alications in statistics, articularly in the fitting of linear models. Notation and conventions: Elements of a matrix A are denoted by a ij, where i indexes the rows and
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analysis of Variance and Design of Exeriment-I MODULE II LECTURE -4 GENERAL LINEAR HPOTHESIS AND ANALSIS OF VARIANCE Dr. Shalabh Deartment of Mathematics and Statistics Indian Institute of Technology Kanur
More informationIntroduction to Probability and Statistics
Introduction to Probability and Statistics Chater 8 Ammar M. Sarhan, asarhan@mathstat.dal.ca Deartment of Mathematics and Statistics, Dalhousie University Fall Semester 28 Chater 8 Tests of Hyotheses Based
More informationSAS for Bayesian Mediation Analysis
Paer 1569-2014 SAS for Bayesian Mediation Analysis Miočević Milica, Arizona State University; David P. MacKinnon, Arizona State University ABSTRACT Recent statistical mediation analysis research focuses
More informationMATH 2710: NOTES FOR ANALYSIS
MATH 270: NOTES FOR ANALYSIS The main ideas we will learn from analysis center around the idea of a limit. Limits occurs in several settings. We will start with finite limits of sequences, then cover infinite
More informationMULTIVARIATE STATISTICAL PROCESS OF HOTELLING S T CONTROL CHARTS PROCEDURES WITH INDUSTRIAL APPLICATION
Journal of Statistics: Advances in heory and Alications Volume 8, Number, 07, Pages -44 Available at htt://scientificadvances.co.in DOI: htt://dx.doi.org/0.864/jsata_700868 MULIVARIAE SAISICAL PROCESS
More informationute measures of uncertainty called standard errors for these b j estimates and the resulting forecasts if certain conditions are satis- ed. Note the e
Regression with Time Series Errors David A. Dickey, North Carolina State University Abstract: The basic assumtions of regression are reviewed. Grahical and statistical methods for checking the assumtions
More informationEcon 3790: Business and Economics Statistics. Instructor: Yogesh Uppal
Econ 379: Business and Economics Statistics Instructor: Yogesh Ual Email: yual@ysu.edu Chater 9, Part A: Hyothesis Tests Develoing Null and Alternative Hyotheses Tye I and Tye II Errors Poulation Mean:
More informationEcon 3790: Business and Economics Statistics. Instructor: Yogesh Uppal
Econ 379: Business and Economics Statistics Instructor: Yogesh Ual Email: yual@ysu.edu Chater 9, Part A: Hyothesis Tests Develoing Null and Alternative Hyotheses Tye I and Tye II Errors Poulation Mean:
More informationPretest (Optional) Use as an additional pacing tool to guide instruction. August 21
Trimester 1 Pretest (Otional) Use as an additional acing tool to guide instruction. August 21 Beyond the Basic Facts In Trimester 1, Grade 8 focus on multilication. Daily Unit 1: Rational vs. Irrational
More informationStatics and dynamics: some elementary concepts
1 Statics and dynamics: some elementary concets Dynamics is the study of the movement through time of variables such as heartbeat, temerature, secies oulation, voltage, roduction, emloyment, rices and
More informationGOOD MODELS FOR CUBIC SURFACES. 1. Introduction
GOOD MODELS FOR CUBIC SURFACES ANDREAS-STEPHAN ELSENHANS Abstract. This article describes an algorithm for finding a model of a hyersurface with small coefficients. It is shown that the aroach works in
More informationA Comparison between Biased and Unbiased Estimators in Ordinary Least Squares Regression
Journal of Modern Alied Statistical Methods Volume Issue Article 7 --03 A Comarison between Biased and Unbiased Estimators in Ordinary Least Squares Regression Ghadban Khalaf King Khalid University, Saudi
More informationOn the asymptotic sizes of subset Anderson-Rubin and Lagrange multiplier tests in linear instrumental variables regression
On the asymtotic sizes of subset Anderson-Rubin and Lagrange multilier tests in linear instrumental variables regression Patrik Guggenberger Frank Kleibergeny Sohocles Mavroeidisz Linchun Chen\ June 22
More informationElements of Asymptotic Theory. James L. Powell Department of Economics University of California, Berkeley
Elements of Asymtotic Theory James L. Powell Deartment of Economics University of California, Berkeley Objectives of Asymtotic Theory While exact results are available for, say, the distribution of the
More informationChater Matrix Norms and Singular Value Decomosition Introduction In this lecture, we introduce the notion of a norm for matrices The singular value de
Lectures on Dynamic Systems and Control Mohammed Dahleh Munther A Dahleh George Verghese Deartment of Electrical Engineering and Comuter Science Massachuasetts Institute of Technology c Chater Matrix Norms
More informationState Estimation with ARMarkov Models
Deartment of Mechanical and Aerosace Engineering Technical Reort No. 3046, October 1998. Princeton University, Princeton, NJ. State Estimation with ARMarkov Models Ryoung K. Lim 1 Columbia University,
More information4. Score normalization technical details We now discuss the technical details of the score normalization method.
SMT SCORING SYSTEM This document describes the scoring system for the Stanford Math Tournament We begin by giving an overview of the changes to scoring and a non-technical descrition of the scoring rules
More informationTests for Two Proportions in a Stratified Design (Cochran/Mantel-Haenszel Test)
Chater 225 Tests for Two Proortions in a Stratified Design (Cochran/Mantel-Haenszel Test) Introduction In a stratified design, the subects are selected from two or more strata which are formed from imortant
More informationwhere x i is the ith coordinate of x R N. 1. Show that the following upper bound holds for the growth function of H:
Mehryar Mohri Foundations of Machine Learning Courant Institute of Mathematical Sciences Homework assignment 2 October 25, 2017 Due: November 08, 2017 A. Growth function Growth function of stum functions.
More informationSlides Prepared by JOHN S. LOUCKS St. Edward s s University Thomson/South-Western. Slide
s Preared by JOHN S. LOUCKS St. Edward s s University 1 Chater 11 Comarisons Involving Proortions and a Test of Indeendence Inferences About the Difference Between Two Poulation Proortions Hyothesis Test
More informationChapter 10. Supplemental Text Material
Chater 1. Sulemental Tet Material S1-1. The Covariance Matri of the Regression Coefficients In Section 1-3 of the tetbook, we show that the least squares estimator of β in the linear regression model y=
More information8.7 Associated and Non-associated Flow Rules
8.7 Associated and Non-associated Flow Rules Recall the Levy-Mises flow rule, Eqn. 8.4., d ds (8.7.) The lastic multilier can be determined from the hardening rule. Given the hardening rule one can more
More informationOutline for today. Maximum likelihood estimation. Computation with multivariate normal distributions. Multivariate normal distribution
Outline for today Maximum likelihood estimation Rasmus Waageetersen Deartment of Mathematics Aalborg University Denmark October 30, 2007 the multivariate normal distribution linear and linear mixed models
More informationCMSC 425: Lecture 4 Geometry and Geometric Programming
CMSC 425: Lecture 4 Geometry and Geometric Programming Geometry for Game Programming and Grahics: For the next few lectures, we will discuss some of the basic elements of geometry. There are many areas
More informationA Bound on the Error of Cross Validation Using the Approximation and Estimation Rates, with Consequences for the Training-Test Split
A Bound on the Error of Cross Validation Using the Aroximation and Estimation Rates, with Consequences for the Training-Test Slit Michael Kearns AT&T Bell Laboratories Murray Hill, NJ 7974 mkearns@research.att.com
More information2. Sample representativeness. That means some type of probability/random sampling.
1 Neuendorf Cluster Analysis Assumes: 1. Actually, any level of measurement (nominal, ordinal, interval/ratio) is accetable for certain tyes of clustering. The tyical methods, though, require metric (I/R)
More information216 S. Chandrasearan and I.C.F. Isen Our results dier from those of Sun [14] in two asects: we assume that comuted eigenvalues or singular values are
Numer. Math. 68: 215{223 (1994) Numerische Mathemati c Sringer-Verlag 1994 Electronic Edition Bacward errors for eigenvalue and singular value decomositions? S. Chandrasearan??, I.C.F. Isen??? Deartment
More informationSupplementary Materials for Robust Estimation of the False Discovery Rate
Sulementary Materials for Robust Estimation of the False Discovery Rate Stan Pounds and Cheng Cheng This sulemental contains roofs regarding theoretical roerties of the roosed method (Section S1), rovides
More informationElements of Asymptotic Theory. James L. Powell Department of Economics University of California, Berkeley
Elements of Asymtotic Theory James L. Powell Deartment of Economics University of California, Berkeley Objectives of Asymtotic Theory While exact results are available for, say, the distribution of the
More informationEstimation of the large covariance matrix with two-step monotone missing data
Estimation of the large covariance matrix with two-ste monotone missing data Masashi Hyodo, Nobumichi Shutoh 2, Takashi Seo, and Tatjana Pavlenko 3 Deartment of Mathematical Information Science, Tokyo
More informationAn Improved Generalized Estimation Procedure of Current Population Mean in Two-Occasion Successive Sampling
Journal of Modern Alied Statistical Methods Volume 15 Issue Article 14 11-1-016 An Imroved Generalized Estimation Procedure of Current Poulation Mean in Two-Occasion Successive Samling G. N. Singh Indian
More informationOne-way ANOVA Inference for one-way ANOVA
One-way ANOVA Inference for one-way ANOVA IPS Chater 12.1 2009 W.H. Freeman and Comany Objectives (IPS Chater 12.1) Inference for one-way ANOVA Comaring means The two-samle t statistic An overview of ANOVA
More informationSolved Problems. (a) (b) (c) Figure P4.1 Simple Classification Problems First we draw a line between each set of dark and light data points.
Solved Problems Solved Problems P Solve the three simle classification roblems shown in Figure P by drawing a decision boundary Find weight and bias values that result in single-neuron ercetrons with the
More informationThe Poisson Regression Model
The Poisson Regression Model The Poisson regression model aims at modeling a counting variable Y, counting the number of times that a certain event occurs during a given time eriod. We observe a samle
More informationElementary Analysis in Q p
Elementary Analysis in Q Hannah Hutter, May Szedlák, Phili Wirth November 17, 2011 This reort follows very closely the book of Svetlana Katok 1. 1 Sequences and Series In this section we will see some
More informationResearch of power plant parameter based on the Principal Component Analysis method
Research of ower lant arameter based on the Princial Comonent Analysis method Yang Yang *a, Di Zhang b a b School of Engineering, Bohai University, Liaoning Jinzhou, 3; Liaoning Datang international Jinzhou
More informationMobius Functions, Legendre Symbols, and Discriminants
Mobius Functions, Legendre Symbols, and Discriminants 1 Introduction Zev Chonoles, Erick Knight, Tim Kunisky Over the integers, there are two key number-theoretic functions that take on values of 1, 1,
More informationStatistics II Logistic Regression. So far... Two-way repeated measures ANOVA: an example. RM-ANOVA example: the data after log transform
Statistics II Logistic Regression Çağrı Çöltekin Exam date & time: June 21, 10:00 13:00 (The same day/time lanned at the beginning of the semester) University of Groningen, Det of Information Science May
More informationScaling Multiple Point Statistics for Non-Stationary Geostatistical Modeling
Scaling Multile Point Statistics or Non-Stationary Geostatistical Modeling Julián M. Ortiz, Steven Lyster and Clayton V. Deutsch Centre or Comutational Geostatistics Deartment o Civil & Environmental Engineering
More informationA New Perspective on Learning Linear Separators with Large L q L p Margins
A New Persective on Learning Linear Searators with Large L q L Margins Maria-Florina Balcan Georgia Institute of Technology Christoher Berlind Georgia Institute of Technology Abstract We give theoretical
More informationFE FORMULATIONS FOR PLASTICITY
G These slides are designed based on the book: Finite Elements in Plasticity Theory and Practice, D.R.J. Owen and E. Hinton, 1970, Pineridge Press Ltd., Swansea, UK. 1 Course Content: A INTRODUCTION AND
More informationUsing Factor Analysis to Study the Effecting Factor on Traffic Accidents
Using Factor Analysis to Study the Effecting Factor on Traffic Accidents Abstract Layla A. Ahmed Deartment of Mathematics, College of Education, University of Garmian, Kurdistan Region Iraq This aer is
More informationECON 4130 Supplementary Exercises 1-4
HG Set. 0 ECON 430 Sulementary Exercises - 4 Exercise Quantiles (ercentiles). Let X be a continuous random variable (rv.) with df f( x ) and cdf F( x ). For 0< < we define -th quantile (or 00-th ercentile),
More informationPositive decomposition of transfer functions with multiple poles
Positive decomosition of transfer functions with multile oles Béla Nagy 1, Máté Matolcsi 2, and Márta Szilvási 1 Deartment of Analysis, Technical University of Budaest (BME), H-1111, Budaest, Egry J. u.
More informationResearch Note REGRESSION ANALYSIS IN MARKOV CHAIN * A. Y. ALAMUTI AND M. R. MESHKANI **
Iranian Journal of Science & Technology, Transaction A, Vol 3, No A3 Printed in The Islamic Reublic of Iran, 26 Shiraz University Research Note REGRESSION ANALYSIS IN MARKOV HAIN * A Y ALAMUTI AND M R
More informationPOINTS ON CONICS MODULO p
POINTS ON CONICS MODULO TEAM 2: JONGMIN BAEK, ANAND DEOPURKAR, AND KATHERINE REDFIELD Abstract. We comute the number of integer oints on conics modulo, where is an odd rime. We extend our results to conics
More informationSystem Reliability Estimation and Confidence Regions from Subsystem and Full System Tests
009 American Control Conference Hyatt Regency Riverfront, St. Louis, MO, USA June 0-, 009 FrB4. System Reliability Estimation and Confidence Regions from Subsystem and Full System Tests James C. Sall Abstract
More informationMATH 829: Introduction to Data Mining and Analysis Consistency of Linear Regression
1/9 MATH 829: Introduction to Data Mining and Analysis Consistency of Linear Regression Dominique Guillot Deartments of Mathematical Sciences University of Delaware February 15, 2016 Distribution of regression
More informationHENSEL S LEMMA KEITH CONRAD
HENSEL S LEMMA KEITH CONRAD 1. Introduction In the -adic integers, congruences are aroximations: for a and b in Z, a b mod n is the same as a b 1/ n. Turning information modulo one ower of into similar
More informationTowards understanding the Lorenz curve using the Uniform distribution. Chris J. Stephens. Newcastle City Council, Newcastle upon Tyne, UK
Towards understanding the Lorenz curve using the Uniform distribution Chris J. Stehens Newcastle City Council, Newcastle uon Tyne, UK (For the Gini-Lorenz Conference, University of Siena, Italy, May 2005)
More informationSTK4900/ Lecture 7. Program
STK4900/9900 - Lecture 7 Program 1. Logistic regression with one redictor 2. Maximum likelihood estimation 3. Logistic regression with several redictors 4. Deviance and likelihood ratio tests 5. A comment
More informationMODELING THE RELIABILITY OF C4ISR SYSTEMS HARDWARE/SOFTWARE COMPONENTS USING AN IMPROVED MARKOV MODEL
Technical Sciences and Alied Mathematics MODELING THE RELIABILITY OF CISR SYSTEMS HARDWARE/SOFTWARE COMPONENTS USING AN IMPROVED MARKOV MODEL Cezar VASILESCU Regional Deartment of Defense Resources Management
More informationChapter 13 Variable Selection and Model Building
Chater 3 Variable Selection and Model Building The comlete regsion analysis deends on the exlanatory variables ent in the model. It is understood in the regsion analysis that only correct and imortant
More informationMULTIVARIATE SHEWHART QUALITY CONTROL FOR STANDARD DEVIATION
MULTIVARIATE SHEWHART QUALITY CONTROL FOR STANDARD DEVIATION M. Jabbari Nooghabi, Deartment of Statistics, Faculty of Mathematical Sciences, Ferdowsi University of Mashhad, Mashhad-Iran. and H. Jabbari
More informationarxiv:cond-mat/ v2 25 Sep 2002
Energy fluctuations at the multicritical oint in two-dimensional sin glasses arxiv:cond-mat/0207694 v2 25 Se 2002 1. Introduction Hidetoshi Nishimori, Cyril Falvo and Yukiyasu Ozeki Deartment of Physics,
More informationHidden Predictors: A Factor Analysis Primer
Hidden Predictors: A Factor Analysis Primer Ryan C Sanchez Western Washington University Factor Analysis is a owerful statistical method in the modern research sychologist s toolbag When used roerly, factor
More informationCHAPTER 5 STATISTICAL INFERENCE. 1.0 Hypothesis Testing. 2.0 Decision Errors. 3.0 How a Hypothesis is Tested. 4.0 Test for Goodness of Fit
Chater 5 Statistical Inference 69 CHAPTER 5 STATISTICAL INFERENCE.0 Hyothesis Testing.0 Decision Errors 3.0 How a Hyothesis is Tested 4.0 Test for Goodness of Fit 5.0 Inferences about Two Means It ain't
More informationON THE LEAST SIGNIFICANT p ADIC DIGITS OF CERTAIN LUCAS NUMBERS
#A13 INTEGERS 14 (014) ON THE LEAST SIGNIFICANT ADIC DIGITS OF CERTAIN LUCAS NUMBERS Tamás Lengyel Deartment of Mathematics, Occidental College, Los Angeles, California lengyel@oxy.edu Received: 6/13/13,
More informationCompletely Randomized Design
CHAPTER 4 Comletely Randomized Design 4.1 Descrition of the Design Chaters 1 to 3 introduced some basic concets and statistical tools that are used in exerimental design. In this and the following chaters,
More informationCombining Logistic Regression with Kriging for Mapping the Risk of Occurrence of Unexploded Ordnance (UXO)
Combining Logistic Regression with Kriging for Maing the Risk of Occurrence of Unexloded Ordnance (UXO) H. Saito (), P. Goovaerts (), S. A. McKenna (2) Environmental and Water Resources Engineering, Deartment
More informationNONLINEAR OPTIMIZATION WITH CONVEX CONSTRAINTS. The Goldstein-Levitin-Polyak algorithm
- (23) NLP - NONLINEAR OPTIMIZATION WITH CONVEX CONSTRAINTS The Goldstein-Levitin-Polya algorithm We consider an algorithm for solving the otimization roblem under convex constraints. Although the convexity
More informationBiostat Methods STAT 5500/6500 Handout #12: Methods and Issues in (Binary Response) Logistic Regression
Biostat Methods STAT 5500/6500 Handout #12: Methods and Issues in (Binary Resonse) Logistic Regression Recall general χ 2 test setu: Y 0 1 Trt 0 a b Trt 1 c d I. Basic logistic regression Previously (Handout
More informationChapter 7 Sampling and Sampling Distributions. Introduction. Selecting a Sample. Introduction. Sampling from a Finite Population
Chater 7 and s Selecting a Samle Point Estimation Introduction to s of Proerties of Point Estimators Other Methods Introduction An element is the entity on which data are collected. A oulation is a collection
More informationPlotting the Wilson distribution
, Survey of English Usage, University College London Setember 018 1 1. Introduction We have discussed the Wilson score interval at length elsewhere (Wallis 013a, b). Given an observed Binomial roortion
More informationIntroduction to MVC. least common denominator of all non-identical-zero minors of all order of G(s). Example: The minor of order 2: 1 2 ( s 1)
Introduction to MVC Definition---Proerness and strictly roerness A system G(s) is roer if all its elements { gij ( s)} are roer, and strictly roer if all its elements are strictly roer. Definition---Causal
More informationJohn Weatherwax. Analysis of Parallel Depth First Search Algorithms
Sulementary Discussions and Solutions to Selected Problems in: Introduction to Parallel Comuting by Viin Kumar, Ananth Grama, Anshul Guta, & George Karyis John Weatherwax Chater 8 Analysis of Parallel
More informationPrinciples of Computed Tomography (CT)
Page 298 Princiles of Comuted Tomograhy (CT) The theoretical foundation of CT dates back to Johann Radon, a mathematician from Vienna who derived a method in 1907 for rojecting a 2-D object along arallel
More informationAsymptotic Properties of the Markov Chain Model method of finding Markov chains Generators of..
IOSR Journal of Mathematics (IOSR-JM) e-issn: 78-578, -ISSN: 319-765X. Volume 1, Issue 4 Ver. III (Jul. - Aug.016), PP 53-60 www.iosrournals.org Asymtotic Proerties of the Markov Chain Model method of
More informationEvaluating Process Capability Indices for some Quality Characteristics of a Manufacturing Process
Journal of Statistical and Econometric Methods, vol., no.3, 013, 105-114 ISSN: 051-5057 (rint version), 051-5065(online) Scienress Ltd, 013 Evaluating Process aability Indices for some Quality haracteristics
More informationPositive Definite Uncertain Homogeneous Matrix Polynomials: Analysis and Application
BULGARIA ACADEMY OF SCIECES CYBEREICS AD IFORMAIO ECHOLOGIES Volume 9 o 3 Sofia 009 Positive Definite Uncertain Homogeneous Matrix Polynomials: Analysis and Alication Svetoslav Savov Institute of Information
More informationA New Asymmetric Interaction Ridge (AIR) Regression Method
A New Asymmetric Interaction Ridge (AIR) Regression Method by Kristofer Månsson, Ghazi Shukur, and Pär Sölander The Swedish Retail Institute, HUI Research, Stockholm, Sweden. Deartment of Economics and
More information8 STOCHASTIC PROCESSES
8 STOCHASTIC PROCESSES The word stochastic is derived from the Greek στoχαστικoς, meaning to aim at a target. Stochastic rocesses involve state which changes in a random way. A Markov rocess is a articular
More informationPROFIT MAXIMIZATION. π = p y Σ n i=1 w i x i (2)
PROFIT MAXIMIZATION DEFINITION OF A NEOCLASSICAL FIRM A neoclassical firm is an organization that controls the transformation of inuts (resources it owns or urchases into oututs or roducts (valued roducts
More informationNUMERICAL AND THEORETICAL INVESTIGATIONS ON DETONATION- INERT CONFINEMENT INTERACTIONS
NUMERICAL AND THEORETICAL INVESTIGATIONS ON DETONATION- INERT CONFINEMENT INTERACTIONS Tariq D. Aslam and John B. Bdzil Los Alamos National Laboratory Los Alamos, NM 87545 hone: 1-55-667-1367, fax: 1-55-667-6372
More information7.2 Inference for comparing means of two populations where the samples are independent
Objectives 7.2 Inference for comaring means of two oulations where the samles are indeendent Two-samle t significance test (we give three examles) Two-samle t confidence interval htt://onlinestatbook.com/2/tests_of_means/difference_means.ht
More informationLower Confidence Bound for Process-Yield Index S pk with Autocorrelated Process Data
Quality Technology & Quantitative Management Vol. 1, No.,. 51-65, 15 QTQM IAQM 15 Lower onfidence Bound for Process-Yield Index with Autocorrelated Process Data Fu-Kwun Wang * and Yeneneh Tamirat Deartment
More informationsubstantial literature on emirical likelihood indicating that it is widely viewed as a desirable and natural aroach to statistical inference in a vari
Condence tubes for multile quantile lots via emirical likelihood John H.J. Einmahl Eindhoven University of Technology Ian W. McKeague Florida State University May 7, 998 Abstract The nonarametric emirical
More informationEstimating function analysis for a class of Tweedie regression models
Title Estimating function analysis for a class of Tweedie regression models Author Wagner Hugo Bonat Deartamento de Estatística - DEST, Laboratório de Estatística e Geoinformação - LEG, Universidade Federal
More informationUsing a Computational Intelligence Hybrid Approach to Recognize the Faults of Variance Shifts for a Manufacturing Process
Journal of Industrial and Intelligent Information Vol. 4, No. 2, March 26 Using a Comutational Intelligence Hybrid Aroach to Recognize the Faults of Variance hifts for a Manufacturing Process Yuehjen E.
More informationNew Information Measures for the Generalized Normal Distribution
Information,, 3-7; doi:.339/info3 OPEN ACCESS information ISSN 75-7 www.mdi.com/journal/information Article New Information Measures for the Generalized Normal Distribution Christos P. Kitsos * and Thomas
More informationPHYS 301 HOMEWORK #9-- SOLUTIONS
PHYS 0 HOMEWORK #9-- SOLUTIONS. We are asked to use Dirichlet' s theorem to determine the value of f (x) as defined below at x = 0, ± /, ± f(x) = 0, - < x
More informationBayesian Spatially Varying Coefficient Models in the Presence of Collinearity
Bayesian Satially Varying Coefficient Models in the Presence of Collinearity David C. Wheeler 1, Catherine A. Calder 1 he Ohio State University 1 Abstract he belief that relationshis between exlanatory
More informationOptimal array pattern synthesis with desired magnitude response
Otimal array attern synthesis with desired magnitude resonse A.M. Pasqual a, J.R. Arruda a and P. erzog b a Universidade Estadual de Caminas, Rua Mendeleiev, 00, Cidade Universitária Zeferino Vaz, 13083-970
More informationOXFORD UNIVERSITY. MATHEMATICS, JOINT SCHOOLS AND COMPUTER SCIENCE WEDNESDAY 4 NOVEMBER 2009 Time allowed: hours
OXFORD UNIVERSITY MATHEMATICS, JOINT SCHOOLS AND COMPUTER SCIENCE WEDNESDAY 4 NOVEMBER 2009 Time allowed: 2 1 2 hours For candidates alying for Mathematics, Mathematics & Statistics, Comuter Science, Mathematics
More informationOn Line Parameter Estimation of Electric Systems using the Bacterial Foraging Algorithm
On Line Parameter Estimation of Electric Systems using the Bacterial Foraging Algorithm Gabriel Noriega, José Restreo, Víctor Guzmán, Maribel Giménez and José Aller Universidad Simón Bolívar Valle de Sartenejas,
More informationChurilova Maria Saint-Petersburg State Polytechnical University Department of Applied Mathematics
Churilova Maria Saint-Petersburg State Polytechnical University Deartment of Alied Mathematics Technology of EHIS (staming) alied to roduction of automotive arts The roblem described in this reort originated
More informationAI*IA 2003 Fusion of Multiple Pattern Classifiers PART III
AI*IA 23 Fusion of Multile Pattern Classifiers PART III AI*IA 23 Tutorial on Fusion of Multile Pattern Classifiers by F. Roli 49 Methods for fusing multile classifiers Methods for fusing multile classifiers
More informationPretest (Optional) Use as an additional pacing tool to guide instruction. August 21
Trimester 1 Pretest (Otional) Use as an additional acing tool to guide instruction. August 21 Beyond the Basic Facts In Trimester 1, Grade 7 focus on multilication. Daily Unit 1: The Number System Part
More informationChapter 7: Special Distributions
This chater first resents some imortant distributions, and then develos the largesamle distribution theory which is crucial in estimation and statistical inference Discrete distributions The Bernoulli
More informationMaximum Entropy and the Stress Distribution in Soft Disk Packings Above Jamming
Maximum Entroy and the Stress Distribution in Soft Disk Packings Above Jamming Yegang Wu and S. Teitel Deartment of Physics and Astronomy, University of ochester, ochester, New York 467, USA (Dated: August
More informationAn Improved Calibration Method for a Chopped Pyrgeometer
96 JOURNAL OF ATMOSPHERIC AND OCEANIC TECHNOLOGY VOLUME 17 An Imroved Calibration Method for a Choed Pyrgeometer FRIEDRICH FERGG OtoLab, Ingenieurbüro, Munich, Germany PETER WENDLING Deutsches Forschungszentrum
More informationA CONCRETE EXAMPLE OF PRIME BEHAVIOR IN QUADRATIC FIELDS. 1. Abstract
A CONCRETE EXAMPLE OF PRIME BEHAVIOR IN QUADRATIC FIELDS CASEY BRUCK 1. Abstract The goal of this aer is to rovide a concise way for undergraduate mathematics students to learn about how rime numbers behave
More informationOn the Estimation Of Population Mean Under Systematic Sampling Using Auxiliary Attributes
Oriental Journal of Physical Sciences Vol 1 (1 & ) 17 (016) On the Estimation Of Poulation Mean Under Systematic Samling Using Auxiliary Attributes Usman Shahzad Deartment of Mathematics Statistics PMAS
More informationA SIMPLE PLASTICITY MODEL FOR PREDICTING TRANSVERSE COMPOSITE RESPONSE AND FAILURE
THE 19 TH INTERNATIONAL CONFERENCE ON COMPOSITE MATERIALS A SIMPLE PLASTICITY MODEL FOR PREDICTING TRANSVERSE COMPOSITE RESPONSE AND FAILURE K.W. Gan*, M.R. Wisnom, S.R. Hallett, G. Allegri Advanced Comosites
More informationOn a Markov Game with Incomplete Information
On a Markov Game with Incomlete Information Johannes Hörner, Dinah Rosenberg y, Eilon Solan z and Nicolas Vieille x{ January 24, 26 Abstract We consider an examle of a Markov game with lack of information
More informationAdditive results for the generalized Drazin inverse in a Banach algebra
Additive results for the generalized Drazin inverse in a Banach algebra Dragana S. Cvetković-Ilić Dragan S. Djordjević and Yimin Wei* Abstract In this aer we investigate additive roerties of the generalized
More information2x2x2 Heckscher-Ohlin-Samuelson (H-O-S) model with factor substitution
2x2x2 Heckscher-Ohlin-amuelson (H-O- model with factor substitution The HAT ALGEBRA of the Heckscher-Ohlin model with factor substitution o far we were dealing with the easiest ossible version of the H-O-
More information