Multivariate Analysis. Hermine Maes TC19 March 2006

Size: px
Start display at page:

Download "Multivariate Analysis. Hermine Maes TC19 March 2006"

Transcription

1 Multivariate Analysis Hermine Maes TC9 March 2006

2 Files to Copy to your Computer Faculty/hmaes/tc9/maes/multivariate *.rec *.dat *.mx Multivariate.ppt

3 Multivariate Questions I Bivariate Analysis: What are the contributions of genetic and environmental factors to the covariance between two traits? Multivariate Analysis: What are the contributions of genetic and environmental factors to the covariance between more than two traits?

4 Phenotypic Cholesky F2 F3 F4 P f F2 F3 F4 P2 f 2 f f 2 f 3 f 4 P3 f 3 P4 f 4 P t P2 t P3 t P4 t

5 Phenotypic Cholesky F2 F2 F3 F4 P f F2 F3 0 F4 P2 f 2 f 22 f 22 f 32 f 42 P3 f 3 f 32 P4 f 4 f 42 P t P2 t P3 t P4 t

6 Phenotypic Cholesky F2 F3 F4 P f F2 F3 0 0 F4 P2 0 f 33 f 43 P3 f 2 f 22 f 3 f 33 P4 f 4 f 32 f 42 f 43 P t P2 t P3 t P4 t

7 Phenotypic Cholesky F2 F3 F4 P f F2 F3 F P2 f 2 f 22 0 f 33 0 f 44 P3 f 3 f 32 0 f f P4 f 4 f 42 P t P2 t P3 t P4 t

8 Cholesky Decomposition F2 F3 F4 P f f f 2 f 3 f 4 P2 P3 f 2 f f 3 f 32 f 33 0 f f * 0 0 f 22 f 32 f 42 0 f 33 f 43 P4 f 4 f f 44 F * F'

9 Saturated Model Use Cholesky decomposition to estimate covariance matrix Fully saturated Model: Cov P = F*F F: Lower nvar nvar

10 Phenotypic Single Factor P P2 f f 2 * f f 2 f 3 f 4 P3 f 3 f f 2 f 3 f 4 P4 f 4 F * F' P t P2 t P3 t P4 t

11 Residual Variances P P2 P3 E E2 E3 E4 e e e 33 0 e 44 * e e e 33 0 e 44 f f 2 f 3 f 4 P E * E' P t P2 t P3 t P4 t e e 22 e 33 e 44 E E2 E3 E4

12 Factor Analysis Explain covariance by limited number of factors Exploratory / Confirmatory Model: Cov P = F*F + E*E F: Full nvar nfac E: Diag nvar nvar Model: Cov P = F*I*F + E*E

13 Twin Data? f f 2 f 3 f 4 f f 2 f 3 f 4 P t P2 t P3 t P4 t P t2 P2 t2 P3 t2 P4 t2 e e 22 e 33 e 44 e e 22 e 33 e 44 E E2 E3 E4 E E2 E3 E4

14 Genetic Single Factor.0 / 0.5 A A a a 2 a 3 a 4 a a 2 a 3 a 4 P t P2 t P3 t P4 t P t2 P2 t2 P3 t2 P4 t2 e e 22 e 33 e 44 e e 22 e 33 e 44 E E2 E3 E4 E E2 E3 E4

15 Common Environmental Single Factor.0 / A C A C c c 2 c 3 c 4 c c 2 c 3 c 4 P t P2 t P3 t P4 t P t2 P2 t2 P3 t2 P4 t2 e e 22 e 33 e 44 e e 22 e 33 e 44 E E2 E3 E4 E E2 E3 E4

16 Specific Environmental Single Factor.0 / A C E A C E e e 2 e 3 e 4 e e 2 e 3 e 4 P t P2 t P3 t P4 t P t2 P2 t2 P3 t2 P4 t2 e e 22 e 33 e 44 e e 22 e 33 e 44 E E2 E3 E4 E E2 E3 E4

17 Single [Common] Factor X: genetic Full 4 x Full nvar x nfac P P2 P3 P4 A a a 2 * a a 2 a 3 a 4 a 3 a 4 X * X' Y: shared environmental Z: specific environmental

18 Residuals partitioned in ACE.0 / A C E A C E P t P2 t P3 t P4 t P t2 P2 t2 P3 t2 P4 t2 a c A C e e 22 e 33 e 44 E E2 E3 E4 e e 22 e 33 e 44 E E2 E3 E4

19 Residual Factors T: genetic U: shared environmental V: specific environmental Diag 4 x 4 Diag nvar x nvar E E2 E3 E4 P e P2 0 e P3 0 0 e 33 0 P e 44 V * * e e e e 44 V'

20 Independent Pathway Model.0 / A C C C [X] [Y] [Z] E C A C C C E C P t P2 t P3 t P4 t P t2 P2 t2 P3 t2 P4 t2 [U] C A E A2 E2 A3 E3 A4 E4 [T] [V] A E A2 E2 A3 E3 A4 E4.0 / / / / 0.5

21 IP Independent pathways Biometric model Different covariance structure for A, C and E

22 Independent Pathway I G: Define matrices Calculation Begin Matrices; X full nvar nfac Free! common factor genetic path coefficients Y full nvar nfac Free! common factor shared environment paths Z full nvar nfac Free! common factor unique environment paths T diag nvar nvar Free! variable specific genetic paths U diag nvar nvar Free! variable specific shared env paths V diag nvar nvar Free! variable specific residual paths M full nvar Free! means End Matrices; Start Begin Algebra; A= X*X' + T*T';! additive genetic variance components C= Y*Y' + U*U';! shared environment variance components E= Z*Z' + V*V';! nonshared environment variance components End Algebra; End indpath.mx

23 Independent Pathway II G2: MZ twins #include iqnlmz.dat Begin Matrices = Group ; Means M M ; Covariance A+C+E A+C _ A+C A+C+E ; Option Rsiduals End G3: DZ twins #include iqnldz.dat Begin Matrices= Group ; H full End Matrices; Matrix H.5 Means M M ; Covariance A+C+E H@A+C _ H@A+C A+C+E ; Option Rsiduals End

24 Independent Pathway III G4: Calculate Standardised Solution Calculation Matrices = Group I Iden nvar nvar End Matrices; Begin Algebra; R=A+C+E;! total variance S=(\sqrt(I.R))~;! diagonal matrix of standard deviations P=S*X_ S*Y_ S*Z;! standardized estimates for common factors Q=S*T_ S*U_ S*V;! standardized estimates for spec factors End Algebra; Labels Row P a a2 a3 a4 a5 a6 c c2 c3 c4 c5 c6 e e2 e3 e4 e5 e6 Labels Col P var var2 var3 var4 var5 var6 Labels Row Q as as2 as3 as4 as5 as6 cs cs2 cs3 cs4 cs5 cs6 es es2 es3 es4 es5 es6 Labels Col Q var var2 var3 var4 var5 var6 Options NDecimals=4 End

25 Practical Example Dataset: NL-IQ Study 6 WAIS-III IQ subtests var = onvolledige tekeningen / picture completion var2 = woordenschat / vocabulary var3 = paren associeren / digit span var4 = incidenteel leren / incidental learning var5 = overeenkomsten / similarities var6 = blokpatronen / block design N MZF: 27, DZF: 70

26 Dat Files iqnlmz.dat Data NInputvars=8 Missing=-.00 Rectangular File=iqnl.rec Labels famid zygos age_t sex_t var_t var2_t var3_t var4_t var5_t var6_t age_t2 sex_t2 var_t2 var2_t2 var3_t2 var4_t2 var5_t2 var6_t2 Select if zygos < 3 ;!select mz's Select var_t var2_t var3_t var4_t var5_t var6_t var_t2 var2_t2 var3_t2 var4_t2 var5_t2 var6_t2 ; iqnldz.dat... Select if zygos > 2 ;!select dz's...

27 Goodness-of-Fit Statistics -2LL df 2 df p AIC 2 df p Saturated (iqnlsat2.mx) Cholesky (cholesky.mx) Independent Pathway Common Pathway

28 MATRIX M This is a FULL matrix of order by MATRIX X This is a LOWER TRIANGULAR matrix of order 6 by MATRIX Y This is a LOWER TRIANGULAR matrix of order 6 by MATRIX Z This is a LOWER TRIANGULAR matrix of order 6 by

29 Goodness-of-Fit Statistics -2LL df 2 df p AIC 2 df p Saturated Cholesky Independent Pathway Common Pathway

30 MATRIX M This is a FULL matrix of order by MATRIX P This is a computed FULL matrix of order 8 by 6 [=S*X_S*Y_S*Z] VAR VAR2 VAR3 VAR4 VAR5 VAR6 A A A A A A C C C C C C E E E E E E

31 Independent Pathway Model.0 / A C C C [X] [Y] [Z] E C A C C C E C P t P2 t P3 t P4 t P t2 P2 t2 P3 t2 P4 t2 [U] C A E A2 E2 A3 E3 A4 E4 [T] [V] A E A2 E2 A3 E3 A4 E4.0 / / / / 0.5

32 Path Diagram to Matrices Variance Component a 2 c 2 e 2 Common Factors [X] 6 x [Y] 6 x [Z] 6 x Residual Factors [T] 6 x 6 [U] 6 x 6 [V] 6 x 6 #define nvar 6 #define nfac

33 MATRIX M This is a FULL matrix of order by MATRIX T This is a DIAGONAL matrix of order 6 by MATRIX U This is a DIAGONAL matrix of order 6 by MATRIX V This is a DIAGONAL matrix of order 6 by MATRIX X This is a FULL matrix of order 6 by MATRIX Y This is a FULL matrix of order 6 by MATRIX Z This is a FULL matrix of order 6 by

34 Goodness-of-Fit Statistics -2LL df 2 df p AIC 2 df p Saturated Cholesky Independent Pathway Common Pathway

35 MATRIX M This is a FULL matrix of order by MATRIX P 8 by [=S*X_S*Y_S*Z] VAR A A A A A A C C C C C C E E E E E5 0.3 E MATRIX Q This is a computed FULL matrix of order 8 by 6 [=S*T_S*U_S*V] VAR VAR2 VAR3 VAR4 VAR5 VAR6 AS AS AS AS AS AS CS CS CS CS CS CS ES ES ES ES ES ES

36 Exercise I. Drop common factor for shared environment 2. Drop common factor for specific environment 3. Add second genetic common factor

37 Phenotypic Single Factor P P2 f f 2 * f f 2 f 3 f 4 P3 f 3 f f 2 f 3 f 4 P4 f 4 F * F' P t P2 t P3 t P4 t

38 Latent Phenotype A C E a c e f f 2 f 3 f 4 P t P2 t P3 t P4 t

39 Twin Data.0 / A C E A C E a c e a c e f f 2 f 3 f 4 f f 2 f 3 f 4 P t P2 t P3 t P4 t P t P2 t P3 t P4 t

40 Factor on Latent Phenotype P P2 P3 P4 = f f 2 * a * a * f f 2 f 3 f 4 f 3 f 4 F * X * X' * F & ( X * X' ) F'

41 Common Pathway Model.0 / A C [X] a [Y] c e [Z] E A a C c e E [F] f f 2 f 3 f 4 f f 2 f 3 f 4 P t P2 t P3 t P4 t P t P2 t P3 t P4 t [U] C A E A2 E2 A3 E3 A4 E4 [T] [V] A E A2 E2 A3 E3 A4 E4.0 / / / / 0.5

42 Common Pathway Model I G: Define matrices Calculation Begin Matrices; X full nfac nfac Free! latent factor genetic path coefficient Y full nfac nfac Free! latent factor shared environment path Z full nfac nfac Free! latent factor unique environment path T diag nvar nvar Free! variable specific genetic paths U diag nvar nvar Free! variable specific shared env paths V diag nvar nvar Free! variable specific residual paths F full nvar nfac Free! loadings of variables on latent factor I Iden 2 2 M full nvar Free! means End Matrices; Start.. Begin Algebra; A= F&(X*X') + T*T';! genetic variance components C= F&(Y*Y') + U*U';! shared environment variance components E= F&(Z*Z') + V*V';! nonshared environment variance components L= X*X' + Y*Y' + Z*Z';! variance of latent factor End Algebra; End

43 Common Pathway II G4: Constrain variance of latent factor to Constraint Begin Matrices; L computed =L I unit End Matrices; Constraint L = I ; End G5: Calculate Standardised Solution Calculation Matrices = Group D Iden nvar nvar End Matrices; Begin Algebra; R=A+C+E;! total variance S=(\sqrt(D.R))~;! diagonal matrix of standard deviations P=S*F;! standardized estimates for loadings on F Q=S*T_ S*U_ S*V;! standardized estimates for specific factors End Algebra; Options NDecimals=4 End

44 CP Common pathway Psychometric model Same covariance structure for A, C and E

45 Common Pathway Model.0 / A C [X] a [Y] c e [Z] E A a C c e E [F] f f 2 f 3 f 4 f f 2 f 3 f 4 P t P2 t P3 t P4 t P t P2 t P3 t P4 t [U] C A E A2 E2 A3 E3 A4 E4 [T] [V] A E A2 E2 A3 E3 A4 E4.0 / / / / 0.5

46 Path Diagram to Matrices Variance Component a 2 c 2 e 2 Common Factor [X] x [Y] x [Z] x [F] 6 x Residual Factors [T] 6 x 6 [U] 6 x 6 [V] 6 x 6 #define nvar 6 #define nfac

47 MATRIX M This is a FULL matrix of order by MATRIX T This is a DIAGONAL matrix of order 6 by MATRIX U This is a DIAGONAL matrix of order 6 by MATRIX X This is a FULL matrix of order by MATRIX Y This is a FULL matrix of order by 2 MATRIX Z This is a FULL matrix of order by 3 MATRIX V This is a DIAGONAL matrix of order 6 by

48 Goodness-of-Fit Statistics -2LL df 2 df p AIC 2 df p Saturated Cholesky Independent Pathway Common Pathway

49 MATRIX M This is a FULL matrix of order by MATRIX P 6 by [=S*F] F F F F F MATRIX Q This is a computed FULL matrix of order 8 by 6 [=S*T_S*U_S*V] AS AS AS AS AS AS CS CS CS CS CS CS ES ES ES ES ES ES

50 WAIS-III IQ Verbal IQ var2 = woordenschat / vocabulary var3 = paren associeren / digit span var5 = overeenkomsten / similarities Performance IQ var = onvolledige tekeningen / picture completion var4 = incidenteel leren / incidental learning var6 = blokpatronen / block design

51 Exercise II. Change to 2 Latent Phenotypes corresponding to Verbal IQ and Performance IQ

52 Summary Independent Pathway Model Biometric Factor Model Loadings differ for genetic and environmental common factors Common Pathway Model Psychometric Factor Model Loadings equal for genetic and environmental common factor

53 Pathway Model [X] A [Y] C [Z] E A2.0 / 0.5 C2 E2.0 A3 C3 E3 A C E a a 2 a 22 a 3 a 32 a 33 a c e F2 F3 F2 F3 [F] f f 2 f 3 f 4 f 5 f 6 f f f 2 f 3 f 4 f 5 f 6 P t P2 t P3 t P4 t P5 t P6 t P t2 P2 t2 P3 t2 P4 t2 P5 t2 P6 t2 A E C [T] [V] [U] E2 E3 E4 E5 E6 E.0 / A C

54 Two Common Pathway Model [X] A [Y] C [Z] E A2.0 / 0.5 C2 E2.0 A3 C3 E3 A C E a a 2 a 22 a c e F2 F3 F2 F3 [F] f f 2 f 3 f 4 f 5 f f f 2 f 3 f 4 f 5 f 6 P t P2 t P3 t P4 t P5 t P6 t P t2 P2 t2 P3 t2 P4 t2 P5 t2 P6 t2 A E C [T] [V] [U] E2 E3 E4 E5 E6 E.0 / A C

55 Two Independent CP Model [X] A [Y] C [Z] E A2.0 / 0.5 C2 E2.0 A3 C3 E3 A C E a a 22 a c e F2 F3 F2 F3 [F] f f 2 f 3 f 4 f 5 f f f 2 f 3 f 4 f 5 f 6 P t P2 t P3 t P4 t P5 t P6 t P t2 P2 t2 P3 t2 P4 t2 P5 t2 P6 t2 A E C [T] [V] [U] E2 E3 E4 E5 E6 E.0 / A C

56 Two Reduced Indep CP Model [X] A [Y] C [Z] E A2.0 / 0.5 C2 E2.0 A3 C3 E3 A C E a a 22 a c e F2 F3 F2 F3 [F] f 2 f 3 f 2 f 5 f 42 f 62 f f 2 f 3 f 4 f 5 f 6 P t P2 t P3 t P4 t P5 t P6 t P t2 P2 t2 P3 t2 P4 t2 P5 t2 P6 t2 E E2 E3 E4 E5 E6 E A C A C [T] [V] [U].0 / 0.5.0

57 Common Pathway Model [X] A [Y] C [Z] E A2.0 / 0.5 C2 E2.0 A3 C3 E3 A C E a a c e F2 F3 F2 F3 [F] f f 2 f 3 f 4 f 5 f 6 f f 2 f 3 f 4 f 5 f 6 P t P2 t P3 t P4 t P5 t P6 t P t2 P2 t2 P3 t2 P4 t2 P5 t2 P6 t2 E E2 E3 E4 E5 E6 E A C A C [T] [V] [U].0 / 0.5.0

58 Independent Pathway Model [X] A [Y] C [Z] E A2.0 / 0.5 C2 E2.0 A3 C3 E3 A C E F2 F3 F2 F3 [F] f f 2 f 3 f 4 f 5 f 6 f f f 2 f 3 f 4 f 5 f 6 P t P2 t P3 t P4 t P5 t P6 t P t2 P2 t2 P3 t2 P4 t2 P5 t2 P6 t2 A E C [T] [V] [U] E2 E3 E4 E5 E6 E.0 / A C

Introduction to Multivariate Genetic Analysis. Meike Bartels, Hermine Maes, Elizabeth Prom-Wormley and Michel Nivard

Introduction to Multivariate Genetic Analysis. Meike Bartels, Hermine Maes, Elizabeth Prom-Wormley and Michel Nivard Introduction to Multivariate Genetic nalysis Meike Bartels, Hermine Maes, Elizabeth Prom-Wormley and Michel Nivard im and Rationale im: to examine the source of factors that make traits correlate or co-vary

More information

Phenotypic factor analysis

Phenotypic factor analysis 1 Phenotypic factor analysis Conor V. Dolan & Michel Nivard VU, Amsterdam Boulder Workshop - March 2018 2 Phenotypic factor analysis A statistical technique to investigate the dimensionality of correlated

More information

Correction for Ascertainment

Correction for Ascertainment Correction for Ascertainment Michael C. Neale International Workshop on Methodology for Genetic Studies of Twins and Families Boulder CO 2004 Virginia Institute for Psychiatric and Behavioral Genetics

More information

Sex-limited expression of genetic or environmental

Sex-limited expression of genetic or environmental Multivariate Genetic Analysis of Sex Limitation and G E Interaction Michael C. Neale, 1 Espen Røysamb, 2 and Kristen Jacobson 3 1 Virginia Institute for Psychiatric and Behavioral Genetics,Virginia Commonwealth

More information

Review Packet 1 B 11 B 12 B 13 B = B 21 B 22 B 23 B 31 B 32 B 33 B 41 B 42 B 43

Review Packet 1 B 11 B 12 B 13 B = B 21 B 22 B 23 B 31 B 32 B 33 B 41 B 42 B 43 Review Packet. For each of the following, write the vector or matrix that is specified: a. e 3 R 4 b. D = diag{, 3, } c. e R 3 d. I. For each of the following matrices and vectors, give their dimension.

More information

Substance Assortment: APPENDIX 1

Substance Assortment: APPENDIX 1 Substance Assortment: APPENDIX 1 Appix Reynolds, C.A., Barlow, T., Pedersen, N.L. (in press June 22, 2005). Alcohol, tobacco and caffeine use: Spouse similarity processes. Behavior Genetics. #define nvar

More information

Variations. ECE 6540, Lecture 02 Multivariate Random Variables & Linear Algebra

Variations. ECE 6540, Lecture 02 Multivariate Random Variables & Linear Algebra Variations ECE 6540, Lecture 02 Multivariate Random Variables & Linear Algebra Last Time Probability Density Functions Normal Distribution Expectation / Expectation of a function Independence Uncorrelated

More information

Measuring relationships among multiple responses

Measuring relationships among multiple responses Measuring relationships among multiple responses Linear association (correlation, relatedness, shared information) between pair-wise responses is an important property used in almost all multivariate analyses.

More information

Go to Faculty/marleen/Boulder2012/Moderating_cov Copy all files to your own directory

Go to Faculty/marleen/Boulder2012/Moderating_cov Copy all files to your own directory Go to Faculty/marleen/Boulder01/Moderating_cov Copy all files to your own directory Go to Faculty/sanja/Boulder01/Moderating_covariances _IQ_SES Copy all files to your own directory Moderating covariances

More information

Gregory Carey, 1998 Regression & Path Analysis - 1 MULTIPLE REGRESSION AND PATH ANALYSIS

Gregory Carey, 1998 Regression & Path Analysis - 1 MULTIPLE REGRESSION AND PATH ANALYSIS Gregory Carey, 1998 Regression & Path Analysis - 1 MULTIPLE REGRESSION AND PATH ANALYSIS Introduction Path analysis and multiple regression go hand in hand (almost). Also, it is easier to learn about multivariate

More information

Variance Component Models for Quantitative Traits. Biostatistics 666

Variance Component Models for Quantitative Traits. Biostatistics 666 Variance Component Models for Quantitative Traits Biostatistics 666 Today Analysis of quantitative traits Modeling covariance for pairs of individuals estimating heritability Extending the model beyond

More information

Lesson 7: Linear Transformations Applied to Cubes

Lesson 7: Linear Transformations Applied to Cubes Classwork Opening Exercise Consider the following matrices: AA = 1 2 0 2, BB = 2, and CC = 2 2 4 0 0 2 2 a. Compute the following determinants. i. det(aa) ii. det(bb) iii. det(cc) b. Sketch the image of

More information

3. Properties of the relationship matrix

3. Properties of the relationship matrix 3. Properties of the relationship matrix 3.1 Partitioning of the relationship matrix The additive relationship matrix, A, can be written as the product of a lower triangular matrix, T, a diagonal matrix,

More information

Continuously moderated effects of A,C, and E in the twin design

Continuously moderated effects of A,C, and E in the twin design Continuously moderated effects of A,C, and E in the twin design Conor V Dolan & Sanja Franić Boulder Twin Workshop March 8, 2016 Includes slides by Sophie van der Sluis & Marleen de Moor 1977 Acta Genet

More information

Continuously moderated effects of A,C, and E in the twin design

Continuously moderated effects of A,C, and E in the twin design Continuously moderated effects of A,C, and E in the twin design Conor V Dolan & Michel Nivard Boulder Twin Workshop March, 208 Standard AE model s 2 A or.5s 2 A A E A E s 2 A s 2 E s 2 A s 2 E m pheno

More information

Multivariate Statistical Analysis

Multivariate Statistical Analysis Multivariate Statistical Analysis Fall 2011 C. L. Williams, Ph.D. Lecture 4 for Applied Multivariate Analysis Outline 1 Eigen values and eigen vectors Characteristic equation Some properties of eigendecompositions

More information

Describing Within-Person Fluctuation over Time using Alternative Covariance Structures

Describing Within-Person Fluctuation over Time using Alternative Covariance Structures Describing Within-Person Fluctuation over Time using Alternative Covariance Structures Today s Class: The Big Picture ACS models using the R matrix only Introducing the G, Z, and V matrices ACS models

More information

. a m1 a mn. a 1 a 2 a = a n

. a m1 a mn. a 1 a 2 a = a n Biostat 140655, 2008: Matrix Algebra Review 1 Definition: An m n matrix, A m n, is a rectangular array of real numbers with m rows and n columns Element in the i th row and the j th column is denoted by

More information

I Have the Power in QTL linkage: single and multilocus analysis

I Have the Power in QTL linkage: single and multilocus analysis I Have the Power in QTL linkage: single and multilocus analysis Benjamin Neale 1, Sir Shaun Purcell 2 & Pak Sham 13 1 SGDP, IoP, London, UK 2 Harvard School of Public Health, Cambridge, MA, USA 3 Department

More information

Univariate Linkage in Mx. Boulder, TC 18, March 2005 Posthuma, Maes, Neale

Univariate Linkage in Mx. Boulder, TC 18, March 2005 Posthuma, Maes, Neale Univariate Linkage in Mx Boulder, TC 18, March 2005 Posthuma, Maes, Neale VC analysis of Linkage Incorporating IBD Coefficients Covariance might differ according to sharing at a particular locus. Sharing

More information

Multivariate Gaussian Distribution. Auxiliary notes for Time Series Analysis SF2943. Spring 2013

Multivariate Gaussian Distribution. Auxiliary notes for Time Series Analysis SF2943. Spring 2013 Multivariate Gaussian Distribution Auxiliary notes for Time Series Analysis SF2943 Spring 203 Timo Koski Department of Mathematics KTH Royal Institute of Technology, Stockholm 2 Chapter Gaussian Vectors.

More information

VAR Model. (k-variate) VAR(p) model (in the Reduced Form): Y t-2. Y t-1 = A + B 1. Y t + B 2. Y t-p. + ε t. + + B p. where:

VAR Model. (k-variate) VAR(p) model (in the Reduced Form): Y t-2. Y t-1 = A + B 1. Y t + B 2. Y t-p. + ε t. + + B p. where: VAR Model (k-variate VAR(p model (in the Reduced Form: where: Y t = A + B 1 Y t-1 + B 2 Y t-2 + + B p Y t-p + ε t Y t = (y 1t, y 2t,, y kt : a (k x 1 vector of time series variables A: a (k x 1 vector

More information

Model building & assumptions. Matt Keller, Sarah Medland, Hermine Maes TC21 March 2008

Model building & assumptions. Matt Keller, Sarah Medland, Hermine Maes TC21 March 2008 Model building & assumptions Matt Keller, Sarah Medland, Hermine Maes TC2 March 2008 cknowledgments John Jinks David Fulker Robert Cloninger John DeFries Lindon aves Nick Martin Dorret Boomsma Michael

More information

Introduction to Random Effects of Time and Model Estimation

Introduction to Random Effects of Time and Model Estimation Introduction to Random Effects of Time and Model Estimation Today s Class: The Big Picture Multilevel model notation Fixed vs. random effects of time Random intercept vs. random slope models How MLM =

More information

Inverse of a Square Matrix. For an N N square matrix A, the inverse of A, 1

Inverse of a Square Matrix. For an N N square matrix A, the inverse of A, 1 Inverse of a Square Matrix For an N N square matrix A, the inverse of A, 1 A, exists if and only if A is of full rank, i.e., if and only if no column of A is a linear combination 1 of the others. A is

More information

Supplementary File 3: Tutorial for ASReml-R. Tutorial 1 (ASReml-R) - Estimating the heritability of birth weight

Supplementary File 3: Tutorial for ASReml-R. Tutorial 1 (ASReml-R) - Estimating the heritability of birth weight Supplementary File 3: Tutorial for ASReml-R Tutorial 1 (ASReml-R) - Estimating the heritability of birth weight This tutorial will demonstrate how to run a univariate animal model using the software ASReml

More information

Some Multivariate techniques Principal components analysis (PCA) Factor analysis (FA) Structural equation models (SEM) Applications: Personality

Some Multivariate techniques Principal components analysis (PCA) Factor analysis (FA) Structural equation models (SEM) Applications: Personality Some Multivariate techniques Principal components analysis (PCA) Factor analysis (FA) Structural equation models (SEM) Applications: Personality Boulder March 2006 Dorret I. Boomsma Danielle Dick Marleen

More information

Bare minimum on matrix algebra. Psychology 588: Covariance structure and factor models

Bare minimum on matrix algebra. Psychology 588: Covariance structure and factor models Bare minimum on matrix algebra Psychology 588: Covariance structure and factor models Matrix multiplication 2 Consider three notations for linear combinations y11 y1 m x11 x 1p b11 b 1m y y x x b b n1

More information

Gene± environment interaction is likely to be a common and

Gene± environment interaction is likely to be a common and Variance Components Models for Gene Environment Interaction in Twin Analysis Shaun Purcell Social, Genetic and Developmental Psychiatry Research Centre, Institute of Psychiatry, King s College, London,

More information

Structural Equation Modeling and Confirmatory Factor Analysis. Types of Variables

Structural Equation Modeling and Confirmatory Factor Analysis. Types of Variables /4/04 Structural Equation Modeling and Confirmatory Factor Analysis Advanced Statistics for Researchers Session 3 Dr. Chris Rakes Website: http://csrakes.yolasite.com Email: Rakes@umbc.edu Twitter: @RakesChris

More information

Lecture 11. Multivariate Normal theory

Lecture 11. Multivariate Normal theory 10. Lecture 11. Multivariate Normal theory Lecture 11. Multivariate Normal theory 1 (1 1) 11. Multivariate Normal theory 11.1. Properties of means and covariances of vectors Properties of means and covariances

More information

CS4495/6495 Introduction to Computer Vision. 8B-L2 Principle Component Analysis (and its use in Computer Vision)

CS4495/6495 Introduction to Computer Vision. 8B-L2 Principle Component Analysis (and its use in Computer Vision) CS4495/6495 Introduction to Computer Vision 8B-L2 Principle Component Analysis (and its use in Computer Vision) Wavelength 2 Wavelength 2 Principal Components Principal components are all about the directions

More information

Confirmatory Factor Models (CFA: Confirmatory Factor Analysis)

Confirmatory Factor Models (CFA: Confirmatory Factor Analysis) Confirmatory Factor Models (CFA: Confirmatory Factor Analysis) Today s topics: Comparison of EFA and CFA CFA model parameters and identification CFA model estimation CFA model fit evaluation CLP 948: Lecture

More information

Sex-limitation Models

Sex-limitation Models Sex-limitation Models Meike Bartels (Brad, Sarah, Hermine, Ben, Elizabeth, and most of the rest of the faculty that has contributed bits and pieces to various versions of this talk) COPY FILES FROM: Faculty/meike/2016/heterogeneity

More information

Consistent Bivariate Distribution

Consistent Bivariate Distribution A Characterization of the Normal Conditional Distributions MATSUNO 79 Therefore, the function ( ) = G( : a/(1 b2)) = N(0, a/(1 b2)) is a solu- tion for the integral equation (10). The constant times of

More information

The Multivariate Normal Distribution. In this case according to our theorem

The Multivariate Normal Distribution. In this case according to our theorem The Multivariate Normal Distribution Defn: Z R 1 N(0, 1) iff f Z (z) = 1 2π e z2 /2. Defn: Z R p MV N p (0, I) if and only if Z = (Z 1,..., Z p ) T with the Z i independent and each Z i N(0, 1). In this

More information

Introduction to Confirmatory Factor Analysis

Introduction to Confirmatory Factor Analysis Introduction to Confirmatory Factor Analysis Multivariate Methods in Education ERSH 8350 Lecture #12 November 16, 2011 ERSH 8350: Lecture 12 Today s Class An Introduction to: Confirmatory Factor Analysis

More information

A Note on the Parameterization of Purcell s G 3 E Model for Ordinal and Binary Data

A Note on the Parameterization of Purcell s G 3 E Model for Ordinal and Binary Data Behav Genet (2009) 39:220 229 DOI 10.1007/s10519-008-9247-7 BRIEF COMMUNICATION A Note on the Parameterization of Purcell s G 3 E Model for Ordinal and Binary Data Sarah E. Medland Æ Michael C. Neale Æ

More information

SAS Syntax and Output for Data Manipulation:

SAS Syntax and Output for Data Manipulation: CLP 944 Example 5 page 1 Practice with Fixed and Random Effects of Time in Modeling Within-Person Change The models for this example come from Hoffman (2015) chapter 5. We will be examining the extent

More information

Supplemental Tables. Investigating the Theoretical Structure of the Differential Ability Scales Second Edition Through Hierarchical Exploratory

Supplemental Tables. Investigating the Theoretical Structure of the Differential Ability Scales Second Edition Through Hierarchical Exploratory Supplemental Tables Investigating the Theoretical Structure of the Differential Ability Scales Second Edition Through Hierarchical Exploratory Factor Analysis By S. C. Dombrowksi et al., Journal of Psychoeducational

More information

Introduction to Machine Learning. PCA and Spectral Clustering. Introduction to Machine Learning, Slides: Eran Halperin

Introduction to Machine Learning. PCA and Spectral Clustering. Introduction to Machine Learning, Slides: Eran Halperin 1 Introduction to Machine Learning PCA and Spectral Clustering Introduction to Machine Learning, 2013-14 Slides: Eran Halperin Singular Value Decomposition (SVD) The singular value decomposition (SVD)

More information

Dependence. Practitioner Course: Portfolio Optimization. John Dodson. September 10, Dependence. John Dodson. Outline.

Dependence. Practitioner Course: Portfolio Optimization. John Dodson. September 10, Dependence. John Dodson. Outline. Practitioner Course: Portfolio Optimization September 10, 2008 Before we define dependence, it is useful to define Random variables X and Y are independent iff For all x, y. In particular, F (X,Y ) (x,

More information

In the bivariate regression model, the original parameterization is. Y i = β 1 + β 2 X2 + β 2 X2. + β 2 (X 2i X 2 ) + ε i (2)

In the bivariate regression model, the original parameterization is. Y i = β 1 + β 2 X2 + β 2 X2. + β 2 (X 2i X 2 ) + ε i (2) RNy, econ460 autumn 04 Lecture note Orthogonalization and re-parameterization 5..3 and 7.. in HN Orthogonalization of variables, for example X i and X means that variables that are correlated are made

More information

Consequences of measurement error. Psychology 588: Covariance structure and factor models

Consequences of measurement error. Psychology 588: Covariance structure and factor models Consequences of measurement error Psychology 588: Covariance structure and factor models Scaling indeterminacy of latent variables Scale of a latent variable is arbitrary and determined by a convention

More information

Hypothesis Testing for Var-Cov Components

Hypothesis Testing for Var-Cov Components Hypothesis Testing for Var-Cov Components When the specification of coefficients as fixed, random or non-randomly varying is considered, a null hypothesis of the form is considered, where Additional output

More information

Repeated Measures ANOVA Multivariate ANOVA and Their Relationship to Linear Mixed Models

Repeated Measures ANOVA Multivariate ANOVA and Their Relationship to Linear Mixed Models Repeated Measures ANOVA Multivariate ANOVA and Their Relationship to Linear Mixed Models EPSY 905: Multivariate Analysis Spring 2016 Lecture #12 April 20, 2016 EPSY 905: RM ANOVA, MANOVA, and Mixed Models

More information

Measurement Invariance (MI) in CFA and Differential Item Functioning (DIF) in IRT/IFA

Measurement Invariance (MI) in CFA and Differential Item Functioning (DIF) in IRT/IFA Topics: Measurement Invariance (MI) in CFA and Differential Item Functioning (DIF) in IRT/IFA What are MI and DIF? Testing measurement invariance in CFA Testing differential item functioning in IRT/IFA

More information

SEM with observed variables: parameterization and identification. Psychology 588: Covariance structure and factor models

SEM with observed variables: parameterization and identification. Psychology 588: Covariance structure and factor models SEM with observed variables: parameterization and identification Psychology 588: Covariance structure and factor models Limitations of SEM as a causal modeling 2 If an SEM model reflects the reality, the

More information

Package SEMModComp. R topics documented: February 19, Type Package Title Model Comparisons for SEM Version 1.0 Date Author Roy Levy

Package SEMModComp. R topics documented: February 19, Type Package Title Model Comparisons for SEM Version 1.0 Date Author Roy Levy Type Package Title Model Comparisons for SEM Version 1.0 Date 2009-02-23 Author Roy Levy Package SEMModComp Maintainer Roy Levy February 19, 2015 Conduct tests of difference in fit for

More information

PCA and admixture models

PCA and admixture models PCA and admixture models CM226: Machine Learning for Bioinformatics. Fall 2016 Sriram Sankararaman Acknowledgments: Fei Sha, Ameet Talwalkar, Alkes Price PCA and admixture models 1 / 57 Announcements HW1

More information

Principle Components Analysis (PCA) Relationship Between a Linear Combination of Variables and Axes Rotation for PCA

Principle Components Analysis (PCA) Relationship Between a Linear Combination of Variables and Axes Rotation for PCA Principle Components Analysis (PCA) Relationship Between a Linear Combination of Variables and Axes Rotation for PCA Principle Components Analysis: Uses one group of variables (we will call this X) In

More information

Numerical Linear Algebra

Numerical Linear Algebra Numerical Linear Algebra Carlos Hurtado Department of Economics University of Illinois at Urbana-Champaign hrtdmrt2@illinois.edu Sep 19th, 2017 C. Hurtado (UIUC - Economics) Numerical Methods On the Agenda

More information

Statistical Techniques II

Statistical Techniques II Statistical Techniques II EST705 Regression with atrix Algebra 06a_atrix SLR atrix Algebra We will not be doing our regressions with matrix algebra, except that the computer does employ matrices. In fact,

More information

Reference: Davidson and MacKinnon Ch 2. In particular page

Reference: Davidson and MacKinnon Ch 2. In particular page RNy, econ460 autumn 03 Lecture note Reference: Davidson and MacKinnon Ch. In particular page 57-8. Projection matrices The matrix M I X(X X) X () is often called the residual maker. That nickname is easy

More information

Introduction to Structural Equation Modeling

Introduction to Structural Equation Modeling Introduction to Structural Equation Modeling Notes Prepared by: Lisa Lix, PhD Manitoba Centre for Health Policy Topics Section I: Introduction Section II: Review of Statistical Concepts and Regression

More information

Multiple Group CFA Invariance Example (data from Brown Chapter 7) using MLR Mplus 7.4: Major Depression Criteria across Men and Women (n = 345 each)

Multiple Group CFA Invariance Example (data from Brown Chapter 7) using MLR Mplus 7.4: Major Depression Criteria across Men and Women (n = 345 each) Multiple Group CFA Invariance Example (data from Brown Chapter 7) using MLR Mplus 7.4: Major Depression Criteria across Men and Women (n = 345 each) 9 items rated by clinicians on a scale of 0 to 8 (0

More information

3/10/03 Gregory Carey Cholesky Problems - 1. Cholesky Problems

3/10/03 Gregory Carey Cholesky Problems - 1. Cholesky Problems 3/10/03 Gregory Carey Cholesky Problems - 1 Cholesky Problems Gregory Carey Department of Psychology and Institute for Behavioral Genetics University of Colorado Boulder CO 80309-0345 Email: gregory.carey@colorado.edu

More information

SAS Syntax and Output for Data Manipulation: CLDP 944 Example 3a page 1

SAS Syntax and Output for Data Manipulation: CLDP 944 Example 3a page 1 CLDP 944 Example 3a page 1 From Between-Person to Within-Person Models for Longitudinal Data The models for this example come from Hoffman (2015) chapter 3 example 3a. We will be examining the extent to

More information

Factor Analysis. Robert L. Wolpert Department of Statistical Science Duke University, Durham, NC, USA

Factor Analysis. Robert L. Wolpert Department of Statistical Science Duke University, Durham, NC, USA Factor Analysis Robert L. Wolpert Department of Statistical Science Duke University, Durham, NC, USA 1 Factor Models The multivariate regression model Y = XB +U expresses each row Y i R p as a linear combination

More information

Partitioning Genetic Variance

Partitioning Genetic Variance PSYC 510: Partitioning Genetic Variance (09/17/03) 1 Partitioning Genetic Variance Here, mathematical models are developed for the computation of different types of genetic variance. Several substantive

More information

The 3 Indeterminacies of Common Factor Analysis

The 3 Indeterminacies of Common Factor Analysis The 3 Indeterminacies of Common Factor Analysis James H. Steiger Department of Psychology and Human Development Vanderbilt University James H. Steiger (Vanderbilt University) The 3 Indeterminacies of Common

More information

Preface. List of examples

Preface. List of examples Contents Preface List of examples i xix 1 LISREL models and methods 1 1.1 The general LISREL model 1 Assumptions 2 The covariance matrix of the observations as implied by the LISREL model 3 Fixed, free,

More information

Proportional Variance Explained by QLT and Statistical Power. Proportional Variance Explained by QTL and Statistical Power

Proportional Variance Explained by QLT and Statistical Power. Proportional Variance Explained by QTL and Statistical Power Proportional Variance Explained by QTL and Statistical Power Partitioning the Genetic Variance We previously focused on obtaining variance components of a quantitative trait to determine the proportion

More information

ME5286 Robotics Spring 2017 Quiz 2

ME5286 Robotics Spring 2017 Quiz 2 Page 1 of 5 ME5286 Robotics Spring 2017 Quiz 2 Total Points: 30 You are responsible for following these instructions. Please take a minute and read them completely. 1. Put your name on this page, any other

More information

Factor Analysis (10/2/13)

Factor Analysis (10/2/13) STA561: Probabilistic machine learning Factor Analysis (10/2/13) Lecturer: Barbara Engelhardt Scribes: Li Zhu, Fan Li, Ni Guan Factor Analysis Factor analysis is related to the mixture models we have studied.

More information

Key Algebraic Results in Linear Regression

Key Algebraic Results in Linear Regression Key Algebraic Results in Linear Regression James H. Steiger Department of Psychology and Human Development Vanderbilt University James H. Steiger (Vanderbilt University) 1 / 30 Key Algebraic Results in

More information

RESMA course Introduction to LISREL. Harry Ganzeboom RESMA Data Analysis & Report #4 February

RESMA course Introduction to LISREL. Harry Ganzeboom RESMA Data Analysis & Report #4 February RESMA course Introduction to LISREL Harry Ganzeboom RESMA Data Analysis & Report #4 February 17 2009 LISREL SEM: Simultaneous [Structural] Equations Model: A system of linear equations ( causal model )

More information

Prof. Dr.-Ing. Armin Dekorsy Department of Communications Engineering. Stochastic Processes and Linear Algebra Recap Slides

Prof. Dr.-Ing. Armin Dekorsy Department of Communications Engineering. Stochastic Processes and Linear Algebra Recap Slides Prof. Dr.-Ing. Armin Dekorsy Department of Communications Engineering Stochastic Processes and Linear Algebra Recap Slides Stochastic processes and variables XX tt 0 = XX xx nn (tt) xx 2 (tt) XX tt XX

More information

The Cholesky Approach: A Cautionary Note

The Cholesky Approach: A Cautionary Note Behavior Genetics, Vol. 26, No. 1, 1996 The Cholesky Approach: A Cautionary Note John C. Loehlin I Received 18 Jan. 1995--Final 27 July 1995 Attention is called to a common misinterpretation of a bivariate

More information

7. Symmetric Matrices and Quadratic Forms

7. Symmetric Matrices and Quadratic Forms Linear Algebra 7. Symmetric Matrices and Quadratic Forms CSIE NCU 1 7. Symmetric Matrices and Quadratic Forms 7.1 Diagonalization of symmetric matrices 2 7.2 Quadratic forms.. 9 7.4 The singular value

More information

2.1 Linear regression with matrices

2.1 Linear regression with matrices 21 Linear regression with matrices The values of the independent variables are united into the matrix X (design matrix), the values of the outcome and the coefficient are represented by the vectors Y and

More information

Factor Analysis. Qian-Li Xue

Factor Analysis. Qian-Li Xue Factor Analysis Qian-Li Xue Biostatistics Program Harvard Catalyst The Harvard Clinical & Translational Science Center Short course, October 7, 06 Well-used latent variable models Latent variable scale

More information

Principal Component Analysis (PCA) Principal Component Analysis (PCA)

Principal Component Analysis (PCA) Principal Component Analysis (PCA) Recall: Eigenvectors of the Covariance Matrix Covariance matrices are symmetric. Eigenvectors are orthogonal Eigenvectors are ordered by the magnitude of eigenvalues: λ 1 λ 2 λ p {v 1, v 2,..., v n } Recall:

More information

The Matrix Algebra of Sample Statistics

The Matrix Algebra of Sample Statistics The Matrix Algebra of Sample Statistics James H. Steiger Department of Psychology and Human Development Vanderbilt University James H. Steiger (Vanderbilt University) The Matrix Algebra of Sample Statistics

More information

Math 3191 Applied Linear Algebra

Math 3191 Applied Linear Algebra Math 9 Applied Linear Algebra Lecture : Orthogonal Projections, Gram-Schmidt Stephen Billups University of Colorado at Denver Math 9Applied Linear Algebra p./ Orthonormal Sets A set of vectors {u, u,...,

More information

Dependence. MFM Practitioner Module: Risk & Asset Allocation. John Dodson. September 11, Dependence. John Dodson. Outline.

Dependence. MFM Practitioner Module: Risk & Asset Allocation. John Dodson. September 11, Dependence. John Dodson. Outline. MFM Practitioner Module: Risk & Asset Allocation September 11, 2013 Before we define dependence, it is useful to define Random variables X and Y are independent iff For all x, y. In particular, F (X,Y

More information

Lecture 7a: Vector Autoregression (VAR)

Lecture 7a: Vector Autoregression (VAR) Lecture 7a: Vector Autoregression (VAR) 1 Big Picture We are done with univariate time series analysis Now we switch to multivariate analysis, that is, studying several time series simultaneously. VAR

More information

F.4 Solving Polynomial Equations and Applications of Factoring

F.4 Solving Polynomial Equations and Applications of Factoring section F4 243 F.4 Zero-Product Property Many application problems involve solving polynomial equations. In Chapter L, we studied methods for solving linear, or first-degree, equations. Solving higher

More information

Passing-Bablok Regression for Method Comparison

Passing-Bablok Regression for Method Comparison Chapter 313 Passing-Bablok Regression for Method Comparison Introduction Passing-Bablok regression for method comparison is a robust, nonparametric method for fitting a straight line to two-dimensional

More information

Linear Models for the Prediction of Animal Breeding Values

Linear Models for the Prediction of Animal Breeding Values Linear Models for the Prediction of Animal Breeding Values R.A. Mrode, PhD Animal Data Centre Fox Talbot House Greenways Business Park Bellinger Close Chippenham Wilts, UK CAB INTERNATIONAL Preface ix

More information

Lecture 9 SLR in Matrix Form

Lecture 9 SLR in Matrix Form Lecture 9 SLR in Matrix Form STAT 51 Spring 011 Background Reading KNNL: Chapter 5 9-1 Topic Overview Matrix Equations for SLR Don t focus so much on the matrix arithmetic as on the form of the equations.

More information

Ratio of Polynomials Fit Many Variables

Ratio of Polynomials Fit Many Variables Chapter 376 Ratio of Polynomials Fit Many Variables Introduction This program fits a model that is the ratio of two polynomials of up to fifth order. Instead of a single independent variable, these polynomials

More information

How to run the RI CLPM with Mplus By Ellen Hamaker March 21, 2018

How to run the RI CLPM with Mplus By Ellen Hamaker March 21, 2018 How to run the RI CLPM with Mplus By Ellen Hamaker March 21, 2018 The random intercept cross lagged panel model (RI CLPM) as proposed by Hamaker, Kuiper and Grasman (2015, Psychological Methods) is a model

More information

Principal Components Analysis (PCA) and Singular Value Decomposition (SVD) with applications to Microarrays

Principal Components Analysis (PCA) and Singular Value Decomposition (SVD) with applications to Microarrays Principal Components Analysis (PCA) and Singular Value Decomposition (SVD) with applications to Microarrays Prof. Tesler Math 283 Fall 2015 Prof. Tesler Principal Components Analysis Math 283 / Fall 2015

More information

Tree Building Activity

Tree Building Activity Tree Building Activity Introduction In this activity, you will construct phylogenetic trees using a phenotypic similarity (cartoon microbe pictures) and genotypic similarity (real microbe sequences). For

More information

Determinants. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 25

Determinants. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 25 Determinants opyright c 2012 Dan Nettleton (Iowa State University) Statistics 611 1 / 25 Notation The determinant of a square matrix n n A is denoted det(a) or A. opyright c 2012 Dan Nettleton (Iowa State

More information

Addition and subtraction: element by element, and dimensions must match.

Addition and subtraction: element by element, and dimensions must match. Matrix Essentials review: ) Matrix: Rectangular array of numbers. ) ranspose: Rows become columns and vice-versa ) single row or column is called a row or column) Vector ) R ddition and subtraction: element

More information

Factor Analysis Edpsy/Soc 584 & Psych 594

Factor Analysis Edpsy/Soc 584 & Psych 594 Factor Analysis Edpsy/Soc 584 & Psych 594 Carolyn J. Anderson University of Illinois, Urbana-Champaign April 29, 2009 1 / 52 Rotation Assessing Fit to Data (one common factor model) common factors Assessment

More information

Estimating Variances and Covariances in a Non-stationary Multivariate Time Series Using the K-matrix

Estimating Variances and Covariances in a Non-stationary Multivariate Time Series Using the K-matrix Estimating Variances and Covariances in a Non-stationary Multivariate ime Series Using the K-matrix Stephen P Smith, January 019 Abstract. A second order time series model is described, and generalized

More information

1. A Brief History of Longitudinal Factor Analysis

1. A Brief History of Longitudinal Factor Analysis Factor Analysis in Longitudinal and Repeated Measures Studies Jack McArdle, Psychology Dept., University of Virginia, Charlottesville, VA The Factor Analysis at 00 Meeting University of North Carolina,

More information

Principal Component Analysis-I Geog 210C Introduction to Spatial Data Analysis. Chris Funk. Lecture 17

Principal Component Analysis-I Geog 210C Introduction to Spatial Data Analysis. Chris Funk. Lecture 17 Principal Component Analysis-I Geog 210C Introduction to Spatial Data Analysis Chris Funk Lecture 17 Outline Filters and Rotations Generating co-varying random fields Translating co-varying fields into

More information

Linear Algebra Background

Linear Algebra Background CS76A Text Retrieval and Mining Lecture 5 Recap: Clustering Hierarchical clustering Agglomerative clustering techniques Evaluation Term vs. document space clustering Multi-lingual docs Feature selection

More information

Multiple Group Analysis. Structural Equation Models. Interactions in SEMs. Multiple Group Analysis

Multiple Group Analysis. Structural Equation Models. Interactions in SEMs. Multiple Group Analysis Multiple Group Analysis Structural Equation Models Multiple Group Analysis Klaus Kähler Holst kkho@biostat.ku.dk Esben Budtz-Jørgensen ebj@biostat.ku.dk Department of Biostatistics, University of Copenhagen

More information

ECE Lecture #10 Overview

ECE Lecture #10 Overview ECE 450 - Lecture #0 Overview Introduction to Random Vectors CDF, PDF Mean Vector, Covariance Matrix Jointly Gaussian RV s: vector form of pdf Introduction to Random (or Stochastic) Processes Definitions

More information

Mathematics: Pre-Algebra Eight

Mathematics: Pre-Algebra Eight Mathematics: Pre-Algebra Eight Students in 8 th Grade Pre-Algebra will study expressions and equations using one or two unknown values. Students will be introduced to the concept of a mathematical function

More information

Ch. 12 Linear Bayesian Estimators

Ch. 12 Linear Bayesian Estimators Ch. 1 Linear Bayesian Estimators 1 In chapter 11 we saw: the MMSE estimator takes a simple form when and are jointly Gaussian it is linear and used only the 1 st and nd order moments (means and covariances).

More information

MATH 2331 Linear Algebra. Section 2.1 Matrix Operations. Definition: A : m n, B : n p. Example: Compute AB, if possible.

MATH 2331 Linear Algebra. Section 2.1 Matrix Operations. Definition: A : m n, B : n p. Example: Compute AB, if possible. MATH 2331 Linear Algebra Section 2.1 Matrix Operations Definition: A : m n, B : n p ( 1 2 p ) ( 1 2 p ) AB = A b b b = Ab Ab Ab Example: Compute AB, if possible. 1 Row-column rule: i-j-th entry of AB:

More information

STA 431s17 Assignment Eight 1

STA 431s17 Assignment Eight 1 STA 43s7 Assignment Eight The first three questions of this assignment are about how instrumental variables can help with measurement error and omitted variables at the same time; see Lecture slide set

More information

Matrix Algebra Review

Matrix Algebra Review APPENDIX A Matrix Algebra Review This appendix presents some of the basic definitions and properties of matrices. Many of the matrices in the appendix are named the same as the matrices that appear in

More information

Review of Multilevel Models for Longitudinal Data

Review of Multilevel Models for Longitudinal Data Review of Multilevel Models for Longitudinal Data Topics: Concepts in longitudinal multilevel modeling Describing within-person fluctuation using ACS models Describing within-person change using random

More information