Multivariate Analysis. Hermine Maes TC19 March 2006
|
|
- Camron Mitchell
- 5 years ago
- Views:
Transcription
1 Multivariate Analysis Hermine Maes TC9 March 2006
2 Files to Copy to your Computer Faculty/hmaes/tc9/maes/multivariate *.rec *.dat *.mx Multivariate.ppt
3 Multivariate Questions I Bivariate Analysis: What are the contributions of genetic and environmental factors to the covariance between two traits? Multivariate Analysis: What are the contributions of genetic and environmental factors to the covariance between more than two traits?
4 Phenotypic Cholesky F2 F3 F4 P f F2 F3 F4 P2 f 2 f f 2 f 3 f 4 P3 f 3 P4 f 4 P t P2 t P3 t P4 t
5 Phenotypic Cholesky F2 F2 F3 F4 P f F2 F3 0 F4 P2 f 2 f 22 f 22 f 32 f 42 P3 f 3 f 32 P4 f 4 f 42 P t P2 t P3 t P4 t
6 Phenotypic Cholesky F2 F3 F4 P f F2 F3 0 0 F4 P2 0 f 33 f 43 P3 f 2 f 22 f 3 f 33 P4 f 4 f 32 f 42 f 43 P t P2 t P3 t P4 t
7 Phenotypic Cholesky F2 F3 F4 P f F2 F3 F P2 f 2 f 22 0 f 33 0 f 44 P3 f 3 f 32 0 f f P4 f 4 f 42 P t P2 t P3 t P4 t
8 Cholesky Decomposition F2 F3 F4 P f f f 2 f 3 f 4 P2 P3 f 2 f f 3 f 32 f 33 0 f f * 0 0 f 22 f 32 f 42 0 f 33 f 43 P4 f 4 f f 44 F * F'
9 Saturated Model Use Cholesky decomposition to estimate covariance matrix Fully saturated Model: Cov P = F*F F: Lower nvar nvar
10 Phenotypic Single Factor P P2 f f 2 * f f 2 f 3 f 4 P3 f 3 f f 2 f 3 f 4 P4 f 4 F * F' P t P2 t P3 t P4 t
11 Residual Variances P P2 P3 E E2 E3 E4 e e e 33 0 e 44 * e e e 33 0 e 44 f f 2 f 3 f 4 P E * E' P t P2 t P3 t P4 t e e 22 e 33 e 44 E E2 E3 E4
12 Factor Analysis Explain covariance by limited number of factors Exploratory / Confirmatory Model: Cov P = F*F + E*E F: Full nvar nfac E: Diag nvar nvar Model: Cov P = F*I*F + E*E
13 Twin Data? f f 2 f 3 f 4 f f 2 f 3 f 4 P t P2 t P3 t P4 t P t2 P2 t2 P3 t2 P4 t2 e e 22 e 33 e 44 e e 22 e 33 e 44 E E2 E3 E4 E E2 E3 E4
14 Genetic Single Factor.0 / 0.5 A A a a 2 a 3 a 4 a a 2 a 3 a 4 P t P2 t P3 t P4 t P t2 P2 t2 P3 t2 P4 t2 e e 22 e 33 e 44 e e 22 e 33 e 44 E E2 E3 E4 E E2 E3 E4
15 Common Environmental Single Factor.0 / A C A C c c 2 c 3 c 4 c c 2 c 3 c 4 P t P2 t P3 t P4 t P t2 P2 t2 P3 t2 P4 t2 e e 22 e 33 e 44 e e 22 e 33 e 44 E E2 E3 E4 E E2 E3 E4
16 Specific Environmental Single Factor.0 / A C E A C E e e 2 e 3 e 4 e e 2 e 3 e 4 P t P2 t P3 t P4 t P t2 P2 t2 P3 t2 P4 t2 e e 22 e 33 e 44 e e 22 e 33 e 44 E E2 E3 E4 E E2 E3 E4
17 Single [Common] Factor X: genetic Full 4 x Full nvar x nfac P P2 P3 P4 A a a 2 * a a 2 a 3 a 4 a 3 a 4 X * X' Y: shared environmental Z: specific environmental
18 Residuals partitioned in ACE.0 / A C E A C E P t P2 t P3 t P4 t P t2 P2 t2 P3 t2 P4 t2 a c A C e e 22 e 33 e 44 E E2 E3 E4 e e 22 e 33 e 44 E E2 E3 E4
19 Residual Factors T: genetic U: shared environmental V: specific environmental Diag 4 x 4 Diag nvar x nvar E E2 E3 E4 P e P2 0 e P3 0 0 e 33 0 P e 44 V * * e e e e 44 V'
20 Independent Pathway Model.0 / A C C C [X] [Y] [Z] E C A C C C E C P t P2 t P3 t P4 t P t2 P2 t2 P3 t2 P4 t2 [U] C A E A2 E2 A3 E3 A4 E4 [T] [V] A E A2 E2 A3 E3 A4 E4.0 / / / / 0.5
21 IP Independent pathways Biometric model Different covariance structure for A, C and E
22 Independent Pathway I G: Define matrices Calculation Begin Matrices; X full nvar nfac Free! common factor genetic path coefficients Y full nvar nfac Free! common factor shared environment paths Z full nvar nfac Free! common factor unique environment paths T diag nvar nvar Free! variable specific genetic paths U diag nvar nvar Free! variable specific shared env paths V diag nvar nvar Free! variable specific residual paths M full nvar Free! means End Matrices; Start Begin Algebra; A= X*X' + T*T';! additive genetic variance components C= Y*Y' + U*U';! shared environment variance components E= Z*Z' + V*V';! nonshared environment variance components End Algebra; End indpath.mx
23 Independent Pathway II G2: MZ twins #include iqnlmz.dat Begin Matrices = Group ; Means M M ; Covariance A+C+E A+C _ A+C A+C+E ; Option Rsiduals End G3: DZ twins #include iqnldz.dat Begin Matrices= Group ; H full End Matrices; Matrix H.5 Means M M ; Covariance A+C+E H@A+C _ H@A+C A+C+E ; Option Rsiduals End
24 Independent Pathway III G4: Calculate Standardised Solution Calculation Matrices = Group I Iden nvar nvar End Matrices; Begin Algebra; R=A+C+E;! total variance S=(\sqrt(I.R))~;! diagonal matrix of standard deviations P=S*X_ S*Y_ S*Z;! standardized estimates for common factors Q=S*T_ S*U_ S*V;! standardized estimates for spec factors End Algebra; Labels Row P a a2 a3 a4 a5 a6 c c2 c3 c4 c5 c6 e e2 e3 e4 e5 e6 Labels Col P var var2 var3 var4 var5 var6 Labels Row Q as as2 as3 as4 as5 as6 cs cs2 cs3 cs4 cs5 cs6 es es2 es3 es4 es5 es6 Labels Col Q var var2 var3 var4 var5 var6 Options NDecimals=4 End
25 Practical Example Dataset: NL-IQ Study 6 WAIS-III IQ subtests var = onvolledige tekeningen / picture completion var2 = woordenschat / vocabulary var3 = paren associeren / digit span var4 = incidenteel leren / incidental learning var5 = overeenkomsten / similarities var6 = blokpatronen / block design N MZF: 27, DZF: 70
26 Dat Files iqnlmz.dat Data NInputvars=8 Missing=-.00 Rectangular File=iqnl.rec Labels famid zygos age_t sex_t var_t var2_t var3_t var4_t var5_t var6_t age_t2 sex_t2 var_t2 var2_t2 var3_t2 var4_t2 var5_t2 var6_t2 Select if zygos < 3 ;!select mz's Select var_t var2_t var3_t var4_t var5_t var6_t var_t2 var2_t2 var3_t2 var4_t2 var5_t2 var6_t2 ; iqnldz.dat... Select if zygos > 2 ;!select dz's...
27 Goodness-of-Fit Statistics -2LL df 2 df p AIC 2 df p Saturated (iqnlsat2.mx) Cholesky (cholesky.mx) Independent Pathway Common Pathway
28 MATRIX M This is a FULL matrix of order by MATRIX X This is a LOWER TRIANGULAR matrix of order 6 by MATRIX Y This is a LOWER TRIANGULAR matrix of order 6 by MATRIX Z This is a LOWER TRIANGULAR matrix of order 6 by
29 Goodness-of-Fit Statistics -2LL df 2 df p AIC 2 df p Saturated Cholesky Independent Pathway Common Pathway
30 MATRIX M This is a FULL matrix of order by MATRIX P This is a computed FULL matrix of order 8 by 6 [=S*X_S*Y_S*Z] VAR VAR2 VAR3 VAR4 VAR5 VAR6 A A A A A A C C C C C C E E E E E E
31 Independent Pathway Model.0 / A C C C [X] [Y] [Z] E C A C C C E C P t P2 t P3 t P4 t P t2 P2 t2 P3 t2 P4 t2 [U] C A E A2 E2 A3 E3 A4 E4 [T] [V] A E A2 E2 A3 E3 A4 E4.0 / / / / 0.5
32 Path Diagram to Matrices Variance Component a 2 c 2 e 2 Common Factors [X] 6 x [Y] 6 x [Z] 6 x Residual Factors [T] 6 x 6 [U] 6 x 6 [V] 6 x 6 #define nvar 6 #define nfac
33 MATRIX M This is a FULL matrix of order by MATRIX T This is a DIAGONAL matrix of order 6 by MATRIX U This is a DIAGONAL matrix of order 6 by MATRIX V This is a DIAGONAL matrix of order 6 by MATRIX X This is a FULL matrix of order 6 by MATRIX Y This is a FULL matrix of order 6 by MATRIX Z This is a FULL matrix of order 6 by
34 Goodness-of-Fit Statistics -2LL df 2 df p AIC 2 df p Saturated Cholesky Independent Pathway Common Pathway
35 MATRIX M This is a FULL matrix of order by MATRIX P 8 by [=S*X_S*Y_S*Z] VAR A A A A A A C C C C C C E E E E E5 0.3 E MATRIX Q This is a computed FULL matrix of order 8 by 6 [=S*T_S*U_S*V] VAR VAR2 VAR3 VAR4 VAR5 VAR6 AS AS AS AS AS AS CS CS CS CS CS CS ES ES ES ES ES ES
36 Exercise I. Drop common factor for shared environment 2. Drop common factor for specific environment 3. Add second genetic common factor
37 Phenotypic Single Factor P P2 f f 2 * f f 2 f 3 f 4 P3 f 3 f f 2 f 3 f 4 P4 f 4 F * F' P t P2 t P3 t P4 t
38 Latent Phenotype A C E a c e f f 2 f 3 f 4 P t P2 t P3 t P4 t
39 Twin Data.0 / A C E A C E a c e a c e f f 2 f 3 f 4 f f 2 f 3 f 4 P t P2 t P3 t P4 t P t P2 t P3 t P4 t
40 Factor on Latent Phenotype P P2 P3 P4 = f f 2 * a * a * f f 2 f 3 f 4 f 3 f 4 F * X * X' * F & ( X * X' ) F'
41 Common Pathway Model.0 / A C [X] a [Y] c e [Z] E A a C c e E [F] f f 2 f 3 f 4 f f 2 f 3 f 4 P t P2 t P3 t P4 t P t P2 t P3 t P4 t [U] C A E A2 E2 A3 E3 A4 E4 [T] [V] A E A2 E2 A3 E3 A4 E4.0 / / / / 0.5
42 Common Pathway Model I G: Define matrices Calculation Begin Matrices; X full nfac nfac Free! latent factor genetic path coefficient Y full nfac nfac Free! latent factor shared environment path Z full nfac nfac Free! latent factor unique environment path T diag nvar nvar Free! variable specific genetic paths U diag nvar nvar Free! variable specific shared env paths V diag nvar nvar Free! variable specific residual paths F full nvar nfac Free! loadings of variables on latent factor I Iden 2 2 M full nvar Free! means End Matrices; Start.. Begin Algebra; A= F&(X*X') + T*T';! genetic variance components C= F&(Y*Y') + U*U';! shared environment variance components E= F&(Z*Z') + V*V';! nonshared environment variance components L= X*X' + Y*Y' + Z*Z';! variance of latent factor End Algebra; End
43 Common Pathway II G4: Constrain variance of latent factor to Constraint Begin Matrices; L computed =L I unit End Matrices; Constraint L = I ; End G5: Calculate Standardised Solution Calculation Matrices = Group D Iden nvar nvar End Matrices; Begin Algebra; R=A+C+E;! total variance S=(\sqrt(D.R))~;! diagonal matrix of standard deviations P=S*F;! standardized estimates for loadings on F Q=S*T_ S*U_ S*V;! standardized estimates for specific factors End Algebra; Options NDecimals=4 End
44 CP Common pathway Psychometric model Same covariance structure for A, C and E
45 Common Pathway Model.0 / A C [X] a [Y] c e [Z] E A a C c e E [F] f f 2 f 3 f 4 f f 2 f 3 f 4 P t P2 t P3 t P4 t P t P2 t P3 t P4 t [U] C A E A2 E2 A3 E3 A4 E4 [T] [V] A E A2 E2 A3 E3 A4 E4.0 / / / / 0.5
46 Path Diagram to Matrices Variance Component a 2 c 2 e 2 Common Factor [X] x [Y] x [Z] x [F] 6 x Residual Factors [T] 6 x 6 [U] 6 x 6 [V] 6 x 6 #define nvar 6 #define nfac
47 MATRIX M This is a FULL matrix of order by MATRIX T This is a DIAGONAL matrix of order 6 by MATRIX U This is a DIAGONAL matrix of order 6 by MATRIX X This is a FULL matrix of order by MATRIX Y This is a FULL matrix of order by 2 MATRIX Z This is a FULL matrix of order by 3 MATRIX V This is a DIAGONAL matrix of order 6 by
48 Goodness-of-Fit Statistics -2LL df 2 df p AIC 2 df p Saturated Cholesky Independent Pathway Common Pathway
49 MATRIX M This is a FULL matrix of order by MATRIX P 6 by [=S*F] F F F F F MATRIX Q This is a computed FULL matrix of order 8 by 6 [=S*T_S*U_S*V] AS AS AS AS AS AS CS CS CS CS CS CS ES ES ES ES ES ES
50 WAIS-III IQ Verbal IQ var2 = woordenschat / vocabulary var3 = paren associeren / digit span var5 = overeenkomsten / similarities Performance IQ var = onvolledige tekeningen / picture completion var4 = incidenteel leren / incidental learning var6 = blokpatronen / block design
51 Exercise II. Change to 2 Latent Phenotypes corresponding to Verbal IQ and Performance IQ
52 Summary Independent Pathway Model Biometric Factor Model Loadings differ for genetic and environmental common factors Common Pathway Model Psychometric Factor Model Loadings equal for genetic and environmental common factor
53 Pathway Model [X] A [Y] C [Z] E A2.0 / 0.5 C2 E2.0 A3 C3 E3 A C E a a 2 a 22 a 3 a 32 a 33 a c e F2 F3 F2 F3 [F] f f 2 f 3 f 4 f 5 f 6 f f f 2 f 3 f 4 f 5 f 6 P t P2 t P3 t P4 t P5 t P6 t P t2 P2 t2 P3 t2 P4 t2 P5 t2 P6 t2 A E C [T] [V] [U] E2 E3 E4 E5 E6 E.0 / A C
54 Two Common Pathway Model [X] A [Y] C [Z] E A2.0 / 0.5 C2 E2.0 A3 C3 E3 A C E a a 2 a 22 a c e F2 F3 F2 F3 [F] f f 2 f 3 f 4 f 5 f f f 2 f 3 f 4 f 5 f 6 P t P2 t P3 t P4 t P5 t P6 t P t2 P2 t2 P3 t2 P4 t2 P5 t2 P6 t2 A E C [T] [V] [U] E2 E3 E4 E5 E6 E.0 / A C
55 Two Independent CP Model [X] A [Y] C [Z] E A2.0 / 0.5 C2 E2.0 A3 C3 E3 A C E a a 22 a c e F2 F3 F2 F3 [F] f f 2 f 3 f 4 f 5 f f f 2 f 3 f 4 f 5 f 6 P t P2 t P3 t P4 t P5 t P6 t P t2 P2 t2 P3 t2 P4 t2 P5 t2 P6 t2 A E C [T] [V] [U] E2 E3 E4 E5 E6 E.0 / A C
56 Two Reduced Indep CP Model [X] A [Y] C [Z] E A2.0 / 0.5 C2 E2.0 A3 C3 E3 A C E a a 22 a c e F2 F3 F2 F3 [F] f 2 f 3 f 2 f 5 f 42 f 62 f f 2 f 3 f 4 f 5 f 6 P t P2 t P3 t P4 t P5 t P6 t P t2 P2 t2 P3 t2 P4 t2 P5 t2 P6 t2 E E2 E3 E4 E5 E6 E A C A C [T] [V] [U].0 / 0.5.0
57 Common Pathway Model [X] A [Y] C [Z] E A2.0 / 0.5 C2 E2.0 A3 C3 E3 A C E a a c e F2 F3 F2 F3 [F] f f 2 f 3 f 4 f 5 f 6 f f 2 f 3 f 4 f 5 f 6 P t P2 t P3 t P4 t P5 t P6 t P t2 P2 t2 P3 t2 P4 t2 P5 t2 P6 t2 E E2 E3 E4 E5 E6 E A C A C [T] [V] [U].0 / 0.5.0
58 Independent Pathway Model [X] A [Y] C [Z] E A2.0 / 0.5 C2 E2.0 A3 C3 E3 A C E F2 F3 F2 F3 [F] f f 2 f 3 f 4 f 5 f 6 f f f 2 f 3 f 4 f 5 f 6 P t P2 t P3 t P4 t P5 t P6 t P t2 P2 t2 P3 t2 P4 t2 P5 t2 P6 t2 A E C [T] [V] [U] E2 E3 E4 E5 E6 E.0 / A C
Introduction to Multivariate Genetic Analysis. Meike Bartels, Hermine Maes, Elizabeth Prom-Wormley and Michel Nivard
Introduction to Multivariate Genetic nalysis Meike Bartels, Hermine Maes, Elizabeth Prom-Wormley and Michel Nivard im and Rationale im: to examine the source of factors that make traits correlate or co-vary
More informationPhenotypic factor analysis
1 Phenotypic factor analysis Conor V. Dolan & Michel Nivard VU, Amsterdam Boulder Workshop - March 2018 2 Phenotypic factor analysis A statistical technique to investigate the dimensionality of correlated
More informationCorrection for Ascertainment
Correction for Ascertainment Michael C. Neale International Workshop on Methodology for Genetic Studies of Twins and Families Boulder CO 2004 Virginia Institute for Psychiatric and Behavioral Genetics
More informationSex-limited expression of genetic or environmental
Multivariate Genetic Analysis of Sex Limitation and G E Interaction Michael C. Neale, 1 Espen Røysamb, 2 and Kristen Jacobson 3 1 Virginia Institute for Psychiatric and Behavioral Genetics,Virginia Commonwealth
More informationReview Packet 1 B 11 B 12 B 13 B = B 21 B 22 B 23 B 31 B 32 B 33 B 41 B 42 B 43
Review Packet. For each of the following, write the vector or matrix that is specified: a. e 3 R 4 b. D = diag{, 3, } c. e R 3 d. I. For each of the following matrices and vectors, give their dimension.
More informationSubstance Assortment: APPENDIX 1
Substance Assortment: APPENDIX 1 Appix Reynolds, C.A., Barlow, T., Pedersen, N.L. (in press June 22, 2005). Alcohol, tobacco and caffeine use: Spouse similarity processes. Behavior Genetics. #define nvar
More informationVariations. ECE 6540, Lecture 02 Multivariate Random Variables & Linear Algebra
Variations ECE 6540, Lecture 02 Multivariate Random Variables & Linear Algebra Last Time Probability Density Functions Normal Distribution Expectation / Expectation of a function Independence Uncorrelated
More informationMeasuring relationships among multiple responses
Measuring relationships among multiple responses Linear association (correlation, relatedness, shared information) between pair-wise responses is an important property used in almost all multivariate analyses.
More informationGo to Faculty/marleen/Boulder2012/Moderating_cov Copy all files to your own directory
Go to Faculty/marleen/Boulder01/Moderating_cov Copy all files to your own directory Go to Faculty/sanja/Boulder01/Moderating_covariances _IQ_SES Copy all files to your own directory Moderating covariances
More informationGregory Carey, 1998 Regression & Path Analysis - 1 MULTIPLE REGRESSION AND PATH ANALYSIS
Gregory Carey, 1998 Regression & Path Analysis - 1 MULTIPLE REGRESSION AND PATH ANALYSIS Introduction Path analysis and multiple regression go hand in hand (almost). Also, it is easier to learn about multivariate
More informationVariance Component Models for Quantitative Traits. Biostatistics 666
Variance Component Models for Quantitative Traits Biostatistics 666 Today Analysis of quantitative traits Modeling covariance for pairs of individuals estimating heritability Extending the model beyond
More informationLesson 7: Linear Transformations Applied to Cubes
Classwork Opening Exercise Consider the following matrices: AA = 1 2 0 2, BB = 2, and CC = 2 2 4 0 0 2 2 a. Compute the following determinants. i. det(aa) ii. det(bb) iii. det(cc) b. Sketch the image of
More information3. Properties of the relationship matrix
3. Properties of the relationship matrix 3.1 Partitioning of the relationship matrix The additive relationship matrix, A, can be written as the product of a lower triangular matrix, T, a diagonal matrix,
More informationContinuously moderated effects of A,C, and E in the twin design
Continuously moderated effects of A,C, and E in the twin design Conor V Dolan & Sanja Franić Boulder Twin Workshop March 8, 2016 Includes slides by Sophie van der Sluis & Marleen de Moor 1977 Acta Genet
More informationContinuously moderated effects of A,C, and E in the twin design
Continuously moderated effects of A,C, and E in the twin design Conor V Dolan & Michel Nivard Boulder Twin Workshop March, 208 Standard AE model s 2 A or.5s 2 A A E A E s 2 A s 2 E s 2 A s 2 E m pheno
More informationMultivariate Statistical Analysis
Multivariate Statistical Analysis Fall 2011 C. L. Williams, Ph.D. Lecture 4 for Applied Multivariate Analysis Outline 1 Eigen values and eigen vectors Characteristic equation Some properties of eigendecompositions
More informationDescribing Within-Person Fluctuation over Time using Alternative Covariance Structures
Describing Within-Person Fluctuation over Time using Alternative Covariance Structures Today s Class: The Big Picture ACS models using the R matrix only Introducing the G, Z, and V matrices ACS models
More information. a m1 a mn. a 1 a 2 a = a n
Biostat 140655, 2008: Matrix Algebra Review 1 Definition: An m n matrix, A m n, is a rectangular array of real numbers with m rows and n columns Element in the i th row and the j th column is denoted by
More informationI Have the Power in QTL linkage: single and multilocus analysis
I Have the Power in QTL linkage: single and multilocus analysis Benjamin Neale 1, Sir Shaun Purcell 2 & Pak Sham 13 1 SGDP, IoP, London, UK 2 Harvard School of Public Health, Cambridge, MA, USA 3 Department
More informationUnivariate Linkage in Mx. Boulder, TC 18, March 2005 Posthuma, Maes, Neale
Univariate Linkage in Mx Boulder, TC 18, March 2005 Posthuma, Maes, Neale VC analysis of Linkage Incorporating IBD Coefficients Covariance might differ according to sharing at a particular locus. Sharing
More informationMultivariate Gaussian Distribution. Auxiliary notes for Time Series Analysis SF2943. Spring 2013
Multivariate Gaussian Distribution Auxiliary notes for Time Series Analysis SF2943 Spring 203 Timo Koski Department of Mathematics KTH Royal Institute of Technology, Stockholm 2 Chapter Gaussian Vectors.
More informationVAR Model. (k-variate) VAR(p) model (in the Reduced Form): Y t-2. Y t-1 = A + B 1. Y t + B 2. Y t-p. + ε t. + + B p. where:
VAR Model (k-variate VAR(p model (in the Reduced Form: where: Y t = A + B 1 Y t-1 + B 2 Y t-2 + + B p Y t-p + ε t Y t = (y 1t, y 2t,, y kt : a (k x 1 vector of time series variables A: a (k x 1 vector
More informationModel building & assumptions. Matt Keller, Sarah Medland, Hermine Maes TC21 March 2008
Model building & assumptions Matt Keller, Sarah Medland, Hermine Maes TC2 March 2008 cknowledgments John Jinks David Fulker Robert Cloninger John DeFries Lindon aves Nick Martin Dorret Boomsma Michael
More informationIntroduction to Random Effects of Time and Model Estimation
Introduction to Random Effects of Time and Model Estimation Today s Class: The Big Picture Multilevel model notation Fixed vs. random effects of time Random intercept vs. random slope models How MLM =
More informationInverse of a Square Matrix. For an N N square matrix A, the inverse of A, 1
Inverse of a Square Matrix For an N N square matrix A, the inverse of A, 1 A, exists if and only if A is of full rank, i.e., if and only if no column of A is a linear combination 1 of the others. A is
More informationSupplementary File 3: Tutorial for ASReml-R. Tutorial 1 (ASReml-R) - Estimating the heritability of birth weight
Supplementary File 3: Tutorial for ASReml-R Tutorial 1 (ASReml-R) - Estimating the heritability of birth weight This tutorial will demonstrate how to run a univariate animal model using the software ASReml
More informationSome Multivariate techniques Principal components analysis (PCA) Factor analysis (FA) Structural equation models (SEM) Applications: Personality
Some Multivariate techniques Principal components analysis (PCA) Factor analysis (FA) Structural equation models (SEM) Applications: Personality Boulder March 2006 Dorret I. Boomsma Danielle Dick Marleen
More informationBare minimum on matrix algebra. Psychology 588: Covariance structure and factor models
Bare minimum on matrix algebra Psychology 588: Covariance structure and factor models Matrix multiplication 2 Consider three notations for linear combinations y11 y1 m x11 x 1p b11 b 1m y y x x b b n1
More informationGene± environment interaction is likely to be a common and
Variance Components Models for Gene Environment Interaction in Twin Analysis Shaun Purcell Social, Genetic and Developmental Psychiatry Research Centre, Institute of Psychiatry, King s College, London,
More informationStructural Equation Modeling and Confirmatory Factor Analysis. Types of Variables
/4/04 Structural Equation Modeling and Confirmatory Factor Analysis Advanced Statistics for Researchers Session 3 Dr. Chris Rakes Website: http://csrakes.yolasite.com Email: Rakes@umbc.edu Twitter: @RakesChris
More informationLecture 11. Multivariate Normal theory
10. Lecture 11. Multivariate Normal theory Lecture 11. Multivariate Normal theory 1 (1 1) 11. Multivariate Normal theory 11.1. Properties of means and covariances of vectors Properties of means and covariances
More informationCS4495/6495 Introduction to Computer Vision. 8B-L2 Principle Component Analysis (and its use in Computer Vision)
CS4495/6495 Introduction to Computer Vision 8B-L2 Principle Component Analysis (and its use in Computer Vision) Wavelength 2 Wavelength 2 Principal Components Principal components are all about the directions
More informationConfirmatory Factor Models (CFA: Confirmatory Factor Analysis)
Confirmatory Factor Models (CFA: Confirmatory Factor Analysis) Today s topics: Comparison of EFA and CFA CFA model parameters and identification CFA model estimation CFA model fit evaluation CLP 948: Lecture
More informationSex-limitation Models
Sex-limitation Models Meike Bartels (Brad, Sarah, Hermine, Ben, Elizabeth, and most of the rest of the faculty that has contributed bits and pieces to various versions of this talk) COPY FILES FROM: Faculty/meike/2016/heterogeneity
More informationConsistent Bivariate Distribution
A Characterization of the Normal Conditional Distributions MATSUNO 79 Therefore, the function ( ) = G( : a/(1 b2)) = N(0, a/(1 b2)) is a solu- tion for the integral equation (10). The constant times of
More informationThe Multivariate Normal Distribution. In this case according to our theorem
The Multivariate Normal Distribution Defn: Z R 1 N(0, 1) iff f Z (z) = 1 2π e z2 /2. Defn: Z R p MV N p (0, I) if and only if Z = (Z 1,..., Z p ) T with the Z i independent and each Z i N(0, 1). In this
More informationIntroduction to Confirmatory Factor Analysis
Introduction to Confirmatory Factor Analysis Multivariate Methods in Education ERSH 8350 Lecture #12 November 16, 2011 ERSH 8350: Lecture 12 Today s Class An Introduction to: Confirmatory Factor Analysis
More informationA Note on the Parameterization of Purcell s G 3 E Model for Ordinal and Binary Data
Behav Genet (2009) 39:220 229 DOI 10.1007/s10519-008-9247-7 BRIEF COMMUNICATION A Note on the Parameterization of Purcell s G 3 E Model for Ordinal and Binary Data Sarah E. Medland Æ Michael C. Neale Æ
More informationSAS Syntax and Output for Data Manipulation:
CLP 944 Example 5 page 1 Practice with Fixed and Random Effects of Time in Modeling Within-Person Change The models for this example come from Hoffman (2015) chapter 5. We will be examining the extent
More informationSupplemental Tables. Investigating the Theoretical Structure of the Differential Ability Scales Second Edition Through Hierarchical Exploratory
Supplemental Tables Investigating the Theoretical Structure of the Differential Ability Scales Second Edition Through Hierarchical Exploratory Factor Analysis By S. C. Dombrowksi et al., Journal of Psychoeducational
More informationIntroduction to Machine Learning. PCA and Spectral Clustering. Introduction to Machine Learning, Slides: Eran Halperin
1 Introduction to Machine Learning PCA and Spectral Clustering Introduction to Machine Learning, 2013-14 Slides: Eran Halperin Singular Value Decomposition (SVD) The singular value decomposition (SVD)
More informationDependence. Practitioner Course: Portfolio Optimization. John Dodson. September 10, Dependence. John Dodson. Outline.
Practitioner Course: Portfolio Optimization September 10, 2008 Before we define dependence, it is useful to define Random variables X and Y are independent iff For all x, y. In particular, F (X,Y ) (x,
More informationIn the bivariate regression model, the original parameterization is. Y i = β 1 + β 2 X2 + β 2 X2. + β 2 (X 2i X 2 ) + ε i (2)
RNy, econ460 autumn 04 Lecture note Orthogonalization and re-parameterization 5..3 and 7.. in HN Orthogonalization of variables, for example X i and X means that variables that are correlated are made
More informationConsequences of measurement error. Psychology 588: Covariance structure and factor models
Consequences of measurement error Psychology 588: Covariance structure and factor models Scaling indeterminacy of latent variables Scale of a latent variable is arbitrary and determined by a convention
More informationHypothesis Testing for Var-Cov Components
Hypothesis Testing for Var-Cov Components When the specification of coefficients as fixed, random or non-randomly varying is considered, a null hypothesis of the form is considered, where Additional output
More informationRepeated Measures ANOVA Multivariate ANOVA and Their Relationship to Linear Mixed Models
Repeated Measures ANOVA Multivariate ANOVA and Their Relationship to Linear Mixed Models EPSY 905: Multivariate Analysis Spring 2016 Lecture #12 April 20, 2016 EPSY 905: RM ANOVA, MANOVA, and Mixed Models
More informationMeasurement Invariance (MI) in CFA and Differential Item Functioning (DIF) in IRT/IFA
Topics: Measurement Invariance (MI) in CFA and Differential Item Functioning (DIF) in IRT/IFA What are MI and DIF? Testing measurement invariance in CFA Testing differential item functioning in IRT/IFA
More informationSEM with observed variables: parameterization and identification. Psychology 588: Covariance structure and factor models
SEM with observed variables: parameterization and identification Psychology 588: Covariance structure and factor models Limitations of SEM as a causal modeling 2 If an SEM model reflects the reality, the
More informationPackage SEMModComp. R topics documented: February 19, Type Package Title Model Comparisons for SEM Version 1.0 Date Author Roy Levy
Type Package Title Model Comparisons for SEM Version 1.0 Date 2009-02-23 Author Roy Levy Package SEMModComp Maintainer Roy Levy February 19, 2015 Conduct tests of difference in fit for
More informationPCA and admixture models
PCA and admixture models CM226: Machine Learning for Bioinformatics. Fall 2016 Sriram Sankararaman Acknowledgments: Fei Sha, Ameet Talwalkar, Alkes Price PCA and admixture models 1 / 57 Announcements HW1
More informationPrinciple Components Analysis (PCA) Relationship Between a Linear Combination of Variables and Axes Rotation for PCA
Principle Components Analysis (PCA) Relationship Between a Linear Combination of Variables and Axes Rotation for PCA Principle Components Analysis: Uses one group of variables (we will call this X) In
More informationNumerical Linear Algebra
Numerical Linear Algebra Carlos Hurtado Department of Economics University of Illinois at Urbana-Champaign hrtdmrt2@illinois.edu Sep 19th, 2017 C. Hurtado (UIUC - Economics) Numerical Methods On the Agenda
More informationStatistical Techniques II
Statistical Techniques II EST705 Regression with atrix Algebra 06a_atrix SLR atrix Algebra We will not be doing our regressions with matrix algebra, except that the computer does employ matrices. In fact,
More informationReference: Davidson and MacKinnon Ch 2. In particular page
RNy, econ460 autumn 03 Lecture note Reference: Davidson and MacKinnon Ch. In particular page 57-8. Projection matrices The matrix M I X(X X) X () is often called the residual maker. That nickname is easy
More informationIntroduction to Structural Equation Modeling
Introduction to Structural Equation Modeling Notes Prepared by: Lisa Lix, PhD Manitoba Centre for Health Policy Topics Section I: Introduction Section II: Review of Statistical Concepts and Regression
More informationMultiple Group CFA Invariance Example (data from Brown Chapter 7) using MLR Mplus 7.4: Major Depression Criteria across Men and Women (n = 345 each)
Multiple Group CFA Invariance Example (data from Brown Chapter 7) using MLR Mplus 7.4: Major Depression Criteria across Men and Women (n = 345 each) 9 items rated by clinicians on a scale of 0 to 8 (0
More information3/10/03 Gregory Carey Cholesky Problems - 1. Cholesky Problems
3/10/03 Gregory Carey Cholesky Problems - 1 Cholesky Problems Gregory Carey Department of Psychology and Institute for Behavioral Genetics University of Colorado Boulder CO 80309-0345 Email: gregory.carey@colorado.edu
More informationSAS Syntax and Output for Data Manipulation: CLDP 944 Example 3a page 1
CLDP 944 Example 3a page 1 From Between-Person to Within-Person Models for Longitudinal Data The models for this example come from Hoffman (2015) chapter 3 example 3a. We will be examining the extent to
More informationFactor Analysis. Robert L. Wolpert Department of Statistical Science Duke University, Durham, NC, USA
Factor Analysis Robert L. Wolpert Department of Statistical Science Duke University, Durham, NC, USA 1 Factor Models The multivariate regression model Y = XB +U expresses each row Y i R p as a linear combination
More informationPartitioning Genetic Variance
PSYC 510: Partitioning Genetic Variance (09/17/03) 1 Partitioning Genetic Variance Here, mathematical models are developed for the computation of different types of genetic variance. Several substantive
More informationThe 3 Indeterminacies of Common Factor Analysis
The 3 Indeterminacies of Common Factor Analysis James H. Steiger Department of Psychology and Human Development Vanderbilt University James H. Steiger (Vanderbilt University) The 3 Indeterminacies of Common
More informationPreface. List of examples
Contents Preface List of examples i xix 1 LISREL models and methods 1 1.1 The general LISREL model 1 Assumptions 2 The covariance matrix of the observations as implied by the LISREL model 3 Fixed, free,
More informationProportional Variance Explained by QLT and Statistical Power. Proportional Variance Explained by QTL and Statistical Power
Proportional Variance Explained by QTL and Statistical Power Partitioning the Genetic Variance We previously focused on obtaining variance components of a quantitative trait to determine the proportion
More informationME5286 Robotics Spring 2017 Quiz 2
Page 1 of 5 ME5286 Robotics Spring 2017 Quiz 2 Total Points: 30 You are responsible for following these instructions. Please take a minute and read them completely. 1. Put your name on this page, any other
More informationFactor Analysis (10/2/13)
STA561: Probabilistic machine learning Factor Analysis (10/2/13) Lecturer: Barbara Engelhardt Scribes: Li Zhu, Fan Li, Ni Guan Factor Analysis Factor analysis is related to the mixture models we have studied.
More informationKey Algebraic Results in Linear Regression
Key Algebraic Results in Linear Regression James H. Steiger Department of Psychology and Human Development Vanderbilt University James H. Steiger (Vanderbilt University) 1 / 30 Key Algebraic Results in
More informationRESMA course Introduction to LISREL. Harry Ganzeboom RESMA Data Analysis & Report #4 February
RESMA course Introduction to LISREL Harry Ganzeboom RESMA Data Analysis & Report #4 February 17 2009 LISREL SEM: Simultaneous [Structural] Equations Model: A system of linear equations ( causal model )
More informationProf. Dr.-Ing. Armin Dekorsy Department of Communications Engineering. Stochastic Processes and Linear Algebra Recap Slides
Prof. Dr.-Ing. Armin Dekorsy Department of Communications Engineering Stochastic Processes and Linear Algebra Recap Slides Stochastic processes and variables XX tt 0 = XX xx nn (tt) xx 2 (tt) XX tt XX
More informationThe Cholesky Approach: A Cautionary Note
Behavior Genetics, Vol. 26, No. 1, 1996 The Cholesky Approach: A Cautionary Note John C. Loehlin I Received 18 Jan. 1995--Final 27 July 1995 Attention is called to a common misinterpretation of a bivariate
More information7. Symmetric Matrices and Quadratic Forms
Linear Algebra 7. Symmetric Matrices and Quadratic Forms CSIE NCU 1 7. Symmetric Matrices and Quadratic Forms 7.1 Diagonalization of symmetric matrices 2 7.2 Quadratic forms.. 9 7.4 The singular value
More information2.1 Linear regression with matrices
21 Linear regression with matrices The values of the independent variables are united into the matrix X (design matrix), the values of the outcome and the coefficient are represented by the vectors Y and
More informationFactor Analysis. Qian-Li Xue
Factor Analysis Qian-Li Xue Biostatistics Program Harvard Catalyst The Harvard Clinical & Translational Science Center Short course, October 7, 06 Well-used latent variable models Latent variable scale
More informationPrincipal Component Analysis (PCA) Principal Component Analysis (PCA)
Recall: Eigenvectors of the Covariance Matrix Covariance matrices are symmetric. Eigenvectors are orthogonal Eigenvectors are ordered by the magnitude of eigenvalues: λ 1 λ 2 λ p {v 1, v 2,..., v n } Recall:
More informationThe Matrix Algebra of Sample Statistics
The Matrix Algebra of Sample Statistics James H. Steiger Department of Psychology and Human Development Vanderbilt University James H. Steiger (Vanderbilt University) The Matrix Algebra of Sample Statistics
More informationMath 3191 Applied Linear Algebra
Math 9 Applied Linear Algebra Lecture : Orthogonal Projections, Gram-Schmidt Stephen Billups University of Colorado at Denver Math 9Applied Linear Algebra p./ Orthonormal Sets A set of vectors {u, u,...,
More informationDependence. MFM Practitioner Module: Risk & Asset Allocation. John Dodson. September 11, Dependence. John Dodson. Outline.
MFM Practitioner Module: Risk & Asset Allocation September 11, 2013 Before we define dependence, it is useful to define Random variables X and Y are independent iff For all x, y. In particular, F (X,Y
More informationLecture 7a: Vector Autoregression (VAR)
Lecture 7a: Vector Autoregression (VAR) 1 Big Picture We are done with univariate time series analysis Now we switch to multivariate analysis, that is, studying several time series simultaneously. VAR
More informationF.4 Solving Polynomial Equations and Applications of Factoring
section F4 243 F.4 Zero-Product Property Many application problems involve solving polynomial equations. In Chapter L, we studied methods for solving linear, or first-degree, equations. Solving higher
More informationPassing-Bablok Regression for Method Comparison
Chapter 313 Passing-Bablok Regression for Method Comparison Introduction Passing-Bablok regression for method comparison is a robust, nonparametric method for fitting a straight line to two-dimensional
More informationLinear Models for the Prediction of Animal Breeding Values
Linear Models for the Prediction of Animal Breeding Values R.A. Mrode, PhD Animal Data Centre Fox Talbot House Greenways Business Park Bellinger Close Chippenham Wilts, UK CAB INTERNATIONAL Preface ix
More informationLecture 9 SLR in Matrix Form
Lecture 9 SLR in Matrix Form STAT 51 Spring 011 Background Reading KNNL: Chapter 5 9-1 Topic Overview Matrix Equations for SLR Don t focus so much on the matrix arithmetic as on the form of the equations.
More informationRatio of Polynomials Fit Many Variables
Chapter 376 Ratio of Polynomials Fit Many Variables Introduction This program fits a model that is the ratio of two polynomials of up to fifth order. Instead of a single independent variable, these polynomials
More informationHow to run the RI CLPM with Mplus By Ellen Hamaker March 21, 2018
How to run the RI CLPM with Mplus By Ellen Hamaker March 21, 2018 The random intercept cross lagged panel model (RI CLPM) as proposed by Hamaker, Kuiper and Grasman (2015, Psychological Methods) is a model
More informationPrincipal Components Analysis (PCA) and Singular Value Decomposition (SVD) with applications to Microarrays
Principal Components Analysis (PCA) and Singular Value Decomposition (SVD) with applications to Microarrays Prof. Tesler Math 283 Fall 2015 Prof. Tesler Principal Components Analysis Math 283 / Fall 2015
More informationTree Building Activity
Tree Building Activity Introduction In this activity, you will construct phylogenetic trees using a phenotypic similarity (cartoon microbe pictures) and genotypic similarity (real microbe sequences). For
More informationDeterminants. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 25
Determinants opyright c 2012 Dan Nettleton (Iowa State University) Statistics 611 1 / 25 Notation The determinant of a square matrix n n A is denoted det(a) or A. opyright c 2012 Dan Nettleton (Iowa State
More informationAddition and subtraction: element by element, and dimensions must match.
Matrix Essentials review: ) Matrix: Rectangular array of numbers. ) ranspose: Rows become columns and vice-versa ) single row or column is called a row or column) Vector ) R ddition and subtraction: element
More informationFactor Analysis Edpsy/Soc 584 & Psych 594
Factor Analysis Edpsy/Soc 584 & Psych 594 Carolyn J. Anderson University of Illinois, Urbana-Champaign April 29, 2009 1 / 52 Rotation Assessing Fit to Data (one common factor model) common factors Assessment
More informationEstimating Variances and Covariances in a Non-stationary Multivariate Time Series Using the K-matrix
Estimating Variances and Covariances in a Non-stationary Multivariate ime Series Using the K-matrix Stephen P Smith, January 019 Abstract. A second order time series model is described, and generalized
More information1. A Brief History of Longitudinal Factor Analysis
Factor Analysis in Longitudinal and Repeated Measures Studies Jack McArdle, Psychology Dept., University of Virginia, Charlottesville, VA The Factor Analysis at 00 Meeting University of North Carolina,
More informationPrincipal Component Analysis-I Geog 210C Introduction to Spatial Data Analysis. Chris Funk. Lecture 17
Principal Component Analysis-I Geog 210C Introduction to Spatial Data Analysis Chris Funk Lecture 17 Outline Filters and Rotations Generating co-varying random fields Translating co-varying fields into
More informationLinear Algebra Background
CS76A Text Retrieval and Mining Lecture 5 Recap: Clustering Hierarchical clustering Agglomerative clustering techniques Evaluation Term vs. document space clustering Multi-lingual docs Feature selection
More informationMultiple Group Analysis. Structural Equation Models. Interactions in SEMs. Multiple Group Analysis
Multiple Group Analysis Structural Equation Models Multiple Group Analysis Klaus Kähler Holst kkho@biostat.ku.dk Esben Budtz-Jørgensen ebj@biostat.ku.dk Department of Biostatistics, University of Copenhagen
More informationECE Lecture #10 Overview
ECE 450 - Lecture #0 Overview Introduction to Random Vectors CDF, PDF Mean Vector, Covariance Matrix Jointly Gaussian RV s: vector form of pdf Introduction to Random (or Stochastic) Processes Definitions
More informationMathematics: Pre-Algebra Eight
Mathematics: Pre-Algebra Eight Students in 8 th Grade Pre-Algebra will study expressions and equations using one or two unknown values. Students will be introduced to the concept of a mathematical function
More informationCh. 12 Linear Bayesian Estimators
Ch. 1 Linear Bayesian Estimators 1 In chapter 11 we saw: the MMSE estimator takes a simple form when and are jointly Gaussian it is linear and used only the 1 st and nd order moments (means and covariances).
More informationMATH 2331 Linear Algebra. Section 2.1 Matrix Operations. Definition: A : m n, B : n p. Example: Compute AB, if possible.
MATH 2331 Linear Algebra Section 2.1 Matrix Operations Definition: A : m n, B : n p ( 1 2 p ) ( 1 2 p ) AB = A b b b = Ab Ab Ab Example: Compute AB, if possible. 1 Row-column rule: i-j-th entry of AB:
More informationSTA 431s17 Assignment Eight 1
STA 43s7 Assignment Eight The first three questions of this assignment are about how instrumental variables can help with measurement error and omitted variables at the same time; see Lecture slide set
More informationMatrix Algebra Review
APPENDIX A Matrix Algebra Review This appendix presents some of the basic definitions and properties of matrices. Many of the matrices in the appendix are named the same as the matrices that appear in
More informationReview of Multilevel Models for Longitudinal Data
Review of Multilevel Models for Longitudinal Data Topics: Concepts in longitudinal multilevel modeling Describing within-person fluctuation using ACS models Describing within-person change using random
More information