Principles of factor analysis. Roger Watson

Transcription

1 Principles of factor analysis Roger Watson

2 Factor analysis

3 Factor analysis

4 Factor analysis

5 Factor analysis is a multivariate statistical method for reducing large numbers of variables to fewer underlying dimensions

6

7

8 Establishing validity Construct validity (unobtainable) Face validity Content validity Factorial validity Criterion concurrent predictive Convergent (divergent) and discriminant validity

9 Establishing validity Construct validity (unobtainable) Face validity Content validity Factorial validity Criterion concurrent predictive Convergent (divergent) and discriminant validity

10

11 EdFED Scale Supervision Physical Help Spillage Leave food on plate Refuse to eat Turn head away Refuse to open mouth Spit out food Leave mouth open Refuse to swallow food

12 Types of factor analysis ( Exploratory (EFA) principal axis factoring maximum likelihood factoring principal components analysis (PCA)* Confirmatory (CFA) structural equation modelling * - not strictly EFA

13

14 Correlation or covariance Variable X Variable Y

15 Correlation

16 Correlation and covariance correlation covariance

17 Factor analysis describes the variance in three or more variables Sources of variance: Common Specific Error

18

19 A Unique Variance Common Variance B Unique Variance Unique Variance C

20 Conducting factor analysis Computer software: EFA CFA SPSS SAS STATA AMOS (SPSS) SAS STATA EQS LISREL

21 Procedure for EFA Ferguson & Cox (1993): Stage 1 Pre-analysis checks Stage 2 Factor extraction Stage 3 Factor rotation

22 Stage 1 pre-analysis checks

23 Data Multivariate Random Normally distributed

24 Tests of suitability Kaiser-Meyer-Olkin (KMO) test of common variance (>0.5) Bartlett s test of sphericity test against an identity matrix (p<0.05)

25 Sample size Need more respondents than variables 5 10 respondents per variable Minimum sample size respondents

26 What does Principal Components Analysis do? It uses a correlation matrix to search for covariance amongst items in the questionnaire.

27

28

29

30

31

32

33

34

35

36 Stage 2 factor extraction

37

38 Unrotated matrix

39 How many factors are present?

40

41 How many factors are present? Eigenvalues > 1 Scree slope Parallel analysis

42 Eigenvalues Eigenvalues are produced by a process called principal components analysis (PCA) and represent the variance accounted for by each underlying factor.

43

44 Scree slope The scree test was suggested by Raymond B. Cattell. In this method you plot the successive eigenvalues, and look for a spot in the plot where the plot abruptly levels out. Cattell named this test after the tapering "scree" or rockpile at the bottom of a landslide.

45

46

47

48 Parallel analysis Parallel analysis is a method for determining the number of components or factors to retain from PCA or factor analysis. Essentially, the program works by creating a random dataset with the same numbers of observations and variables as the original data. A correlation matrix is computed from the randomly generated dataset and then eigenvalues of the correlation matrix are computed. When the eigenvalues from the random data are larger then the eigenvalues from the pca or factor analysis you known that the components or factors are mostly random noise.

49

50

51

52

53

54

55

56 How many factors are present?

57 Stage 3 factor rotation

58 Which rotation? Oblimin? assumes factors are correlated Varimax? assumes factors are orthogonal

59

60

61

62 Interpreting a factor matrix Examine the loadings on the factors

63 Loadings

64 Interpreting a factor matrix Examine the loadings on the factors Select loadings > X to indicate putative factors But what does X =? X = 0.3 or 0.4 usually Whatever helps you to interpret the factor matrix But you must be consistent

65 Factor 1

66 Factor 1 4

67 BUT! AND

68 Cross-loadings What should we do with them? Cross-loading items detract from a simple structure : ie one where the loadings on putative factors are high (ie > X) and those on the remainder are low (ie < X) Cross-loadings should be removed BUT the remaining items MUST be re-rotated

69 Confirmatory factor analysis

70 EFA vs CFA Is EFA adequate and/or sufficient? CFA is very demanding: Item loading of unity on putative factors Zero loading of items on non-putative factors Rarely have the opportunity: costly on data

71 10/08/2017 The University of Sheffield 71/ Department of Marketing and Communications

72 EFA vs CFA EFA remains valuable and even essential in establishing latent structures CFA is an excellent tool if you have the luxury of multiple and large samples

73 10/08/

74 References Bryman A, Cramer D (2005) Quantitative data analysis with SPSS 17, 18 and 19: a guide for social scientists Routledge, London Watson R, Thompson DR (2006) Use of factor analysis in Journal of Advanced Nursing: literature review Journal of Advanced Nursing 55, Byrne BM (2001) Structural equation modelling with AMOS: basic concepts, applications, and programming, 2ndEdition Laurence Erlbaum, London Child D (1990) The essentials of factor analysis 2nd edition Cassell, London DeCoster J (1998) Overview of factor analysis retrieved 1 September 2011 Ferguson E, Cox T (1993) Exploratory factor analysis: a user s guide International Journal of Selection and Assessment 1, Hurley AE, Scandura TA, Schriesheim CA, Brannick MT, Seers A, Vandenberg RJ, Williams LJ (1997) Exploratory and confirmatory factor analysis: guidelines, issues, and alternatives Journal of Organizational Behavior 18, Kline P (1994) An easy guide to factor analysis Routledge, London Marsh HW, Muthén B, Asparouhov T, Lüdtke O, Robitzsch A, Morin AJS, Trautwein U (2009) Exploratory structural equation modelling, intergrating CFA and EFA: application to students evaluations of university teaching Structural Equation Modelling 16,

75