Psychology Seminar Psych 406 Dr. Jeffrey Leitzel


 Kelley Fowler
 7 months ago
 Views:
Transcription
1 Psychology Seminar Psych 406 Dr. Jeffrey Leitzel Structural Equation Modeling Topic 1: Correlation / Linear Regression Outline/Overview Correlations (r, pr, sr) Linear regression Multiple regression interpreting b coefficients ANOVA model test R 2 Diagnostics Distance(Discrepancy), Leverage, Influence, & Multicollinearity The correlation coefficient (Pearson r) Continuous IV & DV (Interval/Ratio level data) Dichotomous variables Strength of linear relationship between variables r 2 coefficient of determination r Z xz y N 1 1
2 Partial and semipartial correlations Partial Correlation r between two variables when one or more other variables is partialled out of both X and Y example: experimenter interested in investigating the relationship between income and success in college measured both variables, ran correlation it was statistically significant he began repeating these results to all of his students do well in college = large salaries what might the bright student in the back of one of his classes have raised as an issue? Partial correlation (cont.) IQ as a third variable effecting both college success and salary earned The partial correlation between college success and salary with IQ partialled out of both variables salary(y) IQ(x 2 ) salary(y) IQ(x 2 ) gpa(x 1 ) gpa(x 1 ) Partial correlation (cont.) correlation between the residuals is the partial correlation between income and success, partialling out IQ generally represented by r y1.23 p subscripts to the left of the dot represent variables being correlated those to the right of the dot are those being partialled out r y1.2 =correlation IQ(x 2 ) between salary and salary(y) GPA with IQ partialled D A out pr 2 B =c/(c + d) gpa(x 1 ) C 2
3 Semipartial correlation also called the part correlation, far more routinely used r y(1.2) represents the correlation between the criterion (y) and a partialled predictor variable the partial correlation has variable x 2 partialled out of both y and x 1 for the semipartial, x 2 is partialled only out of x 1 the correlation between y and the residuals from x 1 predicted by x 2 correlation between y and the part of x 1 that is independent of x 2 r y(1.2) =correlation between salary and IQ(x 2 ) GPA with IQ partialled out salary(y) sr 2 =c/(a + b + c + d) D A B gpa(x 1 ) C Semipartial correlation (cont.) can rearrange semipartial correlation formula: R 2 y.12 = r 2 y2 + r 2 y(1.2) R (Multiple correlation) based on information from variable 1 plus additional nonredundant information from variable 2 through variable p so: R 2 y.123 p = r 2 y1 + r 2 y(2.1) + r 2 y(3.12) + + r 2 y(p.123 p1) If the predictors were completely independent of one another, there would be no shared variance to partial out would simply sum the r 2 for each X variable with Y to get the Multiple R 2 Simple linear regression Finding the equation for the line of best fit Least squares property Minimizes errors of estimation The line will have the form: y = a + bx Where: y' = predicted value of y a = intercept of the line b = slope of the line x = score of x we are using to predict y Multiple regression an extension of this 3
4 Multiple regression models Simple linear regression models generally represent an oversimplification of reality Usually unreasonable to think in terms of a single cause for any variable of interest Our equation for simple linear regression: y = a + bx becomes: y = a+b 1 x 1 +b 2 x 2 + +b k x k Multiple regression (cont.) y =a+b 1 x 1 +b 2 x 2 + +b k x k Where y = dependent variable (what we are predicting) x 1, x 2,, x k = predictors (independent variables or regressors) b 1, b 2,, b k = regression coefficients associated with the k predictors a = y intercept The predictors (x s) may represent interaction terms, cross products, powers, logs or other functions that provide predictive power Interpreting b coefficients If x 1 is held constant, every unit change in x 2 results in a b 2 unit change in y The constant, a (y intercept) does not necessarily have a meaningful interpretation any time 0 is outside the reasonable range for predictors the intercept will be essentially meaningless 4
5 Overall ANOVA Testing overall model adequacy Null hypothesis H 0 : b 1 =b 2 = =b k =0 Alternative hypoth H 1 : any b <> 0 F statistic (ANOVA) = MS regression /MS error MS regression = SS regression / k MS error = SS error / n(k+1) Where n = number of observations k = number of parameters in model (excluding a) ANOVA (cont.) SS regression = (y  M y ) 2 SS error = (y  y ) 2 When the overall regression model provides no predictive power the two mean square quantities will be about equal We are testing an F statistic with (k, n(k+1)) degrees of freedom ANOVA in multiple regression 5
6 R 2 and Adjusted R 2 Multiple R 2, coefficient of determination Total proportion of variance accounted for by all predictors in the model High R 2, values do not necessarily mean that a model will be useful for predicting Y Overfitting (adding essentially irrelevant predictors) can result in a high R 2 in the absence of any predictive power If we fit a regression model with n1 predictors R will always be = 1.0 unless we have a rare data set where two cases are identical on all predictors but differ on Y value Adjusted R 2 takes into account our n and the number of predictors we have used in the model Misuses/problems Multicollinearity exists when two or more independent variables (predictors) contribute redundant information to the model can think of conceptually as a problem in assigning unique variance components to variable creates computational problems and coefficients that do not make sense resolve by removing redundant predictor(s) Predicting outside the range of data that was used to generate the regression model positive linear relationship relationship may changeresulting in substantial error of estimation Failure to explore alternative models need to be familiar with data examine relationships between variables be aware of potential interactions and include in model if necessary try different models Standardized betas with more than one independent variable: b coefficients cannot be directly compared due to different scales across measures standardized Beta coefficients allow us to compare the relative predictive power of variables in the equation we get standardized Betas by converting all of our predictors to zscores and running the regression 6
7 Regression diagnostics help us assess the validity of our conclusions and their accuracy careful screening of the data cannot be overemphasized Outliers outliers: data points that lie outside the general linear pattern (midline is the regression line) removal of outliers can dramatically affect the performance of a regression model should be removed if there is reason to believe that other variables not in the model explain why the cases are unusual these cases may need a separate model Outliers (cont.) outliers may also suggest that additional explanatory variables need to be brought into the model multivariate outliers can be difficult if not impossible to identify by visual inspection ex. 115 lbs. and 6 feet tall either observation alone is not unusual, but together they are. unusual combinations might include odd pairings of scores on separate measures of ability or different indices of production multivariate outliers represent results that when considered as a whole do not make sense Distance, leverage, & influence most common measure of distance (also called discrepancy) is the simple residual distance between any point and the regression surface identifies outliers on the dependent (y) variable leverage statistic, h, also called hatvalue, identifies cases which may influence the regression model more than others with reasonably large n ranges from essentially 0 (no influence on the model, actually the min is 1/n) to 1 7
8 Distance, leverage, & influence (cont.) leverage identifies outliers in the dv s <.2 fine, >.5 case should be examined cases that are high on distance or leverage can strongly influence the regression but do not necessarily do so points that are relatively high on both distance and leverage are very likely to have strong influence Influence on regression line Influence on regression line 8
9 Influence on regression line Cook s distance (D) most common measure of influence of a case it is a function of the squared change that would occur in y if the observation were removed from the data interested in finding cases with D values much larger than the rest cutoff influential cases, D greater than 4/(n  k  1) where n is the number of cases and k is the number of independents Cook's distance obtained by issuing postestimation command in Stata Regression diagnostics 9
10 Diagnostics put to use Multicollinearity intercorrelation of independent variables R 2 s near 1 violate assumption of no perfect collinearity high R 2 s increase the standard error of the beta coefficients and make assessment of the unique role of each independent difficult or impossible simple correlations tell something about multicollinearity preferred method of assessing multicollinearity is to regress each independent on all the other independent variables in the equation Multicollinearity (cont.) inspection of the correlation matrix reveals only bivariate multicollinearity, for bivariate correlations > 0.90 to assess multivariate multicollinearity, one uses tolerance or VIF may not be any extremely high bivariate correlations if any variable can be represented as a linear combination of other variables in the model, perfect multicollinearity exists 10
11 Tolerance/Variance Inflation Factor (VIF) Tolerance 1  R 2 for the regression of that independent variable on all other independents, ignoring the dependent as many tolerance coefficients as there are independents higher intercorrelation of the independents, the tolerance will approach zero part of the denominator for calculating the confidence limits on the b (partial regression) coefficient Variance inflation factor (VIF) reciprocal of tolerance when VIF is high there is high multicollinearity and instability of the b coefficients Variance inflation factor (VIF) Rj Tolerance VIF Impact on SEb
Correlation and Linear Regression
Correlation and Linear Regression Correlation: Relationships between Variables So far, nearly all of our discussion of inferential statistics has focused on testing for differences between group means
More informationMulticollinearity Richard Williams, University of Notre Dame, https://www3.nd.edu/~rwilliam/ Last revised January 13, 2015
Multicollinearity Richard Williams, University of Notre Dame, https://www3.nd.edu/~rwilliam/ Last revised January 13, 2015 Stata Example (See appendices for full example).. use http://www.nd.edu/~rwilliam/stats2/statafiles/multicoll.dta,
More informationRegression Models. Chapter 4. Introduction. Introduction. Introduction
Chapter 4 Regression Models Quantitative Analysis for Management, Tenth Edition, by Render, Stair, and Hanna 008 PrenticeHall, Inc. Introduction Regression analysis is a very valuable tool for a manager
More informationCS 5014: Research Methods in Computer Science
Computer Science Clifford A. Shaffer Department of Computer Science Virginia Tech Blacksburg, Virginia Fall 2010 Copyright c 2010 by Clifford A. Shaffer Computer Science Fall 2010 1 / 207 Correlation and
More informationCHAPTER 6: SPECIFICATION VARIABLES
Recall, we had the following six assumptions required for the GaussMarkov Theorem: 1. The regression model is linear, correctly specified, and has an additive error term. 2. The error term has a zero
More informationIntroduction to Regression
Regression Introduction to Regression If two variables covary, we should be able to predict the value of one variable from another. Correlation only tells us how much two variables covary. In regression,
More informationChapter 1 Statistical Inference
Chapter 1 Statistical Inference causal inference To infer causality, you need a randomized experiment (or a huge observational study and lots of outside information). inference to populations Generalizations
More informationMultiple Linear Regression CIVL 7012/8012
Multiple Linear Regression CIVL 7012/8012 2 Multiple Regression Analysis (MLR) Allows us to explicitly control for many factors those simultaneously affect the dependent variable This is important for
More informationRegression: Main Ideas Setting: Quantitative outcome with a quantitative explanatory variable. Example, cont.
TCELL 9/4/205 36309/749 Experimental Design for Behavioral and Social Sciences Simple Regression Example Male black wheatear birds carry stones to the nest as a form of sexual display. Soler et al. wanted
More informationApplied Multivariate Statistical Modeling Prof. J. Maiti Department of Industrial Engineering and Management Indian Institute of Technology, Kharagpur
Applied Multivariate Statistical Modeling Prof. J. Maiti Department of Industrial Engineering and Management Indian Institute of Technology, Kharagpur Lecture  29 Multivariate Linear Regression Model
More informationSchool of Mathematical Sciences. Question 1. Best Subsets Regression
School of Mathematical Sciences MTH5120 Statistical Modelling I Practical 9 and Assignment 8 Solutions Question 1 Best Subsets Regression Response is Crime I n W c e I P a n A E P U U l e Mallows g E P
More informationChapter 8: Correlation & Regression
Chapter 8: Correlation & Regression We can think of ANOVA and the twosample ttest as applicable to situations where there is a response variable which is quantitative, and another variable that indicates
More informationLinear Regression. Linear Regression. Linear Regression. Did You Mean Association Or Correlation?
Did You Mean Association Or Correlation? AP Statistics Chapter 8 Be careful not to use the word correlation when you really mean association. Often times people will incorrectly use the word correlation
More informationChapter 15  Multiple Regression
15.1 Predicting Quality of Life: Chapter 15  Multiple Regression a. All other variables held constant, a difference of +1 degree in Temperature is associated with a difference of.01 in perceived Quality
More informationMulticollinearity occurs when two or more predictors in the model are correlated and provide redundant information about the response.
Multicollinearity Read Section 7.5 in textbook. Multicollinearity occurs when two or more predictors in the model are correlated and provide redundant information about the response. Example of multicollinear
More informationMultiple Linear Regression II. Lecture 8. Overview. Readings
Multiple Linear Regression II Lecture 8 Image source:https://commons.wikimedia.org/wiki/file:autobunnskr%c3%a4izroa201.jpg Survey Research & Design in Psychology James Neill, 2016 Creative Commons Attribution
More informationMultiple Linear Regression I. Lecture 7. Correlation (Review) Overview
Multiple Linear Regression I Lecture 7 Image source:http://commons.wikimedia.org/wiki/file:vidrarias_de_laboratorio.jpg Survey Research & Design in Psychology James Neill, 017 Creative Commons Attribution
More informationMultiple Linear Regression
Andrew Lonardelli December 20, 2013 Multiple Linear Regression 1 Table Of Contents Introduction: p.3 Multiple Linear Regression Model: p.3 Least Squares Estimation of the Parameters: p.45 The matrix approach
More informationMultiple Regression. Peerapat Wongchaiwat, Ph.D.
Peerapat Wongchaiwat, Ph.D. wongchaiwat@hotmail.com The Multiple Regression Model Examine the linear relationship between 1 dependent (Y) & 2 or more independent variables (X i ) Multiple Regression Model
More informationOrdinary Least Squares Regression Explained: Vartanian
Ordinary Least Squares Regression Eplained: Vartanian When to Use Ordinary Least Squares Regression Analysis A. Variable types. When you have an interval/ratio scale dependent variable.. When your independent
More informationPBAF 528 Week 8. B. Regression Residuals These properties have implications for the residuals of the regression.
PBAF 528 Week 8 What are some problems with our model? Regression models are used to represent relationships between a dependent variable and one or more predictors. In order to make inference from the
More informationCorrelation and simple linear regression S5
Basic medical statistics for clinical and eperimental research Correlation and simple linear regression S5 Katarzyna Jóźwiak k.jozwiak@nki.nl November 15, 2017 1/41 Introduction Eample: Brain size and
More informationLinear Regression Models
Linear Regression Models Model Description and Model Parameters Modelling is a central theme in these notes. The idea is to develop and continuously improve a library of predictive models for hazards,
More informationCorrelation and Regression
Correlation and Regression October 25, 2017 STAT 151 Class 9 Slide 1 Outline of Topics 1 Associations 2 Scatter plot 3 Correlation 4 Regression 5 Testing and estimation 6 Goodnessoffit STAT 151 Class
More informationECON3150/4150 Spring 2015
ECON3150/4150 Spring 2015 Lecture 3&4  The linear regression model SivElisabeth Skjelbred University of Oslo January 29, 2015 1 / 67 Chapter 4 in S&W Section 17.1 in S&W (extended OLS assumptions) 2
More informationMultiple Regression Analysis. Part III. Multiple Regression Analysis
Part III Multiple Regression Analysis As of Sep 26, 2017 1 Multiple Regression Analysis Estimation Matrix form GoodnessofFit Rsquare Adjusted Rsquare Expected values of the OLS estimators Irrelevant
More informationChapter Learning Objectives. Regression Analysis. Correlation. Simple Linear Regression. Chapter 12. Simple Linear Regression
Chapter 12 121 North Seattle Community College BUS21 Business Statistics Chapter 12 Learning Objectives In this chapter, you learn:! How to use regression analysis to predict the value of a dependent
More informationCorrelation: Relationships between Variables
Correlation Correlation: Relationships between Variables So far, nearly all of our discussion of inferential statistics has focused on testing for differences between group means However, researchers are
More information3 Variables: Cyberloafing Conscientiousness Age
title 'Cyberloafing, Mike Sage'; run; PROC CORR data=sage; var Cyberloafing Conscientiousness Age; run; quit; The CORR Procedure 3 Variables: Cyberloafing Conscientiousness Age Simple Statistics Variable
More informationCorrelation & Simple Regression
Chapter 11 Correlation & Simple Regression The previous chapter dealt with inference for two categorical variables. In this chapter, we would like to examine the relationship between two quantitative variables.
More informationRon Heck, Fall Week 8: Introducing Generalized Linear Models: Logistic Regression 1 (Replaces prior revision dated October 20, 2011)
Ron Heck, Fall 2011 1 EDEP 768E: Seminar in Multilevel Modeling rev. January 3, 2012 (see footnote) Week 8: Introducing Generalized Linear Models: Logistic Regression 1 (Replaces prior revision dated October
More informationAnswer Key. 9.1 Scatter Plots and Linear Correlation. Chapter 9 Regression and Correlation. CK12 Advanced Probability and Statistics Concepts 1
9.1 Scatter Plots and Linear Correlation Answers 1. A high school psychologist wants to conduct a survey to answer the question: Is there a relationship between a student s athletic ability and his/her
More informationApplied Regression Modeling
Applied Regression Modeling A Business Approach Iain Pardoe University of Oregon Charles H. Lundquist College of Business Eugene, Oregon WILEY INTERSCIENCE A JOHN WILEY & SONS, INC., PUBLICATION CONTENTS
More informationSimple linear regression
Simple linear regression Business Statistics 41000 Fall 2015 1 Topics 1. conditional distributions, squared error, means and variances 2. linear prediction 3. signal + noise and R 2 goodness of fit 4.
More informationCorrelation and regression
1 Correlation and regression Yongjua Laosiritaworn Introductory on Field Epidemiology 6 July 2015, Thailand Data 2 Illustrative data (Doll, 1955) 3 Scatter plot 4 Doll, 1955 5 6 Correlation coefficient,
More informationCorrelation Analysis
Simple Regression Correlation Analysis Correlation analysis is used to measure strength of the association (linear relationship) between two variables Correlation is only concerned with strength of the
More information15.8 MULTIPLE REGRESSION WITH MANY EXPLANATORY VARIABLES
15.8 MULTIPLE REGRESSION WITH MANY EXPLANATORY VARIABLES The method of multiple regression that we have studied through the use of the two explanatory variable life expectancies example can be extended
More informationKeller: Stats for Mgmt & Econ, 7th Ed July 17, 2006
Chapter 17 Simple Linear Regression and Correlation 17.1 Regression Analysis Our problem objective is to analyze the relationship between interval variables; regression analysis is the first tool we will
More informationLecture Notes #7: Residual Analysis and Multiple Regression 71
Lecture Notes #7: Residual Analysis and Multiple Regression 71 Richard Gonzalez Psych 613 Version 2.5 (Dec 2016) LECTURE NOTES #7: Residual Analysis and Multiple Regression Reading Assignment KNNL chapter
More informationUsing the same data as before, here is part of the output we get in Stata when we do a logistic regression of Grade on Gpa, Tuce and Psi.
Logistic Regression, Part III: Hypothesis Testing, Comparisons to OLS Richard Williams, University of Notre Dame, https://www3.nd.edu/~rwilliam/ Last revised January 14, 2018 This handout steals heavily
More informationChapter 14 Student Lecture Notes 141
Chapter 14 Student Lecture Notes 141 Business Statistics: A DecisionMaking Approach 6 th Edition Chapter 14 Multiple Regression Analysis and Model Building Chap 141 Chapter Goals After completing this
More informationChapter 12 Summarizing Bivariate Data Linear Regression and Correlation
Chapter 1 Summarizing Bivariate Data Linear Regression and Correlation This chapter introduces an important method for making inferences about a linear correlation (or relationship) between two variables,
More informationChapter 12 : Linear Correlation and Linear Regression
Chapter 1 : Linear Correlation and Linear Regression Determining whether a linear relationship exists between two quantitative variables, and modeling the relationship with a line, if the linear relationship
More informationOrdinary Least Squares Regression Explained: Vartanian
Ordinary Least Squares Regression Explained: Vartanian When to Use Ordinary Least Squares Regression Analysis A. Variable types. When you have an interval/ratio scale dependent variable.. When your independent
More informationGreene, Econometric Analysis (7th ed, 2012)
EC771: Econometrics, Spring 2012 Greene, Econometric Analysis (7th ed, 2012) Chapters 2 3: Classical Linear Regression The classical linear regression model is the single most useful tool in econometrics.
More informationLinear Models 1. Isfahan University of Technology Fall Semester, 2014
Linear Models 1 Isfahan University of Technology Fall Semester, 2014 References: [1] G. A. F., Seber and A. J. Lee (2003). Linear Regression Analysis (2nd ed.). Hoboken, NJ: Wiley. [2] A. C. Rencher and
More informationOnesided and twosided ttest
Onesided and twosided ttest Given a mean cancer rate in Montreal, 1. What is the probability of finding a deviation of > 1 stdev from the mean? 2. What is the probability of finding 1 stdev more cases?
More informationIris Wang.
Chapter 10: Multicollinearity Iris Wang iris.wang@kau.se Econometric problems Multicollinearity What does it mean? A high degree of correlation amongst the explanatory variables What are its consequences?
More informationMultiple Regression Analysis
Multiple Regression Analysis Where as simple linear regression has 2 variables (1 dependent, 1 independent): y ˆ = a + bx Multiple linear regression has >2 variables (1 dependent, many independent): ˆ
More informationInference in Regression Analysis
ECNS 561 Inference Inference in Regression Analysis Up to this point 1.) OLS is unbiased 2.) OLS is BLUE (best linear unbiased estimator i.e., the variance is smallest among linear unbiased estimators)
More informationChapter 1. An Overview of Regression Analysis. Econometrics and Quantitative Analysis. What is Econometrics? (cont.) What is Econometrics?
Econometrics and Quantitative Analysis Using Econometrics: A Practical Guide A.H. Studenmund 6th Edition. Addison Wesley Longman Chapter 1 An Overview of Regression Analysis Instructor: Dr. Samir Safi
More informationttest for b Copyright 2000 Tom Malloy. All rights reserved. Regression
ttest for b Copyright 2000 Tom Malloy. All rights reserved. Regression Recall, back some time ago, we used a descriptive statistic which allowed us to draw the best fit line through a scatter plot. We
More information4.1 Introduction. 4.2 The Scatter Diagram. Chapter 4 Linear Correlation and Regression Analysis
4.1 Introduction Correlation is a technique that measures the strength (or the degree) of the relationship between two variables. For example, we could measure how strong the relationship is between people
More informationIn Class Review Exercises Vartanian: SW 540
In Class Review Exercises Vartanian: SW 540 1. Given the following output from an OLS model looking at income, what is the slope and intercept for those who are black and those who are not black? b SE
More informationMultiple Regression. Midterm results: AVG = 26.5 (88%) A = 27+ B = C =
Economics 130 Lecture 6 Midterm Review Next Steps for the Class Multiple Regression Review & Issues Model Specification Issues Launching the Projects!!!!! Midterm results: AVG = 26.5 (88%) A = 27+ B =
More informationUnit 27 OneWay Analysis of Variance
Unit 27 OneWay Analysis of Variance Objectives: To perform the hypothesis test in a oneway analysis of variance for comparing more than two population means Recall that a two sample t test is applied
More informationBusiness Statistics. Lecture 9: Simple Regression
Business Statistics Lecture 9: Simple Regression 1 On to Model Building! Up to now, class was about descriptive and inferential statistics Numerical and graphical summaries of data Confidence intervals
More informationQuantitative Techniques  Lecture 8: Estimation
Quantitative Techniques  Lecture 8: Estimation Key words: Estimation, hypothesis testing, bias, e ciency, least squares Hypothesis testing when the population variance is not known roperties of estimates
More informationRegression Model Specification in R/Splus and Model Diagnostics. Daniel B. Carr
Regression Model Specification in R/Splus and Model Diagnostics By Daniel B. Carr Note 1: See 10 for a summary of diagnostics 2: Books have been written on model diagnostics. These discuss diagnostics
More informationGroup Comparisons: Differences in Composition Versus Differences in Models and Effects
Group Comparisons: Differences in Composition Versus Differences in Models and Effects Richard Williams, University of Notre Dame, https://www3.nd.edu/~rwilliam/ Last revised February 15, 2015 Overview.
More informationSTOCKHOLM UNIVERSITY Department of Economics Course name: Empirical Methods Course code: EC40 Examiner: Per PetterssonLidbom Number of creds: 7,5 creds Date of exam: Thursday, January 15, 009 Examination
More informationStat/F&W Ecol/Hort 572 Review Points Ané, Spring 2010
1 Linear models Y = Xβ + ɛ with ɛ N (0, σ 2 e) or Y N (Xβ, σ 2 e) where the model matrix X contains the information on predictors and β includes all coefficients (intercept, slope(s) etc.). 1. Number of
More informationThe general linear regression with k explanatory variables is just an extension of the simple regression as follows
3. Multiple Regression Analysis The general linear regression with k explanatory variables is just an extension of the simple regression as follows (1) y i = β 0 + β 1 x i1 + + β k x ik + u i. Because
More informationSTAT 512 MidTerm I (2/21/2013) Spring 2013 INSTRUCTIONS
STAT 512 MidTerm I (2/21/2013) Spring 2013 Name: Key INSTRUCTIONS 1. This exam is open book/open notes. All papers (but no electronic devices except for calculators) are allowed. 2. There are 5 pages in
More informationFor Bonnie and Jesse (again)
SECOND EDITION A P P L I E D R E G R E S S I O N A N A L Y S I S a n d G E N E R A L I Z E D L I N E A R M O D E L S For Bonnie and Jesse (again) SECOND EDITION A P P L I E D R E G R E S S I O N A N A
More informationInformation Sources. Class webpage (also linked to my.ucdavis page for the class):
STATISTICS 108 Outline for today: Go over syllabus Provide requested information I will hand out blank paper and ask questions Brief introduction and handson activity Information Sources Class webpage
More informationUNIT 12 ~ More About Regression
***SECTION 15.1*** The Regression Model When a scatterplot shows a relationship between a variable x and a y, we can use the fitted to the data to predict y for a given value of x. Now we want to do tests
More information3.2: Least Squares Regressions
3.2: Least Squares Regressions Section 3.2 LeastSquares Regression After this section, you should be able to INTERPRET a regression line CALCULATE the equation of the leastsquares regression line CALCULATE
More informationBivariate Data Summary
Bivariate Data Summary Bivariate data data that examines the relationship between two variables What individuals to the data describe? What are the variables and how are they measured Are the variables
More informationSection 3: Simple Linear Regression
Section 3: Simple Linear Regression Carlos M. Carvalho The University of Texas at Austin McCombs School of Business http://faculty.mccombs.utexas.edu/carlos.carvalho/teaching/ 1 Regression: General Introduction
More informationChapter 9  Correlation and Regression
Chapter 9  Correlation and Regression 9. Scatter diagram of percentage of LBW infants (Y) and highrisk fertility rate (X ) in Vermont Health Planning Districts. 9.3 Correlation between percentage of
More informationRegression, part II. I. What does it all mean? A) Notice that so far all we ve done is math.
Regression, part II I. What does it all mean? A) Notice that so far all we ve done is math. 1) One can calculate the Least Squares Regression Line for anything, regardless of any assumptions. 2) But, if
More informationAnswer Key: Problem Set 6
: Problem Set 6 1. Consider a linear model to explain monthly beer consumption: beer = + inc + price + educ + female + u 0 1 3 4 E ( u inc, price, educ, female ) = 0 ( u inc price educ female) σ inc var,,,
More information, (1) e i = ˆσ 1 h ii. c 2016, Jeffrey S. Simonoff 1
Regression diagnostics As is true of all statistical methodologies, linear regression analysis can be a very effective way to model data, as along as the assumptions being made are true. For the regression
More informationLab #12: Exam 3 Review Key
Psychological Statistics Practice Lab#1 Dr. M. Plonsky Page 1 of 7 Lab #1: Exam 3 Review Key 1) a. Probability  Refers to the likelihood that an event will occur. Ranges from 0 to 1. b. Sampling Distribution
More informationChapter 7 Student Lecture Notes 71
Chapter 7 Student Lecture Notes 7 Chapter Goals QM353: Business Statistics Chapter 7 Multiple Regression Analysis and Model Building After completing this chapter, you should be able to: Explain model
More informationCorrelation & Regression Chapter 5
Correlation & Regression Chapter 5 Correlation: Do you have a relationship? Between two Quantitative Variables (measured on Same Person) (1) If you have a relationship (p
More informationNonrecursive Models Highlights Richard Williams, University of Notre Dame, https://www3.nd.edu/~rwilliam/ Last revised April 6, 2015
Nonrecursive Models Highlights Richard Williams, University of Notre Dame, https://www3.nd.edu/~rwilliam/ Last revised April 6, 2015 This lecture borrows heavily from Duncan s Introduction to Structural
More informationMultivariate Lineare Modelle
01 TALEB AHMAD CASE  Center for Applied Statistics and Economics HumboldtUniversität zu Berlin Motivation 11 Motivation Multivariate regression models can accommodate many explanatory which simultaneously
More informationLinear Regression Spring 2014
Linear Regression 18.05 Spring 2014 Agenda Fitting curves to bivariate data Measuring the goodness of fit The fit vs. complexity tradeoff Regression to the mean Multiple linear regression January 1, 2017
More informationTopic 1. Definitions
S Topic. Definitions. Scalar A scalar is a number. 2. Vector A vector is a column of numbers. 3. Linear combination A scalar times a vector plus a scalar times a vector, plus a scalar times a vector...
More informationThe following formulas related to this topic are provided on the formula sheet:
Student Notes Prep Session Topic: Exploring Content The AP Statistics topic outline contains a long list of items in the category titled Exploring Data. Section D topics will be reviewed in this session.
More informationComparing Several Means: ANOVA
Comparing Several Means: ANOVA Understand the basic principles of ANOVA Why it is done? What it tells us? Theory of one way independent ANOVA Following up an ANOVA: Planned contrasts/comparisons Choosing
More informationData Set 1A: Algal Photosynthesis vs. Salinity and Temperature
Data Set A: Algal Photosynthesis vs. Salinity and Temperature Statistical setting These data are from a controlled experiment in which two quantitative variables were manipulated, to determine their effects
More informationbivariate correlation bivariate regression multiple regression
bivariate correlation bivariate regression multiple regression Today Bivariate Correlation Pearson productmoment correlation (r) assesses nature and strength of the linear relationship between two continuous
More informationSchool of Mathematical Sciences. Question 1
School of Mathematical Sciences MTH5120 Statistical Modelling I Practical 8 and Assignment 7 Solutions Question 1 Figure 1: The residual plots do not contradict the model assumptions of normality, constant
More informationWooldridge, Introductory Econometrics, 4th ed. Chapter 15: Instrumental variables and two stage least squares
Wooldridge, Introductory Econometrics, 4th ed. Chapter 15: Instrumental variables and two stage least squares Many economic models involve endogeneity: that is, a theoretical relationship does not fit
More informationChapter 2: simple regression model
Chapter 2: simple regression model Goal: understand how to estimate and more importantly interpret the simple regression Reading: chapter 2 of the textbook Advice: this chapter is foundation of econometrics.
More informationLecture 11 Multiple Linear Regression
Lecture 11 Multiple Linear Regression STAT 512 Spring 2011 Background Reading KNNL: 6.16.5 111 Topic Overview Review: Multiple Linear Regression (MLR) Computer Science Case Study 112 Multiple Regression
More informationDescription Syntax for predict Menu for predict Options for predict Remarks and examples Methods and formulas References Also see
Title stata.com logistic postestimation Postestimation tools for logistic Description Syntax for predict Menu for predict Options for predict Remarks and examples Methods and formulas References Also see
More informationStatistical Inference with Regression Analysis
Introductory Applied Econometrics EEP/IAS 118 Spring 2015 Steven Buck Lecture #13 Statistical Inference with Regression Analysis Next we turn to calculating confidence intervals and hypothesis testing
More informationMultiple Regression Methods
Chapter 1: Multiple Regression Methods Hildebrand, Ott and Gray Basic Statistical Ideas for Managers Second Edition 1 Learning Objectives for Ch. 1 The Multiple Linear Regression Model How to interpret
More informationChapter 26 Multiple Regression, Logistic Regression, and Indicator Variables
Chapter 26 Multiple Regression, Logistic Regression, and Indicator Variables 26.1 S 4 /IEE Application Examples: Multiple Regression An S 4 /IEE project was created to improve the 30,000footlevel metric
More informationSTA 108 Applied Linear Models: Regression Analysis Spring Solution for Homework #6
STA 8 Applied Linear Models: Regression Analysis Spring 011 Solution for Homework #6 6. a) = 11 1 31 41 51 1 3 4 5 11 1 31 41 51 β = β1 β β 3 b) = 1 1 1 1 1 11 1 31 41 51 1 3 4 5 β = β 0 β1 β 6.15 a) Stemandleaf
More informationLinear Regression. Simple linear regression model determines the relationship between one dependent variable (y) and one independent variable (x).
Linear Regression Simple linear regression model determines the relationship between one dependent variable (y) and one independent variable (x). A dependent variable is a random variable whose variation
More informationMultiple regression: introduction
Chapter 9 Multiple regression: introduction Multiple regression involves predicting values of a dependent variable from the values on a collection of other (predictor) variables. In particular, linear
More informationApart from this page, you are not permitted to read the contents of this question paper until instructed to do so by an invigilator.
B. Sc. Examination by course unit 2014 MTH5120 Statistical Modelling I Duration: 2 hours Date and time: 16 May 2014, 1000h 1200h Apart from this page, you are not permitted to read the contents of this
More informationWorksheet 4  Multiple and nonlinear regression models
Worksheet 4  Multiple and nonlinear regression models Multiple and nonlinear regression references Quinn & Keough (2002)  Chpt 6 Question 1  Multiple Linear Regression Paruelo & Lauenroth (1996) analyzed
More informationImmigration attitudes (opposes immigration or supports it) it may seriously misestimate the magnitude of the effects of IVs
Logistic Regression, Part I: Problems with the Linear Probability Model (LPM) Richard Williams, University of Notre Dame, https://www3.nd.edu/~rwilliam/ Last revised February 22, 2015 This handout steals
More informationIntroduction to Linear Regression
Introduction to Linear Regression James H. Steiger Department of Psychology and Human Development Vanderbilt University James H. Steiger (Vanderbilt University) Introduction to Linear Regression 1 / 46
More information