STATISTICS. Multiple regression
|
|
- Luke Stafford
- 6 years ago
- Views:
Transcription
1 STATISTICS Multiple regression
2 Problem : Explain the price of a ski pass. 2
3 3
4 4
5 Model (Constant) nb pistes SPSS results Unstandardized Coefficients a. Dependent Variable: prix forfait jour Coefficients a Standardized Coefficients B Std. Error Beta t Sig. 88,459 4,596 9,248,000,873,076,760,470,000 Model Regression Residual Total ANOVA b Sum of Squares df Mean Square F Sig , ,82 3,558,000 a 58980, , ,9 97 a. Predictors: (Constant), nb pistes b. Dependent Variable: prix forfait jour PFJ=88, ,873 PIS + ε 5
6 Direct calculation for R? SPSS : Model Model Summary Adjusted Std. Error of R R Square R Square the Estimate,760 a,578,574 24,78660 a. Predictors: (Constant), nb pistes 6
7 Multiple regression : Maybe there are other variables to explain PFJ 7
8 Multiple regression explain PFJ by variables Objective :. AST Altitude station 2. REM Nb of Ski tows (remonte pente) 3. API Altitude Ski run 4. PIS Nb of ski run (pistes) 5. KMF Cross country run (Km) (ski de fond) 6. LIT Nb bed 7. HOT Nb hotel What is the best model available? Onchercheraàmettreenplaceunmodèledelaforme Y =β 0 +β X +β 2 X 2 + +β k X k +ǫ oùlesβ j sontdesparamètresfixes(maisinconnus)etǫuntermealéatoiredemoyenne0 et d écart-type σ. 8
9 9 On définit les vecteurs suivants Y = Y Y 2. Y n β= β 0. β k ǫ= ǫ ǫ 2. ǫ n et la matrice X= x x k.... x i x ik.... x n x nk Y =Xβ+ǫ.
10 Ilfautrechercherb 0,b,,b k telque soit minimum. n i= (y i b 0 b x i b k x ik ) 2 oùw estlesousespacevectorielengendréparlesvecteurs,x,x 2,,x k. 0
11 Model (Constant) altitude de la station nb de remontees altitude des pistes nb de pistes kilometrage ski de fond nb de lits nb d'hotels a. Dependent Variable: prix forfait jour SPSS results Coefficients a Unstandardized Coefficients Standardized Coefficients B Std. Error Beta t Sig. 52,646,404 4,66,000-2,0E-03,006 -,09 -,309,758 -,E-02,060 -,02 -,85,853,885E-02,006,269 3,247,002,430,092,375 4,702,000-7,40E-02,05 -,079 -,455,49,60E-03,000,434 5,058,000-3,7E-02,69 -,04 -,220,827 ANOVA b Model a. Regression Residual Total Sum of Squares df Mean Square F Sig. 3065, ,278 54,365,000 a 26739, , ,9 97 Predictors: (Constant), nb d'hotels, nb de remontees, kilometrage ski de fond, altitude de la station, altitude des pistes, nb de pistes, nb de lits b. Dependent Variable: prix forfait jour
12 With the least squares method : PFJ= AST -0.0REM API PIS KMF LIT HOT + residual We can still use R²=RegSS/TSS R² % of the information (of the price) is explained by this model 2
13 Precision of the model? As for the simple regression, ε follows a normal distribution N(0, σ) We can estimate σ with the given data
14 Estimation of σ (standard deviation of residual) Estimation of σ 2 : σˆ 2 = n n i= e 2 i k Estimation of σ : σ ˆ = σˆ 2 4
15 Forecast intervall for y i Model : Y i = β 0 + β x i + + β k x ki + ε i ŷ i = βˆ + βˆ x + L+ βˆ = 0 i prévision de y i k x ki Simplified formula : ŷ i ± 2 σˆ 95% of the ei are in [- 2σˆ; 2σˆ ] 5
16 Isn t there a problem? Model (Constant) altitude de la station nb de remontees altitude des pistes nb de pistes kilometrage ski de fond nb de lits nb d'hotels a. Dependent Variable: prix forfait jour Coefficients a Unstandardized Coefficients Standardized Coefficients B Std. Error Beta t Sig. 52,646,404 4,66,000-2,0E-03,006 -,09 -,309,758 -,E-02,060 -,02 -,85,853,885E-02,006,269 3,247,002,430,092,375 4,702,000-7,40E-02,05 -,079 -,455,49,60E-03,000,434 5,058,000-3,7E-02,69 -,04 -,220,827
17 We don t use R in multiple regression What can we say about each coefficient regarding the others? What can we say about the signs of the coefficients? Ex : nb de remontées Do all the variables seem useful?
18 Is the contribution of X j significant? Model : Y = β 0 + β X + + β j X j + + β k X k + ε Test : H 0 : β j = 0 H : β j 0 Statistic used : t j = βˆ s j j ˆ où s = écart-type( β ) = j j 2 2 R (X j;autres X) (x ji x j) i Reject of H 0 with risk α : Reject of H 0 if t j t -α/2 (n-k-) Fractil of a Student distribution σˆ 2
19 What is the signification level (SIG)? The smallest value for α with a reject of H 0 Student distribution Sig/2 α/2 Sig/2 - t j 0 t j t -α/2 (n-k-) We can reject «H 0 : β j = 0» with a risk α if Sig α
20 What are the significant variables in this model (α = 0.05)? Model (Constant) altitude de la station nb de remontees altitude des pistes nb de pistes kilometrage ski de fond nb de lits nb d'hotels a. Dependent Variable: prix forfait jour Coefficients a Unstandardized Coefficients Standardized Coefficients B Std. Error Beta t Sig. 52,646,404 4,66,000-2,0E-03,006 -,09 -,309,758 -,E-02,060 -,02 -,85,853,885E-02,006,269 3,247,002,430,092,375 4,702,000-7,40E-02,05 -,079 -,455,49,60E-03,000,434 5,058,000-3,7E-02,69 -,04 -,220,827 t 0.975[ 90] =. 987
21 Selection of variables Backward method Step : model with all variables Step 2 : I take out the variable X j with the smallest contribution : t j minimum or Sig(t j ) maximum I compute a new model until I find a model in which all the variables are significant (default value in SPSS : Sig(t j ) 0. )
22 Model (Constant) altitude de la station nb de remontees altitude des pistes nb de pistes kilometrage ski de fond nb de lits nb d'hotels (Constant) altitude de la station altitude des pistes nb de pistes kilometrage ski de fond nb de lits nb d'hotels (Constant) altitude de la station altitude des pistes nb de pistes kilometrage ski de fond nb de lits (Constant) altitude des pistes nb de pistes kilometrage ski de fond nb de lits (Constant) altitude des pistes nb de pistes nb de lits a. Dependent Variable: prix forfait jour Coefficients a Unstandardized Coefficients Standardized Coefficients B Std. Error Beta t Sig. 52,646,404 4,66,000-2,0E-03,006 -,09 -,309,758 -,E-02,060 -,02 -,85,853,885E-02,006,269 3,247,002,430,092,375 4,702,000-7,40E-02,05 -,079 -,455,49,60E-03,000,434 5,058,000-3,7E-02,69 -,04 -,220,827 52,43,285 4,646,000-2,08E-03,006 -,020 -,323,748,902E-02,006,272 3,336,00,49,069,365 6,058,000-7,32E-02,050 -,078 -,452,50,60E-03,000,434 5,083,000-3,59E-02,68 -,04 -,24,83 5,557 0,463 4,928,000 -,74E-03,006 -,06 -,28,780,97E-02,006,274 3,404,00,420,069,366 6,20,000-7,25E-02,050 -,077 -,448,5,569E-03,000,423 6,96,000 5,28 0,299 4,964,000,827E-02,005,26 3,958,000,42,068,367 6,73,000-7,3E-02,050 -,078 -,469,45,589E-03,000,429 6,574,000 42,096 8,32 5,065,000 2,6E-02,004,309 5,34,000,45,069,36 6,057,000,456E-03,000,393 6,460,000
23 Model Regression Residual Total Regression Residual Total Regression Residual Total Regression Residual Total Regression Residual Total ANOVA f Sum of Squares df Mean Square F Sig. 3065, ,278 54,365,000 a 26739, , , , ,624 64,00,000 b 26750, , , , ,463 77,77,000 c 26763, , , , ,854 98,098,000 d 26786, , , , ,080 28,497,000 e 27407, , ,9 97 a. Predictors: (Constant), nb d'hotels, nb de remontees, kilometrage ski de fond, altitude de la station, altitude des pistes, nb de pistes, nb de lits b. Predictors: (Constant), nb d'hotels, kilometrage ski de fond, altitude de la station, altitude des pistes, nb de pistes, nb de lits Compare the precision of the models : c. Predictors: (Constant), kilometrage ski de fond, altitude de la station, altitude des pistes, nb de pistes, nb de lits which one will you choose? d. Predictors: (Constant), kilometrage ski de fond, altitude des pistes, nb de pistes, nb de lits e. Predictors: (Constant), altitude des pistes, nb de pistes, nb de lits f. Dependent Variable: prix forfait jour
24 How can we get a better model? Study the outliers ( ) We can exclude them and run a new model e i > 2σˆ What else can we do?
25 We can also build new variables : Ex : VENTES PRIX
26 This model seems to look like : Y=aX²+bX+c We create the variables : X=X X2=X² And we study the model given by SPSS with Y ˆ = b + b X + 0 b 2 X 2
27 Model Model Summary Adjusted Std. Error of R R Square R Square the Estimate.97 a a. Predictors: (Constant), PRIX2, PRIX Model Regression Residual Total ANOVA b Sum of Squares df Mean Square F Sig a a. Predictors: (Constant), PRIX2, PRIX b. Dependent Variable: VENTES Model (Constant) PRIX PRIX2 Unstandardized Coefficients a. Dependent Variable: VENTES Coefficients a Standardized Coefficients B Std. Error Beta t Sig E
28 60 VENTES Observé 0 Quadratiique PRIX
29 Case Number Casewise Diagnostics a Predicted Std. Residual VENTES Value Residual a. Dependent Variable: VENTES
30 Ex 2 : graph salary/age
31 Blue : men Green : women
32 Blue : men Green : women
33 Ex 2 : graph salary/ Basic model : salary = b0+b*age+residual How can we make the difference between men and women?
34 What about this model? Salary ' ' ' = b0 + bage + b2woman + residual
35 Better model : '' '' '' '' Salary = b0 + b Age + b2woman + b3age* Woman + residual Model 2 (Constant) Woman womanage Age (Constant) womanage Age a. Dependent Variable: Salary Unstandardized Coefficients Coefficients a Standardized Coefficients B Std. Error Beta t Sig. 4443, ,72,388, , ,435,23,533, ,4 25,0 -,630-2,689,02 888,759 80,068,92,00, , ,664 2,32, ,34 34,2 -,50-7,978, , 6,70,893 3,972,000 Model 2 Model Summary Adjusted Std. Error of R R Square R Square the Estimate,944 a,89, ,07,943 b,889, ,953 a. Predictors: (Constant), Age, Woman, womanage b. Predictors: (Constant), Age, womanage
36 36
Simple Linear Regression
Simple Linear Regression 1 Correlation indicates the magnitude and direction of the linear relationship between two variables. Linear Regression: variable Y (criterion) is predicted by variable X (predictor)
More information: The model hypothesizes a relationship between the variables. The simplest probabilistic model: or.
Chapter Simple Linear Regression : comparing means across groups : presenting relationships among numeric variables. Probabilistic Model : The model hypothesizes an relationship between the variables.
More informationWORKSHOP 3 Measuring Association
WORKSHOP 3 Measuring Association Concepts Analysing Categorical Data o Testing of Proportions o Contingency Tables & Tests o Odds Ratios Linear Association Measures o Correlation o Simple Linear Regression
More informationArea1 Scaled Score (NAPLEX) .535 ** **.000 N. Sig. (2-tailed)
Institutional Assessment Report Texas Southern University College of Pharmacy and Health Sciences "An Analysis of 2013 NAPLEX, P4-Comp. Exams and P3 courses The following analysis illustrates relationships
More information( ), which of the coefficients would end
Discussion Sheet 29.7.9 Qualitative Variables We have devoted most of our attention in multiple regression to quantitative or numerical variables. MR models can become more useful and complex when we consider
More informationMultiple linear regression S6
Basic medical statistics for clinical and experimental research Multiple linear regression S6 Katarzyna Jóźwiak k.jozwiak@nki.nl November 15, 2017 1/42 Introduction Two main motivations for doing multiple
More informationECON 497 Midterm Spring
ECON 497 Midterm Spring 2009 1 ECON 497: Economic Research and Forecasting Name: Spring 2009 Bellas Midterm You have three hours and twenty minutes to complete this exam. Answer all questions and explain
More informationRegression: Main Ideas Setting: Quantitative outcome with a quantitative explanatory variable. Example, cont.
TCELL 9/4/205 36-309/749 Experimental Design for Behavioral and Social Sciences Simple Regression Example Male black wheatear birds carry stones to the nest as a form of sexual display. Soler et al. wanted
More information36-309/749 Experimental Design for Behavioral and Social Sciences. Sep. 22, 2015 Lecture 4: Linear Regression
36-309/749 Experimental Design for Behavioral and Social Sciences Sep. 22, 2015 Lecture 4: Linear Regression TCELL Simple Regression Example Male black wheatear birds carry stones to the nest as a form
More informationSTAT 3900/4950 MIDTERM TWO Name: Spring, 2015 (print: first last ) Covered topics: Two-way ANOVA, ANCOVA, SLR, MLR and correlation analysis
STAT 3900/4950 MIDTERM TWO Name: Spring, 205 (print: first last ) Covered topics: Two-way ANOVA, ANCOVA, SLR, MLR and correlation analysis Instructions: You may use your books, notes, and SPSS/SAS. NO
More informationMultiple Regression. More Hypothesis Testing. More Hypothesis Testing The big question: What we really want to know: What we actually know: We know:
Multiple Regression Ψ320 Ainsworth More Hypothesis Testing What we really want to know: Is the relationship in the population we have selected between X & Y strong enough that we can use the relationship
More informationHomework 2: Simple Linear Regression
STAT 4385 Applied Regression Analysis Homework : Simple Linear Regression (Simple Linear Regression) Thirty (n = 30) College graduates who have recently entered the job market. For each student, the CGPA
More informationSociology 593 Exam 2 Answer Key March 28, 2002
Sociology 59 Exam Answer Key March 8, 00 I. True-False. (0 points) Indicate whether the following statements are true or false. If false, briefly explain why.. A variable is called CATHOLIC. This probably
More informationReview of Multiple Regression
Ronald H. Heck 1 Let s begin with a little review of multiple regression this week. Linear models [e.g., correlation, t-tests, analysis of variance (ANOVA), multiple regression, path analysis, multivariate
More informationRegression ( Kemampuan Individu, Lingkungan kerja dan Motivasi)
Regression (, Lingkungan kerja dan ) Descriptive Statistics Mean Std. Deviation N 3.87.333 32 3.47.672 32 3.78.585 32 s Pearson Sig. (-tailed) N Kemampuan Lingkungan Individu Kerja.000.432.49.432.000.3.49.3.000..000.000.000..000.000.000.
More informationMultiple Regression. Peerapat Wongchaiwat, Ph.D.
Peerapat Wongchaiwat, Ph.D. wongchaiwat@hotmail.com The Multiple Regression Model Examine the linear relationship between 1 dependent (Y) & 2 or more independent variables (X i ) Multiple Regression Model
More informationEstimating σ 2. We can do simple prediction of Y and estimation of the mean of Y at any value of X.
Estimating σ 2 We can do simple prediction of Y and estimation of the mean of Y at any value of X. To perform inferences about our regression line, we must estimate σ 2, the variance of the error term.
More information10. Alternative case influence statistics
10. Alternative case influence statistics a. Alternative to D i : dffits i (and others) b. Alternative to studres i : externally-studentized residual c. Suggestion: use whatever is convenient with the
More informationOct Simple linear regression. Minimum mean square error prediction. Univariate. regression. Calculating intercept and slope
Oct 2017 1 / 28 Minimum MSE Y is the response variable, X the predictor variable, E(X) = E(Y) = 0. BLUP of Y minimizes average discrepancy var (Y ux) = C YY 2u C XY + u 2 C XX This is minimized when u
More informationMultiple linear regression
Multiple linear regression Course MF 930: Introduction to statistics June 0 Tron Anders Moger Department of biostatistics, IMB University of Oslo Aims for this lecture: Continue where we left off. Repeat
More informationThe inductive effect in nitridosilicates and oxysilicates and its effects on 5d energy levels of Ce 3+
The inductive effect in nitridosilicates and oxysilicates and its effects on 5d energy levels of Ce 3+ Yuwei Kong, Zhen Song, Shuxin Wang, Zhiguo Xia and Quanlin Liu* The Beijing Municipal Key Laboratory
More information(ii) Scan your answer sheets INTO ONE FILE only, and submit it in the drop-box.
FINAL EXAM ** Two different ways to submit your answer sheet (i) Use MS-Word and place it in a drop-box. (ii) Scan your answer sheets INTO ONE FILE only, and submit it in the drop-box. Deadline: December
More informationCorrelation and simple linear regression S5
Basic medical statistics for clinical and eperimental research Correlation and simple linear regression S5 Katarzyna Jóźwiak k.jozwiak@nki.nl November 15, 2017 1/41 Introduction Eample: Brain size and
More informationLI EAR REGRESSIO A D CORRELATIO
CHAPTER 6 LI EAR REGRESSIO A D CORRELATIO Page Contents 6.1 Introduction 10 6. Curve Fitting 10 6.3 Fitting a Simple Linear Regression Line 103 6.4 Linear Correlation Analysis 107 6.5 Spearman s Rank Correlation
More informationEDF 7405 Advanced Quantitative Methods in Educational Research MULTR.SAS
EDF 7405 Advanced Quantitative Methods in Educational Research MULTR.SAS The data used in this example describe teacher and student behavior in 8 classrooms. The variables are: Y percentage of interventions
More informationThe Multiple Regression Model
Multiple Regression The Multiple Regression Model Idea: Examine the linear relationship between 1 dependent (Y) & or more independent variables (X i ) Multiple Regression Model with k Independent Variables:
More informationx3,..., Multiple Regression β q α, β 1, β 2, β 3,..., β q in the model can all be estimated by least square estimators
Multiple Regression Relating a response (dependent, input) y to a set of explanatory (independent, output, predictor) variables x, x 2, x 3,, x q. A technique for modeling the relationship between variables.
More informationAMS 7 Correlation and Regression Lecture 8
AMS 7 Correlation and Regression Lecture 8 Department of Applied Mathematics and Statistics, University of California, Santa Cruz Suumer 2014 1 / 18 Correlation pairs of continuous observations. Correlation
More informationy response variable x 1, x 2,, x k -- a set of explanatory variables
11. Multiple Regression and Correlation y response variable x 1, x 2,, x k -- a set of explanatory variables In this chapter, all variables are assumed to be quantitative. Chapters 12-14 show how to incorporate
More informationChapter Goals. To understand the methods for displaying and describing relationship among variables. Formulate Theories.
Chapter Goals To understand the methods for displaying and describing relationship among variables. Formulate Theories Interpret Results/Make Decisions Collect Data Summarize Results Chapter 7: Is There
More informationAdvanced Quantitative Data Analysis
Chapter 24 Advanced Quantitative Data Analysis Daniel Muijs Doing Regression Analysis in SPSS When we want to do regression analysis in SPSS, we have to go through the following steps: 1 As usual, we choose
More informationNATCOR Regression Modelling for Time Series
Universität Hamburg Institut für Wirtschaftsinformatik Prof. Dr. D.B. Preßmar Professor Robert Fildes NATCOR Regression Modelling for Time Series The material presented has been developed with the substantial
More informationSPSS Output. ANOVA a b Residual Coefficients a Standardized Coefficients
SPSS Output Homework 1-1e ANOVA a Sum of Squares df Mean Square F Sig. 1 Regression 351.056 1 351.056 11.295.002 b Residual 932.412 30 31.080 Total 1283.469 31 a. Dependent Variable: Sexual Harassment
More information4 Multiple Linear Regression
4 Multiple Linear Regression 4. The Model Definition 4.. random variable Y fits a Multiple Linear Regression Model, iff there exist β, β,..., β k R so that for all (x, x 2,..., x k ) R k where ε N (, σ
More informationRef.: Spring SOS3003 Applied data analysis for social science Lecture note
SOS3003 Applied data analysis for social science Lecture note 05-2010 Erling Berge Department of sociology and political science NTNU Spring 2010 Erling Berge 2010 1 Literature Regression criticism I Hamilton
More informationData Analysis 1 LINEAR REGRESSION. Chapter 03
Data Analysis 1 LINEAR REGRESSION Chapter 03 Data Analysis 2 Outline The Linear Regression Model Least Squares Fit Measures of Fit Inference in Regression Other Considerations in Regression Model Qualitative
More informationChapter 3. Diagnostics and Remedial Measures
Chapter 3. Diagnostics and Remedial Measures So far, we took data (X i, Y i ) and we assumed Y i = β 0 + β 1 X i + ǫ i i = 1, 2,..., n, where ǫ i iid N(0, σ 2 ), β 0, β 1 and σ 2 are unknown parameters,
More informationInteractions and Centering in Regression: MRC09 Salaries for graduate faculty in psychology
Psychology 308c Dale Berger Interactions and Centering in Regression: MRC09 Salaries for graduate faculty in psychology This example illustrates modeling an interaction with centering and transformations.
More informationMultivariate Correlational Analysis: An Introduction
Assignment. Multivariate Correlational Analysis: An Introduction Mertler & Vanetta, Chapter 7 Kachigan, Chapter 4, pps 180-193 Terms you should know. Multiple Regression Linear Equations Least Squares
More informationChapter 4 Regression with Categorical Predictor Variables Page 1. Overview of regression with categorical predictors
Chapter 4 Regression with Categorical Predictor Variables Page. Overview of regression with categorical predictors 4-. Dummy coding 4-3 4-5 A. Karpinski Regression with Categorical Predictor Variables.
More informationInference for Regression Inference about the Regression Model and Using the Regression Line, with Details. Section 10.1, 2, 3
Inference for Regression Inference about the Regression Model and Using the Regression Line, with Details Section 10.1, 2, 3 Basic components of regression setup Target of inference: linear dependency
More informationTopic 1. Definitions
S Topic. Definitions. Scalar A scalar is a number. 2. Vector A vector is a column of numbers. 3. Linear combination A scalar times a vector plus a scalar times a vector, plus a scalar times a vector...
More informationChapter 9 - Correlation and Regression
Chapter 9 - Correlation and Regression 9. Scatter diagram of percentage of LBW infants (Y) and high-risk fertility rate (X ) in Vermont Health Planning Districts. 9.3 Correlation between percentage of
More informationOrdinary Least Squares Regression Explained: Vartanian
Ordinary Least Squares Regression Eplained: Vartanian When to Use Ordinary Least Squares Regression Analysis A. Variable types. When you have an interval/ratio scale dependent variable.. When your independent
More information3. Diagnostics and Remedial Measures
3. Diagnostics and Remedial Measures So far, we took data (X i, Y i ) and we assumed where ɛ i iid N(0, σ 2 ), Y i = β 0 + β 1 X i + ɛ i i = 1, 2,..., n, β 0, β 1 and σ 2 are unknown parameters, X i s
More informationSociology 593 Exam 1 February 14, 1997
Sociology 9 Exam February, 997 I. True-False. ( points) Indicate whether the following statements are true or false. If false, briefly explain why.. There are IVs in a multiple regression model. If the
More information4:3 LEC - PLANNED COMPARISONS AND REGRESSION ANALYSES
4:3 LEC - PLANNED COMPARISONS AND REGRESSION ANALYSES FOR SINGLE FACTOR BETWEEN-S DESIGNS Planned or A Priori Comparisons We previously showed various ways to test all possible pairwise comparisons for
More informationUnivariate analysis. Simple and Multiple Regression. Univariate analysis. Simple Regression How best to summarise the data?
Univariate analysis Example - linear regression equation: y = ax + c Least squares criteria ( yobs ycalc ) = yobs ( ax + c) = minimum Simple and + = xa xc xy xa + nc = y Solve for a and c Univariate analysis
More informationSTATISTICS 110/201 PRACTICE FINAL EXAM
STATISTICS 110/201 PRACTICE FINAL EXAM Questions 1 to 5: There is a downloadable Stata package that produces sequential sums of squares for regression. In other words, the SS is built up as each variable
More informationLinear Regression. Simple linear regression model determines the relationship between one dependent variable (y) and one independent variable (x).
Linear Regression Simple linear regression model determines the relationship between one dependent variable (y) and one independent variable (x). A dependent variable is a random variable whose variation
More informationRegression. Notes. Page 1. Output Created Comments 25-JAN :29:55
REGRESSION /MISSING LISTWISE /STATISTICS COEFF OUTS CI(95) BCOV R ANOVA /CRITERIA=PIN(.05) POUT(.10) /NOORIGIN /DEPENDENT favorability /METHOD=ENTER Zcontemp ZAnxious6 zallcontact. Regression Notes Output
More informationCh 3: Multiple Linear Regression
Ch 3: Multiple Linear Regression 1. Multiple Linear Regression Model Multiple regression model has more than one regressor. For example, we have one response variable and two regressor variables: 1. delivery
More informationSOS3003 Applied data analysis for social science Lecture note Erling Berge Department of sociology and political science NTNU.
SOS3003 Applied data analysis for social science Lecture note 08-00 Erling Berge Department of sociology and political science NTNU Erling Berge 00 Literature Logistic regression II Hamilton Ch 7 p7-4
More informationSociology 593 Exam 2 March 28, 2002
Sociology 59 Exam March 8, 00 I. True-False. (0 points) Indicate whether the following statements are true or false. If false, briefly explain why.. A variable is called CATHOLIC. This probably means that
More informationCorrelation & Simple Regression
Chapter 11 Correlation & Simple Regression The previous chapter dealt with inference for two categorical variables. In this chapter, we would like to examine the relationship between two quantitative variables.
More informationMultiple Regression and Model Building Lecture 20 1 May 2006 R. Ryznar
Multiple Regression and Model Building 11.220 Lecture 20 1 May 2006 R. Ryznar Building Models: Making Sure the Assumptions Hold 1. There is a linear relationship between the explanatory (independent) variable(s)
More informationLecture 3: Inference in SLR
Lecture 3: Inference in SLR STAT 51 Spring 011 Background Reading KNNL:.1.6 3-1 Topic Overview This topic will cover: Review of hypothesis testing Inference about 1 Inference about 0 Confidence Intervals
More informationMultiple Regression Analysis
Multiple Regression Analysis Where as simple linear regression has 2 variables (1 dependent, 1 independent): y ˆ = a + bx Multiple linear regression has >2 variables (1 dependent, many independent): ˆ
More informationMcGill University. Faculty of Science MATH 204 PRINCIPLES OF STATISTICS II. Final Examination
McGill University Faculty of Science MATH 204 PRINCIPLES OF STATISTICS II Final Examination Date: 20th April 2009 Time: 9am-2pm Examiner: Dr David A Stephens Associate Examiner: Dr Russell Steele Please
More information22s:152 Applied Linear Regression
22s:152 Applied Linear Regression Chapter 7: Dummy Variable Regression So far, we ve only considered quantitative variables in our models. We can integrate categorical predictors by constructing artificial
More informationInferences for Regression
Inferences for Regression An Example: Body Fat and Waist Size Looking at the relationship between % body fat and waist size (in inches). Here is a scatterplot of our data set: Remembering Regression In
More informationLinear Modelling: Simple Regression
Linear Modelling: Simple Regression 10 th of Ma 2018 R. Nicholls / D.-L. Couturier / M. Fernandes Introduction: ANOVA Used for testing hpotheses regarding differences between groups Considers the variation
More informationWELCOME! Lecture 13 Thommy Perlinger
Quantitative Methods II WELCOME! Lecture 13 Thommy Perlinger Parametrical tests (tests for the mean) Nature and number of variables One-way vs. two-way ANOVA One-way ANOVA Y X 1 1 One dependent variable
More informationChapter 14 Student Lecture Notes Department of Quantitative Methods & Information Systems. Business Statistics. Chapter 14 Multiple Regression
Chapter 14 Student Lecture Notes 14-1 Department of Quantitative Methods & Information Systems Business Statistics Chapter 14 Multiple Regression QMIS 0 Dr. Mohammad Zainal Chapter Goals After completing
More informationPractical Biostatistics
Practical Biostatistics Clinical Epidemiology, Biostatistics and Bioinformatics AMC Multivariable regression Day 5 Recap Describing association: Correlation Parametric technique: Pearson (PMCC) Non-parametric:
More informationbivariate correlation bivariate regression multiple regression
bivariate correlation bivariate regression multiple regression Today Bivariate Correlation Pearson product-moment correlation (r) assesses nature and strength of the linear relationship between two continuous
More informationSociology 593 Exam 1 February 17, 1995
Sociology 593 Exam 1 February 17, 1995 I. True-False. (25 points) Indicate whether the following statements are true or false. If false, briefly explain why. 1. A researcher regressed Y on. When he plotted
More informationMultiple Comparisons
Multiple Comparisons Error Rates, A Priori Tests, and Post-Hoc Tests Multiple Comparisons: A Rationale Multiple comparison tests function to tease apart differences between the groups within our IV when
More informationMultiple OLS Regression
Multiple OLS Regression Ronet Bachman, Ph.D. Presented by Justice Research and Statistics Association 12/8/2016 Justice Research and Statistics Association 720 7 th Street, NW, Third Floor Washington,
More informationSection 4.6 Simple Linear Regression
Section 4.6 Simple Linear Regression Objectives ˆ Basic philosophy of SLR and the regression assumptions ˆ Point & interval estimation of the model parameters, and how to make predictions ˆ Point and interval
More informationST430 Exam 1 with Answers
ST430 Exam 1 with Answers Date: October 5, 2015 Name: Guideline: You may use one-page (front and back of a standard A4 paper) of notes. No laptop or textook are permitted but you may use a calculator.
More informationPrepared by: Prof. Dr Bahaman Abu Samah Department of Professional Development and Continuing Education Faculty of Educational Studies Universiti
Prepared by: Prof Dr Bahaman Abu Samah Department of Professional Development and Continuing Education Faculty of Educational Studies Universiti Putra Malaysia Serdang M L Regression is an extension to
More informationAssoc.Prof.Dr. Wolfgang Feilmayr Multivariate Methods in Regional Science: Regression and Correlation Analysis REGRESSION ANALYSIS
REGRESSION ANALYSIS Regression Analysis can be broadly defined as the analysis of statistical relationships between one dependent and one or more independent variables. Although the terms dependent and
More informationA discussion on multiple regression models
A discussion on multiple regression models In our previous discussion of simple linear regression, we focused on a model in which one independent or explanatory variable X was used to predict the value
More informationExample: Poisondata. 22s:152 Applied Linear Regression. Chapter 8: ANOVA
s:5 Applied Linear Regression Chapter 8: ANOVA Two-way ANOVA Used to compare populations means when the populations are classified by two factors (or categorical variables) For example sex and occupation
More informationChapter 10-Regression
Chapter 10-Regression 10.1 Regression equation predicting infant mortality from income Y = Infant mortality X = Income Y = 6.70 s Y = 0.698 s 2 Y = 0.487 X = 46.00 s X = 6.289 s 2 X = 39.553 cov XY = 2.7245
More informationLecture 9: Linear Regression
Lecture 9: Linear Regression Goals Develop basic concepts of linear regression from a probabilistic framework Estimating parameters and hypothesis testing with linear models Linear regression in R Regression
More informationInteractions between Binary & Quantitative Predictors
Interactions between Binary & Quantitative Predictors The purpose of the study was to examine the possible joint effects of the difficulty of the practice task and the amount of practice, upon the performance
More informationCAMPBELL COLLABORATION
CAMPBELL COLLABORATION Random and Mixed-effects Modeling C Training Materials 1 Overview Effect-size estimates Random-effects model Mixed model C Training Materials Effect sizes Suppose we have computed
More informationParametric Test. Multiple Linear Regression Spatial Application I: State Homicide Rates Equations taken from Zar, 1984.
Multiple Linear Regression Spatial Application I: State Homicide Rates Equations taken from Zar, 984. y ˆ = a + b x + b 2 x 2K + b n x n where n is the number of variables Example: In an earlier bivariate
More informationDensity Temp vs Ratio. temp
Temp Ratio Density 0.00 0.02 0.04 0.06 0.08 0.10 0.12 Density 0.0 0.2 0.4 0.6 0.8 1.0 1. (a) 170 175 180 185 temp 1.0 1.5 2.0 2.5 3.0 ratio The histogram shows that the temperature measures have two peaks,
More informationInteractions among Continuous Predictors
Interactions among Continuous Predictors Today s Class: Simple main effects within two-way interactions Conquering TEST/ESTIMATE/LINCOM statements Regions of significance Three-way interactions (and beyond
More informationCorrelation and Regression Notes. Categorical / Categorical Relationship (Chi-Squared Independence Test)
Relationship Hypothesis Tests Correlation and Regression Notes Categorical / Categorical Relationship (Chi-Squared Independence Test) Ho: Categorical Variables are independent (show distribution of conditional
More informationFREC 608 Guided Exercise 9
FREC 608 Guided Eercise 9 Problem. Model of Average Annual Precipitation An article in Geography (July 980) used regression to predict average annual rainfall levels in California. Data on the following
More informationQUANTITATIVE STATISTICAL METHODS: REGRESSION AND FORECASTING JOHANNES LEDOLTER VIENNA UNIVERSITY OF ECONOMICS AND BUSINESS ADMINISTRATION SPRING 2013
QUANTITATIVE STATISTICAL METHODS: REGRESSION AND FORECASTING JOHANNES LEDOLTER VIENNA UNIVERSITY OF ECONOMICS AND BUSINESS ADMINISTRATION SPRING 3 Introduction Objectives of course: Regression and Forecasting
More informationSelf-Assessment Weeks 6 and 7: Multiple Regression with a Qualitative Predictor; Multiple Comparisons
Self-Assessment Weeks 6 and 7: Multiple Regression with a Qualitative Predictor; Multiple Comparisons 1. Suppose we wish to assess the impact of five treatments on an outcome Y. How would these five treatments
More informationConfidence Interval for the mean response
Week 3: Prediction and Confidence Intervals at specified x. Testing lack of fit with replicates at some x's. Inference for the correlation. Introduction to regression with several explanatory variables.
More informationSPSS LAB FILE 1
SPSS LAB FILE www.mcdtu.wordpress.com 1 www.mcdtu.wordpress.com 2 www.mcdtu.wordpress.com 3 OBJECTIVE 1: Transporation of Data Set to SPSS Editor INPUTS: Files: group1.xlsx, group1.txt PROCEDURE FOLLOWED:
More informationStatistics and Quantitative Analysis U4320
Statistics and Quantitative Analysis U3 Lecture 13: Explaining Variation Prof. Sharyn O Halloran Explaining Variation: Adjusted R (cont) Definition of Adjusted R So we'd like a measure like R, but one
More informationChaper 5: Matrix Approach to Simple Linear Regression. Matrix: A m by n matrix B is a grid of numbers with m rows and n columns. B = b 11 b m1 ...
Chaper 5: Matrix Approach to Simple Linear Regression Matrix: A m by n matrix B is a grid of numbers with m rows and n columns B = b 11 b 1n b m1 b mn Element b ik is from the ith row and kth column A
More informationStatistical Modelling in Stata 5: Linear Models
Statistical Modelling in Stata 5: Linear Models Mark Lunt Arthritis Research UK Epidemiology Unit University of Manchester 07/11/2017 Structure This Week What is a linear model? How good is my model? Does
More information3 Multiple Linear Regression
3 Multiple Linear Regression 3.1 The Model Essentially, all models are wrong, but some are useful. Quote by George E.P. Box. Models are supposed to be exact descriptions of the population, but that is
More informationIII. Inferential Tools
III. Inferential Tools A. Introduction to Bat Echolocation Data (10.1.1) 1. Q: Do echolocating bats expend more enery than non-echolocating bats and birds, after accounting for mass? 2. Strategy: (i) Explore
More informationANOVA Situation The F Statistic Multiple Comparisons. 1-Way ANOVA MATH 143. Department of Mathematics and Statistics Calvin College
1-Way ANOVA MATH 143 Department of Mathematics and Statistics Calvin College An example ANOVA situation Example (Treating Blisters) Subjects: 25 patients with blisters Treatments: Treatment A, Treatment
More informationEstadística II Chapter 5. Regression analysis (second part)
Estadística II Chapter 5. Regression analysis (second part) Chapter 5. Regression analysis (second part) Contents Diagnostic: Residual analysis The ANOVA (ANalysis Of VAriance) decomposition Nonlinear
More informationST430 Exam 2 Solutions
ST430 Exam 2 Solutions Date: November 9, 2015 Name: Guideline: You may use one-page (front and back of a standard A4 paper) of notes. No laptop or textbook are permitted but you may use a calculator. Giving
More informationStat 411/511 ESTIMATING THE SLOPE AND INTERCEPT. Charlotte Wickham. stat511.cwick.co.nz. Nov
Stat 411/511 ESTIMATING THE SLOPE AND INTERCEPT Nov 20 2015 Charlotte Wickham stat511.cwick.co.nz Quiz #4 This weekend, don t forget. Usual format Assumptions Display 7.5 p. 180 The ideal normal, simple
More information*************NO YOGA!!!!!!!************************************.
*************NO YOGA!!!!!!!************************************. temporary. select if human gt 1 and Q_TotalDuration gt 239 and subjectnum ne 672 and subj ectnum ne 115 and subjectnum ne 104 and subjectnum
More informationTable of z values and probabilities for the standard normal distribution. z is the first column plus the top row. Each cell shows P(X z).
Table of z values and probabilities for the standard normal distribution. z is the first column plus the top row. Each cell shows P(X z). For example P(X.04) =.8508. For z < 0 subtract the value from,
More informationNature vs. nurture? Lecture 18 - Regression: Inference, Outliers, and Intervals. Regression Output. Conditions for inference.
Understanding regression output from software Nature vs. nurture? Lecture 18 - Regression: Inference, Outliers, and Intervals In 1966 Cyril Burt published a paper called The genetic determination of differences
More information