Statistical Inference
|
|
- Bathsheba MargaretMargaret Dixon
- 5 years ago
- Views:
Transcription
1 Statistical Inference Jean Daunizeau Wellcome rust Centre for Neuroimaging University College London SPM Course Edinburgh, April 2010
2 Image time-series Spatial filter Design matrix Statistical Parametric Map Realignment Smoothing General Linear Model Normalisation Statistical Inference RF Anatomical reference Parameter estimates p <0.05
3 Voxel-wise time series analysis ime ime Model specification Parameter estimation Hypothesis Statistic single voxel time series BOLD signal SPM
4 Overview Model specification and parameters estimation Hypothesis testing Contrasts -tests F-tests Contrast estimability Correlation between regressors Example(s) Design efficiency
5 Model Specification: he General Linear Model 1 p 1 1 β y = Xβ + ε yy = X p + ε Sphericity assumption: Independent and identically distributed (i.i.d.) error terms N N N ε ~ N(0, σ 2 I ) N: number of scans, p: number of regressors he General Linear Model is an equation that expresses the observed response variable in terms of a linear combination of explanatory variables X plus a well behaved error term. Each column of the design matrix corresponds to an effect one has built into the experiment or that may confound the results.
6 Parameter Estimation: Ordinary Least Squares Find βˆ that minimises y Xβ = ε ε 2 he Ordinary Least Estimates are: ˆ β = ( X X ) 1 X y Under i.i.d. assumptions, the Ordinary Least Squares estimates are Maximum Likelihood. ε ~ N(0, σ 2 I) Y ~ N( Xβ, σ 2 I) ˆ 2 σ = ˆ ε ˆ ε N p ˆ 2 1 β ~ N( β, σ ( X X ) )
7 Hypothesis esting o test an hypothesis, we construct test statistics. he Null Hypothesis H 0 ypically what we want to disprove (no effect). he Alternative Hypothesis H A expresses outcome of interest. he est Statistic he test statistic summarises evidence about H 0. ypically, test statistic is small in magnitude when the hypothesis H 0 is true and large when false. We need to know the distribution of under the null hypothesis. Null Distribution of
8 Hypothesis esting Significance level α: Acceptable false positive rate α. threshold u α hreshold u α controls the false positive rate α = p( > u α H 0) Observation of test statistic t, a realisation of he conclusion about the hypothesis: We reject the null hypothesis in favour of the alternative hypothesis if t > u α P-value: A p-value summarises evidence against H 0. his is the chance of observing value more extreme than t under the null hypothesis. p ( > t H 0) u α α Null Distribution of P-val Null Distribution of t
9 Contrasts We are usually not interested in the whole β vector. A contrast selects a specific effect of interest: a contrast c is a vector of length p. c β is a linear combination of regression coefficients β. Under i.i.d assumptions: c ˆ 1 β ~ N( c c = [ ] c β = 1xβ 1 + 0xβ 2 + 0xβ 3 + 0xβ 4 + 0xβ c = [ ] c β = 0xβ xβ 2 + 1xβ 3 + 0xβ 4 + 0xβ β, σ c ( X X ) c)
10 -test - one dimensional contrasts SPM{t} c = Question: box-car amplitude > 0? = β 1 = c β> 0? β 1 β 2 β 3 β 4 β 5... Null hypothesis: H 0 : c β=0 est statistic: = contrast of estimated parameters variance estimate c ˆ β c ˆ β = = ~ 2 1 var( c ˆ) β ˆ σ c c ( X X ) t N p
11 -contrast in SPM For a given contrast c: ˆ β = beta_???? images ( X X ) 1 X y σ ResMS image ˆ 2 ˆ ε ˆ ε = N p con_???? image c βˆ spm_???? image SPM{t}
12 -test: a simple example Passive word listening versus rest c = [ 1 0 ] Q: Q: activation during listening? X Design matrix Null Null hypothesis: β 1 = 0 t = c ˆ β Std( c ˆ) β SPMresults: Height threshold = {p<0.001} voxel-level mm mm mm ( Z ) Statistics: p-values adjusted for search volume set-level p c p corrected p uncorrected Inf cluster-level voxel-level Inf k E p uncorrected p FWE-corr p FDR-corr (Z ) p Inf uncorrected Inf mm mm mm Inf Inf Inf Inf Inf Inf
13 -test: a few remarks -test is a signal-to-noise measure (ratio of estimate to standard deviation of estimate). -contrasts are simple combinations of the betas; the - statistic does not depend on the scaling of the regressors or the scaling of the contrast. Unilateral test: H 0 : c β = 0 vs H A : c β > 0
14 Subject 5 Subject 1 Scaling issue [ ] / 4 [1 1 1 ] / 3 = c ˆ β var( c ˆ) β = 2 ˆ σ c ( X X ) 1 c he -statistic does not depend on the scaling of the regressors. c ˆ β he -statistic does not depend on the scaling of the contrast. Contrast c βˆ depends on scaling. Be careful of the interpretation of the contrasts c βˆ themselves (eg, for a second level analysis): sum average
15 F-test - the extra-sum-of-squares principle Model comparison: Full vs. Reduced model? Null Hypothesis H 0 : rue model is X 0 (reduced model) X 0 X 1 X 0 est statistic: ratio of explained variability and unexplained variability (error) Full model? RSS ε ˆ 2 full RSS 0 ˆreduced ε 2 Or Reduced model? F RSS RSS RSS 0 F ESS RSS ~ F ν ν 1, ν 1 = rank(x) rank(x 0 ) ν 2 = N rank(x) 2
16 F-test - multidimensional contrasts SPM{F} ests multiple linear hypotheses: H 0 : rue model is X 0 X 1 (β 3-9 ) X0 X 0 H 0 : β 3 = β 4 =... = β 9 = 0 c = test H 0 : c β = 0? SPM{F 6,322 } Full model? Reduced model?
17 F-contrast in SPM ˆ β = beta_???? images ( X X ) 1 X y σ ResMS image ˆ 2 ˆ ε ˆ ε = N p ess_???? images ( RSS 0 -RSS) spmf_???? images SPM{F}
18 F-test example: movement related effects
19 Multidimensional contrasts hink of it as constructing 3 regressors from the 3 differences and complement this new design matrix such that data can be fitted in the same exact way (same error, same fitted data).
20 F-test: a few remarks F-tests can be viewed as testing for the additional variance explained by a larger model wrt a simpler (nested) model Model comparison. F tests a weighted sum of squares of one or several combinations of the regression coefficients β. In practice, we don t have to explicitly separate X into [X 1 X 2 ] thanks to multidimensional contrasts. Hypotheses: Null Hypothesis H 0 : β1 = β 2 = β 3 = 0 Alternative HypothesisH : at least one β In testing uni-dimensional contrast with an F-test, for example β 1 β 2, the result will be the same as testing β 2 β 1. It will be exactly the square of the t-test, testing for both positive and negative effects. A k 0
21 Estimability of a contrast If X is not of full rank then we can have Xβ 1 = Xβ 2 with β 1 β 2 (different parameters). he parameters are not therefore unique, identifiable or estimable. For such models, X X is not invertible so we must resort to generalised inverses (SPM uses the pseudo-inverse). Example: One-way ANOVA (unpaired two-sample t-test) parameters Rank(X)=2 [1 0 0], [0 1 0], [0 0 1] are not estimable. [1 0 1], [0 1 1], [1-1 0], [ ] are estimable. images Factor 1 Factor 2 Mean parameter estimability (gray β not uniquely specified)
22 Design orthogonality For each pair of columns of the design matrix, the orthogonality matrix depicts the magnitude of the cosine of the angle between them, with the range 0 to 1 mapped from white to black. he cosine of the angle between two vectors a and b is obtained by: cos α = a b a b If both vectors have zero mean then the cosine of the angle between the vectors is the same as the correlation between the two variates.
23 Multicollinearity Orthogonal regressors (=uncorrelated): By varying each separately, one can predict the combined effect of varying them jointly. x 2 Var( c 2 ˆ) β =σ c ( X X ) 1 c ( X X ) 1 is diagonal x 1 x 2 x 1 Non-orthogonal regressors (=correlated): When testing for the first regressor, we are effectively removing the part of the signal that can be accounted for by the second regressor implicit orthogonalisation. x 2 x 2 x 2 x 2 x 1 x = x 2 2 x 1.x 2 x 1 x 1 It does not reduce the predictive power or reliability of the model as a whole. x 1 x 1
24 Shared variance Orthogonal regressors.
25 Shared variance esting for the green: Correlated regressors, for example: green: subject age yellow: subject score
26 Shared variance esting for the red: Correlated regressors.
27 Shared variance esting for the green: Highly correlated. Entirely correlated non estimable
28 Shared variance esting for the green and yellow If significant, can be G and/or Y Examples
29 A few remarks We implicitly test for an additional effect only, be careful if there is correlation - Orthogonalisation = decorrelation : not generally needed - Parameters and test on the non modified regressor change It is always simpler to have orthogonal regressors and therefore designs. In case of correlation, use F-tests to see the overall significance. here is generally no way to decide to which regressor the «common» part should be attributed to. Original regressors may not matter: it s the contrast you are testing which should be as decorrelated as possible from the rest of the design matrix
30 Design efficiency he aim is to minimize the standard error of a t-contrast (i.e. the denominator of a t-statistic). var( c 2 ˆ) β = ˆ σ c ( X X ) 1 c = c ˆ β var( c ˆ) β his is equivalent to maximizing the efficiency e: e( ˆ σ 2, c, X ) ˆ 2 1 = ( σ c ( X X ) c ) 1 Noise variance Design variance If we assume that the noise variance is independent of the specific design: e( c, X ) = ( c ( X X ) c 1 1 ) his is a relative measure: all we can really say is that one design is more efficient than another (for a given contrast).
31 Design efficiency he efficiency of an estimator is a measure of how reliable it is and depends on error variance (the variance not modeled by explanatory variables in the design matrix) and the design variance (a function of the explanatory variables and the contrast tested). X X represents covariance of regressors in design matrix; high covariance increases elements of (X X) -1. High correlation between regressors leads to low sensitivity to each regressor alone. c ( X X ) 1 c c =[1 0]: 5.26 c =[1 1]: 20 c =[1-1]: 1.05
32 Bibliography: Statistical Parametric Mapping: he Analysis of Functional Brain Images. Elsevier, Plane Answers to Complex Questions: he heory of Linear Models. R. Christensen, Springer, Statistical parametric maps in functional imaging: a general linear approach. K.J. Friston et al, Human Brain Mapping, Ambiguous results in functional neuroimaging data analysis due to covariate correlation. A. Andrade et al., NeuroImage, Estimating efficiency a priori: a comparison of blocked and randomized designs. A. Mechelli et al., NeuroImage, With many thanks to G. Flandin, J.-B. Poline and om Nichols for slides.
Statistical Inference
Statistical Inference J. Daunizeau Institute of Empirical Research in Economics, Zurich, Switzerland Brain and Spine Institute, Paris, France SPM Course Edinburgh, April 2011 Image time-series Spatial
More informationThe General Linear Model. Guillaume Flandin Wellcome Trust Centre for Neuroimaging University College London
The General Linear Model Guillaume Flandin Wellcome Trust Centre for Neuroimaging University College London SPM Course Lausanne, April 2012 Image time-series Spatial filter Design matrix Statistical Parametric
More informationNeuroimaging for Machine Learners Validation and inference
GIGA in silico medicine, ULg, Belgium http://www.giga.ulg.ac.be Neuroimaging for Machine Learners Validation and inference Christophe Phillips, Ir. PhD. PRoNTo course June 2017 Univariate analysis: Introduction:
More informationGroup analysis. Jean Daunizeau Wellcome Trust Centre for Neuroimaging University College London. SPM Course Edinburgh, April 2010
Group analysis Jean Daunizeau Wellcome Trust Centre for Neuroimaging University College London SPM Course Edinburgh, April 2010 Image time-series Spatial filter Design matrix Statistical Parametric Map
More informationJean-Baptiste Poline
Edinburgh course Avril 2010 Linear Models Contrasts Variance components Jean-Baptiste Poline Neurospin, I2BM, CEA Saclay, France Credits: Will Penny, G. Flandin, SPM course authors Outline Part I: Linear
More informationThe General Linear Model (GLM)
he General Linear Model (GLM) Klaas Enno Stephan ranslational Neuromodeling Unit (NU) Institute for Biomedical Engineering University of Zurich & EH Zurich Wellcome rust Centre for Neuroimaging Institute
More informationGroup Analysis. Lexicon. Hierarchical models Mixed effect models Random effect (RFX) models Components of variance
Group Analysis J. Daunizeau Institute of Empirical Research in Economics, Zurich, Switzerland Brain and Spine Institute, Paris, France SPM Course Edinburgh, April 2011 Image time-series Spatial filter
More informationThe General Linear Model (GLM)
The General Linear Model (GLM) Dr. Frederike Petzschner Translational Neuromodeling Unit (TNU) Institute for Biomedical Engineering, University of Zurich & ETH Zurich With many thanks for slides & images
More informationOverview of SPM. Overview. Making the group inferences we want. Non-sphericity Beyond Ordinary Least Squares. Model estimation A word on power
Group Inference, Non-sphericity & Covariance Components in SPM Alexa Morcom Edinburgh SPM course, April 011 Centre for Cognitive & Neural Systems/ Department of Psychology University of Edinburgh Overview
More informationExtracting fmri features
Extracting fmri features PRoNTo course May 2018 Christophe Phillips, GIGA Institute, ULiège, Belgium c.phillips@uliege.be - http://www.giga.ulg.ac.be Overview Introduction Brain decoding problem Subject
More informationContents. Introduction The General Linear Model. General Linear Linear Model Model. The General Linear Model, Part I. «Take home» message
DISCOS SPM course, CRC, Liège, 2009 Contents The General Linear Model, Part I Introduction The General Linear Model Data & model Design matrix Parameter estimates & interpretation Simple contrast «Take
More informationStatistical inference for MEG
Statistical inference for MEG Vladimir Litvak Wellcome Trust Centre for Neuroimaging University College London, UK MEG-UK 2014 educational day Talk aims Show main ideas of common methods Explain some of
More information心智科學大型研究設備共同使用服務計畫身體 心靈與文化整合影像研究中心. fmri 教育講習課程 I. Hands-on (2 nd level) Group Analysis to Factorial Design
心智科學大型研究設備共同使用服務計畫身體 心靈與文化整合影像研究中心 fmri 教育講習課程 I Hands-on (2 nd level) Group Analysis to Factorial Design 黃從仁助理教授臺灣大學心理學系 trhuang@ntu.edu.tw Analysis So+ware h"ps://goo.gl/ctvqce Where are we? Where are
More informationContents. design. Experimental design Introduction & recap Experimental design «Take home» message. N εˆ. DISCOS SPM course, CRC, Liège, 2009
DISCOS SPM course, CRC, Liège, 2009 Contents Experimental design Introduction & recap Experimental design «Take home» message C. Phillips, Centre de Recherches du Cyclotron, ULg, Belgium Based on slides
More informationExperimental design of fmri studies
Experimental design of fmri studies Sandra Iglesias With many thanks for slides & images to: Klaas Enno Stephan, FIL Methods group, Christian Ruff SPM Course 2015 Overview of SPM Image time-series Kernel
More informationContents. Data. Introduction & recap Variance components Hierarchical model RFX and summary statistics Variance/covariance matrix «Take home» message
SPM course, CRC, Liege,, Septembre 2009 Contents Group analysis (RF) Variance components Hierarchical model RF and summary statistics Variance/covariance matrix «Tae home» message C. Phillips, Centre de
More informationExperimental design of fmri studies
Experimental design of fmri studies Zurich SPM Course 2016 Sandra Iglesias Translational Neuromodeling Unit (TNU) Institute for Biomedical Engineering (IBT) University and ETH Zürich With many thanks for
More informationContrasts and Classical Inference
Elsevier UK Chapter: Ch9-P3756 8-7-6 7:p.m. Page:6 Trim:7.5in 9.5in C H A P T E R 9 Contrasts and Classical Inference J. Poline, F. Kherif, C. Pallier and W. Penny INTRODUCTION The general linear model
More informationExperimental design of fmri studies & Resting-State fmri
Methods & Models for fmri Analysis 2016 Experimental design of fmri studies & Resting-State fmri Sandra Iglesias With many thanks for slides & images to: Klaas Enno Stephan, FIL Methods group, Christian
More informationPeak Detection for Images
Peak Detection for Images Armin Schwartzman Division of Biostatistics, UC San Diego June 016 Overview How can we improve detection power? Use a less conservative error criterion Take advantage of prior
More informationEvent-related fmri. Christian Ruff. Laboratory for Social and Neural Systems Research Department of Economics University of Zurich
Event-related fmri Christian Ruff Laboratory for Social and Neural Systems Research Department of Economics University of Zurich Institute of Neurology University College London With thanks to the FIL
More informationMixed effects and Group Modeling for fmri data
Mixed effects and Group Modeling for fmri data Thomas Nichols, Ph.D. Department of Statistics Warwick Manufacturing Group University of Warwick Warwick fmri Reading Group May 19, 2010 1 Outline Mixed effects
More informationBayesian inference J. Daunizeau
Bayesian inference J. Daunizeau Brain and Spine Institute, Paris, France Wellcome Trust Centre for Neuroimaging, London, UK Overview of the talk 1 Probabilistic modelling and representation of uncertainty
More informationFor GLM y = Xβ + e (1) where X is a N k design matrix and p(e) = N(0, σ 2 I N ), we can estimate the coefficients from the normal equations
1 Generalised Inverse For GLM y = Xβ + e (1) where X is a N k design matrix and p(e) = N(0, σ 2 I N ), we can estimate the coefficients from the normal equations (X T X)β = X T y (2) If rank of X, denoted
More informationExperimental design of fmri studies
Methods & Models for fmri Analysis 2017 Experimental design of fmri studies Sara Tomiello With many thanks for slides & images to: Sandra Iglesias, Klaas Enno Stephan, FIL Methods group, Christian Ruff
More informationSignal Processing for Functional Brain Imaging: General Linear Model (2)
Signal Processing for Functional Brain Imaging: General Linear Model (2) Maria Giulia Preti, Dimitri Van De Ville Medical Image Processing Lab, EPFL/UniGE http://miplab.epfl.ch/teaching/micro-513/ March
More informationBayesian inference J. Daunizeau
Bayesian inference J. Daunizeau Brain and Spine Institute, Paris, France Wellcome Trust Centre for Neuroimaging, London, UK Overview of the talk 1 Probabilistic modelling and representation of uncertainty
More information1. The OLS Estimator. 1.1 Population model and notation
1. The OLS Estimator OLS stands for Ordinary Least Squares. There are 6 assumptions ordinarily made, and the method of fitting a line through data is by least-squares. OLS is a common estimation methodology
More informationData Analysis I: Single Subject
Data Analysis I: Single Subject ON OFF he General Linear Model (GLM) y= X fmri Signal = Design Matrix our data = what we CAN explain x β x Betas + + how much x of it we CAN + explain ε Residuals what
More informationExperimental design of fmri studies
Experimental design of fmri studies Sandra Iglesias Translational Neuromodeling Unit University of Zurich & ETH Zurich With many thanks for slides & images to: Klaas Enno Stephan, FIL Methods group, Christian
More information(a) (3 points) Construct a 95% confidence interval for β 2 in Equation 1.
Problem 1 (21 points) An economist runs the regression y i = β 0 + x 1i β 1 + x 2i β 2 + x 3i β 3 + ε i (1) The results are summarized in the following table: Equation 1. Variable Coefficient Std. Error
More informationEconometrics I KS. Module 2: Multivariate Linear Regression. Alexander Ahammer. This version: April 16, 2018
Econometrics I KS Module 2: Multivariate Linear Regression Alexander Ahammer Department of Economics Johannes Kepler University of Linz This version: April 16, 2018 Alexander Ahammer (JKU) Module 2: Multivariate
More informationThe general linear model and Statistical Parametric Mapping I: Introduction to the GLM
The general linear mdel and Statistical Parametric Mapping I: Intrductin t the GLM Alexa Mrcm and Stefan Kiebel, Rik Hensn, Andrew Hlmes & J-B J Pline Overview Intrductin Essential cncepts Mdelling Design
More informationEconomic modelling and forecasting
Economic modelling and forecasting 2-6 February 2015 Bank of England he generalised method of moments Ole Rummel Adviser, CCBS at the Bank of England ole.rummel@bankofengland.co.uk Outline Classical estimation
More informationA. Motivation To motivate the analysis of variance framework, we consider the following example.
9.07 ntroduction to Statistics for Brain and Cognitive Sciences Emery N. Brown Lecture 14: Analysis of Variance. Objectives Understand analysis of variance as a special case of the linear model. Understand
More informationThe Linear Regression Model
The Linear Regression Model Carlo Favero Favero () The Linear Regression Model 1 / 67 OLS To illustrate how estimation can be performed to derive conditional expectations, consider the following general
More informationLecture 10 Multiple Linear Regression
Lecture 10 Multiple Linear Regression STAT 512 Spring 2011 Background Reading KNNL: 6.1-6.5 10-1 Topic Overview Multiple Linear Regression Model 10-2 Data for Multiple Regression Y i is the response variable
More information14 Multiple Linear Regression
B.Sc./Cert./M.Sc. Qualif. - Statistics: Theory and Practice 14 Multiple Linear Regression 14.1 The multiple linear regression model In simple linear regression, the response variable y is expressed in
More informationInterpreting Regression Results
Interpreting Regression Results Carlo Favero Favero () Interpreting Regression Results 1 / 42 Interpreting Regression Results Interpreting regression results is not a simple exercise. We propose to split
More informationTests about a population mean
October 2 nd, 2017 Overview Week 1 Week 2 Week 4 Week 7 Week 10 Week 12 Chapter 1: Descriptive statistics Chapter 6: Statistics and Sampling Distributions Chapter 7: Point Estimation Chapter 8: Confidence
More informationExperimental Design and Data Analysis for Biologists
Experimental Design and Data Analysis for Biologists Gerry P. Quinn Monash University Michael J. Keough University of Melbourne CAMBRIDGE UNIVERSITY PRESS Contents Preface page xv I I Introduction 1 1.1
More informationThis Appendix proposes a set of terms and definitions for use in analyses of 1D biomechanical
Appendix A Nomenclature This Appendix proposes a set of terms and definitions for use in analyses of D biomechanical continua (Table A.) and relates these terms to analogous, established terms from the
More information1. The Multivariate Classical Linear Regression Model
Business School, Brunel University MSc. EC550/5509 Modelling Financial Decisions and Markets/Introduction to Quantitative Methods Prof. Menelaos Karanasos (Room SS69, Tel. 08956584) Lecture Notes 5. The
More information[y i α βx i ] 2 (2) Q = i=1
Least squares fits This section has no probability in it. There are no random variables. We are given n points (x i, y i ) and want to find the equation of the line that best fits them. We take the equation
More informationOptimization of Designs for fmri
Optimization of Designs for fmri UCLA Advanced Neuroimaging Summer School August 2, 2007 Thomas Liu, Ph.D. UCSD Center for Functional MRI Why optimize? Scans are expensive. Subjects can be difficult to
More informationRecent Advances in the Field of Trade Theory and Policy Analysis Using Micro-Level Data
Recent Advances in the Field of Trade Theory and Policy Analysis Using Micro-Level Data July 2012 Bangkok, Thailand Cosimo Beverelli (World Trade Organization) 1 Content a) Classical regression model b)
More informationChapter 1 Statistical Inference
Chapter 1 Statistical Inference causal inference To infer causality, you need a randomized experiment (or a huge observational study and lots of outside information). inference to populations Generalizations
More informationMultiple Linear Regression
Multiple Linear Regression Simple linear regression tries to fit a simple line between two variables Y and X. If X is linearly related to Y this explains some of the variability in Y. In most cases, there
More informationStatistical Analysis Aspects of Resting State Functional Connectivity
Statistical Analysis Aspects of Resting State Functional Connectivity Biswal s result (1995) Correlations between RS Fluctuations of left and right motor areas Why studying resting state? Human Brain =
More informationMultiple Linear Regression
Multiple Linear Regression University of California, San Diego Instructor: Ery Arias-Castro http://math.ucsd.edu/~eariasca/teaching.html 1 / 42 Passenger car mileage Consider the carmpg dataset taken from
More informationBayesian Regression (1/31/13)
STA613/CBB540: Statistical methods in computational biology Bayesian Regression (1/31/13) Lecturer: Barbara Engelhardt Scribe: Amanda Lea 1 Bayesian Paradigm Bayesian methods ask: given that I have observed
More informationMultiple Regression Analysis
Chapter 4 Multiple Regression Analysis The simple linear regression covered in Chapter 2 can be generalized to include more than one variable. Multiple regression analysis is an extension of the simple
More informationSTK4900/ Lecture 3. Program
STK4900/9900 - Lecture 3 Program 1. Multiple regression: Data structure and basic questions 2. The multiple linear regression model 3. Categorical predictors 4. Planned experiments and observational studies
More informationQuantitative Analysis of Financial Markets. Summary of Part II. Key Concepts & Formulas. Christopher Ting. November 11, 2017
Summary of Part II Key Concepts & Formulas Christopher Ting November 11, 2017 christopherting@smu.edu.sg http://www.mysmu.edu/faculty/christophert/ Christopher Ting 1 of 16 Why Regression Analysis? Understand
More informationReview of Statistics 101
Review of Statistics 101 We review some important themes from the course 1. Introduction Statistics- Set of methods for collecting/analyzing data (the art and science of learning from data). Provides methods
More informationAnalysis of longitudinal neuroimaging data with OLS & Sandwich Estimator of variance
Analysis of longitudinal neuroimaging data with OLS & Sandwich Estimator of variance Bryan Guillaume Reading workshop lifespan neurobiology 27 June 2014 Supervisors: Thomas Nichols (Warwick University)
More informationUnit 12: Analysis of Single Factor Experiments
Unit 12: Analysis of Single Factor Experiments Statistics 571: Statistical Methods Ramón V. León 7/16/2004 Unit 12 - Stat 571 - Ramón V. León 1 Introduction Chapter 8: How to compare two treatments. Chapter
More informationMultivariate Regression Generalized Likelihood Ratio Tests for FMRI Activation
Multivariate Regression Generalized Likelihood Ratio Tests for FMRI Activation Daniel B Rowe Division of Biostatistics Medical College of Wisconsin Technical Report 40 November 00 Division of Biostatistics
More informationMachine Learning Linear Classification. Prof. Matteo Matteucci
Machine Learning Linear Classification Prof. Matteo Matteucci Recall from the first lecture 2 X R p Regression Y R Continuous Output X R p Y {Ω 0, Ω 1,, Ω K } Classification Discrete Output X R p Y (X)
More informationMicroeconometria Day # 5 L. Cembalo. Regressione con due variabili e ipotesi dell OLS
Microeconometria Day # 5 L. Cembalo Regressione con due variabili e ipotesi dell OLS Multiple regression model Classical hypothesis of a regression model: Assumption 1: Linear regression model.the regression
More informationLecture 3: Multiple Regression
Lecture 3: Multiple Regression R.G. Pierse 1 The General Linear Model Suppose that we have k explanatory variables Y i = β 1 + β X i + β 3 X 3i + + β k X ki + u i, i = 1,, n (1.1) or Y i = β j X ji + u
More informationLecture 4: Testing Stuff
Lecture 4: esting Stuff. esting Hypotheses usually has three steps a. First specify a Null Hypothesis, usually denoted, which describes a model of H 0 interest. Usually, we express H 0 as a restricted
More informationThe General Linear Model in Functional MRI
The General Linear Model in Functional MRI Henrik BW Larsson Functional Imaging Unit, Glostrup Hospital University of Copenhagen Part I 1 2 Preface The General Linear Model (GLM) or multiple regression
More informationSchool of Mathematical Sciences. Question 1
School of Mathematical Sciences MTH5120 Statistical Modelling I Practical 8 and Assignment 7 Solutions Question 1 Figure 1: The residual plots do not contradict the model assumptions of normality, constant
More informationThe General Linear Model Ivo Dinov
Stats 33 Statistical Methods for Biomedical Data The General Linear Model Ivo Dinov dinov@stat.ucla.edu http://www.stat.ucla.edu/~dinov Slide 1 Problems with t-tests and correlations 1) How do we evaluate
More information2 Regression Analysis
FORK 1002 Preparatory Course in Statistics: 2 Regression Analysis Genaro Sucarrat (BI) http://www.sucarrat.net/ Contents: 1 Bivariate Correlation Analysis 2 Simple Regression 3 Estimation and Fit 4 T -Test:
More informationMULTIPLE REGRESSION AND ISSUES IN REGRESSION ANALYSIS
MULTIPLE REGRESSION AND ISSUES IN REGRESSION ANALYSIS Page 1 MSR = Mean Regression Sum of Squares MSE = Mean Squared Error RSS = Regression Sum of Squares SSE = Sum of Squared Errors/Residuals α = Level
More informationStatistics and econometrics
1 / 36 Slides for the course Statistics and econometrics Part 10: Asymptotic hypothesis testing European University Institute Andrea Ichino September 8, 2014 2 / 36 Outline Why do we need large sample
More informationStatement: With my signature I confirm that the solutions are the product of my own work. Name: Signature:.
MATHEMATICAL STATISTICS Take-home final examination February 1 st -February 8 th, 019 Instructions You do not need to edit the solutions Just make sure the handwriting is legible The final solutions should
More informationThe Simple Regression Model. Simple Regression Model 1
The Simple Regression Model Simple Regression Model 1 Simple regression model: Objectives Given the model: - where y is earnings and x years of education - Or y is sales and x is spending in advertising
More informationExperimental Design. Rik Henson. With thanks to: Karl Friston, Andrew Holmes
Experimental Design Rik Henson With thanks to: Karl Friston, Andrew Holmes Overview 1. A Taxonomy of Designs 2. Epoch vs Event-related 3. Mixed Epoch/Event Designs A taxonomy of design Categorical designs
More informationStatistical Modelling in Stata 5: Linear Models
Statistical Modelling in Stata 5: Linear Models Mark Lunt Arthritis Research UK Epidemiology Unit University of Manchester 07/11/2017 Structure This Week What is a linear model? How good is my model? Does
More informationMultiple Regression Analysis
Multiple Regression Analysis y = β 0 + β 1 x 1 + β 2 x 2 +... β k x k + u 2. Inference 0 Assumptions of the Classical Linear Model (CLM)! So far, we know: 1. The mean and variance of the OLS estimators
More informationOverview of Spatial Statistics with Applications to fmri
with Applications to fmri School of Mathematics & Statistics Newcastle University April 8 th, 2016 Outline Why spatial statistics? Basic results Nonstationary models Inference for large data sets An example
More informationIntroduction to Regression Analysis. Dr. Devlina Chatterjee 11 th August, 2017
Introduction to Regression Analysis Dr. Devlina Chatterjee 11 th August, 2017 What is regression analysis? Regression analysis is a statistical technique for studying linear relationships. One dependent
More informationChapter 12 - Lecture 2 Inferences about regression coefficient
Chapter 12 - Lecture 2 Inferences about regression coefficient April 19th, 2010 Facts about slope Test Statistic Confidence interval Hypothesis testing Test using ANOVA Table Facts about slope In previous
More informationy response variable x 1, x 2,, x k -- a set of explanatory variables
11. Multiple Regression and Correlation y response variable x 1, x 2,, x k -- a set of explanatory variables In this chapter, all variables are assumed to be quantitative. Chapters 12-14 show how to incorporate
More informationChapter 8 Handout: Interval Estimates and Hypothesis Testing
Chapter 8 Handout: Interval Estimates and Hypothesis esting Preview Clint s Assignment: aking Stock General Properties of the Ordinary Least Squares (OLS) Estimation Procedure Estimate Reliability: Interval
More information22s:152 Applied Linear Regression. Chapter 8: 1-Way Analysis of Variance (ANOVA) 2-Way Analysis of Variance (ANOVA)
22s:152 Applied Linear Regression Chapter 8: 1-Way Analysis of Variance (ANOVA) 2-Way Analysis of Variance (ANOVA) We now consider an analysis with only categorical predictors (i.e. all predictors are
More informationIntroduction to Estimation Methods for Time Series models. Lecture 1
Introduction to Estimation Methods for Time Series models Lecture 1 Fulvio Corsi SNS Pisa Fulvio Corsi Introduction to Estimation () Methods for Time Series models Lecture 1 SNS Pisa 1 / 19 Estimation
More informationSTAT 263/363: Experimental Design Winter 2016/17. Lecture 1 January 9. Why perform Design of Experiments (DOE)? There are at least two reasons:
STAT 263/363: Experimental Design Winter 206/7 Lecture January 9 Lecturer: Minyong Lee Scribe: Zachary del Rosario. Design of Experiments Why perform Design of Experiments (DOE)? There are at least two
More informationMultivariate Regression (Chapter 10)
Multivariate Regression (Chapter 10) This week we ll cover multivariate regression and maybe a bit of canonical correlation. Today we ll mostly review univariate multivariate regression. With multivariate
More informationEmpirical Economic Research, Part II
Based on the text book by Ramanathan: Introductory Econometrics Robert M. Kunst robert.kunst@univie.ac.at University of Vienna and Institute for Advanced Studies Vienna December 7, 2011 Outline Introduction
More informationECON 4160, Autumn term Lecture 1
ECON 4160, Autumn term 2017. Lecture 1 a) Maximum Likelihood based inference. b) The bivariate normal model Ragnar Nymoen University of Oslo 24 August 2017 1 / 54 Principles of inference I Ordinary least
More informationAn introduction to Bayesian inference and model comparison J. Daunizeau
An introduction to Bayesian inference and model comparison J. Daunizeau ICM, Paris, France TNU, Zurich, Switzerland Overview of the talk An introduction to probabilistic modelling Bayesian model comparison
More informationRegression Analysis. y t = β 1 x t1 + β 2 x t2 + β k x tk + ϵ t, t = 1,..., T,
Regression Analysis The multiple linear regression model with k explanatory variables assumes that the tth observation of the dependent or endogenous variable y t is described by the linear relationship
More informationMa 3/103: Lecture 24 Linear Regression I: Estimation
Ma 3/103: Lecture 24 Linear Regression I: Estimation March 3, 2017 KC Border Linear Regression I March 3, 2017 1 / 32 Regression analysis Regression analysis Estimate and test E(Y X) = f (X). f is the
More informationA Note on UMPI F Tests
A Note on UMPI F Tests Ronald Christensen Professor of Statistics Department of Mathematics and Statistics University of New Mexico May 22, 2015 Abstract We examine the transformations necessary for establishing
More informationLecture 5: Clustering, Linear Regression
Lecture 5: Clustering, Linear Regression Reading: Chapter 10, Sections 3.1-3.2 STATS 202: Data mining and analysis October 4, 2017 1 / 22 .0.0 5 5 1.0 7 5 X2 X2 7 1.5 1.0 0.5 3 1 2 Hierarchical clustering
More informationUNIVERSITY OF TORONTO Faculty of Arts and Science
UNIVERSITY OF TORONTO Faculty of Arts and Science December 2013 Final Examination STA442H1F/2101HF Methods of Applied Statistics Jerry Brunner Duration - 3 hours Aids: Calculator Model(s): Any calculator
More informationChapter 10: Analysis of variance (ANOVA)
Chapter 10: Analysis of variance (ANOVA) ANOVA (Analysis of variance) is a collection of techniques for dealing with more general experiments than the previous one-sample or two-sample tests. We first
More informationT.I.H.E. IT 233 Statistics and Probability: Sem. 1: 2013 ESTIMATION AND HYPOTHESIS TESTING OF TWO POPULATIONS
ESTIMATION AND HYPOTHESIS TESTING OF TWO POPULATIONS In our work on hypothesis testing, we used the value of a sample statistic to challenge an accepted value of a population parameter. We focused only
More informationStochastic Dynamic Causal Modelling for resting-state fmri
Stochastic Dynamic Causal Modelling for resting-state fmri Ged Ridgway, FIL, Wellcome Trust Centre for Neuroimaging, UCL Institute of Neurology, London Overview Connectivity in the brain Introduction to
More informationcoefficients n 2 are the residuals obtained when we estimate the regression on y equals the (simple regression) estimated effect of the part of x 1
Review - Interpreting the Regression If we estimate: It can be shown that: where ˆ1 r i coefficients β ˆ+ βˆ x+ βˆ ˆ= 0 1 1 2x2 y ˆβ n n 2 1 = rˆ i1yi rˆ i1 i= 1 i= 1 xˆ are the residuals obtained when
More informationCOMPARING SEVERAL MEANS: ANOVA
LAST UPDATED: November 15, 2012 COMPARING SEVERAL MEANS: ANOVA Objectives 2 Basic principles of ANOVA Equations underlying one-way ANOVA Doing a one-way ANOVA in R Following up an ANOVA: Planned contrasts/comparisons
More information9. Model Selection. statistical models. overview of model selection. information criteria. goodness-of-fit measures
FE661 - Statistical Methods for Financial Engineering 9. Model Selection Jitkomut Songsiri statistical models overview of model selection information criteria goodness-of-fit measures 9-1 Statistical models
More informationMA 575 Linear Models: Cedric E. Ginestet, Boston University Midterm Review Week 7
MA 575 Linear Models: Cedric E. Ginestet, Boston University Midterm Review Week 7 1 Random Vectors Let a 0 and y be n 1 vectors, and let A be an n n matrix. Here, a 0 and A are non-random, whereas y is
More informationProbability and Statistics Notes
Probability and Statistics Notes Chapter Seven Jesse Crawford Department of Mathematics Tarleton State University Spring 2011 (Tarleton State University) Chapter Seven Notes Spring 2011 1 / 42 Outline
More informationBIOS 2083 Linear Models c Abdus S. Wahed
Chapter 5 206 Chapter 6 General Linear Model: Statistical Inference 6.1 Introduction So far we have discussed formulation of linear models (Chapter 1), estimability of parameters in a linear model (Chapter
More informationLECTURE 2 LINEAR REGRESSION MODEL AND OLS
SEPTEMBER 29, 2014 LECTURE 2 LINEAR REGRESSION MODEL AND OLS Definitions A common question in econometrics is to study the effect of one group of variables X i, usually called the regressors, on another
More information