What is NIRS? First-Level Statistical Models 5/18/18

Size: px
Start display at page:

Download "What is NIRS? First-Level Statistical Models 5/18/18"

Transcription

1 First-Level Statistical Models Theodore Huppert, PhD University of Pittsburgh Departments of Radiology and Bioengineering What is NIRS? Light Intensity SO 2 and Heart Rate 2 1

2 5/18/18 FunctionalWhat near-ir isspectroscopy NIRS? From Light Sources Light Intensity To Light Detectors SO2 and Heart Rate 3 FunctionalWhat near-ir isspectroscopy NIRS? Thicknesses Scalp 5-8 mm Skull 3-7 mm CSF 0-2 mm Cortex limited to outer ~8mm of brain 4 2

3 5/18/18 What is NIRS? NIRS measures changes in oxygenated (HbO2) and deoxygenated (HbR) hemoglobin HbO2 HbR HbT (volume) 2-second duration finger-tapping 5 What is NIRS? NIRS measures changes in oxygenated (HbO2) and deoxygenated (HbR) hemoglobin Due to CMRO2 Due to Flow 2-second duration finger-tapping 6 3

4 Assumptions in model Responses sum linearly. Noise (ε) is: normally distributed zero mean. Homoscedasticity i.i.d. No autocorrelation Stationary and ergodic Assumptions in model Responses sum linearly. Noise (ε) is: normally distributed zero mean. Homoscedasticity i.i.d. No autocorrelation Stationary and ergodic Translation - Every time the task is done, the signal changes by the same amount. - Independent of the baseline level - Not true for really short stimulus intervals <4s ISI (neural-refraction) or really long stimuli (habituation/windkessel effect) 4

5 Assumptions in model Responses sum linearly. Noise (ε) is: normally distributed zero mean. Homoscedasticity i.i.d. No autocorrelation Stationary and ergodic Translation - The error in the measurements is random and centered around zero. Normal (Good) noise Heteroscedastic (Bad) noise Assumptions in model Responses sum linearly. Noise (ε) is: normally distributed zero mean. Homoscedasticity i.i.d. No autocorrelation Stationary and ergodic True in NIRS? NIRS noise is heteroscedastic (Temporal) Motion artifacts are heavy tailed (Spatial) Channel noise determined by probe placement and contact 5

6 Assumptions in model Responses sum linearly. Temporal non-sphericity Noise (ε) is: NIRS noise is colored. normally distributed Specific frequencies (cardiac, respiratory, Meyer waves) are over zero mean. represented Homoscedasticity Noise has autocorrelation i.i.d. No autocorrelation Stationary and ergodic True in NIRS? Assumptions in model Responses sum linearly. Noise (ε) is: normally distributed zero mean. Homoscedasticity i.i.d. No autocorrelation Stationary and ergodic True in NIRS? Spatial non-sphericity NIRS noise has low spatial frequency (superficial) Noise between channels is correlated HbO 2 -Hb noise is correlated 6

7 Assumptions in model True in NIRS? Responses sum linearly. Physiological noise can be Noise (ε) is: stimulus-locked. Thus, noise can be non-stationary. normally distributed zero mean. Homoscedasticity i.i.d. No autocorrelation Stationary and ergodic Dealing with non-sphericity Pre-filtering Example: Band-pass filtering Only applied to data (Y) Can distort estimate of β Based on prior assumptions (may not match noise) Pre-coloring (low-pass filtering) Example: Spatial or Temporal smoothing Convolve noise with a known structure Correct the statistics to match structure Applied to both sides of equation Used in fmri and NIRS-SPM Should not be applied to heteroscedastic data Pre-whitening (high-pass filtering) 7

8 Dealing with non-sphericity Pre-whitening Apply a filter to remove colored noise Similar to pre-filtering but applied to BOTH sides of equation. Filter either pre-defined (e.g. NIRS- SPM) or iterative from noise Examples Autoregressive (AR), ARMA, or ARIMA models Auto-regressive model Whitening filter Dealing with non-sphericity Pre-whitening Apply a filter to remove colored noise Similar to pre-filtering but applied to BOTH sides of equation. Filter either pre-defined (e.g. NIRS- SPM) or iterative from noise Examples Autoregressive (AR), ARMA, or ARIMA models 8

9 Dealing with heteroscedastic noise Robust-regression Iteratively weighted solution Detect and discount outliers Apply weights to both sides of the equation Noise is still heavy-tailed after whitening Pre-whitening sharpens outliers Pre-coloring smears outliers 1. Set S =1 (no weighting) 2. Solve equation 3. Compute studentized residual (e.g. prob(outliers) ) 4. Update S 5. Repeat 2-4 Barker JW1, Aarabi A, Huppert TJ. (2013) Autoregressive model based algorithm for correcting motion and serially correlated errors in fnirs. Biomed Opt Express Jul 17;4(8): No Motion Spike Artifacts Shift Artifacts 9

10 The fnirs linear model is given by (or in shortened-notation) The unbiased solution is given by β With parameter uncertainty Canonical vs Deconvolution models Canonical model Assumes the shape of the response Estimates only the magnitude Widely used in fmri/nirs-spm Deconvolution (FIR) Estimates the full time-course of response One parameter per time point Implemented in HOMER1/2 Requires a contrast window to calculate effects β 10

11 11

12 Canonical vs Deconvolution models For either model: And they are equal* to each other when Which for ideal stimulus designs reduces to this: Remarks: 1. The canonical model is equivalent to a FIR model followed by using the prior response as the contrast window 2. The contrast is maximized when c has a tapered shape matching the response 3. Errors in the canonical shape are equivalent to using the wrong window (increase type-ii error) 4. A boxcar canonical model is equivalent to using a uniform contrast window. Data BH (locked) Preprocessing Nothing GLM OLS BH (locked) BH (random) BH (random) PCA-same AR-IRLS Resting PCAseparate SD-filter OLS + SD-regression AR-IRLS + SDregression ME + AR-IRLS + SDregression 12

13 13

14 A look at general linear models Whitening, coloring, and noise distributions Canonical and deconvolution models Group-level models Mixed Effects and ANOVA Extension to image reconstruction Huppert Lab: NIRS-toolbox Overview of toolbox structure Example of GLM analysis Example of group-level methods Example of forward model and image reconstructions GLM Coefficients Average Response Subject Response Condition Subj1 β 1A A Subj1 β 1B B Subj2 β 2A A Subj2 β 2B B Subj3 β 3A A Subj3 β 3B B 14

15 GLM Coefficients Average Response Similar assumptions Noise (ε) is: normally distributed Homoscedasticity i.i.d. So we should use the same pre-whitening and robust regression concepts as before Is this true for NIRS? Noise across subjects is not normal Heteroscedasticity e.g. Bad contact in sensors Channels are not independent and we already know the whitening from the GLM model * W = 1/cholesky(Cov β) Average of Conditions Does response vary with age? Subject Response Condition Age Subj1 β 1A A 4 Subj1 β 1B B 4 Subj2 β 2A A 7 Subj2 β 2B B 7 Subj3 β 3A A 6 Subj3 β 3B B 6 With Subject as a random variable 15

16 Model for a single source-detector pair Model for whole NIRS probe at once Accounts for covariance between src-dets Allows region-of-interest analysis Model for image reconstruction 16

Commentary on the statistical properties of noise and its implication on general linear models in functional near-infrared spectroscopy

Commentary on the statistical properties of noise and its implication on general linear models in functional near-infrared spectroscopy Commentary on the statistical properties of noise and its implication on general linear models in functional near-infrared spectroscopy Theodore J. Huppert Neurophotonics 3(1), 010401 (Jan Mar 2016) COMMENTARY

More information

Data Analysis I: Single Subject

Data Analysis I: Single Subject Data Analysis I: Single Subject ON OFF he General Linear Model (GLM) y= X fmri Signal = Design Matrix our data = what we CAN explain x β x Betas + + how much x of it we CAN + explain ε Residuals what

More information

The General Linear Model (GLM)

The General Linear Model (GLM) he General Linear Model (GLM) Klaas Enno Stephan ranslational Neuromodeling Unit (NU) Institute for Biomedical Engineering University of Zurich & EH Zurich Wellcome rust Centre for Neuroimaging Institute

More information

Overview of SPM. Overview. Making the group inferences we want. Non-sphericity Beyond Ordinary Least Squares. Model estimation A word on power

Overview of SPM. Overview. Making the group inferences we want. Non-sphericity Beyond Ordinary Least Squares. Model estimation A word on power Group Inference, Non-sphericity & Covariance Components in SPM Alexa Morcom Edinburgh SPM course, April 011 Centre for Cognitive & Neural Systems/ Department of Psychology University of Edinburgh Overview

More information

The General Linear Model (GLM)

The General Linear Model (GLM) The General Linear Model (GLM) Dr. Frederike Petzschner Translational Neuromodeling Unit (TNU) Institute for Biomedical Engineering, University of Zurich & ETH Zurich With many thanks for slides & images

More information

Group analysis. Jean Daunizeau Wellcome Trust Centre for Neuroimaging University College London. SPM Course Edinburgh, April 2010

Group analysis. Jean Daunizeau Wellcome Trust Centre for Neuroimaging University College London. SPM Course Edinburgh, April 2010 Group analysis Jean Daunizeau Wellcome Trust Centre for Neuroimaging University College London SPM Course Edinburgh, April 2010 Image time-series Spatial filter Design matrix Statistical Parametric Map

More information

Modelling temporal structure (in noise and signal)

Modelling temporal structure (in noise and signal) Modelling temporal structure (in noise and signal) Mark Woolrich, Christian Beckmann*, Salima Makni & Steve Smith FMRIB, Oxford *Imperial/FMRIB temporal noise: modelling temporal autocorrelation temporal

More information

Imagent for fnirs and EROS measurements

Imagent for fnirs and EROS measurements TECHNICAL NOTE Imagent for fnirs and EROS measurements 1. Brain imaging using Infrared Photons Brain imaging techniques can be broadly classified in two groups. One group includes the techniques that have

More information

Group Analysis. Lexicon. Hierarchical models Mixed effect models Random effect (RFX) models Components of variance

Group Analysis. Lexicon. Hierarchical models Mixed effect models Random effect (RFX) models Components of variance Group Analysis J. Daunizeau Institute of Empirical Research in Economics, Zurich, Switzerland Brain and Spine Institute, Paris, France SPM Course Edinburgh, April 2011 Image time-series Spatial filter

More information

Contents. Introduction The General Linear Model. General Linear Linear Model Model. The General Linear Model, Part I. «Take home» message

Contents. Introduction The General Linear Model. General Linear Linear Model Model. The General Linear Model, Part I. «Take home» message DISCOS SPM course, CRC, Liège, 2009 Contents The General Linear Model, Part I Introduction The General Linear Model Data & model Design matrix Parameter estimates & interpretation Simple contrast «Take

More information

Event-related fmri. Christian Ruff. Laboratory for Social and Neural Systems Research Department of Economics University of Zurich

Event-related fmri. Christian Ruff. Laboratory for Social and Neural Systems Research Department of Economics University of Zurich Event-related fmri Christian Ruff Laboratory for Social and Neural Systems Research Department of Economics University of Zurich Institute of Neurology University College London With thanks to the FIL

More information

The General Linear Model. Guillaume Flandin Wellcome Trust Centre for Neuroimaging University College London

The General Linear Model. Guillaume Flandin Wellcome Trust Centre for Neuroimaging University College London The General Linear Model Guillaume Flandin Wellcome Trust Centre for Neuroimaging University College London SPM Course Lausanne, April 2012 Image time-series Spatial filter Design matrix Statistical Parametric

More information

Spatial Source Filtering. Outline EEG/ERP. ERPs) Event-related Potentials (ERPs( EEG

Spatial Source Filtering. Outline EEG/ERP. ERPs) Event-related Potentials (ERPs( EEG Integration of /MEG/fMRI Vince D. Calhoun, Ph.D. Director, Image Analysis & MR Research The MIND Institute Outline fmri/ data Three Approaches to integration/fusion Prediction Constraints 2 nd Level Fusion

More information

Principal Component Analysis-I Geog 210C Introduction to Spatial Data Analysis. Chris Funk. Lecture 17

Principal Component Analysis-I Geog 210C Introduction to Spatial Data Analysis. Chris Funk. Lecture 17 Principal Component Analysis-I Geog 210C Introduction to Spatial Data Analysis Chris Funk Lecture 17 Outline Filters and Rotations Generating co-varying random fields Translating co-varying fields into

More information

Signal Processing for Functional Brain Imaging: General Linear Model (2)

Signal Processing for Functional Brain Imaging: General Linear Model (2) Signal Processing for Functional Brain Imaging: General Linear Model (2) Maria Giulia Preti, Dimitri Van De Ville Medical Image Processing Lab, EPFL/UniGE http://miplab.epfl.ch/teaching/micro-513/ March

More information

Mixed effects and Group Modeling for fmri data

Mixed effects and Group Modeling for fmri data Mixed effects and Group Modeling for fmri data Thomas Nichols, Ph.D. Department of Statistics Warwick Manufacturing Group University of Warwick Warwick fmri Reading Group May 19, 2010 1 Outline Mixed effects

More information

HomER: a review of time-series analysis methods for near-infrared spectroscopy of the brain

HomER: a review of time-series analysis methods for near-infrared spectroscopy of the brain HomER: a review of time-series analysis methods for near-infrared spectroscopy of the brain Theodore J. Huppert, 1,2, * Solomon G. Diamond, 2,3 Maria A. Franceschini, 2,4 and David A. Boas 2,4 1 Departments

More information

Beyond Univariate Analyses: Multivariate Modeling of Functional Neuroimaging Data

Beyond Univariate Analyses: Multivariate Modeling of Functional Neuroimaging Data Beyond Univariate Analyses: Multivariate Modeling of Functional Neuroimaging Data F. DuBois Bowman Department of Biostatistics and Bioinformatics Center for Biomedical Imaging Statistics Emory University,

More information

Optimization of Designs for fmri

Optimization of Designs for fmri Optimization of Designs for fmri UCLA Advanced Neuroimaging Summer School August 2, 2007 Thomas Liu, Ph.D. UCSD Center for Functional MRI Why optimize? Scans are expensive. Subjects can be difficult to

More information

Time Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY

Time Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY Time Series Analysis James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY & Contents PREFACE xiii 1 1.1. 1.2. Difference Equations First-Order Difference Equations 1 /?th-order Difference

More information

Basics: Definitions and Notation. Stationarity. A More Formal Definition

Basics: Definitions and Notation. Stationarity. A More Formal Definition Basics: Definitions and Notation A Univariate is a sequence of measurements of the same variable collected over (usually regular intervals of) time. Usual assumption in many time series techniques is that

More information

HST 583 FUNCTIONAL MAGNETIC RESONANCE IMAGING DATA ANALYSIS AND ACQUISITION A REVIEW OF STATISTICS FOR FMRI DATA ANALYSIS

HST 583 FUNCTIONAL MAGNETIC RESONANCE IMAGING DATA ANALYSIS AND ACQUISITION A REVIEW OF STATISTICS FOR FMRI DATA ANALYSIS HST 583 FUNCTIONAL MAGNETIC RESONANCE IMAGING DATA ANALYSIS AND ACQUISITION A REVIEW OF STATISTICS FOR FMRI DATA ANALYSIS EMERY N. BROWN AND CHRIS LONG NEUROSCIENCE STATISTICS RESEARCH LABORATORY DEPARTMENT

More information

Introduction to Regression Analysis. Dr. Devlina Chatterjee 11 th August, 2017

Introduction to Regression Analysis. Dr. Devlina Chatterjee 11 th August, 2017 Introduction to Regression Analysis Dr. Devlina Chatterjee 11 th August, 2017 What is regression analysis? Regression analysis is a statistical technique for studying linear relationships. One dependent

More information

EEG- Signal Processing

EEG- Signal Processing Fatemeh Hadaeghi EEG- Signal Processing Lecture Notes for BSP, Chapter 5 Master Program Data Engineering 1 5 Introduction The complex patterns of neural activity, both in presence and absence of external

More information

Experimental Design. Rik Henson. With thanks to: Karl Friston, Andrew Holmes

Experimental Design. Rik Henson. With thanks to: Karl Friston, Andrew Holmes Experimental Design Rik Henson With thanks to: Karl Friston, Andrew Holmes Overview 1. A Taxonomy of Designs 2. Epoch vs Event-related 3. Mixed Epoch/Event Designs A taxonomy of design Categorical designs

More information

Statistical Analysis of fmrl Data

Statistical Analysis of fmrl Data Statistical Analysis of fmrl Data F. Gregory Ashby The MIT Press Cambridge, Massachusetts London, England Preface xi Acronyms xv 1 Introduction 1 What Is fmri? 2 The Scanning Session 4 Experimental Design

More information

TIME SERIES ANALYSIS. Forecasting and Control. Wiley. Fifth Edition GWILYM M. JENKINS GEORGE E. P. BOX GREGORY C. REINSEL GRETA M.

TIME SERIES ANALYSIS. Forecasting and Control. Wiley. Fifth Edition GWILYM M. JENKINS GEORGE E. P. BOX GREGORY C. REINSEL GRETA M. TIME SERIES ANALYSIS Forecasting and Control Fifth Edition GEORGE E. P. BOX GWILYM M. JENKINS GREGORY C. REINSEL GRETA M. LJUNG Wiley CONTENTS PREFACE TO THE FIFTH EDITION PREFACE TO THE FOURTH EDITION

More information

Time Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY

Time Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY Time Series Analysis James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY PREFACE xiii 1 Difference Equations 1.1. First-Order Difference Equations 1 1.2. pth-order Difference Equations 7

More information

Statistical Methods for Forecasting

Statistical Methods for Forecasting Statistical Methods for Forecasting BOVAS ABRAHAM University of Waterloo JOHANNES LEDOLTER University of Iowa John Wiley & Sons New York Chichester Brisbane Toronto Singapore Contents 1 INTRODUCTION AND

More information

M/EEG source analysis

M/EEG source analysis Jérémie Mattout Lyon Neuroscience Research Center Will it ever happen that mathematicians will know enough about the physiology of the brain, and neurophysiologists enough of mathematical discovery, for

More information

Statistical Analysis Aspects of Resting State Functional Connectivity

Statistical Analysis Aspects of Resting State Functional Connectivity Statistical Analysis Aspects of Resting State Functional Connectivity Biswal s result (1995) Correlations between RS Fluctuations of left and right motor areas Why studying resting state? Human Brain =

More information

Multiple Regression Analysis

Multiple Regression Analysis 1 OUTLINE Basic Concept: Multiple Regression MULTICOLLINEARITY AUTOCORRELATION HETEROSCEDASTICITY REASEARCH IN FINANCE 2 BASIC CONCEPTS: Multiple Regression Y i = β 1 + β 2 X 1i + β 3 X 2i + β 4 X 3i +

More information

Contents. Data. Introduction & recap Variance components Hierarchical model RFX and summary statistics Variance/covariance matrix «Take home» message

Contents. Data. Introduction & recap Variance components Hierarchical model RFX and summary statistics Variance/covariance matrix «Take home» message SPM course, CRC, Liege,, Septembre 2009 Contents Group analysis (RF) Variance components Hierarchical model RF and summary statistics Variance/covariance matrix «Tae home» message C. Phillips, Centre de

More information

Decision 411: Class 9. HW#3 issues

Decision 411: Class 9. HW#3 issues Decision 411: Class 9 Presentation/discussion of HW#3 Introduction to ARIMA models Rules for fitting nonseasonal models Differencing and stationarity Reading the tea leaves : : ACF and PACF plots Unit

More information

1. How can you tell if there is serial correlation? 2. AR to model serial correlation. 3. Ignoring serial correlation. 4. GLS. 5. Projects.

1. How can you tell if there is serial correlation? 2. AR to model serial correlation. 3. Ignoring serial correlation. 4. GLS. 5. Projects. 1. How can you tell if there is serial correlation? 2. AR to model serial correlation. 3. Ignoring serial correlation. 4. GLS. 5. Projects. 1) Identifying serial correlation. Plot Y t versus Y t 1. See

More information

Overview. Experimental Design. A categorical analysis. A taxonomy of design. A taxonomy of design. A taxonomy of design. 1. A Taxonomy of Designs

Overview. Experimental Design. A categorical analysis. A taxonomy of design. A taxonomy of design. A taxonomy of design. 1. A Taxonomy of Designs Experimental Design Overview Rik Henson With thanks to: Karl Friston, Andrew Holmes 1. A Taxonomy of Designs 2. Epoch vs Event-related 3. Mixed Epoch/Event Designs designs designs - and nonlinear interactions

More information

Time Series and Forecasting

Time Series and Forecasting Time Series and Forecasting Introduction to Forecasting n What is forecasting? n Primary Function is to Predict the Future using (time series related or other) data we have in hand n Why are we interested?

More information

Independent Component Analysis. Contents

Independent Component Analysis. Contents Contents Preface xvii 1 Introduction 1 1.1 Linear representation of multivariate data 1 1.1.1 The general statistical setting 1 1.1.2 Dimension reduction methods 2 1.1.3 Independence as a guiding principle

More information

Homework #2 Due date: 2/19/2013 (Tuesday) Translate the slice Two Main Paths in Lecture Part II: Neurophysiology and BOLD to words.

Homework #2 Due date: 2/19/2013 (Tuesday) Translate the slice Two Main Paths in Lecture Part II: Neurophysiology and BOLD to words. Homework #2 Due date: 2/19/2013 (Tuesday) 1. What is BOLD? In your own words, fully explain the mechanism of BOLD fmri (from stimulus input to image voxel signal). (20 points) Translate the slice Two Main

More information

Statistics 203: Introduction to Regression and Analysis of Variance Course review

Statistics 203: Introduction to Regression and Analysis of Variance Course review Statistics 203: Introduction to Regression and Analysis of Variance Course review Jonathan Taylor - p. 1/?? Today Review / overview of what we learned. - p. 2/?? General themes in regression models Specifying

More information

HST.582J/6.555J/16.456J

HST.582J/6.555J/16.456J Blind Source Separation: PCA & ICA HST.582J/6.555J/16.456J Gari D. Clifford gari [at] mit. edu http://www.mit.edu/~gari G. D. Clifford 2005-2009 What is BSS? Assume an observation (signal) is a linear

More information

Time Series and Forecasting

Time Series and Forecasting Time Series and Forecasting Introduction to Forecasting n What is forecasting? n Primary Function is to Predict the Future using (time series related or other) data we have in hand n Why are we interested?

More information

at least 50 and preferably 100 observations should be available to build a proper model

at least 50 and preferably 100 observations should be available to build a proper model III Box-Jenkins Methods 1. Pros and Cons of ARIMA Forecasting a) need for data at least 50 and preferably 100 observations should be available to build a proper model used most frequently for hourly or

More information

Signal Modeling Techniques in Speech Recognition. Hassan A. Kingravi

Signal Modeling Techniques in Speech Recognition. Hassan A. Kingravi Signal Modeling Techniques in Speech Recognition Hassan A. Kingravi Outline Introduction Spectral Shaping Spectral Analysis Parameter Transforms Statistical Modeling Discussion Conclusions 1: Introduction

More information

Lecture 2: Univariate Time Series

Lecture 2: Univariate Time Series Lecture 2: Univariate Time Series Analysis: Conditional and Unconditional Densities, Stationarity, ARMA Processes Prof. Massimo Guidolin 20192 Financial Econometrics Spring/Winter 2017 Overview Motivation:

More information

MGR-815. Notes for the MGR-815 course. 12 June School of Superior Technology. Professor Zbigniew Dziong

MGR-815. Notes for the MGR-815 course. 12 June School of Superior Technology. Professor Zbigniew Dziong Modeling, Estimation and Control, for Telecommunication Networks Notes for the MGR-815 course 12 June 2010 School of Superior Technology Professor Zbigniew Dziong 1 Table of Contents Preface 5 1. Example

More information

New Machine Learning Methods for Neuroimaging

New Machine Learning Methods for Neuroimaging New Machine Learning Methods for Neuroimaging Gatsby Computational Neuroscience Unit University College London, UK Dept of Computer Science University of Helsinki, Finland Outline Resting-state networks

More information

Advanced Introduction to Machine Learning CMU-10715

Advanced Introduction to Machine Learning CMU-10715 Advanced Introduction to Machine Learning CMU-10715 Independent Component Analysis Barnabás Póczos Independent Component Analysis 2 Independent Component Analysis Model original signals Observations (Mixtures)

More information

Introduction to time-frequency analysis Centre for Doctoral Training in Healthcare Innovation

Introduction to time-frequency analysis Centre for Doctoral Training in Healthcare Innovation Introduction to time-frequency analysis Centre for Doctoral Training in Healthcare Innovation Dr. Gari D. Clifford, University Lecturer & Director, Centre for Doctoral Training in Healthcare Innovation,

More information

EEG/MEG Inverse Solution Driven by fmri

EEG/MEG Inverse Solution Driven by fmri EEG/MEG Inverse Solution Driven by fmri Yaroslav Halchenko CS @ NJIT 1 Functional Brain Imaging EEG ElectroEncephaloGram MEG MagnetoEncephaloGram fmri Functional Magnetic Resonance Imaging others 2 Functional

More information

Scenario 5: Internet Usage Solution. θ j

Scenario 5: Internet Usage Solution. θ j Scenario : Internet Usage Solution Some more information would be interesting about the study in order to know if we can generalize possible findings. For example: Does each data point consist of the total

More information

Classic Time Series Analysis

Classic Time Series Analysis Classic Time Series Analysis Concepts and Definitions Let Y be a random number with PDF f Y t ~f,t Define t =E[Y t ] m(t) is known as the trend Define the autocovariance t, s =COV [Y t,y s ] =E[ Y t t

More information

Diagnostics of Linear Regression

Diagnostics of Linear Regression Diagnostics of Linear Regression Junhui Qian October 7, 14 The Objectives After estimating a model, we should always perform diagnostics on the model. In particular, we should check whether the assumptions

More information

Neuroimage Processing

Neuroimage Processing Neuroimage Processing Instructor: Moo K. Chung mkchung@wisc.edu Lecture 2. General Linear Models (GLM) Multivariate General Linear Models (MGLM) September 11, 2009 Research Projects If you have your own

More information

MIXED EFFECTS MODELS FOR TIME SERIES

MIXED EFFECTS MODELS FOR TIME SERIES Outline MIXED EFFECTS MODELS FOR TIME SERIES Cristina Gorrostieta Hakmook Kang Hernando Ombao Brown University Biostatistics Section February 16, 2011 Outline OUTLINE OF TALK 1 SCIENTIFIC MOTIVATION 2

More information

NIH Public Access Author Manuscript Hum Brain Mapp. Author manuscript; available in PMC 2009 June 1.

NIH Public Access Author Manuscript Hum Brain Mapp. Author manuscript; available in PMC 2009 June 1. NIH Public Access Author Manuscript Published in final edited form as: Hum Brain Mapp. 2009 May ; 30(5): 1548 1567. doi:10.1002/hbm.20628. Estimating cerebral oxygen metabolism from fmri with a dynamic

More information

Elements of Multivariate Time Series Analysis

Elements of Multivariate Time Series Analysis Gregory C. Reinsel Elements of Multivariate Time Series Analysis Second Edition With 14 Figures Springer Contents Preface to the Second Edition Preface to the First Edition vii ix 1. Vector Time Series

More information

2015 U N I V E R S I T I T E K N O L O G I P E T R O N A S

2015 U N I V E R S I T I T E K N O L O G I P E T R O N A S Multi-Modality based Diagnosis: A way forward by Hafeez Ullah Amin Centre for Intelligent Signal and Imaging Research (CISIR) Department of Electrical & Electronic Engineering 2015 U N I V E R S I T I

More information

Time Series I Time Domain Methods

Time Series I Time Domain Methods Astrostatistics Summer School Penn State University University Park, PA 16802 May 21, 2007 Overview Filtering and the Likelihood Function Time series is the study of data consisting of a sequence of DEPENDENT

More information

In: W. von der Linden, V. Dose, R. Fischer and R. Preuss (eds.), Maximum Entropy and Bayesian Methods, Munich 1998, Dordrecht. Kluwer, pp

In: W. von der Linden, V. Dose, R. Fischer and R. Preuss (eds.), Maximum Entropy and Bayesian Methods, Munich 1998, Dordrecht. Kluwer, pp In: W. von der Linden, V. Dose, R. Fischer and R. Preuss (eds.), Maximum Entropy and Bayesian Methods, Munich 1998, Dordrecht. Kluwer, pp. 17-6. CONVERGENT BAYESIAN FORMULATIONS OF BLIND SOURCE SEPARATION

More information

Independent Component Analysis and Its Applications. By Qing Xue, 10/15/2004

Independent Component Analysis and Its Applications. By Qing Xue, 10/15/2004 Independent Component Analysis and Its Applications By Qing Xue, 10/15/2004 Outline Motivation of ICA Applications of ICA Principles of ICA estimation Algorithms for ICA Extensions of basic ICA framework

More information

Neuroscience Introduction

Neuroscience Introduction Neuroscience Introduction The brain As humans, we can identify galaxies light years away, we can study particles smaller than an atom. But we still haven t unlocked the mystery of the three pounds of matter

More information

Statistical and Adaptive Signal Processing

Statistical and Adaptive Signal Processing r Statistical and Adaptive Signal Processing Spectral Estimation, Signal Modeling, Adaptive Filtering and Array Processing Dimitris G. Manolakis Massachusetts Institute of Technology Lincoln Laboratory

More information

Heteroskedasticity in Time Series

Heteroskedasticity in Time Series Heteroskedasticity in Time Series Figure: Time Series of Daily NYSE Returns. 206 / 285 Key Fact 1: Stock Returns are Approximately Serially Uncorrelated Figure: Correlogram of Daily Stock Market Returns.

More information

Machine learning strategies for fmri analysis

Machine learning strategies for fmri analysis Machine learning strategies for fmri analysis DTU Informatics Technical University of Denmark Co-workers: Morten Mørup, Kristoffer Madsen, Peter Mondrup, Daniel Jacobsen, Stephen Strother,. OUTLINE Do

More information

THE DETECTION OF SHIFTS IN AUTOCORRELATED PROCESSES WITH MR AND EWMA CHARTS

THE DETECTION OF SHIFTS IN AUTOCORRELATED PROCESSES WITH MR AND EWMA CHARTS THE DETECTION OF SHIFTS IN AUTOCORRELATED PROCESSES WITH MR AND EWMA CHARTS Karin Kandananond, kandananond@hotmail.com Faculty of Industrial Technology, Rajabhat University Valaya-Alongkorn, Prathumthani,

More information

RECOGNITION ALGORITHM FOR DEVELOPING A BRAIN- COMPUTER INTERFACE USING FUNCTIONAL NEAR INFRARED SPECTROSCOPY

RECOGNITION ALGORITHM FOR DEVELOPING A BRAIN- COMPUTER INTERFACE USING FUNCTIONAL NEAR INFRARED SPECTROSCOPY The 212 International Conference on Green Technology and Sustainable Development (GTSD212) RECOGNITION ALGORITHM FOR DEVELOPING A BRAIN- COMPUTER INTERFACE USING FUNCTIONAL NEAR INFRARED SPECTROSCOPY Cuong

More information

General linear model: basic

General linear model: basic General linear model: basic Introducing General Linear Model (GLM): Start with an example Proper>es of the BOLD signal Linear Time Invariant (LTI) system The hemodynamic response func>on (Briefly) Evalua>ng

More information

Econometrics. 9) Heteroscedasticity and autocorrelation

Econometrics. 9) Heteroscedasticity and autocorrelation 30C00200 Econometrics 9) Heteroscedasticity and autocorrelation Timo Kuosmanen Professor, Ph.D. http://nomepre.net/index.php/timokuosmanen Today s topics Heteroscedasticity Possible causes Testing for

More information

NIRS-SPM: Statistical Parametric Mapping for Near Infrared Spectroscopy

NIRS-SPM: Statistical Parametric Mapping for Near Infrared Spectroscopy NIRS-SPM: Statistical Parametric Mapping for Near Infrared Spectroscopy Sungho Tak a, Kwang Eun Jang a, Jinwook Jung a, Jaeduck Jang a, Yong Jeong a,jongchulye a a Bio-Imaging and Signal Processing Lab.

More information

Experimental design of fmri studies & Resting-State fmri

Experimental design of fmri studies & Resting-State fmri Methods & Models for fmri Analysis 2016 Experimental design of fmri studies & Resting-State fmri Sandra Iglesias With many thanks for slides & images to: Klaas Enno Stephan, FIL Methods group, Christian

More information

A Data-Driven Model for Software Reliability Prediction

A Data-Driven Model for Software Reliability Prediction A Data-Driven Model for Software Reliability Prediction Author: Jung-Hua Lo IEEE International Conference on Granular Computing (2012) Young Taek Kim KAIST SE Lab. 9/4/2013 Contents Introduction Background

More information

Gatsby Theoretical Neuroscience Lectures: Non-Gaussian statistics and natural images Parts I-II

Gatsby Theoretical Neuroscience Lectures: Non-Gaussian statistics and natural images Parts I-II Gatsby Theoretical Neuroscience Lectures: Non-Gaussian statistics and natural images Parts I-II Gatsby Unit University College London 27 Feb 2017 Outline Part I: Theory of ICA Definition and difference

More information

2. An Introduction to Moving Average Models and ARMA Models

2. An Introduction to Moving Average Models and ARMA Models . An Introduction to Moving Average Models and ARMA Models.1 White Noise. The MA(1) model.3 The MA(q) model..4 Estimation and forecasting of MA models..5 ARMA(p,q) models. The Moving Average (MA) models

More information

Discrete time processes

Discrete time processes Discrete time processes Predictions are difficult. Especially about the future Mark Twain. Florian Herzog 2013 Modeling observed data When we model observed (realized) data, we encounter usually the following

More information

Diagnostic Test for GARCH Models Based on Absolute Residual Autocorrelations

Diagnostic Test for GARCH Models Based on Absolute Residual Autocorrelations Diagnostic Test for GARCH Models Based on Absolute Residual Autocorrelations Farhat Iqbal Department of Statistics, University of Balochistan Quetta-Pakistan farhatiqb@gmail.com Abstract In this paper

More information

HST.582J / 6.555J / J Biomedical Signal and Image Processing Spring 2007

HST.582J / 6.555J / J Biomedical Signal and Image Processing Spring 2007 MIT OpenCourseWare http://ocw.mit.edu HST.582J / 6.555J / 16.456J Biomedical Signal and Image Processing Spring 2007 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms.

More information

Automatic Autocorrelation and Spectral Analysis

Automatic Autocorrelation and Spectral Analysis Piet M.T. Broersen Automatic Autocorrelation and Spectral Analysis With 104 Figures Sprin ger 1 Introduction 1 1.1 Time Series Problems 1 2 Basic Concepts 11 2.1 Random Variables 11 2.2 Normal Distribution

More information

A nonparametric test for seasonal unit roots

A nonparametric test for seasonal unit roots Robert M. Kunst robert.kunst@univie.ac.at University of Vienna and Institute for Advanced Studies Vienna To be presented in Innsbruck November 7, 2007 Abstract We consider a nonparametric test for the

More information

ARIMA Modelling and Forecasting

ARIMA Modelling and Forecasting ARIMA Modelling and Forecasting Economic time series often appear nonstationary, because of trends, seasonal patterns, cycles, etc. However, the differences may appear stationary. Δx t x t x t 1 (first

More information

Variance. Standard deviation VAR = = value. Unbiased SD = SD = 10/23/2011. Functional Connectivity Correlation and Regression.

Variance. Standard deviation VAR = = value. Unbiased SD = SD = 10/23/2011. Functional Connectivity Correlation and Regression. 10/3/011 Functional Connectivity Correlation and Regression Variance VAR = Standard deviation Standard deviation SD = Unbiased SD = 1 10/3/011 Standard error Confidence interval SE = CI = = t value for

More information

Forward and inverse wave problems:quantum billiards and brain imaging p.1

Forward and inverse wave problems:quantum billiards and brain imaging p.1 Forward and inverse wave problems: Quantum billiards and brain imaging Alex Barnett barnett@cims.nyu.edu. Courant Institute Forward and inverse wave problems:quantum billiards and brain imaging p.1 The

More information

The General Linear Model Ivo Dinov

The General Linear Model Ivo Dinov Stats 33 Statistical Methods for Biomedical Data The General Linear Model Ivo Dinov dinov@stat.ucla.edu http://www.stat.ucla.edu/~dinov Slide 1 Problems with t-tests and correlations 1) How do we evaluate

More information

Chapter 3 - Temporal processes

Chapter 3 - Temporal processes STK4150 - Intro 1 Chapter 3 - Temporal processes Odd Kolbjørnsen and Geir Storvik January 23 2017 STK4150 - Intro 2 Temporal processes Data collected over time Past, present, future, change Temporal aspect

More information

Linear regression methods

Linear regression methods Linear regression methods Most of our intuition about statistical methods stem from linear regression. For observations i = 1,..., n, the model is Y i = p X ij β j + ε i, j=1 where Y i is the response

More information

Time Series Outlier Detection

Time Series Outlier Detection Time Series Outlier Detection Tingyi Zhu July 28, 2016 Tingyi Zhu Time Series Outlier Detection July 28, 2016 1 / 42 Outline Time Series Basics Outliers Detection in Single Time Series Outlier Series Detection

More information

Econ 300/QAC 201: Quantitative Methods in Economics/Applied Data Analysis. 17th Class 7/1/10

Econ 300/QAC 201: Quantitative Methods in Economics/Applied Data Analysis. 17th Class 7/1/10 Econ 300/QAC 201: Quantitative Methods in Economics/Applied Data Analysis 17th Class 7/1/10 The only function of economic forecasting is to make astrology look respectable. --John Kenneth Galbraith show

More information

Lecture notes to Stock and Watson chapter 4

Lecture notes to Stock and Watson chapter 4 Lecture notes to Stock and Watson chapter 4 Introductory linear regression Tore Schweder Sept 2009 TS () LN3 03/09 1 / 15 Regression "Regression" is due to Francis Galton (1822-1911): how is a son s height

More information

Neural Encoding Models

Neural Encoding Models Neural Encoding Models Maneesh Sahani maneesh@gatsby.ucl.ac.uk Gatsby Computational Neuroscience Unit University College London Term 1, Autumn 2011 Studying sensory systems x(t) y(t) Decoding: ˆx(t)= G[y(t)]

More information

Ref.: Spring SOS3003 Applied data analysis for social science Lecture note

Ref.:   Spring SOS3003 Applied data analysis for social science Lecture note SOS3003 Applied data analysis for social science Lecture note 05-2010 Erling Berge Department of sociology and political science NTNU Spring 2010 Erling Berge 2010 1 Literature Regression criticism I Hamilton

More information

Choice of Spectral Density Estimator in Ng-Perron Test: Comparative Analysis

Choice of Spectral Density Estimator in Ng-Perron Test: Comparative Analysis MPRA Munich Personal RePEc Archive Choice of Spectral Density Estimator in Ng-Perron Test: Comparative Analysis Muhammad Irfan Malik and Atiq-ur- Rehman International Institute of Islamic Economics, International

More information

Statistics: A review. Why statistics?

Statistics: A review. Why statistics? Statistics: A review Why statistics? What statistical concepts should we know? Why statistics? To summarize, to explore, to look for relations, to predict What kinds of data exist? Nominal, Ordinal, Interval

More information

Towards a Regression using Tensors

Towards a Regression using Tensors February 27, 2014 Outline Background 1 Background Linear Regression Tensorial Data Analysis 2 Definition Tensor Operation Tensor Decomposition 3 Model Attention Deficit Hyperactivity Disorder Data Analysis

More information

Artificial Neural Networks D B M G. Data Base and Data Mining Group of Politecnico di Torino. Elena Baralis. Politecnico di Torino

Artificial Neural Networks D B M G. Data Base and Data Mining Group of Politecnico di Torino. Elena Baralis. Politecnico di Torino Artificial Neural Networks Data Base and Data Mining Group of Politecnico di Torino Elena Baralis Politecnico di Torino Artificial Neural Networks Inspired to the structure of the human brain Neurons as

More information

Blind channel deconvolution of real world signals using source separation techniques

Blind channel deconvolution of real world signals using source separation techniques Blind channel deconvolution of real world signals using source separation techniques Jordi Solé-Casals 1, Enric Monte-Moreno 2 1 Signal Processing Group, University of Vic, Sagrada Família 7, 08500, Vic

More information

TAKEHOME FINAL EXAM e iω e 2iω e iω e 2iω

TAKEHOME FINAL EXAM e iω e 2iω e iω e 2iω ECO 513 Spring 2015 TAKEHOME FINAL EXAM (1) Suppose the univariate stochastic process y is ARMA(2,2) of the following form: y t = 1.6974y t 1.9604y t 2 + ε t 1.6628ε t 1 +.9216ε t 2, (1) where ε is i.i.d.

More information

Wavelet-MDL based detrending method for near infrared spectroscopy (NIRS)

Wavelet-MDL based detrending method for near infrared spectroscopy (NIRS) Wavelet-MDL based detrending method for near infrared spectroscopy (NIRS) Kwang Eun Jang, Sungho Tak, Jaeduck Jang, Jinwook Jung, and Jong Chul Ye a Korea Advanced Institute of Science and Technology (KAIST)

More information

ADAPTIVE FILTER THEORY

ADAPTIVE FILTER THEORY ADAPTIVE FILTER THEORY Fourth Edition Simon Haykin Communications Research Laboratory McMaster University Hamilton, Ontario, Canada Front ice Hall PRENTICE HALL Upper Saddle River, New Jersey 07458 Preface

More information

Dynamic Time Series Regression: A Panacea for Spurious Correlations

Dynamic Time Series Regression: A Panacea for Spurious Correlations International Journal of Scientific and Research Publications, Volume 6, Issue 10, October 2016 337 Dynamic Time Series Regression: A Panacea for Spurious Correlations Emmanuel Alphonsus Akpan *, Imoh

More information

Experimental design of fmri studies

Experimental design of fmri studies Experimental design of fmri studies Zurich SPM Course 2016 Sandra Iglesias Translational Neuromodeling Unit (TNU) Institute for Biomedical Engineering (IBT) University and ETH Zürich With many thanks for

More information