Experimental Design Initial GLM Intro. This Time
|
|
- Lucas Lawson
- 5 years ago
- Views:
Transcription
1 Eperimental Design Initial GLM Intr This Time
2
3
4 GLM General Linear Mdel Single subject fmri mdeling Single Subject fmri Data Data at ne vel Rest vs. passive wrd listening Is there an effect? Linear in parameters & Time A Linear Mdel = errr Intensity
5 Linear mdel, in image frm in image matri frm = = Y Y X in matri frm. Linear Mdel Predictrs Y X Y = p X p Signal Predictrs Blck designs Event-related respnses Nuisance Predictrs Drift Regressin parameters Y X N N N N: Number f scans, p: Number f regressrs Signal Predictrs Y X Cnvlutin Eamples Blck Design Event-Related Y X Linear Time-Invariant system LTI specified slely by Stimulus functin f eperiment Blcks Eperimental Stimulus Functin Hemdynamic Respnse Functin (HRF) Respnse t instantaneus impulse Events Hemdynamic Respnse Functin Predicted Respnse
6 LTI Pet Peeve LTI/cnvlutin apprach implies antisymmetry Shape f rise must match inverted shape f fall Bump here must match... Y X...bump here Cannical HRF Mst sensitive if it is crrect If wrng, leads t bias and/r pr fit E.g. True respnse may be faster/slwer E.g. True respnse may have smaller/ bigger undersht HRF Mdels SPM s HRF Y X HRF Mdels Y X HRF Mdels Y X Smth Basis HRFs Mre fleible Less interpretable N ne parameter eplains the respnse Less sensitive relative t cannical (nly if cannical is crrect) Gamma Basis Decnvlutin Mst fleible Allws any shape Even bizarre, nn-sensical nes Least sensitive relative t cannical (again, if cannical is crrect) Decnvlutin Basis Furier Basis Drift Mdels Drift Slwly varying Nuisance variability Even seen in cadavers! A. Smith et al, NI, 999, 9: Mdels Linear, quadratic Discrete Csine Transfrm Y X Sme Terminlgy SPM ( Statistical Parametric Mapping ) is a massively univariate apprach - meaning that a statistic (e.g., T-value) is calculated fr every vel - using the General Linear Mdel Eperimental manipulatins are specified in a mdel ( design matri ) which is fit t each vel t estimate the size f the eperimental effects ( parameter estimates ) in that vel n which ne r mre hyptheses ( cntrasts ) are tested t make statistical inferences ( p-values ), crrecting fr multiple cmparisns acrss vels (using Randm Field Thery ) Discrete Csine Transfrm Basis The parametric statistics assume cntinuus-valued data and additive nise that cnfrms t a Gaussian distributin ( nnparametric versin SNPM eschews such assumptins)
7 Sme Terminlgy Overview SPM usually fcused n functinal specializatin - i.e. lcalizing different functins t different regins in the brain One might als be interested in functinal integratin - hw different regins (vels) interact Multivariate appraches wrk n whle images and can identify spatial/tempral patterns ver vels, withut necessarily specifying a design matri (PCA, ICA)... r with an eperimental design matri (PLS, CVA), r with an eplicit anatmical mdel f cnnectivity between regins - effective cnnectivity - eg using Dynamic Causal Mdeling. General Linear Mdel Design Matri Estimatin/Cntrasts Cvariates (eg glbal) Estimability/Crrelatin. fmri timeseries Highpass filtering HRF cnvlutin Autcrrelatin (nnsphericity) Overview. General Linear Mdel Design Matri Estimatin/Cntrasts Cvariates (eg glbal) Estimability/Crrelatin. fmri timeseries Highpass filtering HRF cnvlutin Autcrrelatin (nnsphericity) General Linear Mdel Parametric statistics ne sample t-test tw sample t-test paired t-test Anva AnCva crrelatin linear regressin multiple regressin F-tests etc all cases f the General Linear Mdel General Linear Mdel Equatin fr single (and all) vels: Matri Frmulatin Equatin fr scan j y j = j jl L j j ~ N(0, ) y j jl l j : data fr scan, j = J : eplanatry variables / cvariates / regressrs, l = L : parameters / regressin slpes / fied effects : residual errrs, independent & identically distributed ( iid ) (Gaussian, mean f zer and standard deviatin f σ) Simultaneus equatins fr scans.. J Regressrs that can be slved fr parameters.. L Equivalent matri frm: y = X Scans X : design matri / mdel
8 Overview General Linear Mdel (Estimatin) Estimate parameters frm least squares fit t data, y:. General Linear Mdel Design Matri Estimatin/Cntrasts Cvariates (eg glbal) Estimability/Crrelatin. fmri timeseries Highpass filtering HRF cnvlutin Autcrrelatin (nnsphericity) ^ = (X T X) - X T y = X y (OLS estimates) Fitted respnse is: ^ Y = X Residual errrs and estimated errr variance are: ^ = y - Y ^ = ^ T ^/ df where df are the degrees f freedm (assuming iid): df = J - rank(x) (=J-L if X full rank) ( R = I - XX = Ry df = trace(r) ) Simple LS Derivatin GLM Estimatin Gemetric Perspective Y = y y = y X X y DATA (y, y, y 3 ) ^RESIDUALS = ( ^ ^ ^ ) T X (,, 3) Y (Y,Y,Y 3 ) O X (,,) design space General Linear Mdel (Inference) Z-scre and T-statistic Specify cntrast (hypthesis), c, a linear cmbinatin ^ f parameter estimates, c T Calculate T-statistic fr that cntrast: ^ ^ ^ T = c T / std(c T ) = c T / sqrt(^ c T (X T X) - c) (c is a vectr), r an F-statistic: F = [( 0T ε 0 ε T ε) / (L-L 0 )] / [ε T ε / (J-L)] where ε 0 and L 0 are residuals and rank resp. frm the reduced mdel specified by c (which is a matri) Prb. f falsely rejecting Null hypthesis, H 0 : c T =0 ( p-value ) T F T-distributin p( t 0) c = [ - 0 0] c = [ ] u t f ( y) Z T s s s N The z-scre describes the relative lcatin f a particular scre () when the mean (μ) and standard deviatin (σ) are knwn The t-scre describes the relative lcatin f the sample mean () when the ppulatin mean is knwn and the ppulatin standard deviatin is estimated with the sample standard deviatin (s)
9 Simple ANOVA-like Eample Overview scans, 3 cnditins (-way ANOVA) y j = j j 3j 3 4j 4 j where (dummy) variables: j = [0,] = cnditin A (first 4 scans) j = [0,] = cnditin B (secnd 4 scans) 3j = [0,] = cnditin C (third 4 scans) 4j = [] = grand mean T-cntrast : [ - 0 0] tests whether A>B [- 0 0] tests whether B>A F-cntrast: [ ] tests main effect f A,B,C = rank(x)= c=[- 0 0], T=0/sqrt(3.3*8) df=-3=9, T(9)=.94, p<.05. General Linear Mdel Design Matri Estimatin/Cntrasts Cvariates (eg glbal) Estimability/Crrelatin. fmri timeseries Highpass filtering HRF cnvlutin Autcrrelatin (nnsphericity) Glbal Effects Simple ANCOVA Eample May be variatin in verall image intensity frm scan t scan rcbf rcbf scans, 3 cnditins, cnfunding cvariate Such glbal changes may cnfund lcal / reginal induced by eperiment Adjust fr glbal effects by: - AnCva (Additive Mdel) - PET? - Prprtinal Scaling - fmri? Can imprve statistics when rthgnal t effects f interest (as here) but can als wrsen when effects f interest crrelated with glbal (as net) rcbf (adj) k rcbf k rcbf 0 0 AnCva Scaling g.. glbal gcbf k glbal gcbf glbal gcbf 50 y j = j j 3j 3 4j 4 5j 5 j where (dummy) variables: j = [0,] = cnditin A (first 4 scans) j = [0,] = cnditin B (secnd 4 scans) 3j = [0,] = cnditin C (third 4 scans) 4j = grand mean 5j = glbal signal (mean ver all vels) (further mean-crrected ver all scans) Glbal crrelated here with cnditins (and time) = c=[- 0 0], T=3.3/sqrt(3.8*8) df=-4=8, T(8)=0.6, p>.05 Glbal Effects (fmri) Overview Tw types f scaling: Grand Mean scaling and Glbal scaling Grand Mean scaling is autmatic, glbal scaling is ptinal Grand Mean scales by 00/mean ver all vels and ALL scans (i.e, single number per sessin) Glbal scaling scales by 00/mean ver all vels fr EACH scan (i.e, a different scaling factr every scan) Prblem with glbal scaling is that TRUE glbal is nt (nrmally) knwn we nly estimate it by the mean ver vels S if there is a large signal change ver many vels, the glbal estimate will be cnfunded by lcal changes This can prduce artifactual deactivatins in ther regins after glbal scaling Since mst surces f glbal variability in fmri are lw frequency (drift), high-pass filtering may be sufficient, and many peple t nt use glbal scaling. General Linear Mdel Design Matri Estimatin/Cntrasts Cvariates (eg glbal) Estimability/Crrelatin. fmri timeseries Highpass filtering HRF cnvlutin Autcrrelatin (nnsphericity)
10 A wrd n crrelatin/estimability A wrd n crrelatin/estimability If any clumn f X is a linear cmbinatin f any thers (X is rank deficient), sme parameters cannt be estimated uniquely (inestimable) which means sme cntrasts cannt be tested (eg, nly if sum t zer) This has implicatins fr whether baseline (cnstant term) is eplicitly r implicitly mdelled Rank deficiency can be thught f as perfect crrelatin rank(x)= = 0.9 = 0.7 c d * = [ 0]*= 0.9 c m = [ 0 0] c d = [ - 0] A B AB implicit =.6 c m = [ = 0.7 0] c d = [ - ] A B c d * = [ -]*= 0.9 eplicit A AB c d = [ 0] When there is high (but nt perfect) crrelatin between regressrs, parameters can be estimated but the estimates will be inefficiently estimated (ie highly variable) meaning sme cntrasts will nt lead t very pwerful tests SPM shws pairwise crrelatin between regressrs but this will NOT tell yu that, eg, X X is highly crrelated with X 3 s sme cntrasts can still be inefficient/efficient, even thugh pairwise crrelatins are lw/high A B AB cnvlved with HRF! A B AB c m = [ 0 0] c d = [ - 0] c m = [ 0 0] () c d = [ - 0] A wrd n rthgnalizatin A wrd n rthgnalizatin T remve crrelatin between tw regressrs, yu can eplicitly rthgnalize ne (X ) with respect t the ther (X ): X = X (X X )X (Gram-Schmidt) Y X X = 0.9 = 0.7 Paradically, this will NOT change the parameter estimate fr X, but will fr X In ther wrds, the parameter estimate fr the rthgnalized regressr is unchanged! This reflects fact that parameter estimates autmatically reflect rthgnal cmpnent f each regressr s n need t rthgnalize, UNLESS yu have a priri reasn fr assigning cmmn variance t the ther regressr X X X Orthgnalize X (Mdel M) X X (M) =.6 (M) = 0.7 Orthgnalize X (Mdel M) X X (M) = 0.9 =. = = ( Overview fmri Analysis. General Linear Mdel Design Matri Estimatin/Cntrasts Cvariates (eg glbal) Estimability/Crrelatin. fmri timeseries Highpass filtering HRF cnvlutin Autcrrelatin (nnsphericity) Scans are treated as a timeseries and can be filtered t remve lw-frequency (/f) nise Effects f interest are cnvlved with haemdynamic respnse functin (HRF), t capture sluggish nature f (BOLD) respnse Scans can n lnger be treated as independent bservatins they are typically temprally autcrrelated (fr TRs<8s)
11 fmri Analysis (Epch) fmri eample Scans are treated as a timeseries and can be filtered t remve lw-frequency (/f) nise Effects f interest are cnvlved with haemdynamic respnse functin (HRF), t capture sluggish nature f (BOLD) respnse Scans can n lnger be treated as independent bservatins they are typically temprally autcrrelated (fr TRs<8s) = (t) (b-car uncnvlved) vel timeseries b-car functin baseline (mean) (Epch) fmri eample Lw frequency nise Lw frequency nise: Physical (scanner drifts) Physilgical (aliased) cardiac (~ Hz) respiratry (~0.5 Hz) aliasing = pwer spectrum nise signal (eg infinite 30s n-ff) pwer spectrum highpass filter y = X (Epch) fmri eample...with highpass filter (Epch) fmri eample fitted and adjusted data Raw fmri timeseries Adjusted data fitted b-car = highpass filtered (and scaled) Residuals fitted high-pass filter y = X
12 fmri Analysis Cnvlutin with HRF Uncnvlved fit Residuals Scans are treated as a timeseries and can be filtered t remve lw-frequency (/f) nise Effects f interest are cnvlved with haemdynamic respnse functin (HRF), t capture sluggish nature f (BOLD) respnse = Scans can n lnger be treated as independent bservatins they are typically temprally autcrrelated (fr TRs<8s) Bcar functin Cnvlved fit hæmdynamic respnse cnvlved with HRF Residuals (less structure) fmri Analysis Tempral autcrrelatin Scans are treated as a timeseries and can be filtered t remve lw-frequency (/f) nise Effects f interest are cnvlved with haemdynamic respnse functin (HRF), t capture sluggish nature f (BOLD) respnse Scans can n lnger be treated as independent bservatins they are typically temprally autcrrelated (fr TRs<8s) Because the data are typically crrelated frm ne scan t the net, ne cannt assume the degrees f freedm (dfs) are simply the number f scans minus the dfs used in the mdel need effective degrees f freedm In ther wrds, the residual errrs are nt independent: Y = X ~ N(0, V) V I, V=AA' where A is the intrinsic autcrrelatin Generalized least squares: KY = KX K K ~ N(0, V) V = KAA'K' (autcrrelatin is a special case f nnsphericity ) Linear Mdel Errrs Tw sample cvariance matrices... Cv( ) Cv( ) N Y X Cnclusin GLM Encmpasses almst any statistical mdel yu need Imprtant t accunt fr fmri autcrrelatin Cntrasts Way f interrgating GLM T cntrasts (is this effect psitive [negative]?) F cntrasts (are ne r mre f these effects different frm zer?) N independence autcrrelatin
The general linear model and Statistical Parametric Mapping I: Introduction to the GLM
The general linear mdel and Statistical Parametric Mapping I: Intrductin t the GLM Alexa Mrcm and Stefan Kiebel, Rik Hensn, Andrew Hlmes & J-B J Pline Overview Intrductin Essential cncepts Mdelling Design
More informationContents. Introduction & recap. The General Linear Model, Part II. F-test and added variance Good & bad models Improvedmodel
DISCOS SPM curse, CRC, Liège, 2009 Cntents The General Linear Mdel, Part II C. Phillips, Centre de Recherches du Cycltrn, ULg, Belgium Based n slides frm: T. Nichls, R. Hensn, S. Kiebel, JB. Pline Intrductin
More informationLecture 2: Supervised vs. unsupervised learning, bias-variance tradeoff
Lecture 2: Supervised vs. unsupervised learning, bias-variance tradeff Reading: Chapter 2 STATS 202: Data mining and analysis September 27, 2017 1 / 20 Supervised vs. unsupervised learning In unsupervised
More informationInternal vs. external validity. External validity. This section is based on Stock and Watson s Chapter 9.
Sectin 7 Mdel Assessment This sectin is based n Stck and Watsn s Chapter 9. Internal vs. external validity Internal validity refers t whether the analysis is valid fr the ppulatin and sample being studied.
More informationLecture 2: Supervised vs. unsupervised learning, bias-variance tradeoff
Lecture 2: Supervised vs. unsupervised learning, bias-variance tradeff Reading: Chapter 2 STATS 202: Data mining and analysis September 27, 2017 1 / 20 Supervised vs. unsupervised learning In unsupervised
More informationModelling of Clock Behaviour. Don Percival. Applied Physics Laboratory University of Washington Seattle, Washington, USA
Mdelling f Clck Behaviur Dn Percival Applied Physics Labratry University f Washingtn Seattle, Washingtn, USA verheads and paper fr talk available at http://faculty.washingtn.edu/dbp/talks.html 1 Overview
More informationCAUSAL INFERENCE. Technical Track Session I. Phillippe Leite. The World Bank
CAUSAL INFERENCE Technical Track Sessin I Phillippe Leite The Wrld Bank These slides were develped by Christel Vermeersch and mdified by Phillippe Leite fr the purpse f this wrkshp Plicy questins are causal
More informationComparing Several Means: ANOVA. Group Means and Grand Mean
STAT 511 ANOVA and Regressin 1 Cmparing Several Means: ANOVA Slide 1 Blue Lake snap beans were grwn in 12 pen-tp chambers which are subject t 4 treatments 3 each with O 3 and SO 2 present/absent. The ttal
More informationA Matrix Representation of Panel Data
web Extensin 6 Appendix 6.A A Matrix Representatin f Panel Data Panel data mdels cme in tw brad varieties, distinct intercept DGPs and errr cmpnent DGPs. his appendix presents matrix algebra representatins
More informationDistributions, spatial statistics and a Bayesian perspective
Distributins, spatial statistics and a Bayesian perspective Dug Nychka Natinal Center fr Atmspheric Research Distributins and densities Cnditinal distributins and Bayes Thm Bivariate nrmal Spatial statistics
More informationCHAPTER 24: INFERENCE IN REGRESSION. Chapter 24: Make inferences about the population from which the sample data came.
MATH 1342 Ch. 24 April 25 and 27, 2013 Page 1 f 5 CHAPTER 24: INFERENCE IN REGRESSION Chapters 4 and 5: Relatinships between tw quantitative variables. Be able t Make a graph (scatterplt) Summarize the
More informationPSU GISPOPSCI June 2011 Ordinary Least Squares & Spatial Linear Regression in GeoDa
There are tw parts t this lab. The first is intended t demnstrate hw t request and interpret the spatial diagnstics f a standard OLS regressin mdel using GeDa. The diagnstics prvide infrmatin abut the
More informationSAMPLING DYNAMICAL SYSTEMS
SAMPLING DYNAMICAL SYSTEMS Melvin J. Hinich Applied Research Labratries The University f Texas at Austin Austin, TX 78713-8029, USA (512) 835-3278 (Vice) 835-3259 (Fax) hinich@mail.la.utexas.edu ABSTRACT
More informationx 1 Outline IAML: Logistic Regression Decision Boundaries Example Data
Outline IAML: Lgistic Regressin Charles Suttn and Victr Lavrenk Schl f Infrmatics Semester Lgistic functin Lgistic regressin Learning lgistic regressin Optimizatin The pwer f nn-linear basis functins Least-squares
More informationGroup Analysis: Hands-On
Grup Analysis: Hands-On Gang Chen SSCC/NIMH/NIH/HHS 3/19/16 1 Make sure yu have the files!! Under directry grup_analysis_hands_n/! Slides: GrupAna_HO.pdf! Data: AFNI_data6/GrupAna_cases/! In case yu dn
More informationInference in the Multiple-Regression
Sectin 5 Mdel Inference in the Multiple-Regressin Kinds f hypthesis tests in a multiple regressin There are several distinct kinds f hypthesis tests we can run in a multiple regressin. Suppse that amng
More informationk-nearest Neighbor How to choose k Average of k points more reliable when: Large k: noise in attributes +o o noise in class labels
Mtivating Example Memry-Based Learning Instance-Based Learning K-earest eighbr Inductive Assumptin Similar inputs map t similar utputs If nt true => learning is impssible If true => learning reduces t
More informationENSC Discrete Time Systems. Project Outline. Semester
ENSC 49 - iscrete Time Systems Prject Outline Semester 006-1. Objectives The gal f the prject is t design a channel fading simulatr. Upn successful cmpletin f the prject, yu will reinfrce yur understanding
More informationSimple Linear Regression (single variable)
Simple Linear Regressin (single variable) Intrductin t Machine Learning Marek Petrik January 31, 2017 Sme f the figures in this presentatin are taken frm An Intrductin t Statistical Learning, with applicatins
More informationPattern Recognition 2014 Support Vector Machines
Pattern Recgnitin 2014 Supprt Vectr Machines Ad Feelders Universiteit Utrecht Ad Feelders ( Universiteit Utrecht ) Pattern Recgnitin 1 / 55 Overview 1 Separable Case 2 Kernel Functins 3 Allwing Errrs (Sft
More informationWhat is Statistical Learning?
What is Statistical Learning? Sales 5 10 15 20 25 Sales 5 10 15 20 25 Sales 5 10 15 20 25 0 50 100 200 300 TV 0 10 20 30 40 50 Radi 0 20 40 60 80 100 Newspaper Shwn are Sales vs TV, Radi and Newspaper,
More informationAP Statistics Practice Test Unit Three Exploring Relationships Between Variables. Name Period Date
AP Statistics Practice Test Unit Three Explring Relatinships Between Variables Name Perid Date True r False: 1. Crrelatin and regressin require explanatry and respnse variables. 1. 2. Every least squares
More informationDetermining the Accuracy of Modal Parameter Estimation Methods
Determining the Accuracy f Mdal Parameter Estimatin Methds by Michael Lee Ph.D., P.E. & Mar Richardsn Ph.D. Structural Measurement Systems Milpitas, CA Abstract The mst cmmn type f mdal testing system
More informationINSTRUMENTAL VARIABLES
INSTRUMENTAL VARIABLES Technical Track Sessin IV Sergi Urzua University f Maryland Instrumental Variables and IE Tw main uses f IV in impact evaluatin: 1. Crrect fr difference between assignment f treatment
More informationResampling Methods. Chapter 5. Chapter 5 1 / 52
Resampling Methds Chapter 5 Chapter 5 1 / 52 1 51 Validatin set apprach 2 52 Crss validatin 3 53 Btstrap Chapter 5 2 / 52 Abut Resampling An imprtant statistical tl Pretending the data as ppulatin and
More informationCOMP 551 Applied Machine Learning Lecture 9: Support Vector Machines (cont d)
COMP 551 Applied Machine Learning Lecture 9: Supprt Vectr Machines (cnt d) Instructr: Herke van Hf (herke.vanhf@mail.mcgill.ca) Slides mstly by: Class web page: www.cs.mcgill.ca/~hvanh2/cmp551 Unless therwise
More informationKinetic Model Completeness
5.68J/10.652J Spring 2003 Lecture Ntes Tuesday April 15, 2003 Kinetic Mdel Cmpleteness We say a chemical kinetic mdel is cmplete fr a particular reactin cnditin when it cntains all the species and reactins
More informationExcessive Social Imbalances and the Performance of Welfare States in the EU. Frank Vandenbroucke, Ron Diris and Gerlinde Verbist
Excessive Scial Imbalances and the Perfrmance f Welfare States in the EU Frank Vandenbrucke, Rn Diris and Gerlinde Verbist Child pverty in the Eurzne, SILC 2008 35.00 30.00 25.00 20.00 15.00 10.00 5.00.00
More informationKeysight Technologies Understanding the Kramers-Kronig Relation Using A Pictorial Proof
Keysight Technlgies Understanding the Kramers-Krnig Relatin Using A Pictrial Prf By Clin Warwick, Signal Integrity Prduct Manager, Keysight EEsf EDA White Paper Intrductin In principle, applicatin f the
More informationKinematic transformation of mechanical behavior Neville Hogan
inematic transfrmatin f mechanical behavir Neville Hgan Generalized crdinates are fundamental If we assume that a linkage may accurately be described as a cllectin f linked rigid bdies, their generalized
More informationComputational modeling techniques
Cmputatinal mdeling techniques Lecture 2: Mdeling change. In Petre Department f IT, Åb Akademi http://users.ab.fi/ipetre/cmpmd/ Cntent f the lecture Basic paradigm f mdeling change Examples Linear dynamical
More informationPart 3 Introduction to statistical classification techniques
Part 3 Intrductin t statistical classificatin techniques Machine Learning, Part 3, March 07 Fabi Rli Preamble ØIn Part we have seen that if we knw: Psterir prbabilities P(ω i / ) Or the equivalent terms
More informationMath Foundations 20 Work Plan
Math Fundatins 20 Wrk Plan Units / Tpics 20.8 Demnstrate understanding f systems f linear inequalities in tw variables. Time Frame December 1-3 weeks 6-10 Majr Learning Indicatrs Identify situatins relevant
More informationElements of Machine Intelligence - I
ECE-175A Elements f Machine Intelligence - I Ken Kreutz-Delgad Nun Vascncels ECE Department, UCSD Winter 2011 The curse The curse will cver basic, but imprtant, aspects f machine learning and pattern recgnitin
More informationComputational modeling techniques
Cmputatinal mdeling techniques Lecture 11: Mdeling with systems f ODEs In Petre Department f IT, Ab Akademi http://www.users.ab.fi/ipetre/cmpmd/ Mdeling with differential equatins Mdeling strategy Fcus
More informationIN a recent article, Geary [1972] discussed the merit of taking first differences
The Efficiency f Taking First Differences in Regressin Analysis: A Nte J. A. TILLMAN IN a recent article, Geary [1972] discussed the merit f taking first differences t deal with the prblems that trends
More informationCOMP 551 Applied Machine Learning Lecture 5: Generative models for linear classification
COMP 551 Applied Machine Learning Lecture 5: Generative mdels fr linear classificatin Instructr: Herke van Hf (herke.vanhf@mail.mcgill.ca) Slides mstly by: Jelle Pineau Class web page: www.cs.mcgill.ca/~hvanh2/cmp551
More informationBootstrap Method > # Purpose: understand how bootstrap method works > obs=c(11.96, 5.03, 67.40, 16.07, 31.50, 7.73, 11.10, 22.38) > n=length(obs) >
Btstrap Methd > # Purpse: understand hw btstrap methd wrks > bs=c(11.96, 5.03, 67.40, 16.07, 31.50, 7.73, 11.10, 22.38) > n=length(bs) > mean(bs) [1] 21.64625 > # estimate f lambda > lambda = 1/mean(bs);
More informationSection 11 Simultaneous Equations
Sectin 11 Simultaneus Equatins The mst crucial f ur OLS assumptins (which carry er t mst f the ther estimatrs that we hae studied) is that the regressrs be exgenus uncrrelated with the errr term This assumptin
More information1 The limitations of Hartree Fock approximation
Chapter: Pst-Hartree Fck Methds - I The limitatins f Hartree Fck apprximatin The n electrn single determinant Hartree Fck wave functin is the variatinal best amng all pssible n electrn single determinants
More information3.4 Shrinkage Methods Prostate Cancer Data Example (Continued) Ridge Regression
3.3.4 Prstate Cancer Data Example (Cntinued) 3.4 Shrinkage Methds 61 Table 3.3 shws the cefficients frm a number f different selectin and shrinkage methds. They are best-subset selectin using an all-subsets
More informationIntroduction to Quantitative Genetics II: Resemblance Between Relatives
Intrductin t Quantitative Genetics II: Resemblance Between Relatives Bruce Walsh 8 Nvember 006 EEB 600A The heritability f a trait, a central cncept in quantitative genetics, is the prprtin f variatin
More informationReview Problems 3. Four FIR Filter Types
Review Prblems 3 Fur FIR Filter Types Fur types f FIR linear phase digital filters have cefficients h(n fr 0 n M. They are defined as fllws: Type I: h(n = h(m-n and M even. Type II: h(n = h(m-n and M dd.
More informationStatistics, Numerical Models and Ensembles
Statistics, Numerical Mdels and Ensembles Duglas Nychka, Reinhard Furrer,, Dan Cley Claudia Tebaldi, Linda Mearns, Jerry Meehl and Richard Smith (UNC). Spatial predictin and data assimilatin Precipitatin
More informationApplication of ILIUM to the estimation of the T eff [Fe/H] pair from BP/RP
Applicatin f ILIUM t the estimatin f the T eff [Fe/H] pair frm BP/RP prepared by: apprved by: reference: issue: 1 revisin: 1 date: 2009-02-10 status: Issued Cryn A.L. Bailer-Jnes Max Planck Institute fr
More informationFIELD QUALITY IN ACCELERATOR MAGNETS
FIELD QUALITY IN ACCELERATOR MAGNETS S. Russenschuck CERN, 1211 Geneva 23, Switzerland Abstract The field quality in the supercnducting magnets is expressed in terms f the cefficients f the Furier series
More informationHypothesis Tests for One Population Mean
Hypthesis Tests fr One Ppulatin Mean Chapter 9 Ala Abdelbaki Objective Objective: T estimate the value f ne ppulatin mean Inferential statistics using statistics in rder t estimate parameters We will be
More information4th Indian Institute of Astrophysics - PennState Astrostatistics School July, 2013 Vainu Bappu Observatory, Kavalur. Correlation and Regression
4th Indian Institute f Astrphysics - PennState Astrstatistics Schl July, 2013 Vainu Bappu Observatry, Kavalur Crrelatin and Regressin Rahul Ry Indian Statistical Institute, Delhi. Crrelatin Cnsider a tw
More informationCOMP 551 Applied Machine Learning Lecture 4: Linear classification
COMP 551 Applied Machine Learning Lecture 4: Linear classificatin Instructr: Jelle Pineau (jpineau@cs.mcgill.ca) Class web page: www.cs.mcgill.ca/~jpineau/cmp551 Unless therwise nted, all material psted
More informationSURVIVAL ANALYSIS WITH SUPPORT VECTOR MACHINES
1 SURVIVAL ANALYSIS WITH SUPPORT VECTOR MACHINES Wlfgang HÄRDLE Ruslan MORO Center fr Applied Statistics and Ecnmics (CASE), Humbldt-Universität zu Berlin Mtivatin 2 Applicatins in Medicine estimatin f
More informationPerfrmance f Sensitizing Rules n Shewhart Cntrl Charts with Autcrrelated Data Key Wrds: Autregressive, Mving Average, Runs Tests, Shewhart Cntrl Chart
Perfrmance f Sensitizing Rules n Shewhart Cntrl Charts with Autcrrelated Data Sandy D. Balkin Dennis K. J. Lin y Pennsylvania State University, University Park, PA 16802 Sandy Balkin is a graduate student
More informationCHAPTER 4 DIAGNOSTICS FOR INFLUENTIAL OBSERVATIONS
CHAPTER 4 DIAGNOSTICS FOR INFLUENTIAL OBSERVATIONS 1 Influential bservatins are bservatins whse presence in the data can have a distrting effect n the parameter estimates and pssibly the entire analysis,
More informationMATCHING TECHNIQUES Technical Track Session VI Céline Ferré The World Bank
MATCHING TECHNIQUES Technical Track Sessin VI Céline Ferré The Wrld Bank When can we use matching? What if the assignment t the treatment is nt dne randmly r based n an eligibility index, but n the basis
More informationMore Tutorial at
Answer each questin in the space prvided; use back f page if extra space is needed. Answer questins s the grader can READILY understand yur wrk; nly wrk n the exam sheet will be cnsidered. Write answers,
More informationMATCHING TECHNIQUES. Technical Track Session VI. Emanuela Galasso. The World Bank
MATCHING TECHNIQUES Technical Track Sessin VI Emanuela Galass The Wrld Bank These slides were develped by Christel Vermeersch and mdified by Emanuela Galass fr the purpse f this wrkshp When can we use
More informationLecture 24: Flory-Huggins Theory
Lecture 24: 12.07.05 Flry-Huggins Thery Tday: LAST TIME...2 Lattice Mdels f Slutins...2 ENTROPY OF MIXING IN THE FLORY-HUGGINS MODEL...3 CONFIGURATIONS OF A SINGLE CHAIN...3 COUNTING CONFIGURATIONS FOR
More informationResampling Methods. Cross-validation, Bootstrapping. Marek Petrik 2/21/2017
Resampling Methds Crss-validatin, Btstrapping Marek Petrik 2/21/2017 Sme f the figures in this presentatin are taken frm An Intrductin t Statistical Learning, with applicatins in R (Springer, 2013) with
More informationMultiple Source Multiple. using Network Coding
Multiple Surce Multiple Destinatin Tplgy Inference using Netwrk Cding Pegah Sattari EECS, UC Irvine Jint wrk with Athina Markpulu, at UCI, Christina Fraguli, at EPFL, Lausanne Outline Netwrk Tmgraphy Gal,
More informationStatistics Statistical method Variables Value Score Type of Research Level of Measurement...
Lecture 1 Displaying data... 12 Statistics... 13 Statistical methd... 13 Variables... 13 Value... 15 Scre... 15 Type f Research... 15 Level f Measurement... 15 Numeric/Quantitative variables... 15 Ordinal/Rank-rder
More informationChapter Summary. Mathematical Induction Strong Induction Recursive Definitions Structural Induction Recursive Algorithms
Chapter 5 1 Chapter Summary Mathematical Inductin Strng Inductin Recursive Definitins Structural Inductin Recursive Algrithms Sectin 5.1 3 Sectin Summary Mathematical Inductin Examples f Prf by Mathematical
More informationFunctional Form and Nonlinearities
Sectin 6 Functinal Frm and Nnlinearities This is a gd place t remind urselves f Assumptin #0: That all bservatins fllw the same mdel. Levels f measurement and kinds f variables There are (at least) three
More informationSnow avalanche runout from two Canadian mountain ranges
Annals f Glacilgy 18 1993 Internati n al Glaciigicai Sciety Snw avalanche runut frm tw Canadian muntain ranges D.J. NIXON AND D. M. MCCLUNG Department f Civil Engineering, University f British Clumbia,
More informationENG2410 Digital Design Sequential Circuits: Part A
ENG2410 Digital Design Sequential Circuits: Part A Fall 2017 S. Areibi Schl f Engineering University f Guelph Week #6 Tpics Sequential Circuit Definitins Latches Flip-Flps Delays in Sequential Circuits
More informationMidwest Big Data Summer School: Machine Learning I: Introduction. Kris De Brabanter
Midwest Big Data Summer Schl: Machine Learning I: Intrductin Kris De Brabanter kbrabant@iastate.edu Iwa State University Department f Statistics Department f Cmputer Science June 24, 2016 1/24 Outline
More informationData Analysis, Statistics, Machine Learning
Data Analysis, Statistics, Machine Learning Leland Wilkinsn Adjunct Prfessr UIC Cmputer Science Chief Scien
More informationSource Coding and Compression
Surce Cding and Cmpressin Heik Schwarz Cntact: Dr.-Ing. Heik Schwarz heik.schwarz@hhi.fraunhfer.de Heik Schwarz Surce Cding and Cmpressin September 22, 2013 1 / 60 PartI: Surce Cding Fundamentals Heik
More informationLecture 10, Principal Component Analysis
Principal Cmpnent Analysis Lecture 10, Principal Cmpnent Analysis Ha Helen Zhang Fall 2017 Ha Helen Zhang Lecture 10, Principal Cmpnent Analysis 1 / 16 Principal Cmpnent Analysis Lecture 10, Principal
More informationEric Klein and Ning Sa
Week 12. Statistical Appraches t Netwrks: p1 and p* Wasserman and Faust Chapter 15: Statistical Analysis f Single Relatinal Netwrks There are fur tasks in psitinal analysis: 1) Define Equivalence 2) Measure
More informationYou need to be able to define the following terms and answer basic questions about them:
CS440/ECE448 Sectin Q Fall 2017 Midterm Review Yu need t be able t define the fllwing terms and answer basic questins abut them: Intr t AI, agents and envirnments Pssible definitins f AI, prs and cns f
More informationVersatility of Singular Value Decomposition (SVD) January 7, 2015
Versatility f Singular Value Decmpsitin (SVD) January 7, 2015 Assumptin : Data = Real Data + Nise Each Data Pint is a clumn f the n d Data Matrix A. Assumptin : Data = Real Data + Nise Each Data Pint is
More information11. DUAL NATURE OF RADIATION AND MATTER
11. DUAL NATURE OF RADIATION AND MATTER Very shrt answer and shrt answer questins 1. Define wrk functin f a metal? The minimum energy required fr an electrn t escape frm the metal surface is called the
More informationCOMP 551 Applied Machine Learning Lecture 11: Support Vector Machines
COMP 551 Applied Machine Learning Lecture 11: Supprt Vectr Machines Instructr: (jpineau@cs.mcgill.ca) Class web page: www.cs.mcgill.ca/~jpineau/cmp551 Unless therwise nted, all material psted fr this curse
More information[COLLEGE ALGEBRA EXAM I REVIEW TOPICS] ( u s e t h i s t o m a k e s u r e y o u a r e r e a d y )
(Abut the final) [COLLEGE ALGEBRA EXAM I REVIEW TOPICS] ( u s e t h i s t m a k e s u r e y u a r e r e a d y ) The department writes the final exam s I dn't really knw what's n it and I can't very well
More informationT Algorithmic methods for data mining. Slide set 6: dimensionality reduction
T-61.5060 Algrithmic methds fr data mining Slide set 6: dimensinality reductin reading assignment LRU bk: 11.1 11.3 PCA tutrial in mycurses (ptinal) ptinal: An Elementary Prf f a Therem f Jhnsn and Lindenstrauss,
More informationMATHEMATICS SYLLABUS SECONDARY 5th YEAR
Eurpean Schls Office f the Secretary-General Pedaggical Develpment Unit Ref. : 011-01-D-8-en- Orig. : EN MATHEMATICS SYLLABUS SECONDARY 5th YEAR 6 perid/week curse APPROVED BY THE JOINT TEACHING COMMITTEE
More informationPhysics 2B Chapter 23 Notes - Faraday s Law & Inductors Spring 2018
Michael Faraday lived in the Lndn area frm 1791 t 1867. He was 29 years ld when Hand Oersted, in 1820, accidentally discvered that electric current creates magnetic field. Thrugh empirical bservatin and
More informationCHAPTER 8 ANALYSIS OF DESIGNED EXPERIMENTS
CHAPTER 8 ANALYSIS OF DESIGNED EXPERIMENTS Discuss experiments whse main aim is t study and cmpare the effects f treatments (diets, varieties, dses) by measuring respnse (yield, weight gain) n plts r units
More informationEcology 302 Lecture III. Exponential Growth (Gotelli, Chapter 1; Ricklefs, Chapter 11, pp )
Eclgy 302 Lecture III. Expnential Grwth (Gtelli, Chapter 1; Ricklefs, Chapter 11, pp. 222-227) Apcalypse nw. The Santa Ana Watershed Prject Authrity pulls n punches in prtraying its missin in apcalyptic
More informationIAML: Support Vector Machines
1 / 22 IAML: Supprt Vectr Machines Charles Suttn and Victr Lavrenk Schl f Infrmatics Semester 1 2 / 22 Outline Separating hyperplane with maimum margin Nn-separable training data Epanding the input int
More informationPrincipal Components
Principal Cmpnents Suppse we have N measurements n each f p variables X j, j = 1,..., p. There are several equivalent appraches t principal cmpnents: Given X = (X 1,... X p ), prduce a derived (and small)
More informationSmoothing, penalized least squares and splines
Smthing, penalized least squares and splines Duglas Nychka, www.image.ucar.edu/~nychka Lcally weighted averages Penalized least squares smthers Prperties f smthers Splines and Reprducing Kernels The interplatin
More informationAnalysis of Designed Experiments
8 Analysis f Designed Experiments 8.1 Intrductin In this chapter we discuss experiments whse main aim is t study and cmpare the effects f treatments (diets, varieties, dses) by measuring respnse (yield,
More information, which yields. where z1. and z2
The Gaussian r Nrmal PDF, Page 1 The Gaussian r Nrmal Prbability Density Functin Authr: Jhn M Cimbala, Penn State University Latest revisin: 11 September 13 The Gaussian r Nrmal Prbability Density Functin
More informationChapter 5: The Keynesian System (I): The Role of Aggregate Demand
LECTURE NOTES Chapter 5: The Keynesian System (I): The Rle f Aggregate Demand 1. The Prblem f Unemplyment Keynesian ecnmics develped in the cntext f the Great Depressin Sharp fall in GDP High rate f unemplyment
More informationELT COMMUNICATION THEORY
ELT 41307 COMMUNICATION THEORY Matlab Exercise #2 Randm variables and randm prcesses 1 RANDOM VARIABLES 1.1 ROLLING A FAIR 6 FACED DICE (DISCRETE VALIABLE) Generate randm samples fr rlling a fair 6 faced
More informationTree Structured Classifier
Tree Structured Classifier Reference: Classificatin and Regressin Trees by L. Breiman, J. H. Friedman, R. A. Olshen, and C. J. Stne, Chapman & Hall, 98. A Medical Eample (CART): Predict high risk patients
More informationLead/Lag Compensator Frequency Domain Properties and Design Methods
Lectures 6 and 7 Lead/Lag Cmpensatr Frequency Dmain Prperties and Design Methds Definitin Cnsider the cmpensatr (ie cntrller Fr, it is called a lag cmpensatr s K Fr s, it is called a lead cmpensatr Ntatin
More information7.0 Heat Transfer in an External Laminar Boundary Layer
7.0 Heat ransfer in an Eternal Laminar Bundary Layer 7. Intrductin In this chapter, we will assume: ) hat the fluid prperties are cnstant and unaffected by temperature variatins. ) he thermal & mmentum
More information(1.1) V which contains charges. If a charge density ρ, is defined as the limit of the ratio of the charge contained. 0, and if a force density f
1.0 Review f Electrmagnetic Field Thery Selected aspects f electrmagnetic thery are reviewed in this sectin, with emphasis n cncepts which are useful in understanding magnet design. Detailed, rigrus treatments
More informationEnd of Course Algebra I ~ Practice Test #2
End f Curse Algebra I ~ Practice Test #2 Name: Perid: Date: 1: Order the fllwing frm greatest t least., 3, 8.9, 8,, 9.3 A. 8, 8.9,, 9.3, 3 B., 3, 8, 8.9,, 9.3 C. 9.3, 3,,, 8.9, 8 D. 3, 9.3,,, 8.9, 8 2:
More informationAPPLICATION OF THE BRATSETH SCHEME FOR HIGH LATITUDE INTERMITTENT DATA ASSIMILATION USING THE PSU/NCAR MM5 MESOSCALE MODEL
JP2.11 APPLICATION OF THE BRATSETH SCHEME FOR HIGH LATITUDE INTERMITTENT DATA ASSIMILATION USING THE PSU/NCAR MM5 MESOSCALE MODEL Xingang Fan * and Jeffrey S. Tilley University f Alaska Fairbanks, Fairbanks,
More informationBayesian nonparametric modeling approaches for quantile regression
Bayesian nnparametric mdeling appraches fr quantile regressin Athanasis Kttas Department f Applied Mathematics and Statistics University f Califrnia, Santa Cruz Department f Statistics Athens University
More information2.161 Signal Processing: Continuous and Discrete Fall 2008
MIT OpenCurseWare http://cw.mit.edu 2.161 Signal Prcessing: Cntinuus and Discrete Fall 2008 Fr infrmatin abut citing these materials r ur Terms f Use, visit: http://cw.mit.edu/terms. Massachusetts Institute
More informationCS 477/677 Analysis of Algorithms Fall 2007 Dr. George Bebis Course Project Due Date: 11/29/2007
CS 477/677 Analysis f Algrithms Fall 2007 Dr. Gerge Bebis Curse Prject Due Date: 11/29/2007 Part1: Cmparisn f Srting Algrithms (70% f the prject grade) The bjective f the first part f the assignment is
More informationRevision: August 19, E Main Suite D Pullman, WA (509) Voice and Fax
.7.4: Direct frequency dmain circuit analysis Revisin: August 9, 00 5 E Main Suite D Pullman, WA 9963 (509) 334 6306 ice and Fax Overview n chapter.7., we determined the steadystate respnse f electrical
More informationDiscussion on Regularized Regression for Categorical Data (Tutz and Gertheiss)
Discussin n Regularized Regressin fr Categrical Data (Tutz and Gertheiss) Peter Bühlmann, Ruben Dezeure Seminar fr Statistics, Department f Mathematics, ETH Zürich, Switzerland Address fr crrespndence:
More informationElectric Current and Resistance
Electric Current and Resistance Electric Current Electric current is the rate f flw f charge thrugh sme regin f space The SI unit f current is the ampere (A) 1 A = 1 C / s The symbl fr electric current
More informationChapter 8: The Binomial and Geometric Distributions
Sectin 8.1: The Binmial Distributins Chapter 8: The Binmial and Gemetric Distributins A randm variable X is called a BINOMIAL RANDOM VARIABLE if it meets ALL the fllwing cnditins: 1) 2) 3) 4) The MOST
More informationNumerical Simulation of the Thermal Resposne Test Within the Comsol Multiphysics Environment
Presented at the COMSOL Cnference 2008 Hannver University f Parma Department f Industrial Engineering Numerical Simulatin f the Thermal Respsne Test Within the Cmsl Multiphysics Envirnment Authr : C. Crradi,
More information22.54 Neutron Interactions and Applications (Spring 2004) Chapter 11 (3/11/04) Neutron Diffusion
.54 Neutrn Interactins and Applicatins (Spring 004) Chapter (3//04) Neutrn Diffusin References -- J. R. Lamarsh, Intrductin t Nuclear Reactr Thery (Addisn-Wesley, Reading, 966) T study neutrn diffusin
More information