The general linear model and Statistical Parametric Mapping I: Introduction to the GLM
|
|
- Pauline Williams
- 6 years ago
- Views:
Transcription
1 The general linear mdel and Statistical Parametric Mapping I: Intrductin t the GLM Alexa Mrcm and Stefan Kiebel, Rik Hensn, Andrew Hlmes & J-B J Pline
2 Overview Intrductin Essential cncepts Mdelling Design matrix Parameter estimates Simple cntrasts Summary
3 Sme terminlgy SPM is based n a mass univariate apprach that fits a mdel at each vxel Is there an effect at lcatin X? Investigate lcalisatin f functin r functinal specialisatin Hw des regin X interact with Y and Z? Investigate behaviur f netwrks r functinal integratin A General(ised) Linear Mdel Effects are linear and additive If errrs are nrmal (Gaussian), General (SPM99) If errrs are nt nrmal, Generalised (SPM2)
4 Classical statistics... Parametric ne sample t-test tw sample t-test paired t-test ANOVA ANCOVA crrelatin linear regressin multiple regressin F-tests etc all cases f the (univariate) General Linear Mdel Or, with nn-nrmal errrs, the Generalised Linear Mdel
5 Classical statistics... Parametric ne sample t-test tw sample t-test paired t-test ANOVA ANCOVA crrelatin linear regressin multiple regressin F-tests etc all cases f the (univariate) General Linear Mdel Or, with nn-nrmal errrs, the Generalised Linear Mdel
6 Classical statistics... Parametric ne sample t-test tw sample t-test paired t-test ANOVA ANCOVA crrelatin linear regressin multiple regressin F-tests etc Multivariate? all cases f the (univariate) General Linear Mdel Or, with nn-nrmal errrs, the Generalised Linear Mdel fi PCA/ SVD, MLM
7 Classical statistics... Parametric ne sample t-test tw sample t-test paired t-test ANOVA ANCOVA crrelatin linear regressin multiple regressin F-tests etc Multivariate? Nn-parametric? all cases f the (univariate) General Linear Mdel Or, with nn-nrmal errrs, the Generalised Linear Mdel fi PCA/ SVD, MLM fi SnPM
8 Why mdelling? Why? Make inferences abut effects f f interest Hw? Decmpse data data int int effects and and errr errr Frm statistic using estimates f f effects and and errr errr Mdel? Use Use any any available knwledge data data mdel mdel effects effects estimate errr errr estimate statistic statistic
9 Chse yur mdel A very very general general mdel mdel All mdels are wrng, but sme are useful Gerge E.P.Bx Variance N N nrmalisatin N N smthing Massive Massive mdel mdel Captures signal but nt much sensitivity default default SPM SPM Bias Lts Lts f f nrmalisatin Lts Lts f f smthing Sparse Sparse mdel mdel High sensitivity but may miss signal
10 Mdelling with SPM Functinal data data Design Design matrix matrix Cntrasts Preprcessing Smthed nrmalised data data Generalised linear mdel Parameter estimates SPMs Templates Variance cmpnents Threshlding
11 Mdelling with SPM Design Design matrix matrix Cntrasts Preprcessed data: data: single single vxel vxel Generalised linear mdel Parameter estimates SPMs Variance cmpnents
12 fmri example One One sessin Passive wrd listening versus rest rest Time Time series series f f BOLD BOLD respnses in in ne ne vxel vxel 7 cycles f f rest rest and and listening Each Each epch 6 scans with with 7 sec sec TR TR Questin: Is Is there there a a change change in in the the BOLD BOLD respnse between listening and and rest? rest? Stimulus functin functin
13 GLM essentials The mdel Design matrix: Effects f interest Design matrix: Cnfunds (aka effects f n interest) Residuals (errr measures f the whle mdel) Estimate effects and errr fr data Parameter estimates (aka betas) Quantify specific effects using cntrasts f parameter estimates Statistic Cmpare estimated effects the cntrasts with apprpriate errr measures Are the effects surprisingly large?
14 GLM essentials The mdel Design matrix: Effects f interest Design matrix: Cnfunds (aka effects f n interest) Residuals (errr measures f the whle mdel) Estimate effects and errr fr data Parameter estimates (aka betas) Quantify specific effects using cntrasts f parameter estimates Statistic Cmpare estimated effects the cntrasts with apprpriate errr measures Are the effects surprisingly large?
15 Regressin mdel General case Time = b + 1 b + 2 errr e~n(0, s 2 I) (errr is nrmal and independently and identically distributed) Intensity x 1 x 2 e Questin: Is Is there there a change in in the the BOLD respnse between listening and and rest? rest? Hypthesis test: β 1 = 0? (using t-statistic)
16 Regressin mdel General case ˆβ ˆβ 1 2 = + + ˆ Y x + β ˆ x + εˆ = β Mdel is is specified by by Design matrix X Assumptins abut ε
17 Matrix frmulatin Y i = b 1 x i + b 2 + e i i = 1,2,3 Y 1 = b 1 x 1 + b e 1 Y 2 = b 1 x 2 + b e 2 Y 3 = b 1 x 3 + b e 3 dummy variables Y 1 x 1 1 b 1 e 1 Y 2 = x e 2 Y 3 x 3 1 b 1 e 3 Y = X b + e
18 Linear regressin Matrix frmulatin ^ Hats Hats = estimates Y i = b 1 x i + b 2 + e i i = 1,2,3 Y 1 = b 1 x 1 + b e 1 Y 2 = b 1 x 2 + b e 2 y ^ b 2 Y i 1 ^ Y i ^b1 Y 3 = b 1 x 3 + b e 3 Y 1 x 1 1 b 1 e 1 Y 2 = x e 2 Y 3 x 3 1 b 1 e 3 Y = X b + e dummy variables Parameter estimates ^ ^ b 1 & b 2 Fitted values Y ^ 1 & Y ^ 2 Residuals e^ 1 & ^e 2 x
19 Gemetrical perspective Y = Y 1 x 1 1 b 1 e 1 Y 2 = x e 2 Y 3 x 3 1 b 2 e 3 DATA (Y 1, Y 2, Y 3 ) b 1 X 1 +b 2 X 2 + e Y X 1 (x1, x2, x3) O X 2 (1,1,1) design space
20 GLM essentials The mdel Design matrix: Effects f interest Design matrix: Cnfunds (aka effects f n interest) Residuals (errr measures f the whle mdel) Estimate effects and errr fr data Parameter estimates (aka betas) Quantify specific effects using cntrasts f parameter estimates Statistic Cmpare estimated effects the cntrasts with apprpriate errr measures Are the effects surprisingly large?
21 Parameter estimatin Ordinary least squares Y = Xβ + ε βˆ = ( X X ) T 1 X T Y εˆ = Y Xβˆ Parameter estimates residuals Estimate parameters N such such that that t= 1 ˆε 2 t minimal Least squares parameter estimate
22 Parameter estimatin Ordinary least squares Y = Xβ + ε βˆ = ( X X ) T 1 X T Y εˆ = Y Xβˆ Parameter estimates residuals = rr Errr variance s 2 2 = (sum (sum f) f) squared residuals standardised fr fr df df = rr T T r r // df df (sum (sum f f squares) where degrees f f freedm df df (assuming iid): iid): = N --rank(x) (=N-P if if X full full rank)
23 Estimatin (gemetrical) Y = b Y 1 x 1 1 b 1 e 1 Y 2 = x e 2 Y 3 x 3 1 e 3 2 Y b 1 X 1 +b 2 X 2 + e DATA (Y 1, Y 2, Y 3 ) RESIDUALS ^e = (e^ 1,e ^ 2,e^ 3 ) T X 1 (x1, x2, x3) Y^ (Y^ 1,Y ^ 2,Y ^ 3 ) O X 2 (1,1,1) design space
24 GLM essentials The mdel Design matrix: Effects f interest Design matrix: Cnfunds (aka effects f n interest) Residuals (errr measures f the whle mdel) Estimate effects and errr fr data Parameter estimates (aka betas) Quantify specific effects using cntrasts f parameter estimates Statistic Cmpare estimated effects the cntrasts with apprpriate errr measures Are the effects surprisingly large?
25 Inference - cntrasts Y = Xβ + ε A cntrast = a linear cmbinatin f parameters: c x b spm_cn*img t-test: ne-dimensinal cntrast, difference in means/ difference frm zer bxcar parameter > 0? Null Null hypthesis: β 1 = 0 spmt_000*.img SPM{t} map F-test: tests multiple linear hyptheses des subset f mdel accunt fr significant variance Des bxcar parameter mdel anything? Null Null hypthesis: variance f f tested effects = errr errr variance ess_000*.img SPM{F} map
26 t-statistic - example Y = Xβ + ε c c = = t = T c βˆ ˆ T Std( c βˆ) Cntrast f f parameter estimates Variance estimate X Standard errr errr f f cntrast depends n n the the design, and and is is larger with with greater residual errr and and greater cvariance/ autcrrelatin Degrees f f freedm d.f. d.f. then then = n-p, n-p, where n bservatins, p parameters Tests fr fr a directinal difference in in means
27 F-statistic - example D D mvement parameters (r (r ther cnfunds) accunt fr fr anything? H 0 : True mdel is X 0 H 0 : b 3-9 = ( ) test H 0 : c x b = 0? X 0 X 1 (b 3-9 ) X 0 This mdel? Or this ne? Null Null hypthesis H 0 : 0 : That That all all these betas b 3-9 are 3-9 are zer, zer, i.e. i.e. that that n n linear cmbinatin f f the the effects accunts fr fr significant variance This This is is a nn-directinal test test
28 F-statistic - example D D mvement parameters (r (r ther cnfunds) accunt fr fr anything? H 0 : True mdel is X 0 H 0 : b 3-9 = ( ) test H 0 : c x b = 0? X 0 X 1 (b 3-9 ) X 0 c = This mdel? Or this ne? SPM{F}
29 Summary s far The essential mdel cntains Effects f interest A better mdel? A better mdel (within reasn) means smaller residual variance and mre significant statistics Capturing the signal later Add cnfunds/ effects f n interest Example f mvement parameters in fmri A further example (mainly relevant t PET)
30 Example PET experiment b 1 b 2 b 3 b 4 rank(x)= scans, 3 cnditins (1-way ANOVA) y j = j x 1j b 1j x 2j b 2j x 3j b 3j x 4j b 4j e j j where (dummy) variables: x 1j = 1j [0,1] = cnditin A (first (first 4 scans) x 2j = 2j [0,1] = cnditin B (secnd 4 scans) x 3j = 3j [0,1] [0,1] = cnditin C (third 4 scans) x 4j = 4j [1] [1] = grand mean (sessin cnstant)
31 Glbal effects May May be be variatin in in PET PET tracer dse dse frm scan scan t t scan scan Such glbal changes in in image intensity (gcbf) cnfund lcal lcal // reginal (rcbf) changes f f experiment Adjust fr fr glbal effects by: by: --AnCva (Additive Mdel) --PET? --Prprtinal Scaling --fmri? Can Can imprve statistics when rthgnal t t effects f f interest but can can als als wrsen when effects f f interest crrelated with with glbal rcbf (adj) rcbf x x x x x x x rcbf rcbf a k 2 a k 1 rcbf 0 0 AnCva Scaling x x x x x x x x x x x x x x x x 1 x x x x g.. z k x x x x x x 50 glbal gcbf glbal gcbf glbal gcbf
32 Glbal effects (AnCva) b 1 b 2 b 3 b 4 b 5 rank(x)= scans, 3 cnditins, 1 cnfunding cvariate y j = j x 1j b 1j x 2j b 2j x 3j b 3j x 4j b 4j x 5j b 5j e j j where (dummy) variables: x 1j = 1j [0,1] = cnditin A (first (first 4 scans) x 2j = 2j [0,1] = cnditin B (secnd 4 scans) x 3j = 3j [0,1] [0,1] = cnditin C (third 4 scans) x 4j = 4j [1] [1] = grand mean (sessin cnstant) x 5j = 5j glbal signal (mean ver ver all all vxels)
33 Glbal effects (AnCva) N N Glbal Orthgnal glbal Crrelated glbal b 1 b 2 b 3 b 4 b 1 b 2 b 3 b 4 b 5 b 1 b 2 b 3 b 4 b 5 rank(x)=3 rank(x)=4 rank(x)=4 Glbal effects nt nt accunted fr fr Maximum degrees f f freedm (glbal uses uses ne) ne) Glbal effects independent f f effects f f interest Smaller residual variance Larger T statistic Mre significant Glbal effects crrelated with with effects f f interest Smaller effect &/r &/r larger residuals Smaller T statistic Less Less significant
34 Glbal effects (scaling) Tw Tw types f f scaling: Grand Mean scaling and and Glbal scaling -- Grand Mean scaling is is autmatic, glbal scaling is is ptinal -- Grand Mean scales by by 100/mean ver ver all all vxels and and ALL ALL scans (i.e, (i.e, single number per per sessin) -- Glbal scaling scales by by 100/mean ver ver all all vxels fr fr EACH scan scan (i.e, (i.e, a different scaling factr every scan) Prblem with with glbal scaling is is that that TRUE glbal is is nt nt (nrmally) knwn nly nly estimated by by the the mean ver ver vxels -- S S if if there there is is a large large signal change ver ver many vxels, the the glbal estimate will will be be cnfunded by by lcal lcal changes -- This This can can prduce artifactual deactivatins in in ther regins after after glbal scaling Since mst surces f f glbal variability in in fmri are are lw lw frequency (drift), high-pass filtering may may be be sufficient, and and many peple d d nt nt use use glbal scaling
35 Summary General(ised) linear mdel partitins data int Effects f interest & cnfunds/ effects f n interest Errr Least squares estimatin Minimises difference between mdel & data T d this, assumptins made abut errrs mre later Inference at every vxel Test hypthesis using cntrast mre later Inference can be Bayesian as well as classical Next: Applying the GLM t fmri
Experimental Design Initial GLM Intro. This Time
Eperimental Design Initial GLM Intr This Time GLM General Linear Mdel Single subject fmri mdeling Single Subject fmri Data Data at ne vel Rest vs. passive wrd listening Is there an effect? Linear in
More informationContents. Introduction & recap. The General Linear Model, Part II. F-test and added variance Good & bad models Improvedmodel
DISCOS SPM curse, CRC, Liège, 2009 Cntents The General Linear Mdel, Part II C. Phillips, Centre de Recherches du Cycltrn, ULg, Belgium Based n slides frm: T. Nichls, R. Hensn, S. Kiebel, JB. Pline Intrductin
More informationModelling of Clock Behaviour. Don Percival. Applied Physics Laboratory University of Washington Seattle, Washington, USA
Mdelling f Clck Behaviur Dn Percival Applied Physics Labratry University f Washingtn Seattle, Washingtn, USA verheads and paper fr talk available at http://faculty.washingtn.edu/dbp/talks.html 1 Overview
More informationCHAPTER 24: INFERENCE IN REGRESSION. Chapter 24: Make inferences about the population from which the sample data came.
MATH 1342 Ch. 24 April 25 and 27, 2013 Page 1 f 5 CHAPTER 24: INFERENCE IN REGRESSION Chapters 4 and 5: Relatinships between tw quantitative variables. Be able t Make a graph (scatterplt) Summarize the
More informationLecture 2: Supervised vs. unsupervised learning, bias-variance tradeoff
Lecture 2: Supervised vs. unsupervised learning, bias-variance tradeff Reading: Chapter 2 STATS 202: Data mining and analysis September 27, 2017 1 / 20 Supervised vs. unsupervised learning In unsupervised
More informationLecture 2: Supervised vs. unsupervised learning, bias-variance tradeoff
Lecture 2: Supervised vs. unsupervised learning, bias-variance tradeff Reading: Chapter 2 STATS 202: Data mining and analysis September 27, 2017 1 / 20 Supervised vs. unsupervised learning In unsupervised
More informationComparing Several Means: ANOVA. Group Means and Grand Mean
STAT 511 ANOVA and Regressin 1 Cmparing Several Means: ANOVA Slide 1 Blue Lake snap beans were grwn in 12 pen-tp chambers which are subject t 4 treatments 3 each with O 3 and SO 2 present/absent. The ttal
More informationContents. Introduction The General Linear Model. General Linear Linear Model Model. The General Linear Model, Part I. «Take home» message
DISCOS SPM course, CRC, Liège, 2009 Contents The General Linear Model, Part I Introduction The General Linear Model Data & model Design matrix Parameter estimates & interpretation Simple contrast «Take
More informationPSU GISPOPSCI June 2011 Ordinary Least Squares & Spatial Linear Regression in GeoDa
There are tw parts t this lab. The first is intended t demnstrate hw t request and interpret the spatial diagnstics f a standard OLS regressin mdel using GeDa. The diagnstics prvide infrmatin abut the
More informationPart 3 Introduction to statistical classification techniques
Part 3 Intrductin t statistical classificatin techniques Machine Learning, Part 3, March 07 Fabi Rli Preamble ØIn Part we have seen that if we knw: Psterir prbabilities P(ω i / ) Or the equivalent terms
More informationThe General Linear Model (GLM)
he General Linear Model (GLM) Klaas Enno Stephan ranslational Neuromodeling Unit (NU) Institute for Biomedical Engineering University of Zurich & EH Zurich Wellcome rust Centre for Neuroimaging Institute
More informationSimple Linear Regression (single variable)
Simple Linear Regressin (single variable) Intrductin t Machine Learning Marek Petrik January 31, 2017 Sme f the figures in this presentatin are taken frm An Intrductin t Statistical Learning, with applicatins
More informationResampling Methods. Chapter 5. Chapter 5 1 / 52
Resampling Methds Chapter 5 Chapter 5 1 / 52 1 51 Validatin set apprach 2 52 Crss validatin 3 53 Btstrap Chapter 5 2 / 52 Abut Resampling An imprtant statistical tl Pretending the data as ppulatin and
More informationA Matrix Representation of Panel Data
web Extensin 6 Appendix 6.A A Matrix Representatin f Panel Data Panel data mdels cme in tw brad varieties, distinct intercept DGPs and errr cmpnent DGPs. his appendix presents matrix algebra representatins
More informationPrincipal Components
Principal Cmpnents Suppse we have N measurements n each f p variables X j, j = 1,..., p. There are several equivalent appraches t principal cmpnents: Given X = (X 1,... X p ), prduce a derived (and small)
More informationComputational modeling techniques
Cmputatinal mdeling techniques Lecture 11: Mdeling with systems f ODEs In Petre Department f IT, Ab Akademi http://www.users.ab.fi/ipetre/cmpmd/ Mdeling with differential equatins Mdeling strategy Fcus
More informationT Algorithmic methods for data mining. Slide set 6: dimensionality reduction
T-61.5060 Algrithmic methds fr data mining Slide set 6: dimensinality reductin reading assignment LRU bk: 11.1 11.3 PCA tutrial in mycurses (ptinal) ptinal: An Elementary Prf f a Therem f Jhnsn and Lindenstrauss,
More informationDistributions, spatial statistics and a Bayesian perspective
Distributins, spatial statistics and a Bayesian perspective Dug Nychka Natinal Center fr Atmspheric Research Distributins and densities Cnditinal distributins and Bayes Thm Bivariate nrmal Spatial statistics
More informationInternal vs. external validity. External validity. This section is based on Stock and Watson s Chapter 9.
Sectin 7 Mdel Assessment This sectin is based n Stck and Watsn s Chapter 9. Internal vs. external validity Internal validity refers t whether the analysis is valid fr the ppulatin and sample being studied.
More informationStatistical Inference
Statistical Inference J. Daunizeau Institute of Empirical Research in Economics, Zurich, Switzerland Brain and Spine Institute, Paris, France SPM Course Edinburgh, April 2011 Image time-series Spatial
More informationStatistics, Numerical Models and Ensembles
Statistics, Numerical Mdels and Ensembles Duglas Nychka, Reinhard Furrer,, Dan Cley Claudia Tebaldi, Linda Mearns, Jerry Meehl and Richard Smith (UNC). Spatial predictin and data assimilatin Precipitatin
More informationPattern Recognition 2014 Support Vector Machines
Pattern Recgnitin 2014 Supprt Vectr Machines Ad Feelders Universiteit Utrecht Ad Feelders ( Universiteit Utrecht ) Pattern Recgnitin 1 / 55 Overview 1 Separable Case 2 Kernel Functins 3 Allwing Errrs (Sft
More informationCAUSAL INFERENCE. Technical Track Session I. Phillippe Leite. The World Bank
CAUSAL INFERENCE Technical Track Sessin I Phillippe Leite The Wrld Bank These slides were develped by Christel Vermeersch and mdified by Phillippe Leite fr the purpse f this wrkshp Plicy questins are causal
More informationResampling Methods. Cross-validation, Bootstrapping. Marek Petrik 2/21/2017
Resampling Methds Crss-validatin, Btstrapping Marek Petrik 2/21/2017 Sme f the figures in this presentatin are taken frm An Intrductin t Statistical Learning, with applicatins in R (Springer, 2013) with
More informationINSTRUMENTAL VARIABLES
INSTRUMENTAL VARIABLES Technical Track Sessin IV Sergi Urzua University f Maryland Instrumental Variables and IE Tw main uses f IV in impact evaluatin: 1. Crrect fr difference between assignment f treatment
More informationMore Tutorial at
Answer each questin in the space prvided; use back f page if extra space is needed. Answer questins s the grader can READILY understand yur wrk; nly wrk n the exam sheet will be cnsidered. Write answers,
More informationCOMP 551 Applied Machine Learning Lecture 4: Linear classification
COMP 551 Applied Machine Learning Lecture 4: Linear classificatin Instructr: Jelle Pineau (jpineau@cs.mcgill.ca) Class web page: www.cs.mcgill.ca/~jpineau/cmp551 Unless therwise nted, all material psted
More informationSmoothing, penalized least squares and splines
Smthing, penalized least squares and splines Duglas Nychka, www.image.ucar.edu/~nychka Lcally weighted averages Penalized least squares smthers Prperties f smthers Splines and Reprducing Kernels The interplatin
More informationMidwest Big Data Summer School: Machine Learning I: Introduction. Kris De Brabanter
Midwest Big Data Summer Schl: Machine Learning I: Intrductin Kris De Brabanter kbrabant@iastate.edu Iwa State University Department f Statistics Department f Cmputer Science June 24, 2016 1/24 Outline
More informationGroup Analysis: Hands-On
Grup Analysis: Hands-On Gang Chen SSCC/NIMH/NIH/HHS 3/19/16 1 Make sure yu have the files!! Under directry grup_analysis_hands_n/! Slides: GrupAna_HO.pdf! Data: AFNI_data6/GrupAna_cases/! In case yu dn
More informationStatistical Inference
Statistical Inference Jean Daunizeau Wellcome rust Centre for Neuroimaging University College London SPM Course Edinburgh, April 2010 Image time-series Spatial filter Design matrix Statistical Parametric
More informationx 1 Outline IAML: Logistic Regression Decision Boundaries Example Data
Outline IAML: Lgistic Regressin Charles Suttn and Victr Lavrenk Schl f Infrmatics Semester Lgistic functin Lgistic regressin Learning lgistic regressin Optimizatin The pwer f nn-linear basis functins Least-squares
More informationUnit 1: Introduction to Biology
Name: Unit 1: Intrductin t Bilgy Theme: Frm mlecules t rganisms Students will be able t: 1.1 Plan and cnduct an investigatin: Define the questin, develp a hypthesis, design an experiment and cllect infrmatin,
More information3.4 Shrinkage Methods Prostate Cancer Data Example (Continued) Ridge Regression
3.3.4 Prstate Cancer Data Example (Cntinued) 3.4 Shrinkage Methds 61 Table 3.3 shws the cefficients frm a number f different selectin and shrinkage methds. They are best-subset selectin using an all-subsets
More informationCOMP 551 Applied Machine Learning Lecture 5: Generative models for linear classification
COMP 551 Applied Machine Learning Lecture 5: Generative mdels fr linear classificatin Instructr: Herke van Hf (herke.vanhf@mail.mcgill.ca) Slides mstly by: Jelle Pineau Class web page: www.cs.mcgill.ca/~hvanh2/cmp551
More informationInference in the Multiple-Regression
Sectin 5 Mdel Inference in the Multiple-Regressin Kinds f hypthesis tests in a multiple regressin There are several distinct kinds f hypthesis tests we can run in a multiple regressin. Suppse that amng
More informationFIELD QUALITY IN ACCELERATOR MAGNETS
FIELD QUALITY IN ACCELERATOR MAGNETS S. Russenschuck CERN, 1211 Geneva 23, Switzerland Abstract The field quality in the supercnducting magnets is expressed in terms f the cefficients f the Furier series
More informationHypothesis Tests for One Population Mean
Hypthesis Tests fr One Ppulatin Mean Chapter 9 Ala Abdelbaki Objective Objective: T estimate the value f ne ppulatin mean Inferential statistics using statistics in rder t estimate parameters We will be
More informationBootstrap Method > # Purpose: understand how bootstrap method works > obs=c(11.96, 5.03, 67.40, 16.07, 31.50, 7.73, 11.10, 22.38) > n=length(obs) >
Btstrap Methd > # Purpse: understand hw btstrap methd wrks > bs=c(11.96, 5.03, 67.40, 16.07, 31.50, 7.73, 11.10, 22.38) > n=length(bs) > mean(bs) [1] 21.64625 > # estimate f lambda > lambda = 1/mean(bs);
More informationThe standards are taught in the following sequence.
B L U E V A L L E Y D I S T R I C T C U R R I C U L U M MATHEMATICS Third Grade In grade 3, instructinal time shuld fcus n fur critical areas: (1) develping understanding f multiplicatin and divisin and
More informationData mining/machine learning large data sets. STA 302 or 442 (Applied Statistics) :, 1
Data mining/machine learning large data sets STA 302 r 442 (Applied Statistics) :, 1 Data mining/machine learning large data sets high dimensinal spaces STA 302 r 442 (Applied Statistics) :, 2 Data mining/machine
More information5 th grade Common Core Standards
5 th grade Cmmn Cre Standards In Grade 5, instructinal time shuld fcus n three critical areas: (1) develping fluency with additin and subtractin f fractins, and develping understanding f the multiplicatin
More informationComputational modeling techniques
Cmputatinal mdeling techniques Lecture 4: Mdel checing fr ODE mdels In Petre Department f IT, Åb Aademi http://www.users.ab.fi/ipetre/cmpmd/ Cntent Stichimetric matrix Calculating the mass cnservatin relatins
More informationENGI 4430 Parametric Vector Functions Page 2-01
ENGI 4430 Parametric Vectr Functins Page -01. Parametric Vectr Functins (cntinued) Any nn-zer vectr r can be decmpsed int its magnitude r and its directin: r rrˆ, where r r 0 Tangent Vectr: dx dy dz dr
More informationChapter 3: Cluster Analysis
Chapter 3: Cluster Analysis } 3.1 Basic Cncepts f Clustering 3.1.1 Cluster Analysis 3.1. Clustering Categries } 3. Partitining Methds 3..1 The principle 3.. K-Means Methd 3..3 K-Medids Methd 3..4 CLARA
More informationExcessive Social Imbalances and the Performance of Welfare States in the EU. Frank Vandenbroucke, Ron Diris and Gerlinde Verbist
Excessive Scial Imbalances and the Perfrmance f Welfare States in the EU Frank Vandenbrucke, Rn Diris and Gerlinde Verbist Child pverty in the Eurzne, SILC 2008 35.00 30.00 25.00 20.00 15.00 10.00 5.00.00
More informationENSC Discrete Time Systems. Project Outline. Semester
ENSC 49 - iscrete Time Systems Prject Outline Semester 006-1. Objectives The gal f the prject is t design a channel fading simulatr. Upn successful cmpletin f the prject, yu will reinfrce yur understanding
More informationCHAPTER 8 ANALYSIS OF DESIGNED EXPERIMENTS
CHAPTER 8 ANALYSIS OF DESIGNED EXPERIMENTS Discuss experiments whse main aim is t study and cmpare the effects f treatments (diets, varieties, dses) by measuring respnse (yield, weight gain) n plts r units
More informationTree Structured Classifier
Tree Structured Classifier Reference: Classificatin and Regressin Trees by L. Breiman, J. H. Friedman, R. A. Olshen, and C. J. Stne, Chapman & Hall, 98. A Medical Eample (CART): Predict high risk patients
More information1 The limitations of Hartree Fock approximation
Chapter: Pst-Hartree Fck Methds - I The limitatins f Hartree Fck apprximatin The n electrn single determinant Hartree Fck wave functin is the variatinal best amng all pssible n electrn single determinants
More informationWhat is Statistical Learning?
What is Statistical Learning? Sales 5 10 15 20 25 Sales 5 10 15 20 25 Sales 5 10 15 20 25 0 50 100 200 300 TV 0 10 20 30 40 50 Radi 0 20 40 60 80 100 Newspaper Shwn are Sales vs TV, Radi and Newspaper,
More informationAP Statistics Practice Test Unit Three Exploring Relationships Between Variables. Name Period Date
AP Statistics Practice Test Unit Three Explring Relatinships Between Variables Name Perid Date True r False: 1. Crrelatin and regressin require explanatry and respnse variables. 1. 2. Every least squares
More informationSurface and Contact Stress
Surface and Cntact Stress The cncept f the frce is fundamental t mechanics and many imprtant prblems can be cast in terms f frces nly, fr example the prblems cnsidered in Chapter. Hwever, mre sphisticated
More information(1.1) V which contains charges. If a charge density ρ, is defined as the limit of the ratio of the charge contained. 0, and if a force density f
1.0 Review f Electrmagnetic Field Thery Selected aspects f electrmagnetic thery are reviewed in this sectin, with emphasis n cncepts which are useful in understanding magnet design. Detailed, rigrus treatments
More informationCN700 Additive Models and Trees Chapter 9: Hastie et al. (2001)
CN700 Additive Mdels and Trees Chapter 9: Hastie et al. (2001) Madhusudana Shashanka Department f Cgnitive and Neural Systems Bstn University CN700 - Additive Mdels and Trees March 02, 2004 p.1/34 Overview
More informationElements of Machine Intelligence - I
ECE-175A Elements f Machine Intelligence - I Ken Kreutz-Delgad Nun Vascncels ECE Department, UCSD Winter 2011 The curse The curse will cver basic, but imprtant, aspects f machine learning and pattern recgnitin
More informationComputational modeling techniques
Cmputatinal mdeling techniques Lecture 2: Mdeling change. In Petre Department f IT, Åb Akademi http://users.ab.fi/ipetre/cmpmd/ Cntent f the lecture Basic paradigm f mdeling change Examples Linear dynamical
More informationThe General Linear Model. Guillaume Flandin Wellcome Trust Centre for Neuroimaging University College London
The General Linear Model Guillaume Flandin Wellcome Trust Centre for Neuroimaging University College London SPM Course Lausanne, April 2012 Image time-series Spatial filter Design matrix Statistical Parametric
More informationKeysight Technologies Understanding the Kramers-Kronig Relation Using A Pictorial Proof
Keysight Technlgies Understanding the Kramers-Krnig Relatin Using A Pictrial Prf By Clin Warwick, Signal Integrity Prduct Manager, Keysight EEsf EDA White Paper Intrductin In principle, applicatin f the
More informationData Analysis, Statistics, Machine Learning
Data Analysis, Statistics, Machine Learning Leland Wilkinsn Adjunct Prfessr UIC Cmputer Science Chief Scien
More informationk-nearest Neighbor How to choose k Average of k points more reliable when: Large k: noise in attributes +o o noise in class labels
Mtivating Example Memry-Based Learning Instance-Based Learning K-earest eighbr Inductive Assumptin Similar inputs map t similar utputs If nt true => learning is impssible If true => learning reduces t
More informationPhysics 2B Chapter 23 Notes - Faraday s Law & Inductors Spring 2018
Michael Faraday lived in the Lndn area frm 1791 t 1867. He was 29 years ld when Hand Oersted, in 1820, accidentally discvered that electric current creates magnetic field. Thrugh empirical bservatin and
More informationYou need to be able to define the following terms and answer basic questions about them:
CS440/ECE448 Sectin Q Fall 2017 Midterm Review Yu need t be able t define the fllwing terms and answer basic questins abut them: Intr t AI, agents and envirnments Pssible definitins f AI, prs and cns f
More informationIN a recent article, Geary [1972] discussed the merit of taking first differences
The Efficiency f Taking First Differences in Regressin Analysis: A Nte J. A. TILLMAN IN a recent article, Geary [1972] discussed the merit f taking first differences t deal with the prblems that trends
More informationDetermining the Accuracy of Modal Parameter Estimation Methods
Determining the Accuracy f Mdal Parameter Estimatin Methds by Michael Lee Ph.D., P.E. & Mar Richardsn Ph.D. Structural Measurement Systems Milpitas, CA Abstract The mst cmmn type f mdal testing system
More informationTime, Synchronization, and Wireless Sensor Networks
Time, Synchrnizatin, and Wireless Sensr Netwrks Part II Ted Herman University f Iwa Ted Herman/March 2005 1 Presentatin: Part II metrics and techniques single-hp beacns reginal time znes ruting-structure
More informationThe General Linear Model (GLM)
The General Linear Model (GLM) Dr. Frederike Petzschner Translational Neuromodeling Unit (TNU) Institute for Biomedical Engineering, University of Zurich & ETH Zurich With many thanks for slides & images
More informationAircraft Performance - Drag
Aircraft Perfrmance - Drag Classificatin f Drag Ntes: Drag Frce and Drag Cefficient Drag is the enemy f flight and its cst. One f the primary functins f aerdynamicists and aircraft designers is t reduce
More information22.54 Neutron Interactions and Applications (Spring 2004) Chapter 11 (3/11/04) Neutron Diffusion
.54 Neutrn Interactins and Applicatins (Spring 004) Chapter (3//04) Neutrn Diffusin References -- J. R. Lamarsh, Intrductin t Nuclear Reactr Thery (Addisn-Wesley, Reading, 966) T study neutrn diffusin
More informationCHAPTER 4 DIAGNOSTICS FOR INFLUENTIAL OBSERVATIONS
CHAPTER 4 DIAGNOSTICS FOR INFLUENTIAL OBSERVATIONS 1 Influential bservatins are bservatins whse presence in the data can have a distrting effect n the parameter estimates and pssibly the entire analysis,
More informationLecture 10, Principal Component Analysis
Principal Cmpnent Analysis Lecture 10, Principal Cmpnent Analysis Ha Helen Zhang Fall 2017 Ha Helen Zhang Lecture 10, Principal Cmpnent Analysis 1 / 16 Principal Cmpnent Analysis Lecture 10, Principal
More informationAerodynamic Separability in Tip Speed Ratio and Separability in Wind Speed- a Comparison
Jurnal f Physics: Cnference Series OPEN ACCESS Aerdynamic Separability in Tip Speed Rati and Separability in Wind Speed- a Cmparisn T cite this article: M L Gala Sants et al 14 J. Phys.: Cnf. Ser. 555
More informationName: Block: Date: Science 10: The Great Geyser Experiment A controlled experiment
Science 10: The Great Geyser Experiment A cntrlled experiment Yu will prduce a GEYSER by drpping Ments int a bttle f diet pp Sme questins t think abut are: What are yu ging t test? What are yu ging t measure?
More informationMisc. ArcMap Stuff Andrew Phay
Misc. ArcMap Stuff Andrew Phay aphay@whatcmcd.rg Prjectins Used t shw a spherical surface n a flat surface Distrtin Shape Distance True Directin Area Different Classes Thse that minimize distrtin in shape
More informationPhysics 2010 Motion with Constant Acceleration Experiment 1
. Physics 00 Mtin with Cnstant Acceleratin Experiment In this lab, we will study the mtin f a glider as it accelerates dwnhill n a tilted air track. The glider is supprted ver the air track by a cushin
More informationSUPPLEMENTARY MATERIAL GaGa: a simple and flexible hierarchical model for microarray data analysis
SUPPLEMENTARY MATERIAL GaGa: a simple and flexible hierarchical mdel fr micrarray data analysis David Rssell Department f Bistatistics M.D. Andersn Cancer Center, Hustn, TX 77030, USA rsselldavid@gmail.cm
More informationEric Klein and Ning Sa
Week 12. Statistical Appraches t Netwrks: p1 and p* Wasserman and Faust Chapter 15: Statistical Analysis f Single Relatinal Netwrks There are fur tasks in psitinal analysis: 1) Define Equivalence 2) Measure
More information7 TH GRADE MATH STANDARDS
ALGEBRA STANDARDS Gal 1: Students will use the language f algebra t explre, describe, represent, and analyze number expressins and relatins 7 TH GRADE MATH STANDARDS 7.M.1.1: (Cmprehensin) Select, use,
More informationIntroduction to Regression
Intrductin t Regressin Administrivia Hmewrk 6 psted later tnight. Due Friday after Break. 2 Statistical Mdeling Thus far we ve talked abut Descriptive Statistics: This is the way my sample is Inferential
More informationChapter 5: The Keynesian System (I): The Role of Aggregate Demand
LECTURE NOTES Chapter 5: The Keynesian System (I): The Rle f Aggregate Demand 1. The Prblem f Unemplyment Keynesian ecnmics develped in the cntext f the Great Depressin Sharp fall in GDP High rate f unemplyment
More informationComputational Statistics
Cmputatinal Statistics Spring 2008 Peter Bühlmann and Martin Mächler Seminar für Statistik ETH Zürich February 2008 (February 23, 2011) ii Cntents 1 Multiple Linear Regressin 1 1.1 Intrductin....................................
More informationSAMPLING DYNAMICAL SYSTEMS
SAMPLING DYNAMICAL SYSTEMS Melvin J. Hinich Applied Research Labratries The University f Texas at Austin Austin, TX 78713-8029, USA (512) 835-3278 (Vice) 835-3259 (Fax) hinich@mail.la.utexas.edu ABSTRACT
More informationChE 471: LECTURE 4 Fall 2003
ChE 47: LECTURE 4 Fall 003 IDEL RECTORS One f the key gals f chemical reactin engineering is t quantify the relatinship between prductin rate, reactr size, reactin kinetics and selected perating cnditins.
More informationApplication of ILIUM to the estimation of the T eff [Fe/H] pair from BP/RP
Applicatin f ILIUM t the estimatin f the T eff [Fe/H] pair frm BP/RP prepared by: apprved by: reference: issue: 1 revisin: 1 date: 2009-02-10 status: Issued Cryn A.L. Bailer-Jnes Max Planck Institute fr
More informationMultiple Source Multiple. using Network Coding
Multiple Surce Multiple Destinatin Tplgy Inference using Netwrk Cding Pegah Sattari EECS, UC Irvine Jint wrk with Athina Markpulu, at UCI, Christina Fraguli, at EPFL, Lausanne Outline Netwrk Tmgraphy Gal,
More informationMATCHING TECHNIQUES. Technical Track Session VI. Emanuela Galasso. The World Bank
MATCHING TECHNIQUES Technical Track Sessin VI Emanuela Galass The Wrld Bank These slides were develped by Christel Vermeersch and mdified by Emanuela Galass fr the purpse f this wrkshp When can we use
More informationKinetic Model Completeness
5.68J/10.652J Spring 2003 Lecture Ntes Tuesday April 15, 2003 Kinetic Mdel Cmpleteness We say a chemical kinetic mdel is cmplete fr a particular reactin cnditin when it cntains all the species and reactins
More informationNOTE ON THE ANALYSIS OF A RANDOMIZED BLOCK DESIGN. Junjiro Ogawa University of North Carolina
NOTE ON THE ANALYSIS OF A RANDOMIZED BLOCK DESIGN by Junjir Ogawa University f Nrth Carlina This research was supprted by the Office f Naval Research under Cntract N. Nnr-855(06) fr research in prbability
More informationGroup analysis. Jean Daunizeau Wellcome Trust Centre for Neuroimaging University College London. SPM Course Edinburgh, April 2010
Group analysis Jean Daunizeau Wellcome Trust Centre for Neuroimaging University College London SPM Course Edinburgh, April 2010 Image time-series Spatial filter Design matrix Statistical Parametric Map
More informationWeathering. Title: Chemical and Mechanical Weathering. Grade Level: Subject/Content: Earth and Space Science
Weathering Title: Chemical and Mechanical Weathering Grade Level: 9-12 Subject/Cntent: Earth and Space Science Summary f Lessn: Students will test hw chemical and mechanical weathering can affect a rck
More informationLead/Lag Compensator Frequency Domain Properties and Design Methods
Lectures 6 and 7 Lead/Lag Cmpensatr Frequency Dmain Prperties and Design Methds Definitin Cnsider the cmpensatr (ie cntrller Fr, it is called a lag cmpensatr s K Fr s, it is called a lead cmpensatr Ntatin
More informationPhysics 212. Lecture 12. Today's Concept: Magnetic Force on moving charges. Physics 212 Lecture 12, Slide 1
Physics 1 Lecture 1 Tday's Cncept: Magnetic Frce n mving charges F qv Physics 1 Lecture 1, Slide 1 Music Wh is the Artist? A) The Meters ) The Neville rthers C) Trmbne Shrty D) Michael Franti E) Radiatrs
More informationStudy Group Report: Plate-fin Heat Exchangers: AEA Technology
Study Grup Reprt: Plate-fin Heat Exchangers: AEA Technlgy The prblem under study cncerned the apparent discrepancy between a series f experiments using a plate fin heat exchanger and the classical thery
More informationOTHER USES OF THE ICRH COUPL ING CO IL. November 1975
OTHER USES OF THE ICRH COUPL ING CO IL J. C. Sprtt Nvember 1975 -I,," PLP 663 Plasma Studies University f Wiscnsin These PLP Reprts are infrmal and preliminary and as such may cntain errrs nt yet eliminated.
More informationIntroduction to Quantitative Genetics II: Resemblance Between Relatives
Intrductin t Quantitative Genetics II: Resemblance Between Relatives Bruce Walsh 8 Nvember 006 EEB 600A The heritability f a trait, a central cncept in quantitative genetics, is the prprtin f variatin
More informationNeuroimaging for Machine Learners Validation and inference
GIGA in silico medicine, ULg, Belgium http://www.giga.ulg.ac.be Neuroimaging for Machine Learners Validation and inference Christophe Phillips, Ir. PhD. PRoNTo course June 2017 Univariate analysis: Introduction:
More informationLecture 3: Principal Components Analysis (PCA)
Lecture 3: Principal Cmpnents Analysis (PCA) Reading: Sectins 6.3.1, 10.1, 10.2, 10.4 STATS 202: Data mining and analysis Jnathan Taylr, 9/28 Slide credits: Sergi Bacallad 1 / 24 The bias variance decmpsitin
More informationNumerical Simulation of the Thermal Resposne Test Within the Comsol Multiphysics Environment
Presented at the COMSOL Cnference 2008 Hannver University f Parma Department f Industrial Engineering Numerical Simulatin f the Thermal Respsne Test Within the Cmsl Multiphysics Envirnment Authr : C. Crradi,
More informationLecture 5: Equilibrium and Oscillations
Lecture 5: Equilibrium and Oscillatins Energy and Mtin Last time, we fund that fr a system with energy cnserved, v = ± E U m ( ) ( ) One result we see immediately is that there is n slutin fr velcity if
More informationNGSS High School Physics Domain Model
NGSS High Schl Physics Dmain Mdel Mtin and Stability: Frces and Interactins HS-PS2-1: Students will be able t analyze data t supprt the claim that Newtn s secnd law f mtin describes the mathematical relatinship
More information