Claudia Rangel! National institute of genomic medicine!
|
|
- Lauren Webster
- 5 years ago
- Views:
Transcription
1 Inference and Learning in Compuaional Sysems Biology Claudia Rangel! Naional insiue of genomic medicine! David Wild, Warwick Univ. U.K.! John Angus, Claremon graduae Univ., CA! Francesco Falciani, Universiy of Birmingham, U.K! Zoubin Ghahramani, Univ. of cambridge, U.K.! CIMAT May 5, 21 Gene Expression Our body is a machine regulaed by proeins which are in urn regulaed by genes Genes are found in he nucleous of every cell in our body Undersanding how genes are regulaed meaning being urned on and off is key in undersanding diseases, pahologies, even how our brain operaes Differenial gene expression 1
2 Moivaion Quesions people ask when hey do microarray experimens? High percenage of publicaions ha involve microarray experimens are designed o answer he firs 2 quesions) 1) Are genes differenially expressed? Crol vs Treamen 2) Do hey cluser ogeher? Do hey have common funcions? 3) Wha can we undersand abou he underlying genome proein regulaory neworks Possible scenarios 2
3 LDS / SSM 3
4 Daa Daa is generaed wih a high hroughpu echnology called microarrays These are capable of measure housands of genes simulaneously The echnology is expensive - abou 7 dlls per chip. Having he budge for generaing a reasonable sample size is difficul The echnology is noisy hp:// 4
5 Daa srucure: Time series 1 x 44 x 58 {,2,4,6,8,18,24,48,72} g 1 g 2 g : expression levels replicae : 1 expression levels replicae 2 25,52 daa poins replicae 44 Daa Normalizaion 5
6 Daa Normalizaion Moivaion: Common disribuion of inensiies across replicaes. Algorihm: Quanile Normalizaion [Bolsad e al.] (Based on he Q-Q plos) Biological Sysem Daa Acquisiion Pre-processing Daa Normalizaion LDS model, Hidden saes, Parameer Esimaion Use EM-Algorihm (Kalman Filer, Smoher,ec.) Re-esimae Candidae Models wih Consrains (fuure) Idenify Possible Sub models Boosrap (curren) Diagnosics Consrains Biology / Exper Opinion Finish 6
7 T cell Acivaion The cenral even in he generaion of an immune response is he acivaion of T cells. APC pepide TCR Signaling pahway Infeced cell Cyokines T cell T cell recognizes complex of viral pepide and kills infeced ce ll. T cell acivaion is iniiaed by he ineracion beween he T cell recepor (TCR) and he anigen pepide presened on he surface of an anigen -presening cell. This even riggers a cascade of evens ha couple he simulaory signal received form TCR o gene ranscripion evens in he nucleus. Why Linear Dynamical Sysems (LDS)? Linear Dynamical Sysems or Linear Sae-Space models provide a mehodology for reaing problems in ime series analysis. Mulivariae case is easily handled by simple exensions of univariae heory LDS assume he exisence of a hidden sae variable which evolves wih Markovian dynamics. Hidden variables can model The effecs of genes ha have no been included on he microarray Levels of regulaory proeins The effecs of mrna degradaion Coninuous variables Approach is based on he srucural analysis of he problem. 7
8 Hidden Saes Learning probabilisic models using hidden variables means ha we should accoun for unobserved variables ineracing wih he observables A hidden variable can induce nework srucures or subsrucures improving he accuracy of he nework By adding one or more hidden variables in he srucure can resul in a higher score Having oo many hidden variables makes he model more complex affecing he accuracy of he parameers How do we deermine he number of hidden saes? 8
9 Boosrap Cross Validaion 44-way cross validaion experimen o find he opimal number of hidden saes In general in a R-fold cross-validaion experimen, he daa se is randomly divided ino R muually exclusive subses of equal size. Daa is rained R imes, each ime leaving ou one of he subses from raining, bu using only he omied subse o compue he likelihood. Validaion se (likelihood) Training se LDS Definiion of Model Srucure h h +1 Exogenous on saes B Saes Observaions x x A +1 C y y +1 D u u +1 Exogenous on observaions x +1 = Ax +By + w x +1 = Ax + Bh + w y = Cx + Dy -1 + v y = Cx + Du + v Gene expression daa Saes x -1 A B x C y -1 D Observaions y Assumpions: { w } ~ WN(, Q) { v } ~ WN(, R), { w } { v } 9
10 Model Parameers Saes x -1 A x x +1 = Ax +By + w B C y = Cx + Dy -1 + v y -1 D Observaions y { w } ~ WN(, Q) { v } ~ WN(, R), { w } { v } A: K x K ransiion marix (K is he number of hidden saes) B: K x 58 inpu o sae marix C: 58 x K influence of hidden saes on gene expression a each ime poin D: 58 x 58 gene o gene expression level influence a a consecuive ime poins Noes: 1. We are ineresed in he CB+D marix bu ha does no involve addiional parameer esimaion. 2. K=9 General Srucural Properies 1
11 Idenifiabiliy P θ {P θ :θ Θ} P θ {P θ :θ Θ} Imporance The idenifiabiliy problem has been sudied exensively for he linear dynamic sysem model of h form x +1 = Ax +Bu + w y = Cx + Du + v Taking he unknown parameer θ o be he composie of A,B,C,D, Q,R, i is known ha wihou any resricions on he parameer, his model is no idenifiable. In fac, i is easily seen ha by a coordinae ransformaion of he sae variable x, 11
12 Anoher way of Represening he Gene Expression Model The gene expression model can be expressed in a simpler saespace form ~ x A ~ x w~ + 1 = + g = Hx ~ where, ~ x x = y ; A A = CA B CB + D ; H = [ ] ~ I ; w = Cw + v +1 w and he whie noise erm in he sae equaion now has variance ~ Q Q = CQ QC' CQC' + R Simpler form allows us o address sabiliy, conrollabiliy, observabiliy and idenifiabiliy in erms of known resuls. Definiion of Model Srucure h h +1 Exogenous on saes B Saes x x A +1 C x +1 = Ax +By + w Observaions y y +1 D u u +1 Exogenous on observaions y Saes x -1 = Cx + Dy -1 + v A x x +1 = Ax + Bh + w y = Cx + Du + v ~ x A ~ x w~ + 1 = + g = Hx ~ Gene expression daa Saes x~ A ~ x + 1 H g g +1 B C y -1 D y Observaions { w } ~ WN(, Q) { v } ~ WN(, R), { w } { v } Idenify Model Properies Observaions 12
13 13
14 Therefore, In he geneic model we have ha Bu for each ransformaion we have i is clear ha D remains idenifiable, in some sense, as i is invarian o he choice of T. By inspecion, oher invarians can be seen o include CB + D, CB, and CA k B, k = 1, 2,... Model Properies - Geneic Model Sabiliy (parameers) he sae variable does no explode exponenially - The Model will be sable iff he marix A A = CA has specral radius less han one, B CB + D Conrollabiliy (inpus) abiliy o move he sae from any given iniial value o a predeermined final value by manipulaion of he noise - The model will be conrollable iff he marix 2 K 1 [ I, A, A,..., A ] K = dim( ~ x ) is full rank, Observabiliy (oupus) abiliy o deermine he iniial sae from a sequence of noiseless observaions The model will be observable iff he marix is full rank. 2 K 1 [ H HA HA HA ] T K = dim( ~ x ) 14
15 Mehodology Expecaion Maximizaion (EM) algorihm The moivaion for using EM algorihm is ha i ieraively compues he MLE for incomplee daa ses. Filering Filering is aimed a updaing our knowledge of he sysem as each observaion y comes in Smoohing Smoohing enables us o base our esimaes of quaniies of ineres on he enire sample y 1,,y T. Boosrapping Boosrap mehods can be used for esimaing confidence bounds for nework oupus EM Algorihm x +1 = Ax +By + w w ~ N(,Q) y = Cx + Dy -1 + v v ~ N(,R) E-sep M-sep Use x, P, A, B, C, D, Q, R Use x ˆ, P Kalman Filer Smooher To Re-esimae x ˆ, P x, P, Aˆ, Bˆ, Cˆ, Dˆ, Qˆ, Rˆ Compue he expeced log likelihood given he daa By maximizing he log likelihood 15
16 Kalman Filering & Smoohing The likelihood can be calculaed by a rouine applicaion of he Kalman filer, considered he opimal linear esimaor. The Kalman filer esimaes he curren value of our variables incorporaing all informaion available. Knowledge of he sysem The saisical descripion of any uncerainy of he dynamics of he model Noises and measuremen errors Iniial condiions The Smooher solves he problem of esimaing he sae a ime given he parameers and he observaions. Boosrapping 16
17 Usamos resulados del Boosrapping Usamos resulados del Boosrapping 17
18 Usamos resulados del Boosrapping Resuls Simulaed Daa : 4 samples, 1 ime poins, 5 genes
19 Resuls Simulaed Daa: 5 and 11 nodes 11 genes (nodes) 19
20 39 Nodes Arificial ime series are no saionary for a few ime poins sample -> bias Diagnosics on Fied Model Common Mehods Examinaion of sandardized innovaions for lack of correlaion / paern Check ha esimaes of A, B, C, D are in he observable, conrollable, sable region of he parameer space: 2
21 Il-2 Main cellular funcions modulaed during T cell acivaion Acivaion (1) Proliferaion (2) Gene Regulaory Nework Aciv. IL-2Rϒ, IL-4Rα, IL-3Rα Proliferaion gene: Cyclin A2 Il-2 Cell deah (3) Acivaion (1) Proliferaion (2) Main cellular funcions modulaed during T cell acivaion 21
22 Gene Regulaory Nework IL-2Rϒ, IL-4Rα, IL-3Rα Proliferaion gene: Cyclin A2 Apoposis response Il-2 gene: Clusering Cell deah (3) Acivaion (1) Proliferaion (2) Main cellular funcions modulaed during T cell acivaion Gene Regulaory Nework IL-2Rϒ, IL-4Rα, IL-3Rα Proliferaion gene: Cyclin A2 Apoposis response gene: Clusering Early T-cell acivaion marker: CD69 (acivación ardía) Il-2 Cell deah (3) Acivaion (1) Proliferaion (2) Main cellular funcions modulaed during T cell acivaion 22
23 Gene Regulaory Nework IL-2Rϒ, IL-4Rα, IL-3Rα Proliferaion gene: Cyclin A2 Apoposis response gene: Clusering Early T-cell acivaion marker: CD69 TF involved in T-cell anigen reg: GATA Il-2 Cell deah (3) Acivaion (1) Proliferaion (2) Main cellular funcions modulaed during T cell acivaion Gene Regulaory Nework No presen in he microarray and i is considered hidden variable in ACTIVATION Il-2 Cell deah (3) Acivaion (1) Proliferaion (2) Main cellular funcions modulaed during T cell acivaion 23
24 Gene Regulaory Nework TCR phosphoriles FYN Targe gene of NFKB is IL-2 TCR NFKB Il-2 Main cellular funcions modulaed during T cell acivaion Cell deah (3) Acivaion (1) Proliferaion (2) Follow-up Research VBSSM Variaional Bayesian Sae-Space Model Synheic Daa Genome Research Dirk Husmeier Consrains Learning and Inference in Compuaional Biology MIT press
25 Incorporaing Biological Knowledge, Knocking Ou: Implemening Consrains By hinking of each elemen in D as he connecion srengh wih which gene i influences gene j over ime, allows he marix D o be consrained o have zero values where here is no connecion beween wo genes. Two ypes of consrains on D of he form DF=G (*) Fvec(D) = G (**) Consrained model address he esimaion of fewer number of parameers Implemened by Lagrange mulipliers by doing consrained maximizaion in he M sep. * Shumway and Soffer 1982 ** New resul 25
Georey E. Hinton. University oftoronto. Technical Report CRG-TR February 22, Abstract
Parameer Esimaion for Linear Dynamical Sysems Zoubin Ghahramani Georey E. Hinon Deparmen of Compuer Science Universiy oftorono 6 King's College Road Torono, Canada M5S A4 Email: zoubin@cs.orono.edu Technical
More informationAn recursive analytical technique to estimate time dependent physical parameters in the presence of noise processes
WHAT IS A KALMAN FILTER An recursive analyical echnique o esimae ime dependen physical parameers in he presence of noise processes Example of a ime and frequency applicaion: Offse beween wo clocks PREDICTORS,
More informationAugmented Reality II - Kalman Filters - Gudrun Klinker May 25, 2004
Augmened Realiy II Kalman Filers Gudrun Klinker May 25, 2004 Ouline Moivaion Discree Kalman Filer Modeled Process Compuing Model Parameers Algorihm Exended Kalman Filer Kalman Filer for Sensor Fusion Lieraure
More informationLinear Gaussian State Space Models
Linear Gaussian Sae Space Models Srucural Time Series Models Level and Trend Models Basic Srucural Model (BSM Dynamic Linear Models Sae Space Model Represenaion Level, Trend, and Seasonal Models Time Varying
More informationState-Space Models. Initialization, Estimation and Smoothing of the Kalman Filter
Sae-Space Models Iniializaion, Esimaion and Smoohing of he Kalman Filer Iniializaion of he Kalman Filer The Kalman filer shows how o updae pas predicors and he corresponding predicion error variances when
More informationSpeaker Adaptation Techniques For Continuous Speech Using Medium and Small Adaptation Data Sets. Constantinos Boulis
Speaker Adapaion Techniques For Coninuous Speech Using Medium and Small Adapaion Daa Ses Consaninos Boulis Ouline of he Presenaion Inroducion o he speaker adapaion problem Maximum Likelihood Sochasic Transformaions
More informationCHAPTER 10 VALIDATION OF TEST WITH ARTIFICAL NEURAL NETWORK
175 CHAPTER 10 VALIDATION OF TEST WITH ARTIFICAL NEURAL NETWORK 10.1 INTRODUCTION Amongs he research work performed, he bes resuls of experimenal work are validaed wih Arificial Neural Nework. From he
More informationNotes on Kalman Filtering
Noes on Kalman Filering Brian Borchers and Rick Aser November 7, Inroducion Daa Assimilaion is he problem of merging model predicions wih acual measuremens of a sysem o produce an opimal esimae of he curren
More informationZürich. ETH Master Course: L Autonomous Mobile Robots Localization II
Roland Siegwar Margaria Chli Paul Furgale Marco Huer Marin Rufli Davide Scaramuzza ETH Maser Course: 151-0854-00L Auonomous Mobile Robos Localizaion II ACT and SEE For all do, (predicion updae / ACT),
More informationSEIF, EnKF, EKF SLAM. Pieter Abbeel UC Berkeley EECS
SEIF, EnKF, EKF SLAM Pieer Abbeel UC Berkeley EECS Informaion Filer From an analyical poin of view == Kalman filer Difference: keep rack of he inverse covariance raher han he covariance marix [maer of
More informationOBJECTIVES OF TIME SERIES ANALYSIS
OBJECTIVES OF TIME SERIES ANALYSIS Undersanding he dynamic or imedependen srucure of he observaions of a single series (univariae analysis) Forecasing of fuure observaions Asceraining he leading, lagging
More informationDiebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles
Diebold, Chaper 7 Francis X. Diebold, Elemens of Forecasing, 4h Ediion (Mason, Ohio: Cengage Learning, 006). Chaper 7. Characerizing Cycles Afer compleing his reading you should be able o: Define covariance
More informationDEPARTMENT OF STATISTICS
A Tes for Mulivariae ARCH Effecs R. Sco Hacker and Abdulnasser Haemi-J 004: DEPARTMENT OF STATISTICS S-0 07 LUND SWEDEN A Tes for Mulivariae ARCH Effecs R. Sco Hacker Jönköping Inernaional Business School
More informationRecursive Least-Squares Fixed-Interval Smoother Using Covariance Information based on Innovation Approach in Linear Continuous Stochastic Systems
8 Froniers in Signal Processing, Vol. 1, No. 1, July 217 hps://dx.doi.org/1.2266/fsp.217.112 Recursive Leas-Squares Fixed-Inerval Smooher Using Covariance Informaion based on Innovaion Approach in Linear
More informationm = 41 members n = 27 (nonfounders), f = 14 (founders) 8 markers from chromosome 19
Sequenial Imporance Sampling (SIS) AKA Paricle Filering, Sequenial Impuaion (Kong, Liu, Wong, 994) For many problems, sampling direcly from he arge disribuion is difficul or impossible. One reason possible
More information2.160 System Identification, Estimation, and Learning. Lecture Notes No. 8. March 6, 2006
2.160 Sysem Idenificaion, Esimaion, and Learning Lecure Noes No. 8 March 6, 2006 4.9 Eended Kalman Filer In many pracical problems, he process dynamics are nonlinear. w Process Dynamics v y u Model (Linearized)
More informationTesting for a Single Factor Model in the Multivariate State Space Framework
esing for a Single Facor Model in he Mulivariae Sae Space Framework Chen C.-Y. M. Chiba and M. Kobayashi Inernaional Graduae School of Social Sciences Yokohama Naional Universiy Japan Faculy of Economics
More informationInference of Sparse Gene Regulatory Network from RNA-Seq Time Series Data
Inference of Sparse Gene Regulaory Nework from RNA-Seq Time Series Daa Alireza Karbalayghareh and Tao Hu Texas A&M Universiy December 16, 2015 Alireza Karbalayghareh GRN Inference from RNA-Seq Time Series
More informationSimulation-Solving Dynamic Models ABE 5646 Week 2, Spring 2010
Simulaion-Solving Dynamic Models ABE 5646 Week 2, Spring 2010 Week Descripion Reading Maerial 2 Compuer Simulaion of Dynamic Models Finie Difference, coninuous saes, discree ime Simple Mehods Euler Trapezoid
More informationL07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS. NA568 Mobile Robotics: Methods & Algorithms
L07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS NA568 Mobile Roboics: Mehods & Algorihms Today s Topic Quick review on (Linear) Kalman Filer Kalman Filering for Non-Linear Sysems Exended Kalman Filer (EKF)
More informationTom Heskes and Onno Zoeter. Presented by Mark Buller
Tom Heskes and Onno Zoeer Presened by Mark Buller Dynamic Bayesian Neworks Direced graphical models of sochasic processes Represen hidden and observed variables wih differen dependencies Generalize Hidden
More informationObject tracking: Using HMMs to estimate the geographical location of fish
Objec racking: Using HMMs o esimae he geographical locaion of fish 02433 - Hidden Markov Models Marin Wæver Pedersen, Henrik Madsen Course week 13 MWP, compiled June 8, 2011 Objecive: Locae fish from agging
More informationACE 562 Fall Lecture 5: The Simple Linear Regression Model: Sampling Properties of the Least Squares Estimators. by Professor Scott H.
ACE 56 Fall 005 Lecure 5: he Simple Linear Regression Model: Sampling Properies of he Leas Squares Esimaors by Professor Sco H. Irwin Required Reading: Griffihs, Hill and Judge. "Inference in he Simple
More informationSTATE-SPACE MODELLING. A mass balance across the tank gives:
B. Lennox and N.F. Thornhill, 9, Sae Space Modelling, IChemE Process Managemen and Conrol Subjec Group Newsleer STE-SPACE MODELLING Inroducion: Over he pas decade or so here has been an ever increasing
More informationTwo Popular Bayesian Estimators: Particle and Kalman Filters. McGill COMP 765 Sept 14 th, 2017
Two Popular Bayesian Esimaors: Paricle and Kalman Filers McGill COMP 765 Sep 14 h, 2017 1 1 1, dx x Bel x u x P x z P Recall: Bayes Filers,,,,,,, 1 1 1 1 u z u x P u z u x z P Bayes z = observaion u =
More informationGMM - Generalized Method of Moments
GMM - Generalized Mehod of Momens Conens GMM esimaion, shor inroducion 2 GMM inuiion: Maching momens 2 3 General overview of GMM esimaion. 3 3. Weighing marix...........................................
More informationReferences are appeared in the last slide. Last update: (1393/08/19)
SYSEM IDEIFICAIO Ali Karimpour Associae Professor Ferdowsi Universi of Mashhad References are appeared in he las slide. Las updae: 0..204 393/08/9 Lecure 5 lecure 5 Parameer Esimaion Mehods opics o be
More informationApplication of a Stochastic-Fuzzy Approach to Modeling Optimal Discrete Time Dynamical Systems by Using Large Scale Data Processing
Applicaion of a Sochasic-Fuzzy Approach o Modeling Opimal Discree Time Dynamical Sysems by Using Large Scale Daa Processing AA WALASZE-BABISZEWSA Deparmen of Compuer Engineering Opole Universiy of Technology
More informationExcel-Based Solution Method For The Optimal Policy Of The Hadley And Whittin s Exact Model With Arma Demand
Excel-Based Soluion Mehod For The Opimal Policy Of The Hadley And Whiin s Exac Model Wih Arma Demand Kal Nami School of Business and Economics Winson Salem Sae Universiy Winson Salem, NC 27110 Phone: (336)750-2338
More informationEnsamble methods: Bagging and Boosting
Lecure 21 Ensamble mehods: Bagging and Boosing Milos Hauskrech milos@cs.pi.edu 5329 Senno Square Ensemble mehods Mixure of expers Muliple base models (classifiers, regressors), each covers a differen par
More informationEcon107 Applied Econometrics Topic 7: Multicollinearity (Studenmund, Chapter 8)
I. Definiions and Problems A. Perfec Mulicollineariy Econ7 Applied Economerics Topic 7: Mulicollineariy (Sudenmund, Chaper 8) Definiion: Perfec mulicollineariy exiss in a following K-variable regression
More informationVehicle Arrival Models : Headway
Chaper 12 Vehicle Arrival Models : Headway 12.1 Inroducion Modelling arrival of vehicle a secion of road is an imporan sep in raffic flow modelling. I has imporan applicaion in raffic flow simulaion where
More informationModal identification of structures from roving input data by means of maximum likelihood estimation of the state space model
Modal idenificaion of srucures from roving inpu daa by means of maximum likelihood esimaion of he sae space model J. Cara, J. Juan, E. Alarcón Absrac The usual way o perform a forced vibraion es is o fix
More information12: AUTOREGRESSIVE AND MOVING AVERAGE PROCESSES IN DISCRETE TIME. Σ j =
1: AUTOREGRESSIVE AND MOVING AVERAGE PROCESSES IN DISCRETE TIME Moving Averages Recall ha a whie noise process is a series { } = having variance σ. The whie noise process has specral densiy f (λ) = of
More informationRobust estimation based on the first- and third-moment restrictions of the power transformation model
h Inernaional Congress on Modelling and Simulaion, Adelaide, Ausralia, 6 December 3 www.mssanz.org.au/modsim3 Robus esimaion based on he firs- and hird-momen resricions of he power ransformaion Nawaa,
More informationAn introduction to the theory of SDDP algorithm
An inroducion o he heory of SDDP algorihm V. Leclère (ENPC) Augus 1, 2014 V. Leclère Inroducion o SDDP Augus 1, 2014 1 / 21 Inroducion Large scale sochasic problem are hard o solve. Two ways of aacking
More informationUnderstanding the asymptotic behaviour of empirical Bayes methods
Undersanding he asympoic behaviour of empirical Bayes mehods Boond Szabo, Aad van der Vaar and Harry van Zanen EURANDOM, 11.10.2011. Conens 2/20 Moivaion Nonparameric Bayesian saisics Signal in Whie noise
More informationKriging Models Predicting Atrazine Concentrations in Surface Water Draining Agricultural Watersheds
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 Kriging Models Predicing Arazine Concenraions in Surface Waer Draining Agriculural Waersheds Paul L. Mosquin, Jeremy Aldworh, Wenlin Chen Supplemenal Maerial Number
More informationProbabilistic Robotics The Sparse Extended Information Filter
Probabilisic Roboics The Sparse Exended Informaion Filer MSc course Arificial Inelligence 2018 hps://saff.fnwi.uva.nl/a.visser/educaion/probabilisicroboics/ Arnoud Visser Inelligen Roboics Lab Informaics
More informationLecture 20: Riccati Equations and Least Squares Feedback Control
34-5 LINEAR SYSTEMS Lecure : Riccai Equaions and Leas Squares Feedback Conrol 5.6.4 Sae Feedback via Riccai Equaions A recursive approach in generaing he marix-valued funcion W ( ) equaion for i for he
More informationLet us start with a two dimensional case. We consider a vector ( x,
Roaion marices We consider now roaion marices in wo and hree dimensions. We sar wih wo dimensions since wo dimensions are easier han hree o undersand, and one dimension is a lile oo simple. However, our
More informationReconstructing the power grid dynamic model from sparse measurements
Reconsrucing he power grid dynamic model from sparse measuremens Andrey Lokhov wih Michael Cherkov, Deepjyoi Deka, Sidhan Misra, Marc Vuffray Los Alamos Naional Laboraory Banff, Canada Moivaion: learning
More informationhen found from Bayes rule. Specically, he prior disribuion is given by p( ) = N( ; ^ ; r ) (.3) where r is he prior variance (we add on he random drif
Chaper Kalman Filers. Inroducion We describe Bayesian Learning for sequenial esimaion of parameers (eg. means, AR coeciens). The updae procedures are known as Kalman Filers. We show how Dynamic Linear
More informationHidden Markov Models. Adapted from. Dr Catherine Sweeney-Reed s slides
Hidden Markov Models Adaped from Dr Caherine Sweeney-Reed s slides Summary Inroducion Descripion Cenral in HMM modelling Exensions Demonsraion Specificaion of an HMM Descripion N - number of saes Q = {q
More informationLearning a Class from Examples. Training set X. Class C 1. Class C of a family car. Output: Input representation: x 1 : price, x 2 : engine power
Alpaydin Chaper, Michell Chaper 7 Alpaydin slides are in urquoise. Ehem Alpaydin, copyrigh: The MIT Press, 010. alpaydin@boun.edu.r hp://www.cmpe.boun.edu.r/ ehem/imle All oher slides are based on Michell.
More informationLinear Response Theory: The connection between QFT and experiments
Phys540.nb 39 3 Linear Response Theory: The connecion beween QFT and experimens 3.1. Basic conceps and ideas Q: How do we measure he conduciviy of a meal? A: we firs inroduce a weak elecric field E, and
More informationZápadočeská Univerzita v Plzni, Czech Republic and Groupe ESIEE Paris, France
ADAPTIVE SIGNAL PROCESSING USING MAXIMUM ENTROPY ON THE MEAN METHOD AND MONTE CARLO ANALYSIS Pavla Holejšovsá, Ing. *), Z. Peroua, Ing. **), J.-F. Bercher, Prof. Assis. ***) Západočesá Univerzia v Plzni,
More informationApplications in Industry (Extended) Kalman Filter. Week Date Lecture Title
hp://elec34.com Applicaions in Indusry (Eended) Kalman Filer 26 School of Informaion echnology and Elecrical Engineering a he Universiy of Queensland Lecure Schedule: Week Dae Lecure ile 29-Feb Inroducion
More informationINTRODUCTION TO MACHINE LEARNING 3RD EDITION
ETHEM ALPAYDIN The MIT Press, 2014 Lecure Slides for INTRODUCTION TO MACHINE LEARNING 3RD EDITION alpaydin@boun.edu.r hp://www.cmpe.boun.edu.r/~ehem/i2ml3e CHAPTER 2: SUPERVISED LEARNING Learning a Class
More informationHidden Markov Models
Hidden Markov Models Probabilisic reasoning over ime So far, we ve mosly deal wih episodic environmens Excepions: games wih muliple moves, planning In paricular, he Bayesian neworks we ve seen so far describe
More informationLearning a Class from Examples. Training set X. Class C 1. Class C of a family car. Output: Input representation: x 1 : price, x 2 : engine power
Alpaydin Chaper, Michell Chaper 7 Alpaydin slides are in urquoise. Ehem Alpaydin, copyrigh: The MIT Press, 010. alpaydin@boun.edu.r hp://www.cmpe.boun.edu.r/ ehem/imle All oher slides are based on Michell.
More informationComparing Means: t-tests for One Sample & Two Related Samples
Comparing Means: -Tess for One Sample & Two Relaed Samples Using he z-tes: Assumpions -Tess for One Sample & Two Relaed Samples The z-es (of a sample mean agains a populaion mean) is based on he assumpion
More informationAnti-Disturbance Control for Multiple Disturbances
Workshop a 3 ACC Ani-Disurbance Conrol for Muliple Disurbances Lei Guo (lguo@buaa.edu.cn) Naional Key Laboraory on Science and Technology on Aircraf Conrol, Beihang Universiy, Beijing, 9, P.R. China. Presened
More informationTracking. Announcements
Tracking Tuesday, Nov 24 Krisen Grauman UT Ausin Announcemens Pse 5 ou onigh, due 12/4 Shorer assignmen Auo exension il 12/8 I will no hold office hours omorrow 5 6 pm due o Thanksgiving 1 Las ime: Moion
More informationAnnouncements. Recap: Filtering. Recap: Reasoning Over Time. Example: State Representations for Robot Localization. Particle Filtering
Inroducion o Arificial Inelligence V22.0472-001 Fall 2009 Lecure 18: aricle & Kalman Filering Announcemens Final exam will be a 7pm on Wednesday December 14 h Dae of las class 1.5 hrs long I won ask anyhing
More informationAnno accademico 2006/2007. Davide Migliore
Roboica Anno accademico 2006/2007 Davide Migliore migliore@ele.polimi.i Today Eercise session: An Off-side roblem Robo Vision Task Measuring NBA layers erformance robabilisic Roboics Inroducion The Bayesian
More informationDeep Learning: Theory, Techniques & Applications - Recurrent Neural Networks -
Deep Learning: Theory, Techniques & Applicaions - Recurren Neural Neworks - Prof. Maeo Maeucci maeo.maeucci@polimi.i Deparmen of Elecronics, Informaion and Bioengineering Arificial Inelligence and Roboics
More informationIntroduction D P. r = constant discount rate, g = Gordon Model (1962): constant dividend growth rate.
Inroducion Gordon Model (1962): D P = r g r = consan discoun rae, g = consan dividend growh rae. If raional expecaions of fuure discoun raes and dividend growh vary over ime, so should he D/P raio. Since
More informationArticle from. Predictive Analytics and Futurism. July 2016 Issue 13
Aricle from Predicive Analyics and Fuurism July 6 Issue An Inroducion o Incremenal Learning By Qiang Wu and Dave Snell Machine learning provides useful ools for predicive analyics The ypical machine learning
More informationMaximum Likelihood Parameter Estimation in State-Space Models
Maximum Likelihood Parameer Esimaion in Sae-Space Models Arnaud Douce Deparmen of Saisics, Oxford Universiy Universiy College London 4 h Ocober 212 A. Douce (UCL Maserclass Oc. 212 4 h Ocober 212 1 / 32
More informationExpectation- Maximization & Baum-Welch. Slides: Roded Sharan, Jan 15; revised by Ron Shamir, Nov 15
Expecaion- Maximizaion & Baum-Welch Slides: Roded Sharan, Jan 15; revised by Ron Shamir, Nov 15 1 The goal Inpu: incomplee daa originaing from a probabiliy disribuion wih some unknown parameers Wan o find
More informationFinancial Econometrics Kalman Filter: some applications to Finance University of Evry - Master 2
Financial Economerics Kalman Filer: some applicaions o Finance Universiy of Evry - Maser 2 Eric Bouyé January 27, 2009 Conens 1 Sae-space models 2 2 The Scalar Kalman Filer 2 21 Presenaion 2 22 Summary
More informationEnergy Storage and Renewables in New Jersey: Complementary Technologies for Reducing Our Carbon Footprint
Energy Sorage and Renewables in New Jersey: Complemenary Technologies for Reducing Our Carbon Fooprin ACEE E-filliaes workshop November 14, 2014 Warren B. Powell Daniel Seingar Harvey Cheng Greg Davies
More information2016 Possible Examination Questions. Robotics CSCE 574
206 Possible Examinaion Quesions Roboics CSCE 574 ) Wha are he differences beween Hydraulic drive and Shape Memory Alloy drive? Name one applicaion in which each one of hem is appropriae. 2) Wha are he
More informationY, where. 1 Estimate St.error
1 HG Feb 2014 ECON 5101 Exercises III - 24 Feb 2014 Exercise 1 In lecure noes 3 (LN3 page 11) we esimaed an ARMA(1,2) for daa) for he period, 1978q2-2013q2 Le Y ln BNP ln BNP (Norwegian Model: Y Y, where
More informationModeling Economic Time Series with Stochastic Linear Difference Equations
A. Thiemer, SLDG.mcd, 6..6 FH-Kiel Universiy of Applied Sciences Prof. Dr. Andreas Thiemer e-mail: andreas.hiemer@fh-kiel.de Modeling Economic Time Series wih Sochasic Linear Difference Equaions Summary:
More informationAir Traffic Forecast Empirical Research Based on the MCMC Method
Compuer and Informaion Science; Vol. 5, No. 5; 0 ISSN 93-8989 E-ISSN 93-8997 Published by Canadian Cener of Science and Educaion Air Traffic Forecas Empirical Research Based on he MCMC Mehod Jian-bo Wang,
More informationEnsamble methods: Boosting
Lecure 21 Ensamble mehods: Boosing Milos Hauskrech milos@cs.pi.edu 5329 Senno Square Schedule Final exam: April 18: 1:00-2:15pm, in-class Term projecs April 23 & April 25: a 1:00-2:30pm in CS seminar room
More informationEstimation of Poses with Particle Filters
Esimaion of Poses wih Paricle Filers Dr.-Ing. Bernd Ludwig Chair for Arificial Inelligence Deparmen of Compuer Science Friedrich-Alexander-Universiä Erlangen-Nürnberg 12/05/2008 Dr.-Ing. Bernd Ludwig (FAU
More informationACE 562 Fall Lecture 4: Simple Linear Regression Model: Specification and Estimation. by Professor Scott H. Irwin
ACE 56 Fall 005 Lecure 4: Simple Linear Regression Model: Specificaion and Esimaion by Professor Sco H. Irwin Required Reading: Griffihs, Hill and Judge. "Simple Regression: Economic and Saisical Model
More informationThe electromagnetic interference in case of onboard navy ships computers - a new approach
The elecromagneic inerference in case of onboard navy ships compuers - a new approach Prof. dr. ing. Alexandru SOTIR Naval Academy Mircea cel Bărân, Fulgerului Sree, Consanţa, soiralexandru@yahoo.com Absrac.
More informationLecture 1 Overview. course mechanics. outline & topics. what is a linear dynamical system? why study linear systems? some examples
EE263 Auumn 27-8 Sephen Boyd Lecure 1 Overview course mechanics ouline & opics wha is a linear dynamical sysem? why sudy linear sysems? some examples 1 1 Course mechanics all class info, lecures, homeworks,
More informationIsolated-word speech recognition using hidden Markov models
Isolaed-word speech recogniion using hidden Markov models Håkon Sandsmark December 18, 21 1 Inroducion Speech recogniion is a challenging problem on which much work has been done he las decades. Some of
More informationA variational radial basis function approximation for diffusion processes.
A variaional radial basis funcion approximaion for diffusion processes. Michail D. Vreas, Dan Cornford and Yuan Shen {vreasm, d.cornford, y.shen}@ason.ac.uk Ason Universiy, Birmingham, UK hp://www.ncrg.ason.ac.uk
More informationMachine Learning 4771
ony Jebara, Columbia Universiy achine Learning 4771 Insrucor: ony Jebara ony Jebara, Columbia Universiy opic 20 Hs wih Evidence H Collec H Evaluae H Disribue H Decode H Parameer Learning via JA & E ony
More information4.1 Other Interpretations of Ridge Regression
CHAPTER 4 FURTHER RIDGE THEORY 4. Oher Inerpreaions of Ridge Regression In his secion we will presen hree inerpreaions for he use of ridge regression. The firs one is analogous o Hoerl and Kennard reasoning
More informationLecture 3: Exponential Smoothing
NATCOR: Forecasing & Predicive Analyics Lecure 3: Exponenial Smoohing John Boylan Lancaser Cenre for Forecasing Deparmen of Managemen Science Mehods and Models Forecasing Mehod A (numerical) procedure
More information1 Review of Zero-Sum Games
COS 5: heoreical Machine Learning Lecurer: Rob Schapire Lecure #23 Scribe: Eugene Brevdo April 30, 2008 Review of Zero-Sum Games Las ime we inroduced a mahemaical model for wo player zero-sum games. Any
More informationOptimal Path Planning for Flexible Redundant Robot Manipulators
25 WSEAS In. Conf. on DYNAMICAL SYSEMS and CONROL, Venice, Ialy, November 2-4, 25 (pp363-368) Opimal Pah Planning for Flexible Redundan Robo Manipulaors H. HOMAEI, M. KESHMIRI Deparmen of Mechanical Engineering
More informationSequential Importance Resampling (SIR) Particle Filter
Paricle Filers++ Pieer Abbeel UC Berkeley EECS Many slides adaped from Thrun, Burgard and Fox, Probabilisic Roboics 1. Algorihm paricle_filer( S -1, u, z ): 2. Sequenial Imporance Resampling (SIR) Paricle
More informationAn EM based training algorithm for recurrent neural networks
An EM based raining algorihm for recurren neural neworks Jan Unkelbach, Sun Yi, and Jürgen Schmidhuber IDSIA,Galleria 2, 6928 Manno, Swizerland {jan.unkelbach,yi,juergen}@idsia.ch hp://www.idsia.ch Absrac.
More informationProbabilistic Robotics SLAM
Probabilisic Roboics SLAM The SLAM Problem SLAM is he process by which a robo builds a map of he environmen and, a he same ime, uses his map o compue is locaion Localizaion: inferring locaion given a map
More informationPattern Classification (VI) 杜俊
Paern lassificaion VI 杜俊 jundu@usc.edu.cn Ouline Bayesian Decision Theory How o make he oimal decision? Maximum a oserior MAP decision rule Generaive Models Join disribuion of observaion and label sequences
More informationLecture 33: November 29
36-705: Inermediae Saisics Fall 2017 Lecurer: Siva Balakrishnan Lecure 33: November 29 Today we will coninue discussing he boosrap, and hen ry o undersand why i works in a simple case. In he las lecure
More informationh[n] is the impulse response of the discrete-time system:
Definiion Examples Properies Memory Inveribiliy Causaliy Sabiliy Time Invariance Lineariy Sysems Fundamenals Overview Definiion of a Sysem x() h() y() x[n] h[n] Sysem: a process in which inpu signals are
More informationBOKDSGE: A DSGE Model for the Korean Economy
BOKDSGE: A DSGE Model for he Korean Economy June 4, 2008 Joong Shik Lee, Head Macroeconomeric Model Secion Research Deparmen The Bank of Korea Ouline 1. Background 2. Model srucure & parameer values 3.
More informationTime series model fitting via Kalman smoothing and EM estimation in TimeModels.jl
Time series model fiing via Kalman smoohing and EM esimaion in TimeModels.jl Gord Sephen Las updaed: January 206 Conens Inroducion 2. Moivaion and Acknowledgemens....................... 2.2 Noaion......................................
More informationLearning Objectives: Practice designing and simulating digital circuits including flip flops Experience state machine design procedure
Lab 4: Synchronous Sae Machine Design Summary: Design and implemen synchronous sae machine circuis and es hem wih simulaions in Cadence Viruoso. Learning Objecives: Pracice designing and simulaing digial
More informationReliability of Technical Systems
eliabiliy of Technical Sysems Main Topics Inroducion, Key erms, framing he problem eliabiliy parameers: Failure ae, Failure Probabiliy, Availabiliy, ec. Some imporan reliabiliy disribuions Componen reliabiliy
More informationProbabilistic Robotics
Probabilisic Roboics Bayes Filer Implemenaions Gaussian filers Bayes Filer Reminder Predicion bel p u bel d Correcion bel η p z bel Gaussians : ~ π e p N p - Univariae / / : ~ μ μ μ e p Ν p d π Mulivariae
More informationStable block Toeplitz matrix for the processing of multichannel seismic data
Indian Journal of Marine Sciences Vol. 33(3), Sepember 2004, pp. 215-219 Sable block Toepliz marix for he processing of mulichannel seismic daa Kiri Srivasava* & V P Dimri Naional Geophysical Research
More informationEKF SLAM vs. FastSLAM A Comparison
vs. A Comparison Michael Calonder, Compuer Vision Lab Swiss Federal Insiue of Technology, Lausanne EPFL) michael.calonder@epfl.ch The wo algorihms are described wih a planar robo applicaion in mind. Generalizaion
More informationProblemas das Aulas Práticas
Mesrado Inegrado em Engenharia Elecroécnica e de Compuadores Conrolo em Espaço de Esados Problemas das Aulas Práicas J. Miranda Lemos Fevereiro de 3 Translaed o English by José Gaspar, 6 J. M. Lemos, IST
More informationRobust Learning Control with Application to HVAC Systems
Robus Learning Conrol wih Applicaion o HVAC Sysems Naional Science Foundaion & Projec Invesigaors: Dr. Charles Anderson, CS Dr. Douglas Hile, ME Dr. Peer Young, ECE Mechanical Engineering Compuer Science
More informationBias in Conditional and Unconditional Fixed Effects Logit Estimation: a Correction * Tom Coupé
Bias in Condiional and Uncondiional Fixed Effecs Logi Esimaion: a Correcion * Tom Coupé Economics Educaion and Research Consorium, Naional Universiy of Kyiv Mohyla Academy Address: Vul Voloska 10, 04070
More informationOn Measuring Pro-Poor Growth. 1. On Various Ways of Measuring Pro-Poor Growth: A Short Review of the Literature
On Measuring Pro-Poor Growh 1. On Various Ways of Measuring Pro-Poor Growh: A Shor eview of he Lieraure During he pas en years or so here have been various suggesions concerning he way one should check
More informationPhysics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle
Chaper 2 Newonian Mechanics Single Paricle In his Chaper we will review wha Newon s laws of mechanics ell us abou he moion of a single paricle. Newon s laws are only valid in suiable reference frames,
More informationExponential Weighted Moving Average (EWMA) Chart Under The Assumption of Moderateness And Its 3 Control Limits
DOI: 0.545/mjis.07.5009 Exponenial Weighed Moving Average (EWMA) Char Under The Assumpion of Moderaeness And Is 3 Conrol Limis KALPESH S TAILOR Assisan Professor, Deparmen of Saisics, M. K. Bhavnagar Universiy,
More informationScheduling of Crude Oil Movements at Refinery Front-end
Scheduling of Crude Oil Movemens a Refinery Fron-end Ramkumar Karuppiah and Ignacio Grossmann Carnegie Mellon Universiy ExxonMobil Case Sudy: Dr. Kevin Furman Enerprise-wide Opimizaion Projec March 15,
More informationFrequency independent automatic input variable selection for neural networks for forecasting
Universiä Hamburg Insiu für Wirschafsinformaik Prof. Dr. D.B. Preßmar Frequency independen auomaic inpu variable selecion for neural neworks for forecasing Nikolaos Kourenzes Sven F. Crone LUMS Deparmen
More information