Large data sets and complex models: A view from Systems Biology

Size: px
Start display at page:

Download "Large data sets and complex models: A view from Systems Biology"

Transcription

1 Large data sets and comple models: A view from Systems Biology Bärbel Finenstädt, Department of Statistics, University of Warwic OWaSP worshop October 5

2 Joint wor with Mathematical and Statistical Modelling: Sylvia Calderao, Simone Tiberi, Kirsty Hey, Hiroshi Momiji, Dafyd Jenins, George Minas, David Rand (University of Warwic) Eperimental Collaboration: PRL epression in pituitary gland (Julien Davis, Mie White, University of Manchester) Chronotherapy and Cancer Research Unit (Francis Lévi and group), Warwic Medical School and INSERM, Paris Molecular Neurobiology of circadian timing (Michael Hastings and group), MRC Laboratory of Molecular Biology, Cambridge PRESTA Consortium (University of Warwic) Funding: BBSRC, EPSRC, MRC, EU (BIOSIM), Wellcome

3 Gene Epression

4 Standard Model of Gene Epression (Single Gene) DNA$ Transcrip3on$ Transla3on$ mrna$ Protein$ β(t)$ α Degrada3on$ δ $ Degrada3on$ δ $

5 Standard Model of Gene Epression (Single Gene, ODE Version) dm(t) dt = (t) mm(t), dp(t) dt = m(t) pp(t) where m(t) : concentration of mrna p(t) : concentration of protein (t) : transcription rate of mrna m, p : degradation rate of mrna, protein

6 Standard Model of gene epression (Stochastic version, single gene) X(t) = Xm (t) X p (t) 4 reactions (transcription, degradation mrna, translation, degradation protein) v =,v =,v 3 =,v 4 = A reaction of type j changes X(t) tox(t)v j. Each reaction occurs at a rate w j (X(t)).

7 Event E ect Transition Rate Transcription (X m,x p )! (X m,x p ) w = (t) Degradation of mrna (X m,x p )! (X m,x p ) w = m X m (t) Translation (X m,x p )! (X m,x p ) w 3 = X m (t) Degradation of protein (X m,x p )! (X m,x p ) w 4 = p X p (t) Table : Summary of reactions in the standard model of gene epression Reaction networs constitute continuous time Marov jump processes and thus satisfy the Chapman-Kolmogorov equation for which one can obtain the forward form nown as the master equation (ME) describing the evolution of the probability P (X m = n,x p = n ; t). Although an eact numerical simulation algorithm is provided (Gillespie,977) the ME is rarely tractable and hence an eplicit formula for the eact lielihood is not available for parameter inference.

8

9 Gene Networs

10

11 Figure. A model for the mammalian circadian cloc. Relógio A, Westermar PO, Wallach T, Schellenberg K, Kramer A, et al. () Tuning the Mammalian Circadian Cloc: Robust Synergy of Two Loops. PLoS Comput Biol 7(): e39. doi:.37/journal.pcbi.39

12 CLOCK/BMAL 7 d d f dt d = () Rev-Erb ma 3 y d PC g V dt dy y v t v t w i v t # $ & ' # $ & ' # $ & ' # $ & ' = () Ror ma 4 y d PC h V dt dy y p t p t q i p t # $ & ' # $ & ' # $ & ' # $ & ' = (3) REV-ERB C 6 6 ) 3 3 ( d i y y dt d p = (4) ROR C 7 7 ) 4 4 ( d i y y dt d p = (5) REV-ERB N d i dt d = (6) ROR N d i dt d = (7) Bmal ma 5 y d i V dt dy y n t m i n t # $ & ' # $ & ' # $ & ' = (8) BMAL C 8 8 ) 5 5 ( d i y y dt d p = (9) BMAL N d f d i dt d = () Per ma y d PC a V dt dy y b t b t c i b t # $ & ' # $ & ' # $ & ' # $ & ' = () Cry 5 ma y d PC d V dt dy y f i e t e t f i e t # $ & ' # $ & ' # $ & ' # $ & ' # $ & ' = () CRY C ) ( d f f d d y y dt d p = (3)

13 Gene Epression Data

14

15 Plant Microarray time series (PRESTA project) Norm. ep Norm. ep Norm. ep Norm. ep. 4 Timescale (hours) 4 Timescale (hours) 4 Timescale (hours) 4 Timescale (hours)

16 Searching for transcription factors (TFs) of gene regulation from microarray data Scenario: Have (replicate) time series microarray gene epression data across various eperiments and a set of candidate parents from YH eperiments

17

18

19

20 Modeling: Transcription β(t) of a gene (Child gene) is regulated by transcriptional activators and/or inhibitors. These are protein products, called Transcription Factors (TFs), of other genes (Parent genes). Wish to draw inference about regulation of mrna transcription of a child gene by an unnown subset = {,,..., } of the candidate parents G = {g,g,...,g G } Switches occur at times where the epression, Pγ (t) of a parent γ Γ crosses a threshold level due to an increase or decrease.

21 Define activation function (t) =( (t), (t),..., (t)) The set of switch times of the child s transcription is the set of time-points {s,s,...,s } at which at least one parent crosses its threshold. The total time interval split into subintervals [,s ], (s,s ],...,(s,l] where the transcription rates of the subintervals are the same if the epression of all parent genes remains at the same state For a given activation function (t) we then have a set of parental states, b j,j =,,...,apple observed in the union I bj of (at least one of) the above subintervals with the corresponding transcription rates bj,j =,,...,apple

22 dm dt = 8 b M M(t), for t I b >< b M M(t), for t I b >: bapple M M(t), for t I. bapple

23 Statistical Implementation: Bayesian approach: RJMCMC to infer plausible models for parents Lielihood based on normal error with inhomogeneous variance Weighted Least Squares solution to piecewise linear ODE maes algorithm fast Delayed RNA as proy for unobserved TF s

24

25

26

27 Single cell imaging data

28 Reporter Gene constructs ; ; degradation degradation mrna Protein regulation translation DNA transcription translation measurements reporter mrna reporter Protein Light Intensity degradation degradation ; ;

29 Modelling single cell data The class of state space models provides a unifying framewor for modelling SRNs Y t g(y t t, ) X t h( t ) Y Y Y... Y T X X X... X T h is the transition density of the approimating SRN g is the density of the measurement process

30 Approimations ODE (neglects intrinsic noise) Chemical Langevin Equation (usually intractable) Linear Noise Approimation (lineariation of the ME, tractable) Other approimations?

31 Parameter Inference The data lielihood is given by the marginal density f(y ) = Z f(y, )d where the integrand can be factoried as f(y, ) =h( )g(y, ) TY h( t t, )g(y t t, ) t=

32 Parameter Inference Under the LNA (with Gaussian measurement error): Interval can be evaluated eplicitly using Kalman methodology. Inference can be achieved by sampling from the posterior f( y) Under BDA (for eample) : use -step Gibbs sampler:. Sample the parameter vector from f(, y). Sample the latent states from the filtering density f( y, )

33 Time (hours) Time (hours)

34

35 Challenges for statisticians in Systems Biology and Systems Medicine Comple and large networs of genes and their products Data from many sources: Replicates and if so what type? Many cells (Bayesian Hierarchical Modeling) Various labs (Prior Distributions) Destructive Sampling. Different Types of Eperiments imply different modeling approaches Information about intrinsic noise? Etrinsic noise? Destructive sampling? Reporter gene constructs? Which reporter gene? Type of camera used for imaging

36 Not all state variables are observed Can use distributed delay functions as a proy? Parameter Identifiability Spatio-temporal modelling and inference Collaboration between eperimentalists and mathematician/statisticians

37 Research Questions Mammalian Circadian Oscillator under diseases and treatments. Eploitation for Chronotherapy Development of signal processing tools for circadian time series to be used in forecasting systems for patient care at home Development of Spatio-temporal models to investigate how cells synchronie in the SCN

38 #B*(shBmal)* Photon* Implanta(on* pompe* *******************************3**********4**********5**********6**********7***********8*********9**********************************3********4********5*******6** ******************************3**********4**********5**********6*********7**********8**********9*********************************3********4********5********6** Jouraprèsinocula.ontumorale

39 CT49&:&KI/KI&Per::luc&male&mouse&(B)& Implanta(on* pump* DEN*(5*mg/g/j,*ip)* Ac)vity& Photon& 7&&&&&&&&&&&8&&&&&&&&&&9&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&3&&&&&&&&&&4&&&&&&&&&&5&&&&&&&&&&6&&&&&&&&&&7&&&&&&&&&&8&&&&&&&&&&9&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&3& 7&&&&&&&&&&8&&&&&&&&&&9&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&3&&&&&&&&&&4&&&&&&&&&&5&&&&&&&&&&6&&&&&&&&&7&&&&&&&&&&8&&&&&&&&&&9&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&3& Day&

40 ZCM$PICADO$ 9::3 :3:3 :4:3 3:36:3 5:8:3 6:4:3 8::3 9:44:3 :6:3 :48:3 ::3 :5:3 3:4:3 4:56:3 6:8:3 8::3 9:3:3 :4:3 :36:3 4:8:3 5:4:3 7::3 8:44:3 :6:3 :48:3 3::3 :5:3 :4:3 3:56:3 5:8:3 7::3 8:3:3 :4:3 :36:3 3:8:3 4:4:3 6::3 7:44:3 9:6:3 :48:3 ::3 3:5:3 :4:3 :56:3 4:8:3 6::3 7:3:3 9:4:3 :36:3 :8:3 3:4:3 5::3 6:44:3 8:6:3 9:48:3 ::3 :5:3 :4:3 :56:3 3:8:3 5::3 6:3:3 8:4:3 38# 36# 34# 3# 3# 8# 6# 4# # # :# :# :# :# :# :# :# :# :# :# :# Temp#capteur# Temp#collecteur#

41

42 Figure. A model for the mammalian circadian cloc. Relógio A, Westermar PO, Wallach T, Schellenberg K, Kramer A, et al. () Tuning the Mammalian Circadian Cloc: Robust Synergy of Two Loops. PLoS Comput Biol 7(): e39. doi:.37/journal.pcbi.39

Intrinsic Noise in Nonlinear Gene Regulation Inference

Intrinsic Noise in Nonlinear Gene Regulation Inference Intrinsic Noise in Nonlinear Gene Regulation Inference Chao Du Department of Statistics, University of Virginia Joint Work with Wing H. Wong, Department of Statistics, Stanford University Transcription

More information

Modelling gene expression dynamics with Gaussian processes

Modelling gene expression dynamics with Gaussian processes Modelling gene expression dynamics with Gaussian processes Regulatory Genomics and Epigenomics March th 6 Magnus Rattray Faculty of Life Sciences University of Manchester Talk Outline Introduction to Gaussian

More information

F denotes cumulative density. denotes probability density function; (.)

F denotes cumulative density. denotes probability density function; (.) BAYESIAN ANALYSIS: FOREWORDS Notation. System means the real thing and a model is an assumed mathematical form for the system.. he probability model class M contains the set of the all admissible models

More information

Probabilistic Graphical Models

Probabilistic Graphical Models Probabilistic Graphical Models Lecture Notes Fall 2009 November, 2009 Byoung-Ta Zhang School of Computer Science and Engineering & Cognitive Science, Brain Science, and Bioinformatics Seoul National University

More information

2. Mathematical descriptions. (i) the master equation (ii) Langevin theory. 3. Single cell measurements

2. Mathematical descriptions. (i) the master equation (ii) Langevin theory. 3. Single cell measurements 1. Why stochastic?. Mathematical descriptions (i) the master equation (ii) Langevin theory 3. Single cell measurements 4. Consequences Any chemical reaction is stochastic. k P d φ dp dt = k d P deterministic

More information

Why Should I Care About. Stochastic Hybrid Systems?

Why Should I Care About. Stochastic Hybrid Systems? Research Supported by NSF & ARO Why Should I Care About Stochastic Hybrid Systems? João Hespanha 1 Why Care Should I Care About SHSs? Eamples Feedback over shared networks Estimation using remote sensors

More information

Trends in Scientific Investigation

Trends in Scientific Investigation Trends in Scientific Investigation 20 th Century Genomics Reductionism 20 th Century Biomedical Sciences Genes Proteins Cell Organ Organism 21 st Century Genomics Proteomics Molecular biophysics Bioinformatics

More information

7.32/7.81J/8.591J: Systems Biology. Fall Exam #1

7.32/7.81J/8.591J: Systems Biology. Fall Exam #1 7.32/7.81J/8.591J: Systems Biology Fall 2013 Exam #1 Instructions 1) Please do not open exam until instructed to do so. 2) This exam is closed- book and closed- notes. 3) Please do all problems. 4) Use

More information

Bioinformatics 2 - Lecture 4

Bioinformatics 2 - Lecture 4 Bioinformatics 2 - Lecture 4 Guido Sanguinetti School of Informatics University of Edinburgh February 14, 2011 Sequences Many data types are ordered, i.e. you can naturally say what is before and what

More information

Cybergenetics: Control theory for living cells

Cybergenetics: Control theory for living cells Department of Biosystems Science and Engineering, ETH-Zürich Cybergenetics: Control theory for living cells Corentin Briat Joint work with Ankit Gupta and Mustafa Khammash Introduction Overview Cybergenetics:

More information

Langevin Monte Carlo Filtering for Target Tracking

Langevin Monte Carlo Filtering for Target Tracking Langevin Monte Carlo Filtering for Target Tracing Fernando J Iglesias García, Mélanie Bocquel, Hans Driessen Thales Nederland BV - Sensors Development System Engineering, Hengelo, Nederland Email: {FernandojoseIglesiasgarcia,

More information

GLOBEX Bioinformatics (Summer 2015) Genetic networks and gene expression data

GLOBEX Bioinformatics (Summer 2015) Genetic networks and gene expression data GLOBEX Bioinformatics (Summer 2015) Genetic networks and gene expression data 1 Gene Networks Definition: A gene network is a set of molecular components, such as genes and proteins, and interactions between

More information

McGill University. Department of Epidemiology and Biostatistics. Bayesian Analysis for the Health Sciences. Course EPIB-675.

McGill University. Department of Epidemiology and Biostatistics. Bayesian Analysis for the Health Sciences. Course EPIB-675. McGill University Department of Epidemiology and Biostatistics Bayesian Analysis for the Health Sciences Course EPIB-675 Lawrence Joseph Bayesian Analysis for the Health Sciences EPIB-675 3 credits Instructor:

More information

Part 3: Introduction to Master Equation and Complex Initial Conditions in Lattice Microbes

Part 3: Introduction to Master Equation and Complex Initial Conditions in Lattice Microbes Part 3: Introduction to Master Equation Cells: and Complex Initial Conditions in Lattice re cells Microbes en Biophysics, and UC urgh, June 6-8, 2016 rson Joseph R. Peterson and Michael J. Hallock Luthey-Schulten

More information

1 Introduction. Maria Luisa Guerriero. Jane Hillston

1 Introduction. Maria Luisa Guerriero. Jane Hillston Time-Series Analysis of Circadian Clocks: Quantifying the Effect of Stochasticity on the Distribution of Phase, Period and Amplitude of Circadian Oscillations Maria Luisa Guerriero Centre for Systems Biology

More information

State Space and Hidden Markov Models

State Space and Hidden Markov Models State Space and Hidden Markov Models Kunsch H.R. State Space and Hidden Markov Models. ETH- Zurich Zurich; Aliaksandr Hubin Oslo 2014 Contents 1. Introduction 2. Markov Chains 3. Hidden Markov and State

More information

56:198:582 Biological Networks Lecture 8

56:198:582 Biological Networks Lecture 8 56:198:582 Biological Networks Lecture 8 Course organization Two complementary approaches to modeling and understanding biological networks Constraint-based modeling (Palsson) System-wide Metabolism Steady-state

More information

CS-E5880 Modeling biological networks Gene regulatory networks

CS-E5880 Modeling biological networks Gene regulatory networks CS-E5880 Modeling biological networks Gene regulatory networks Jukka Intosalmi (based on slides by Harri Lähdesmäki) Department of Computer Science Aalto University January 12, 2018 Outline Modeling gene

More information

Bayesian Approach 2. CSC412 Probabilistic Learning & Reasoning

Bayesian Approach 2. CSC412 Probabilistic Learning & Reasoning CSC412 Probabilistic Learning & Reasoning Lecture 12: Bayesian Parameter Estimation February 27, 2006 Sam Roweis Bayesian Approach 2 The Bayesian programme (after Rev. Thomas Bayes) treats all unnown quantities

More information

Network Biology-part II

Network Biology-part II Network Biology-part II Jun Zhu, Ph. D. Professor of Genomics and Genetic Sciences Icahn Institute of Genomics and Multi-scale Biology The Tisch Cancer Institute Icahn Medical School at Mount Sinai New

More information

Expression arrays, normalization, and error models

Expression arrays, normalization, and error models 1 Epression arrays, normalization, and error models There are a number of different array technologies available for measuring mrna transcript levels in cell populations, from spotted cdna arrays to in

More information

CS Lecture 18. Expectation Maximization

CS Lecture 18. Expectation Maximization CS 6347 Lecture 18 Expectation Maximization Unobserved Variables Latent or hidden variables in the model are never observed We may or may not be interested in their values, but their existence is crucial

More information

Time Delay Estimation: Microlensing

Time Delay Estimation: Microlensing Time Delay Estimation: Microlensing Hyungsuk Tak Stat310 15 Sep 2015 Joint work with Kaisey Mandel, David A. van Dyk, Vinay L. Kashyap, Xiao-Li Meng, and Aneta Siemiginowska Introduction Image Credit:

More information

Combine Monte Carlo with Exhaustive Search: Effective Variational Inference and Policy Gradient Reinforcement Learning

Combine Monte Carlo with Exhaustive Search: Effective Variational Inference and Policy Gradient Reinforcement Learning Combine Monte Carlo with Exhaustive Search: Effective Variational Inference and Policy Gradient Reinforcement Learning Michalis K. Titsias Department of Informatics Athens University of Economics and Business

More information

Markov Chain Monte Carlo Algorithms for Gaussian Processes

Markov Chain Monte Carlo Algorithms for Gaussian Processes Markov Chain Monte Carlo Algorithms for Gaussian Processes Michalis K. Titsias, Neil Lawrence and Magnus Rattray School of Computer Science University of Manchester June 8 Outline Gaussian Processes Sampling

More information

Gene Expression as a Stochastic Process: From Gene Number Distributions to Protein Statistics and Back

Gene Expression as a Stochastic Process: From Gene Number Distributions to Protein Statistics and Back Gene Expression as a Stochastic Process: From Gene Number Distributions to Protein Statistics and Back June 19, 2007 Motivation & Basics A Stochastic Approach to Gene Expression Application to Experimental

More information

Lecture 6: Multiple Model Filtering, Particle Filtering and Other Approximations

Lecture 6: Multiple Model Filtering, Particle Filtering and Other Approximations Lecture 6: Multiple Model Filtering, Particle Filtering and Other Approximations Department of Biomedical Engineering and Computational Science Aalto University April 28, 2010 Contents 1 Multiple Model

More information

Online appendix to On the stability of the excess sensitivity of aggregate consumption growth in the US

Online appendix to On the stability of the excess sensitivity of aggregate consumption growth in the US Online appendix to On the stability of the excess sensitivity of aggregate consumption growth in the US Gerdie Everaert 1, Lorenzo Pozzi 2, and Ruben Schoonackers 3 1 Ghent University & SHERPPA 2 Erasmus

More information

Dynamical-Systems Perspective to Stem-cell Biology: Relevance of oscillatory gene expression dynamics and cell-cell interaction

Dynamical-Systems Perspective to Stem-cell Biology: Relevance of oscillatory gene expression dynamics and cell-cell interaction Dynamical-Systems Perspective to Stem-cell Biology: Relevance of oscillatory gene expression dynamics and cell-cell interaction Kunihiko Kaneko Universal Biology Inst., Center for Complex-Systems Biology,

More information

Modeling and Systems Analysis of Gene Regulatory Networks

Modeling and Systems Analysis of Gene Regulatory Networks Modeling and Systems Analysis of Gene Regulatory Networks Mustafa Khammash Center for Control Dynamical-Systems and Computations University of California, Santa Barbara Outline Deterministic A case study:

More information

scrna-seq Differential expression analysis methods Olga Dethlefsen NBIS, National Bioinformatics Infrastructure Sweden October 2017

scrna-seq Differential expression analysis methods Olga Dethlefsen NBIS, National Bioinformatics Infrastructure Sweden October 2017 scrna-seq Differential expression analysis methods Olga Dethlefsen NBIS, National Bioinformatics Infrastructure Sweden October 2017 Olga (NBIS) scrna-seq de October 2017 1 / 34 Outline Introduction: what

More information

Recursive Noise Adaptive Kalman Filtering by Variational Bayesian Approximations

Recursive Noise Adaptive Kalman Filtering by Variational Bayesian Approximations PREPRINT 1 Recursive Noise Adaptive Kalman Filtering by Variational Bayesian Approximations Simo Särä, Member, IEEE and Aapo Nummenmaa Abstract This article considers the application of variational Bayesian

More information

Markov Chain Monte Carlo Methods for Stochastic Optimization

Markov Chain Monte Carlo Methods for Stochastic Optimization Markov Chain Monte Carlo Methods for Stochastic Optimization John R. Birge The University of Chicago Booth School of Business Joint work with Nicholas Polson, Chicago Booth. JRBirge U of Toronto, MIE,

More information

Gaussian Mixture Model

Gaussian Mixture Model Case Study : Document Retrieval MAP EM, Latent Dirichlet Allocation, Gibbs Sampling Machine Learning/Statistics for Big Data CSE599C/STAT59, University of Washington Emily Fox 0 Emily Fox February 5 th,

More information

RAO-BLACKWELLIZED PARTICLE FILTER FOR MARKOV MODULATED NONLINEARDYNAMIC SYSTEMS

RAO-BLACKWELLIZED PARTICLE FILTER FOR MARKOV MODULATED NONLINEARDYNAMIC SYSTEMS RAO-BLACKWELLIZED PARTICLE FILTER FOR MARKOV MODULATED NONLINEARDYNAMIC SYSTEMS Saiat Saha and Gustaf Hendeby Linöping University Post Print N.B.: When citing this wor, cite the original article. 2014

More information

BIOMED Programming & Modeling for BME Final Exam, , Instructor: Ahmet Sacan

BIOMED Programming & Modeling for BME Final Exam, , Instructor: Ahmet Sacan BIOMED 201 - Programming & Modeling for BME Final Exam, 2011.12.01, Instructor: Ahmet Sacan Sign the honor code below. No credit will be given for the exam without a signed pledge. I have neither given

More information

Written Exam 15 December Course name: Introduction to Systems Biology Course no

Written Exam 15 December Course name: Introduction to Systems Biology Course no Technical University of Denmark Written Exam 15 December 2008 Course name: Introduction to Systems Biology Course no. 27041 Aids allowed: Open book exam Provide your answers and calculations on separate

More information

A Simple Protein Synthesis Model

A Simple Protein Synthesis Model A Simple Protein Synthesis Model James K. Peterson Department of Biological Sciences and Department of Mathematical Sciences Clemson University September 3, 213 Outline A Simple Protein Synthesis Model

More information

Introduction to Bioinformatics

Introduction to Bioinformatics CSCI8980: Applied Machine Learning in Computational Biology Introduction to Bioinformatics Rui Kuang Department of Computer Science and Engineering University of Minnesota kuang@cs.umn.edu History of Bioinformatics

More information

Chapter 15 Active Reading Guide Regulation of Gene Expression

Chapter 15 Active Reading Guide Regulation of Gene Expression Name: AP Biology Mr. Croft Chapter 15 Active Reading Guide Regulation of Gene Expression The overview for Chapter 15 introduces the idea that while all cells of an organism have all genes in the genome,

More information

Chemistry Chapter 26

Chemistry Chapter 26 Chemistry 2100 Chapter 26 The Central Dogma! The central dogma of molecular biology: Information contained in DNA molecules is expressed in the structure of proteins. Gene expression is the turning on

More information

Genomic Data Assimilation for Estimating Hybrid Functional Petri Net from Time-Course Gene Expression Data

Genomic Data Assimilation for Estimating Hybrid Functional Petri Net from Time-Course Gene Expression Data 46 Genome Informatics 171): 46 61 2006) Genomic Data Assimilation for Estimating Hybrid Functional Petri et from Time-Course Gene Expression Data Masao agasaki 1 Rui Yamaguchi 1 Ryo Yoshida 1 masao@ims.u-tokyo.ac.jp

More information

Linear Dynamical Systems

Linear Dynamical Systems Linear Dynamical Systems Sargur N. srihari@cedar.buffalo.edu Machine Learning Course: http://www.cedar.buffalo.edu/~srihari/cse574/index.html Two Models Described by Same Graph Latent variables Observations

More information

Modelling in Biology

Modelling in Biology Modelling in Biology Dr Guy-Bart Stan Department of Bioengineering 17th October 2017 Dr Guy-Bart Stan (Dept. of Bioeng.) Modelling in Biology 17th October 2017 1 / 77 1 Introduction 2 Linear models of

More information

A Synthetic Oscillatory Network of Transcriptional Regulators

A Synthetic Oscillatory Network of Transcriptional Regulators A Synthetic Oscillatory Network of Transcriptional Regulators Michael Elowitz & Stanislas Leibler Nature, 2000 Presented by Khaled A. Rahman Background Genetic Networks Gene X Operator Operator Gene Y

More information

Gene Autoregulation via Intronic micrornas and its Functions

Gene Autoregulation via Intronic micrornas and its Functions Gene Autoregulation via Intronic micrornas and its Functions Carla Bosia Department of Theoretical Physics University of Torino and INFN, Italy cbosia@to.infn.it Annecy-le-Vieux 20-22/10/2010 OUTLINE microrna

More information

For final project discussion every afternoon Mark and I will be available

For final project discussion every afternoon Mark and I will be available Worshop report 1. Daniels report is on website 2. Don t expect to write it based on listening to one project (we had 6 only 2 was sufficient quality) 3. I suggest writing it on one presentation. 4. Include

More information

Lecture 6: Bayesian Inference in SDE Models

Lecture 6: Bayesian Inference in SDE Models Lecture 6: Bayesian Inference in SDE Models Bayesian Filtering and Smoothing Point of View Simo Särkkä Aalto University Simo Särkkä (Aalto) Lecture 6: Bayesian Inference in SDEs 1 / 45 Contents 1 SDEs

More information

Discovering molecular pathways from protein interaction and ge

Discovering molecular pathways from protein interaction and ge Discovering molecular pathways from protein interaction and gene expression data 9-4-2008 Aim To have a mechanism for inferring pathways from gene expression and protein interaction data. Motivation Why

More information

PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 13: SEQUENTIAL DATA

PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 13: SEQUENTIAL DATA PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 13: SEQUENTIAL DATA Contents in latter part Linear Dynamical Systems What is different from HMM? Kalman filter Its strength and limitation Particle Filter

More information

Molecular Biology: from sequence analysis to signal processing. University of Sao Paulo. Junior Barrera

Molecular Biology: from sequence analysis to signal processing. University of Sao Paulo. Junior Barrera Molecular Biology: from sequence analysis to signal processing Junior Barrera University of Sao Paulo Layout Introduction Knowledge evolution in Genetics Data acquisition Data Analysis A system for genetic

More information

State Estimation and Prediction in a Class of Stochastic Hybrid Systems

State Estimation and Prediction in a Class of Stochastic Hybrid Systems State Estimation and Prediction in a Class of Stochastic Hybrid Systems Eugenio Cinquemani Mario Micheli Giorgio Picci Dipartimento di Ingegneria dell Informazione, Università di Padova, Padova, Italy

More information

Approximate inference for stochastic dynamics in large biological networks

Approximate inference for stochastic dynamics in large biological networks MID-TERM REVIEW Institut Henri Poincaré, Paris 23-24 January 2014 Approximate inference for stochastic dynamics in large biological networks Ludovica Bachschmid Romano Supervisor: Prof. Manfred Opper Artificial

More information

MCMC: Markov Chain Monte Carlo

MCMC: Markov Chain Monte Carlo I529: Machine Learning in Bioinformatics (Spring 2013) MCMC: Markov Chain Monte Carlo Yuzhen Ye School of Informatics and Computing Indiana University, Bloomington Spring 2013 Contents Review of Markov

More information

Bayesian Sparse Correlated Factor Analysis

Bayesian Sparse Correlated Factor Analysis Bayesian Sparse Correlated Factor Analysis 1 Abstract In this paper, we propose a new sparse correlated factor model under a Bayesian framework that intended to model transcription factor regulation in

More information

Numerical Solutions of ODEs by Gaussian (Kalman) Filtering

Numerical Solutions of ODEs by Gaussian (Kalman) Filtering Numerical Solutions of ODEs by Gaussian (Kalman) Filtering Hans Kersting joint work with Michael Schober, Philipp Hennig, Tim Sullivan and Han C. Lie SIAM CSE, Atlanta March 1, 2017 Emmy Noether Group

More information

Genetic transcription and regulation

Genetic transcription and regulation Genetic transcription and regulation Central dogma of biology DNA codes for DNA DNA codes for RNA RNA codes for proteins not surprisingly, many points for regulation of the process https://www.youtube.com/

More information

Causal Discovery by Computer

Causal Discovery by Computer Causal Discovery by Computer Clark Glymour Carnegie Mellon University 1 Outline 1. A century of mistakes about causation and discovery: 1. Fisher 2. Yule 3. Spearman/Thurstone 2. Search for causes is statistical

More information

Expectation propagation for signal detection in flat-fading channels

Expectation propagation for signal detection in flat-fading channels Expectation propagation for signal detection in flat-fading channels Yuan Qi MIT Media Lab Cambridge, MA, 02139 USA yuanqi@media.mit.edu Thomas Minka CMU Statistics Department Pittsburgh, PA 15213 USA

More information

Wavelet-Based Nonparametric Modeling of Hierarchical Functions in Colon Carcinogenesis

Wavelet-Based Nonparametric Modeling of Hierarchical Functions in Colon Carcinogenesis Wavelet-Based Nonparametric Modeling of Hierarchical Functions in Colon Carcinogenesis Jeffrey S. Morris University of Texas, MD Anderson Cancer Center Joint wor with Marina Vannucci, Philip J. Brown,

More information

the noisy gene Biology of the Universidad Autónoma de Madrid Jan 2008 Juan F. Poyatos Spanish National Biotechnology Centre (CNB)

the noisy gene Biology of the Universidad Autónoma de Madrid Jan 2008 Juan F. Poyatos Spanish National Biotechnology Centre (CNB) Biology of the the noisy gene Universidad Autónoma de Madrid Jan 2008 Juan F. Poyatos Spanish National Biotechnology Centre (CNB) day III: noisy bacteria - Regulation of noise (B. subtilis) - Intrinsic/Extrinsic

More information

Control Theory in Physics and other Fields of Science

Control Theory in Physics and other Fields of Science Michael Schulz Control Theory in Physics and other Fields of Science Concepts, Tools, and Applications With 46 Figures Sprin ger 1 Introduction 1 1.1 The Aim of Control Theory 1 1.2 Dynamic State of Classical

More information

Contents. Part I: Fundamentals of Bayesian Inference 1

Contents. Part I: Fundamentals of Bayesian Inference 1 Contents Preface xiii Part I: Fundamentals of Bayesian Inference 1 1 Probability and inference 3 1.1 The three steps of Bayesian data analysis 3 1.2 General notation for statistical inference 4 1.3 Bayesian

More information

Bayesian inference for nonlinear multivariate diffusion processes (and other Markov processes, and their application to systems biology)

Bayesian inference for nonlinear multivariate diffusion processes (and other Markov processes, and their application to systems biology) Bayesian inference for nonlinear multivariate diffusion processes (and other Markov processes, and their application to systems biology) Darren Wilkinson School of Mathematics & Statistics and Centre for

More information

Networks in systems biology

Networks in systems biology Networks in systems biology Matthew Macauley Department of Mathematical Sciences Clemson University http://www.math.clemson.edu/~macaule/ Math 4500, Spring 2017 M. Macauley (Clemson) Networks in systems

More information

Particle Filtering Approaches for Dynamic Stochastic Optimization

Particle Filtering Approaches for Dynamic Stochastic Optimization Particle Filtering Approaches for Dynamic Stochastic Optimization John R. Birge The University of Chicago Booth School of Business Joint work with Nicholas Polson, Chicago Booth. JRBirge I-Sim Workshop,

More information

Statistical inference of the time-varying structure of gene-regulation networks

Statistical inference of the time-varying structure of gene-regulation networks Statistical inference of the time-varying structure of gene-regulation networks S. Lèbre 1, J. Becq 2, F. Devaux 3, M. Stumpf 4, G. Lelandais 2 1 LSIIT, CNRS UMR 7005, University of Strasbourg, 2 DSIMB,

More information

eqr094: Hierarchical MCMC for Bayesian System Reliability

eqr094: Hierarchical MCMC for Bayesian System Reliability eqr094: Hierarchical MCMC for Bayesian System Reliability Alyson G. Wilson Statistical Sciences Group, Los Alamos National Laboratory P.O. Box 1663, MS F600 Los Alamos, NM 87545 USA Phone: 505-667-9167

More information

Parameterized Joint Densities with Gaussian Mixture Marginals and their Potential Use in Nonlinear Robust Estimation

Parameterized Joint Densities with Gaussian Mixture Marginals and their Potential Use in Nonlinear Robust Estimation Proceedings of the 2006 IEEE International Conference on Control Applications Munich, Germany, October 4-6, 2006 WeA0. Parameterized Joint Densities with Gaussian Mixture Marginals and their Potential

More information

Lecture 7: Simple genetic circuits I

Lecture 7: Simple genetic circuits I Lecture 7: Simple genetic circuits I Paul C Bressloff (Fall 2018) 7.1 Transcription and translation In Fig. 20 we show the two main stages in the expression of a single gene according to the central dogma.

More information

A synthetic oscillatory network of transcriptional regulators

A synthetic oscillatory network of transcriptional regulators A synthetic oscillatory network of transcriptional regulators Michael B. Elowitz & Stanislas Leibler, Nature, 403, 2000 igem Team Heidelberg 2008 Journal Club Andreas Kühne Introduction Networks of interacting

More information

Bioinformatics 3. V18 Kinetic Motifs. Fri, Jan 8, 2016

Bioinformatics 3. V18 Kinetic Motifs. Fri, Jan 8, 2016 Bioinformatics 3 V18 Kinetic Motifs Fri, Jan 8, 2016 Modelling of Signalling Pathways Curr. Op. Cell Biol. 15 (2003) 221 1) How do the magnitudes of signal output and signal duration depend on the kinetic

More information

Bioinformatics 3! V20 Kinetic Motifs" Mon, Jan 13, 2014"

Bioinformatics 3! V20 Kinetic Motifs Mon, Jan 13, 2014 Bioinformatics 3! V20 Kinetic Motifs" Mon, Jan 13, 2014" Modelling of Signalling Pathways" Curr. Op. Cell Biol. 15 (2003) 221" 1) How do the magnitudes of signal output and signal duration depend on the

More information

Matteo Figliuzzi

Matteo Figliuzzi Supervisors: Prof. Andrea De Martino, Prof. Enzo Marinari Dottorato in sica, XXVI ciclo (N,1) model (N,M) model 25-10-2013 Systems Biology & Networks (N,1) model (N,M) model Arabidopsis regulatory network

More information

Computational Genomics. Systems biology. Putting it together: Data integration using graphical models

Computational Genomics. Systems biology. Putting it together: Data integration using graphical models 02-710 Computational Genomics Systems biology Putting it together: Data integration using graphical models High throughput data So far in this class we discussed several different types of high throughput

More information

Modelling Transcriptional Regulation with Gaussian Processes

Modelling Transcriptional Regulation with Gaussian Processes Modelling Transcriptional Regulation with Gaussian Processes Neil Lawrence School of Computer Science University of Manchester Joint work with Magnus Rattray and Guido Sanguinetti 8th March 7 Outline Application

More information

A STATE ESTIMATOR FOR NONLINEAR STOCHASTIC SYSTEMS BASED ON DIRAC MIXTURE APPROXIMATIONS

A STATE ESTIMATOR FOR NONLINEAR STOCHASTIC SYSTEMS BASED ON DIRAC MIXTURE APPROXIMATIONS A STATE ESTIMATOR FOR NONINEAR STOCHASTIC SYSTEMS BASED ON DIRAC MIXTURE APPROXIMATIONS Oliver C. Schrempf, Uwe D. Hanebec Intelligent Sensor-Actuator-Systems aboratory, Universität Karlsruhe (TH), Germany

More information

Gene Regula*on, ChIP- X and DNA Mo*fs. Statistics in Genomics Hongkai Ji

Gene Regula*on, ChIP- X and DNA Mo*fs. Statistics in Genomics Hongkai Ji Gene Regula*on, ChIP- X and DNA Mo*fs Statistics in Genomics Hongkai Ji (hji@jhsph.edu) Genetic information is stored in DNA TCAGTTGGAGCTGCTCCCCCACGGCCTCTCCTCACATTCCACGTCCTGTAGCTCTATGACCTCCACCTTTGAGTCCCTCCTC

More information

Simultaneous state and input estimation with partial information on the inputs

Simultaneous state and input estimation with partial information on the inputs Loughborough University Institutional Repository Simultaneous state and input estimation with partial information on the inputs This item was submitted to Loughborough University's Institutional Repository

More information

Identifying Bio-markers for EcoArray

Identifying Bio-markers for EcoArray Identifying Bio-markers for EcoArray Ashish Bhan, Keck Graduate Institute Mustafa Kesir and Mikhail B. Malioutov, Northeastern University February 18, 2010 1 Introduction This problem was presented by

More information

Markov chain optimisation for energy systems (MC-ES)

Markov chain optimisation for energy systems (MC-ES) Markov chain optimisation for energy systems (MC-ES) John Moriarty Queen Mary University of London 19th August 2016 Approaches to the stochastic optimisation of power systems are not mature at research

More information

Bayesian Linear Models

Bayesian Linear Models Bayesian Linear Models Sudipto Banerjee 1 and Andrew O. Finley 2 1 Biostatistics, School of Public Health, University of Minnesota, Minneapolis, Minnesota, U.S.A. 2 Department of Forestry & Department

More information

Bayesian Inference. Chapter 4: Regression and Hierarchical Models

Bayesian Inference. Chapter 4: Regression and Hierarchical Models Bayesian Inference Chapter 4: Regression and Hierarchical Models Conchi Ausín and Mike Wiper Department of Statistics Universidad Carlos III de Madrid Master in Business Administration and Quantitative

More information

Lecture 8: Bayesian Estimation of Parameters in State Space Models

Lecture 8: Bayesian Estimation of Parameters in State Space Models in State Space Models March 30, 2016 Contents 1 Bayesian estimation of parameters in state space models 2 Computational methods for parameter estimation 3 Practical parameter estimation in state space

More information

Need for Sampling in Machine Learning. Sargur Srihari

Need for Sampling in Machine Learning. Sargur Srihari Need for Sampling in Machine Learning Sargur srihari@cedar.buffalo.edu 1 Rationale for Sampling 1. ML methods model data with probability distributions E.g., p(x,y; θ) 2. Models are used to answer queries,

More information

Bayesian Networks: Construction, Inference, Learning and Causal Interpretation. Volker Tresp Summer 2014

Bayesian Networks: Construction, Inference, Learning and Causal Interpretation. Volker Tresp Summer 2014 Bayesian Networks: Construction, Inference, Learning and Causal Interpretation Volker Tresp Summer 2014 1 Introduction So far we were mostly concerned with supervised learning: we predicted one or several

More information

Chapter 9: Bayesian Methods. CS 336/436 Gregory D. Hager

Chapter 9: Bayesian Methods. CS 336/436 Gregory D. Hager Chapter 9: Bayesian Methods CS 336/436 Gregory D. Hager A Simple Eample Why Not Just Use a Kalman Filter? Recall Robot Localization Given Sensor readings y 1, y 2, y = y 1: Known control inputs u 0, u

More information

L'horloge circadienne, le cycle cellulaire et leurs interactions. Madalena CHAVES

L'horloge circadienne, le cycle cellulaire et leurs interactions. Madalena CHAVES L'horloge circadienne, le cycle cellulaire et leurs interactions?? Madalena CHAVES What do all these living organisms have in common? Mus musculus Neurospora crassa Drosophila melanogaster Arabidopsis

More information

Bayesian Prediction of Code Output. ASA Albuquerque Chapter Short Course October 2014

Bayesian Prediction of Code Output. ASA Albuquerque Chapter Short Course October 2014 Bayesian Prediction of Code Output ASA Albuquerque Chapter Short Course October 2014 Abstract This presentation summarizes Bayesian prediction methodology for the Gaussian process (GP) surrogate representation

More information

BIOLOGY IB DIPLOMA PROGRAM PARENTS ORIENTATION DAY

BIOLOGY IB DIPLOMA PROGRAM PARENTS ORIENTATION DAY BIOLOGY IB DIPLOMA PROGRAM PARENTS ORIENTATION DAY 2018-2019 ADITYA NUGRAHA WARDHANA EDUCATION BACKGROUND: Bachelor of Science, Biology major University of Indonesia, Depok WORK EXPERIENCE: Laboratory

More information

Mixed Membership Matrix Factorization

Mixed Membership Matrix Factorization Mixed Membership Matrix Factorization Lester Mackey University of California, Berkeley Collaborators: David Weiss, University of Pennsylvania Michael I. Jordan, University of California, Berkeley 2011

More information

Systems biology and complexity research

Systems biology and complexity research Systems biology and complexity research Peter Schuster Institut für Theoretische Chemie, Universität Wien, Austria and The Santa Fe Institute, Santa Fe, New Mexico, USA Interdisciplinary Challenges for

More information

State Space Representation of Gaussian Processes

State Space Representation of Gaussian Processes State Space Representation of Gaussian Processes Simo Särkkä Department of Biomedical Engineering and Computational Science (BECS) Aalto University, Espoo, Finland June 12th, 2013 Simo Särkkä (Aalto University)

More information

ASSESSMENT OF REGRESSION METHODS FOR INFERENCE OF REGULATORY NETWORKS INVOLVED IN CIRCADIAN REGULATION

ASSESSMENT OF REGRESSION METHODS FOR INFERENCE OF REGULATORY NETWORKS INVOLVED IN CIRCADIAN REGULATION ASSESSMENT OF REGRESSION METHODS FOR INFERENCE OF REGULATORY NETWORKS INVOLVED IN CIRCADIAN REGULATION Andrej Aderhold 1, Dirk Husmeier 2, V. Anne Smith 1, Andrew J. Millar 3, and Marco Grzegorczyk 4 1

More information

Biomolecular Feedback Systems

Biomolecular Feedback Systems Biomolecular Feedback Systems Domitilla Del Vecchio MIT Richard M. Murray Caltech DRAFT v0.4a, January 16, 2011 c California Institute of Technology All rights reserved. This manuscript is for review purposes

More information

Bayesian Inference. Chapter 4: Regression and Hierarchical Models

Bayesian Inference. Chapter 4: Regression and Hierarchical Models Bayesian Inference Chapter 4: Regression and Hierarchical Models Conchi Ausín and Mike Wiper Department of Statistics Universidad Carlos III de Madrid Advanced Statistics and Data Mining Summer School

More information

Geert Geeven. April 14, 2010

Geert Geeven. April 14, 2010 iction of Gene Regulatory Interactions NDNS+ Workshop April 14, 2010 Today s talk - Outline Outline Biological Background Construction of Predictors The main aim of my project is to better understand the

More information

10-701/15-781, Machine Learning: Homework 4

10-701/15-781, Machine Learning: Homework 4 10-701/15-781, Machine Learning: Homewor 4 Aarti Singh Carnegie Mellon University ˆ The assignment is due at 10:30 am beginning of class on Mon, Nov 15, 2010. ˆ Separate you answers into five parts, one

More information

Roles of Diagrams in Computational Modeling of Mechanisms

Roles of Diagrams in Computational Modeling of Mechanisms Roles of Diagrams in Computational Modeling of Mechanisms William Bechtel (bechtel@ucsd.edu) Department of Philosophy and Center for Chronobiology, University of California, San Diego, La Jolla, CA 92093-0119

More information

Gaussian Process Approximations of Stochastic Differential Equations

Gaussian Process Approximations of Stochastic Differential Equations Gaussian Process Approximations of Stochastic Differential Equations Cédric Archambeau Dan Cawford Manfred Opper John Shawe-Taylor May, 2006 1 Introduction Some of the most complex models routinely run

More information