SReach: Combing SMT-based Model Checking and Statistical Tests* Presented by Qinsi Wang

Size: px
Start display at page:

Download "SReach: Combing SMT-based Model Checking and Statistical Tests* Presented by Qinsi Wang"

Transcription

1 SReach: Combing SMT-based Model Checking and Statistical Tests* Presented by Qinsi Wang *Qinsi Wang, Paolo Zuliani, Soonho Kong, Sicun Gao, and Edmund Clarke. SReach: Combining Statistical Tests and Bounded Model Checking for Nonlinear Hybrid Systems with Parametric Uncertainty

2 Probabilistic Bounded Reachability Analysis of S tochastic Hybrid Systems

3 Stochastic Hybrid Systems Application: Biology (e.g. the killerred biological model), Cyber-physical systems (e.g. the quadcopter stabilization control system), Financial models (e.g. insurance pricing systems), and so on. Formalism: Probabilistic hybrid automata (PHA), Stochastic hybrid automata (SHA), General Stochastic hybrid systems (GSHS),

4 SReach considers Hybrid automata with parametric uncertainty unknown parameters, individual differences, noisy data, learning errors, Probabilistic hybrid automata transitions with discrete probability distributions transitions with continuous distributions, but discrete choices 4

5 SReach can handle Probabilistic bounded reachability problems One of the elementary questions for the quantitative analysis of stochastic hybrid systems is to compute the probability of reaching a certain set of states. More specifically, model validation, parameter estimation, and sensitivity analysis

6 SReach answers SReach can answer two types of questions: () Does the model satisfy a given reachability property with probability greater than a certain threshold? hypothesis testing (2) What is the probability that the model satisfies a given reachability property? statistical estimation

7 SReach s algorithm

8 SReach uses The following statistical tests: Hypothesis testing methods: Lai s test, Bayes factor test, Bayes factor test with indifference region, and Sequential probability ratio test. Statistical estimation methods: Chernoff- Hoeffding bound, Bayesian interval estimation with beta prior, and Direct sampling.

9 Hybrid automaton with parametric uncertainty

10 Probabilistic Hybrid Automaton DNA= DNAƛ=0 mrna=0 KRim=0 KRm=0 KRmdS=0 KRmdS*=0 KRmdT*=0 SOX=0 SOXsod=0 SOD=SODinit mode_t >= t_genk Genome injected, k ƛgenome= DNA= DNAƛ=0 mrna=0 KRim=0 KRm=0 KRmdS=0 KRmdS*=0 KRmdT*=0 SOX=0 SOXsod=0 SOD=SODinit mode_t >= t_genk2 Genome inserted, k2 mrna=0 KRim=0 KRm=0 KRmdS=0 KRmdS*=0 KRmdT*=0 SOX=0 SOXsod=0 SOD=SODinit mode_t >= t_addiptg Add IPTG IPTG= mrna=? KRim=? KRm=? KRmdS=? KRmdS*=0 KRmdT*=0 SOX=0 SOXsod=0 SOD=SODinit mode_t >= t_rmiptg (and (mrna = 0) (KRim = 0) (KRmdS = 0)) reset mode_t *Natasa Miskov-Zivanov, Qinsi Wang, Cheryl Telmer, Edmund M. Clarke, et al. Formal analysis estimates parameters for guiding hyperoxidation in bacteria with KillerRed protein. 0. Remove IPTG mrna=a KRim=b KRm=c KRmdS=d KRmdS*=0 KRmdT*=0 SOX=0 SOXsod=0 SOD=SODinit mode_t >= t_lighton 0.9 Add light IPTG= light=l mrna=? KRim=? KRm=? KRmdS=? KRmdS*=? KRmdT*=? SOX=? SOXsod=? SOD=? SOX>threshold & tot_t <= timebound 0.4 mode_t >= t_rmiptg2 -p Remove IPTG & reset mode_t mode_t >= t_lightoff 0.3 mode_t >= t_rmiptg2 0.3 Remove IPTG Remove light SOX>threshold & tot_t <= timebound p2~ B(0.9) cell death IPTG= mrna=? KRim=? KRm=? KRmdS=? KRmdS*=? KRmdT*=? SOX=g SOXsod=h SOD=i light=l mrna=a KRim=b KRm=c KRmdS=d KRmdS*=e KRmdT*=f SOX=g SOXsod=h SOD=i mode_t >= t_rmiptg3 mode_t >= t_lightoff2 p ~ U(0, ) -p2 Remove IPTG Remove light mrna=a KRim=b KRm=c KRmdS=d KRmdS*=e KRmdT*=f SOX=g SOXsod=h SOD=i mrna=a KRim=b KRm=c KRmdS=d KRmdS*=e KRmdT*=f SOX=g SOXsod=h SOD=i SOX>threshold & tot_t <= timebound SOX>threshold & tot_t <= timebound. Will the killerred kill bacteria cells within a certain time with probability no less then 0.95? 2. Will the time duration that keeps the light on impact the whole process significantly? What will be relation between the time to turn on the light and the time needed to kill bacteria cells?

11 Experimental results

12 Future work General Stochastic Hybrid Systems probabilistic jumps with continuous distributions stochastic flows: stochastic differential equations Propose and implement a new theory solver for a subset of probability theory

13 Thanks, Ed! paralleled version will be released soon!

SReach: A Probabilistic Bounded δ-reachability Analyzer for Stochastic Hybrid Systems

SReach: A Probabilistic Bounded δ-reachability Analyzer for Stochastic Hybrid Systems SReach: A Probabilistic Bounded δ-reachability Analyzer for Stochastic Hybrid Systems Qinsi Wang 1, Paolo Zuliani 2, Soonho Kong 1, Sicun Gao 3, Edmund M. Clarke 1 1 Computer Science Department, Carnegie

More information

ProbReach: Probabilistic Bounded Reachability for Uncertain Hybrid Systems

ProbReach: Probabilistic Bounded Reachability for Uncertain Hybrid Systems ProbReach: Probabilistic Bounded Reachability for Uncertain Hybrid Systems Fedor Shmarov, Paolo Zuliani School of Computing Science, Newcastle University, UK 1 / 41 Introduction ProbReach tool for probabilistic

More information

Bounded Model Checking with SAT/SMT. Edmund M. Clarke School of Computer Science Carnegie Mellon University 1/39

Bounded Model Checking with SAT/SMT. Edmund M. Clarke School of Computer Science Carnegie Mellon University 1/39 Bounded Model Checking with SAT/SMT Edmund M. Clarke School of Computer Science Carnegie Mellon University 1/39 Recap: Symbolic Model Checking with BDDs Method used by most industrial strength model checkers:

More information

Nonlinear Real Arithmetic and δ-satisfiability. Paolo Zuliani

Nonlinear Real Arithmetic and δ-satisfiability. Paolo Zuliani Nonlinear Real Arithmetic and δ-satisfiability Paolo Zuliani School of Computing Science Newcastle University, UK (Slides courtesy of Sicun Gao, UCSD) 1 / 27 Introduction We use hybrid systems for modelling

More information

Nonlinear Control as Program Synthesis (A Starter)

Nonlinear Control as Program Synthesis (A Starter) Nonlinear Control as Program Synthesis (A Starter) Sicun Gao MIT December 15, 2014 Preliminaries Definition (L RF ) L RF is the first-order language over the reals that allows arbitrary numerically computable

More information

Analog Circuit Verification by Statistical Model Checking

Analog Circuit Verification by Statistical Model Checking 16 th Asian Pacific Design Automation ti Conference Analog Circuit Verification by Statistical Model Checking Author Ying-Chih Wang (Presenter) Anvesh Komuravelli Paolo Zuliani Edmund M. Clarke Date 2011/1/26

More information

Introduction to Bioinformatics

Introduction to Bioinformatics CSCI8980: Applied Machine Learning in Computational Biology Introduction to Bioinformatics Rui Kuang Department of Computer Science and Engineering University of Minnesota kuang@cs.umn.edu History of Bioinformatics

More information

Analog Circuit Verification by Statistical Model Checking

Analog Circuit Verification by Statistical Model Checking Analog Circuit Verification by Statistical Model Checking Ying-Chih Wang, Anvesh Komuravelli, Paolo Zuliani and Edmund M. Clarke Department of Electrical and Computer Engineering, Carnegie Mellon University,

More information

Learning in Bayesian Networks

Learning in Bayesian Networks Learning in Bayesian Networks Florian Markowetz Max-Planck-Institute for Molecular Genetics Computational Molecular Biology Berlin Berlin: 20.06.2002 1 Overview 1. Bayesian Networks Stochastic Networks

More information

APPROXIMATE SIMULATION RELATIONS FOR HYBRID SYSTEMS 1. Antoine Girard A. Agung Julius George J. Pappas

APPROXIMATE SIMULATION RELATIONS FOR HYBRID SYSTEMS 1. Antoine Girard A. Agung Julius George J. Pappas APPROXIMATE SIMULATION RELATIONS FOR HYBRID SYSTEMS 1 Antoine Girard A. Agung Julius George J. Pappas Department of Electrical and Systems Engineering University of Pennsylvania Philadelphia, PA 1914 {agirard,agung,pappasg}@seas.upenn.edu

More information

SARAH P. OTTO and TROY DAY

SARAH P. OTTO and TROY DAY A Biologist's Guide to Mathematical Modeling in Ecology and Evolution SARAH P. OTTO and TROY DAY Univsr?.ltats- und Lender bibliolhek Darmstadt Bibliothek Biotogi Princeton University Press Princeton and

More information

Computational Systems Biology

Computational Systems Biology Computational Systems Biology Vasant Honavar Artificial Intelligence Research Laboratory Bioinformatics and Computational Biology Graduate Program Center for Computational Intelligence, Learning, & Discovery

More information

Network Biology-part II

Network Biology-part II Network Biology-part II Jun Zhu, Ph. D. Professor of Genomics and Genetic Sciences Icahn Institute of Genomics and Multi-scale Biology The Tisch Cancer Institute Icahn Medical School at Mount Sinai New

More information

Foreword. Grammatical inference. Examples of sequences. Sources. Example of problems expressed by sequences Switching the light

Foreword. Grammatical inference. Examples of sequences. Sources. Example of problems expressed by sequences Switching the light Foreword Vincent Claveau IRISA - CNRS Rennes, France In the course of the course supervised symbolic machine learning technique concept learning (i.e. 2 classes) INSA 4 Sources s of sequences Slides and

More information

Set- membership es-ma-on of hybrid dynamical systems.

Set- membership es-ma-on of hybrid dynamical systems. Set- membership es-ma-on of hybrid dynamical systems. Towards model- based FDI for hybrid systems Prof. Nacim RAMDANI Université d Orléans, Bourges. France. nacim.ramdani@univ- orleans.fr!! ECC14 Pre-

More information

The Monte Carlo Method: Bayesian Networks

The Monte Carlo Method: Bayesian Networks The Method: Bayesian Networks Dieter W. Heermann Methods 2009 Dieter W. Heermann ( Methods)The Method: Bayesian Networks 2009 1 / 18 Outline 1 Bayesian Networks 2 Gene Expression Data 3 Bayesian Networks

More information

Formal Modeling of Biological Systems

Formal Modeling of Biological Systems Formal Modeling of Biological Systems (Invited Paper) Qinsi Wang Computer Science Department Carnegie Mellon University, USA qinsiw@cs.cmu.edu Edmund M. Clarke Computer Science Department Carnegie Mellon

More information

2. Mathematical descriptions. (i) the master equation (ii) Langevin theory. 3. Single cell measurements

2. Mathematical descriptions. (i) the master equation (ii) Langevin theory. 3. Single cell measurements 1. Why stochastic?. Mathematical descriptions (i) the master equation (ii) Langevin theory 3. Single cell measurements 4. Consequences Any chemical reaction is stochastic. k P d φ dp dt = k d P deterministic

More information

Bayesian Regression (1/31/13)

Bayesian Regression (1/31/13) STA613/CBB540: Statistical methods in computational biology Bayesian Regression (1/31/13) Lecturer: Barbara Engelhardt Scribe: Amanda Lea 1 Bayesian Paradigm Bayesian methods ask: given that I have observed

More information

Analog Electronics Mimic Genetic Biochemical Reactions in Living Cells

Analog Electronics Mimic Genetic Biochemical Reactions in Living Cells Analog Electronics Mimic Genetic Biochemical Reactions in Living Cells Dr. Ramez Daniel Laboratory of Synthetic Biology & Bioelectronics (LSB 2 ) Biomedical Engineering, Technion May 9, 2016 Cytomorphic

More information

Decision Procedure Based Discovery of Rare Behaviors in Stochastic Differential Equation Models of Biological Systems

Decision Procedure Based Discovery of Rare Behaviors in Stochastic Differential Equation Models of Biological Systems Decision Procedure Based Discovery of Rare Behaviors in Stochastic Differential Equation Models of Biological Systems Arup K. Ghosh, Faraz Hussain, Sumit K. Jha EECS Department University of Central Florida

More information

Towards Co-Engineering Communicating Autonomous Cyber-physical Systems. Bujorianu, M.C. and Bujorianu, M.L. MIMS EPrint:

Towards Co-Engineering Communicating Autonomous Cyber-physical Systems. Bujorianu, M.C. and Bujorianu, M.L. MIMS EPrint: Towards Co-Engineering Communicating Autonomous Cyber-physical Systems Bujorianu M.C. and Bujorianu M.L. 009 MIMS EPrint: 00.53 Manchester Institute for Mathematical Sciences School of Mathematics The

More information

1 MDP Value Iteration Algorithm

1 MDP Value Iteration Algorithm CS 0. - Active Learning Problem Set Handed out: 4 Jan 009 Due: 9 Jan 009 MDP Value Iteration Algorithm. Implement the value iteration algorithm given in the lecture. That is, solve Bellman s equation using

More information

Can evolution paths be explained by chance alone? arxiv: v1 [math.pr] 12 Oct The model

Can evolution paths be explained by chance alone? arxiv: v1 [math.pr] 12 Oct The model Can evolution paths be explained by chance alone? Rinaldo B. Schinazi Department of Mathematics University of Colorado at Colorado Springs rinaldo.schinazi@uccs.edu arxiv:1810.05705v1 [math.pr] 12 Oct

More information

CS243, Logic and Computation Nondeterministic finite automata

CS243, Logic and Computation Nondeterministic finite automata CS243, Prof. Alvarez NONDETERMINISTIC FINITE AUTOMATA (NFA) Prof. Sergio A. Alvarez http://www.cs.bc.edu/ alvarez/ Maloney Hall, room 569 alvarez@cs.bc.edu Computer Science Department voice: (67) 552-4333

More information

Bayesian statistical model checking with application to Stateflow/Simulink verification

Bayesian statistical model checking with application to Stateflow/Simulink verification Form Methods Syst Des (2013) 43:338 367 DOI 10.1007/s10703-013-0195-3 Bayesian statistical model checking with application to Stateflow/Simulink verification Paolo Zuliani André Platzer Edmund M. Clarke

More information

FMCAD 2013 Parameter Synthesis with IC3

FMCAD 2013 Parameter Synthesis with IC3 FMCAD 2013 Parameter Synthesis with IC3 A. Cimatti, A. Griggio, S. Mover, S. Tonetta FBK, Trento, Italy Motivations and Contributions Parametric descriptions of systems arise in many domains E.g. software,

More information

Complexity of stochastic branch and bound methods for belief tree search in Bayesian reinforcement learning

Complexity of stochastic branch and bound methods for belief tree search in Bayesian reinforcement learning Complexity of stochastic branch and bound methods for belief tree search in Bayesian reinforcement learning Christos Dimitrakakis Informatics Institute, University of Amsterdam, Amsterdam, The Netherlands

More information

Reasoning Under Uncertainty: Conditioning, Bayes Rule & the Chain Rule

Reasoning Under Uncertainty: Conditioning, Bayes Rule & the Chain Rule Reasoning Under Uncertainty: Conditioning, Bayes Rule & the Chain Rule Alan Mackworth UBC CS 322 Uncertainty 2 March 13, 2013 Textbook 6.1.3 Lecture Overview Recap: Probability & Possible World Semantics

More information

CS:4330 Theory of Computation Spring Regular Languages. Finite Automata and Regular Expressions. Haniel Barbosa

CS:4330 Theory of Computation Spring Regular Languages. Finite Automata and Regular Expressions. Haniel Barbosa CS:4330 Theory of Computation Spring 2018 Regular Languages Finite Automata and Regular Expressions Haniel Barbosa Readings for this lecture Chapter 1 of [Sipser 1996], 3rd edition. Sections 1.1 and 1.3.

More information

Statistical Model Checking Applied on Perception and Decision-making Systems for Autonomous Driving

Statistical Model Checking Applied on Perception and Decision-making Systems for Autonomous Driving Statistical Model Checking Applied on Perception and Decision-making Systems for Autonomous Driving J. Quilbeuf 1 M. Barbier 2,3 L. Rummelhard 3 C. Laugier 2 A. Legay 1 T. Genevois 2 J. Ibañez-Guzmán 3

More information

Warwick Business School Forecasting System. Summary. Ana Galvao, Anthony Garratt and James Mitchell November, 2014

Warwick Business School Forecasting System. Summary. Ana Galvao, Anthony Garratt and James Mitchell November, 2014 Warwick Business School Forecasting System Summary Ana Galvao, Anthony Garratt and James Mitchell November, 21 The main objective of the Warwick Business School Forecasting System is to provide competitive

More information

Bayesian Methods for Machine Learning

Bayesian Methods for Machine Learning Bayesian Methods for Machine Learning CS 584: Big Data Analytics Material adapted from Radford Neal s tutorial (http://ftp.cs.utoronto.ca/pub/radford/bayes-tut.pdf), Zoubin Ghahramni (http://hunch.net/~coms-4771/zoubin_ghahramani_bayesian_learning.pdf),

More information

The PAC Learning Framework -II

The PAC Learning Framework -II The PAC Learning Framework -II Prof. Dan A. Simovici UMB 1 / 1 Outline 1 Finite Hypothesis Space - The Inconsistent Case 2 Deterministic versus stochastic scenario 3 Bayes Error and Noise 2 / 1 Outline

More information

Contents Quantum-like Paradigm Classical (Kolmogorovian) and Quantum (Born) Probability

Contents Quantum-like Paradigm Classical (Kolmogorovian) and Quantum (Born) Probability 1 Quantum-like Paradigm... 1 1.1 Applications of Mathematical Apparatus of QM Outside ofphysics... 1 1.2 Irreducible Quantum Randomness, Copenhagen Interpretation... 2 1.3 Quantum Reductionism in Biology

More information

Analysis of Thompson Sampling for the multi-armed bandit problem

Analysis of Thompson Sampling for the multi-armed bandit problem Analysis of Thompson Sampling for the multi-armed bandit problem Shipra Agrawal Microsoft Research India shipra@microsoft.com avin Goyal Microsoft Research India navingo@microsoft.com Abstract We show

More information

Models for Efficient Timed Verification

Models for Efficient Timed Verification Models for Efficient Timed Verification François Laroussinie LSV / ENS de Cachan CNRS UMR 8643 Monterey Workshop - Composition of embedded systems Model checking System Properties Formalizing step? ϕ Model

More information

the noisy gene Biology of the Universidad Autónoma de Madrid Jan 2008 Juan F. Poyatos Spanish National Biotechnology Centre (CNB)

the noisy gene Biology of the Universidad Autónoma de Madrid Jan 2008 Juan F. Poyatos Spanish National Biotechnology Centre (CNB) Biology of the the noisy gene Universidad Autónoma de Madrid Jan 2008 Juan F. Poyatos Spanish National Biotechnology Centre (CNB) day III: noisy bacteria - Regulation of noise (B. subtilis) - Intrinsic/Extrinsic

More information

Parameter iden+fica+on with hybrid systems in a bounded- error framework

Parameter iden+fica+on with hybrid systems in a bounded- error framework Parameter iden+fica+on with hybrid systems in a bounded- error framework Moussa MAIGA, Nacim RAMDANI, & Louise TRAVE- MASSUYES Université d Orléans, Bourges, and LAAS CNRS Toulouse, France.!! SWIM 2015,

More information

Machine Learning (CS 567) Lecture 2

Machine Learning (CS 567) Lecture 2 Machine Learning (CS 567) Lecture 2 Time: T-Th 5:00pm - 6:20pm Location: GFS118 Instructor: Sofus A. Macskassy (macskass@usc.edu) Office: SAL 216 Office hours: by appointment Teaching assistant: Cheol

More information

Biol 206/306 Advanced Biostatistics Lab 12 Bayesian Inference Fall 2016

Biol 206/306 Advanced Biostatistics Lab 12 Bayesian Inference Fall 2016 Biol 206/306 Advanced Biostatistics Lab 12 Bayesian Inference Fall 2016 By Philip J. Bergmann 0. Laboratory Objectives 1. Learn what Bayes Theorem and Bayesian Inference are 2. Reinforce the properties

More information

Bioinformatics Chapter 1. Introduction

Bioinformatics Chapter 1. Introduction Bioinformatics Chapter 1. Introduction Outline! Biological Data in Digital Symbol Sequences! Genomes Diversity, Size, and Structure! Proteins and Proteomes! On the Information Content of Biological Sequences!

More information

Bayesian Social Learning with Random Decision Making in Sequential Systems

Bayesian Social Learning with Random Decision Making in Sequential Systems Bayesian Social Learning with Random Decision Making in Sequential Systems Yunlong Wang supervised by Petar M. Djurić Department of Electrical and Computer Engineering Stony Brook University Stony Brook,

More information

Parallel Bayesian Global Optimization, with Application to Metrics Optimization at Yelp

Parallel Bayesian Global Optimization, with Application to Metrics Optimization at Yelp .. Parallel Bayesian Global Optimization, with Application to Metrics Optimization at Yelp Jialei Wang 1 Peter Frazier 1 Scott Clark 2 Eric Liu 2 1 School of Operations Research & Information Engineering,

More information

Table of Contents. General Introduction... Part 1. Introduction... 3

Table of Contents. General Introduction... Part 1. Introduction... 3 Table of Contents General Introduction... xi PART 1. THE STRUCTURE OF THE GEOGRAPHIC SPACE... 1 Part 1. Introduction... 3 Chapter 1. Structure and System Concepts... 5 1.1. The notion of structure... 5

More information

GLOBEX Bioinformatics (Summer 2015) Genetic networks and gene expression data

GLOBEX Bioinformatics (Summer 2015) Genetic networks and gene expression data GLOBEX Bioinformatics (Summer 2015) Genetic networks and gene expression data 1 Gene Networks Definition: A gene network is a set of molecular components, such as genes and proteins, and interactions between

More information

Reachability Analysis for Hybrid Dynamic Systems*

Reachability Analysis for Hybrid Dynamic Systems* Reachability nalysis for Hybrid Dynamic Systems* Olaf Stursberg Faculty of Electrical Engineering and Information Technology Technische Universität München * Thanks to: Matthias lthoff, Edmund M. Clarke,

More information

Problem Set 5. 1 Waiting times for chemical reactions (8 points)

Problem Set 5. 1 Waiting times for chemical reactions (8 points) Problem Set 5 1 Waiting times for chemical reactions (8 points) In the previous assignment, we saw that for a chemical reaction occurring at rate r, the distribution of waiting times τ between reaction

More information

Universität Potsdam Institut für Informatik Lehrstuhl Maschinelles Lernen. Bayesian Learning. Tobias Scheffer, Niels Landwehr

Universität Potsdam Institut für Informatik Lehrstuhl Maschinelles Lernen. Bayesian Learning. Tobias Scheffer, Niels Landwehr Universität Potsdam Institut für Informatik Lehrstuhl Maschinelles Lernen Bayesian Learning Tobias Scheffer, Niels Landwehr Remember: Normal Distribution Distribution over x. Density function with parameters

More information

CS155: Probability and Computing: Randomized Algorithms and Probabilistic Analysis

CS155: Probability and Computing: Randomized Algorithms and Probabilistic Analysis CS155: Probability and Computing: Randomized Algorithms and Probabilistic Analysis Eli Upfal Eli Upfal@brown.edu Office: 319 TA s: Lorenzo De Stefani and Sorin Vatasoiu cs155tas@cs.brown.edu It is remarkable

More information

Bayesian Classification. Bayesian Classification: Why?

Bayesian Classification. Bayesian Classification: Why? Bayesian Classification http://css.engineering.uiowa.edu/~comp/ Bayesian Classification: Why? Probabilistic learning: Computation of explicit probabilities for hypothesis, among the most practical approaches

More information

Automated Assignment of Backbone NMR Data using Artificial Intelligence

Automated Assignment of Backbone NMR Data using Artificial Intelligence Automated Assignment of Backbone NMR Data using Artificial Intelligence John Emmons στ, Steven Johnson τ, Timothy Urness*, and Adina Kilpatrick* Department of Computer Science and Mathematics Department

More information

Kalman filtering and friends: Inference in time series models. Herke van Hoof slides mostly by Michael Rubinstein

Kalman filtering and friends: Inference in time series models. Herke van Hoof slides mostly by Michael Rubinstein Kalman filtering and friends: Inference in time series models Herke van Hoof slides mostly by Michael Rubinstein Problem overview Goal Estimate most probable state at time k using measurement up to time

More information

An Introduction to Hybrid Systems Modeling

An Introduction to Hybrid Systems Modeling CS620, IIT BOMBAY An Introduction to Hybrid Systems Modeling Ashutosh Trivedi Department of Computer Science and Engineering, IIT Bombay CS620: New Trends in IT: Modeling and Verification of Cyber-Physical

More information

From Electrical Switched Networks to Hybrid Automata. Alessandro Cimatti 1, Sergio Mover 2, Mirko Sessa 1,3

From Electrical Switched Networks to Hybrid Automata. Alessandro Cimatti 1, Sergio Mover 2, Mirko Sessa 1,3 1 2 3 From Electrical Switched Networks to Hybrid Automata Alessandro Cimatti 1, Sergio Mover 2, Mirko Sessa 1,3 Multidomain physical systems Multiple physical domains: electrical hydraulic mechanical

More information

A.I. in health informatics lecture 2 clinical reasoning & probabilistic inference, I. kevin small & byron wallace

A.I. in health informatics lecture 2 clinical reasoning & probabilistic inference, I. kevin small & byron wallace A.I. in health informatics lecture 2 clinical reasoning & probabilistic inference, I kevin small & byron wallace today a review of probability random variables, maximum likelihood, etc. crucial for clinical

More information

Computable Analysis, Hybrid Automata, and Decision Procedures (Extended Thesis Abstract)

Computable Analysis, Hybrid Automata, and Decision Procedures (Extended Thesis Abstract) Computable Analysis, Hybrid Automata, and Decision Procedures (Extended Thesis Abstract) Sicun Gao 1 Introduction 1.1 Overview Cyber-Physical Systems (CPS) are systems that integrate digital computation

More information

An Introduction to Statistical Theory of Learning. Nakul Verma Janelia, HHMI

An Introduction to Statistical Theory of Learning. Nakul Verma Janelia, HHMI An Introduction to Statistical Theory of Learning Nakul Verma Janelia, HHMI Towards formalizing learning What does it mean to learn a concept? Gain knowledge or experience of the concept. The basic process

More information

Machine Learning in Action

Machine Learning in Action Machine Learning in Action Tatyana Goldberg (goldberg@rostlab.org) August 16, 2016 @ Machine Learning in Biology Beijing Genomics Institute in Shenzhen, China June 2014 GenBank 1 173,353,076 DNA sequences

More information

Formal Definition of a Finite Automaton. August 26, 2013

Formal Definition of a Finite Automaton. August 26, 2013 August 26, 2013 Why a formal definition? A formal definition is precise: - It resolves any uncertainties about what is allowed in a finite automaton such as the number of accept states and number of transitions

More information

Inference Control and Driving of Natural Systems

Inference Control and Driving of Natural Systems Inference Control and Driving of Natural Systems MSci/MSc/MRes nick.jones@imperial.ac.uk The fields at play We will be drawing on ideas from Bayesian Cognitive Science (psychology and neuroscience), Biological

More information

A Hybrid Control Model of Fractone-Dependent Morphogenesis

A Hybrid Control Model of Fractone-Dependent Morphogenesis A Hybrid Control Model of Fractone-Dependent Morphogenesis University of Hawaii at Manoa May 28, 2015 Many thanks go to: Dr. Monique Chyba Dr. Frederic Mercier Committee Members: Dr. George Wilkens, Dr.

More information

δ-complete Analysis for Bounded Reachability of Hybrid Systems

δ-complete Analysis for Bounded Reachability of Hybrid Systems δ-complete Analysis for Bounded Reachability of Hybrid Systems Sicun Gao Soonho Kong Wei Chen Edmund M. Clarke July 16, 2014 CMU-CS-14-111 School of Computer Science Carnegie Mellon University Pittsburgh,

More information

Approximate Bayesian Computation

Approximate Bayesian Computation Approximate Bayesian Computation Michael Gutmann https://sites.google.com/site/michaelgutmann University of Helsinki and Aalto University 1st December 2015 Content Two parts: 1. The basics of approximate

More information

Computational methods for predicting protein-protein interactions

Computational methods for predicting protein-protein interactions Computational methods for predicting protein-protein interactions Tomi Peltola T-61.6070 Special course in bioinformatics I 3.4.2008 Outline Biological background Protein-protein interactions Computational

More information

Unbounded, Fully Symbolic Model Checking of Timed Automata using Boolean Methods

Unbounded, Fully Symbolic Model Checking of Timed Automata using Boolean Methods Unbounded, Fully Symbolic Model Checking of Timed Automata using Boolean Methods Sanjit A. Seshia and Randal E. Bryant Computer Science Department Carnegie Mellon University Verifying Timed Embedded Systems

More information

Parameter Discovery for Stochastic Biological Models against Temporal Behavioral Specifications using an SPRT based Metric for Simulated Annealing

Parameter Discovery for Stochastic Biological Models against Temporal Behavioral Specifications using an SPRT based Metric for Simulated Annealing Parameter Discovery for Stochastic Biological Models against Temporal Behavioral Specifications using an SPRT based Metric for Simulated Annealing Faraz Hussain, Raj Gautam Dutta, Sumit Kumar Jha Electrical

More information

Polynomial-Time Verification of PCTL Properties of MDPs with Convex Uncertainties and its Application to Cyber-Physical Systems

Polynomial-Time Verification of PCTL Properties of MDPs with Convex Uncertainties and its Application to Cyber-Physical Systems Polynomial-Time Verification of PCTL Properties of MDPs with Convex Uncertainties and its Application to Cyber-Physical Systems Alberto Puggelli DREAM Seminar - November 26, 2013 Collaborators and PIs:

More information

Accouncements. You should turn in a PDF and a python file(s) Figure for problem 9 should be in the PDF

Accouncements. You should turn in a PDF and a python file(s) Figure for problem 9 should be in the PDF Accouncements You should turn in a PDF and a python file(s) Figure for problem 9 should be in the PDF Please do not zip these files and submit (unless there are >5 files) 1 Bayesian Methods Machine Learning

More information

A Bayesian Approach to Model Checking Biological Systems

A Bayesian Approach to Model Checking Biological Systems A Bayesian Approach to Model Checking Biological Systems Sumit K. Jha, Edmund M. Clarke, Christopher J. Langmead,2, Axel Legay 3, André Platzer, and Paolo Zuliani Computer Science Department, Carnegie

More information

Grundlagen der Künstlichen Intelligenz

Grundlagen der Künstlichen Intelligenz Grundlagen der Künstlichen Intelligenz Uncertainty & Probabilities & Bandits Daniel Hennes 16.11.2017 (WS 2017/18) University Stuttgart - IPVS - Machine Learning & Robotics 1 Today Uncertainty Probability

More information

Hybrid Control and Switched Systems. Lecture #1 Hybrid systems are everywhere: Examples

Hybrid Control and Switched Systems. Lecture #1 Hybrid systems are everywhere: Examples Hybrid Control and Switched Systems Lecture #1 Hybrid systems are everywhere: Examples João P. Hespanha University of California at Santa Barbara Summary Examples of hybrid systems 1. Bouncing ball 2.

More information

BSc MATHEMATICAL SCIENCE

BSc MATHEMATICAL SCIENCE Overview College of Science Modules Electives May 2018 (2) BSc MATHEMATICAL SCIENCE BSc Mathematical Science Degree 2018 1 College of Science, NUI Galway Fullscreen Next page Overview [60 Credits] [60

More information

Software Verification with Abstraction-Based Methods

Software Verification with Abstraction-Based Methods Software Verification with Abstraction-Based Methods Ákos Hajdu PhD student Department of Measurement and Information Systems, Budapest University of Technology and Economics MTA-BME Lendület Cyber-Physical

More information

Introduction to Systems Analysis and Decision Making Prepared by: Jakub Tomczak

Introduction to Systems Analysis and Decision Making Prepared by: Jakub Tomczak Introduction to Systems Analysis and Decision Making Prepared by: Jakub Tomczak 1 Introduction. Random variables During the course we are interested in reasoning about considered phenomenon. In other words,

More information

Non-Parametric Bayes

Non-Parametric Bayes Non-Parametric Bayes Mark Schmidt UBC Machine Learning Reading Group January 2016 Current Hot Topics in Machine Learning Bayesian learning includes: Gaussian processes. Approximate inference. Bayesian

More information

Dr. Dennis Gervin Sections: 4252, 4253, 7734,

Dr. Dennis Gervin Sections: 4252, 4253, 7734, BIOLOGY 111 Dr. Dennis Gervin Sections: 4252, 4253, 7734, 7736 http://www.mjc.edu/ http://gervind.faculty.mjc.edu/default.html A Guide to the Natural World How Does Science Impact Your Everyday World?

More information

Stochastic modeling of a serial killer

Stochastic modeling of a serial killer This paper appeared in the Journal of Theoretical Biology (24) 355: 6 Stochastic modeling of a serial killer M.V. Simkin and V.P. Roychowdhury Department of Electrical Engineering, University of California,

More information

Monitoring Bounded LTL Properties UsingIntervalAnalysis

Monitoring Bounded LTL Properties UsingIntervalAnalysis Available online at www.sciencedirect.com Electronic Notes in Theoretical Computer Science 317 (2015) 85 100 www.elsevier.com/locate/entcs Monitoring Bounded LTL Properties UsingIntervalAnalysis Daisuke

More information

Finite Automata. BİL405 - Automata Theory and Formal Languages 1

Finite Automata. BİL405 - Automata Theory and Formal Languages 1 Finite Automata BİL405 - Automata Theory and Formal Languages 1 Deterministic Finite Automata (DFA) A Deterministic Finite Automata (DFA) is a quintuple A = (Q,,, q 0, F) 1. Q is a finite set of states

More information

Uncertainty Quantification in Performance Evaluation of Manufacturing Processes

Uncertainty Quantification in Performance Evaluation of Manufacturing Processes Uncertainty Quantification in Performance Evaluation of Manufacturing Processes Manufacturing Systems October 27, 2014 Saideep Nannapaneni, Sankaran Mahadevan Vanderbilt University, Nashville, TN Acknowledgement

More information

Verification of Nonlinear Hybrid Systems with Ariadne

Verification of Nonlinear Hybrid Systems with Ariadne Verification of Nonlinear Hybrid Systems with Ariadne Luca Geretti and Tiziano Villa June 2, 2016 June 2, 2016 Verona, Italy 1 / 1 Outline June 2, 2016 Verona, Italy 2 / 1 Outline June 2, 2016 Verona,

More information

Hybrid systems and computer science a short tutorial

Hybrid systems and computer science a short tutorial Hybrid systems and computer science a short tutorial Eugene Asarin Université Paris 7 - LIAFA SFM 04 - RT, Bertinoro p. 1/4 Introductory equations Hybrid Systems = Discrete+Continuous SFM 04 - RT, Bertinoro

More information

Every Social System Is an Automation

Every Social System Is an Automation University of Nebraska - Lincoln DigitalCommons@University of Nebraska - Lincoln Transactions of the Nebraska Academy of Sciences and Affiliated Societies Nebraska Academy of Sciences 1973 Every Social

More information

Introduction Probabilistic Programming ProPPA Inference Results Conclusions. Embedding Machine Learning in Stochastic Process Algebra.

Introduction Probabilistic Programming ProPPA Inference Results Conclusions. Embedding Machine Learning in Stochastic Process Algebra. Embedding Machine Learning in Stochastic Process Algebra Jane Hillston Joint work with Anastasis Georgoulas and Guido Sanguinetti, School of Informatics, University of Edinburgh 16th August 2017 quan col....

More information

arxiv: v1 [cs.et] 22 Jan 2019

arxiv: v1 [cs.et] 22 Jan 2019 Approximation Techniques for Stochastic Analysis of Biological Systems Thakur Neupane, Zhen Zhang, Curtis Madsen, Hao Zheng, and Chris J. Myers arxiv:1901.07857v1 [cs.et] 22 Jan 2019 Abstract There has

More information

Benchmarks for Temporal Logic Requirements for Automotive Systems

Benchmarks for Temporal Logic Requirements for Automotive Systems EPiC Series in Computer Science Volume 34, 5, Pages 5 3 ARCH4-5. st and nd International Workshop on Applied verification for Continuous and Hybrid Systems Benchmarks for Temporal Logic Requirements for

More information

A Sequential Bayesian Approach with Applications to Circadian Rhythm Microarray Gene Expression Data

A Sequential Bayesian Approach with Applications to Circadian Rhythm Microarray Gene Expression Data A Sequential Bayesian Approach with Applications to Circadian Rhythm Microarray Gene Expression Data Faming Liang, Chuanhai Liu, and Naisyin Wang Texas A&M University Multiple Hypothesis Testing Introduction

More information

Computational Cognitive Science

Computational Cognitive Science Computational Cognitive Science Lecture 9: A Bayesian model of concept learning Chris Lucas School of Informatics University of Edinburgh October 16, 218 Reading Rules and Similarity in Concept Learning

More information

Learning Sequence Motif Models Using Expectation Maximization (EM) and Gibbs Sampling

Learning Sequence Motif Models Using Expectation Maximization (EM) and Gibbs Sampling Learning Sequence Motif Models Using Expectation Maximization (EM) and Gibbs Sampling BMI/CS 776 www.biostat.wisc.edu/bmi776/ Spring 009 Mark Craven craven@biostat.wisc.edu Sequence Motifs what is a sequence

More information

COMS 4771 Introduction to Machine Learning. Nakul Verma

COMS 4771 Introduction to Machine Learning. Nakul Verma COMS 4771 Introduction to Machine Learning Nakul Verma Announcements HW2 due now! Project proposal due on tomorrow Midterm next lecture! HW3 posted Last time Linear Regression Parametric vs Nonparametric

More information

ECE521 week 3: 23/26 January 2017

ECE521 week 3: 23/26 January 2017 ECE521 week 3: 23/26 January 2017 Outline Probabilistic interpretation of linear regression - Maximum likelihood estimation (MLE) - Maximum a posteriori (MAP) estimation Bias-variance trade-off Linear

More information

Proteomics. 2 nd semester, Department of Biotechnology and Bioinformatics Laboratory of Nano-Biotechnology and Artificial Bioengineering

Proteomics. 2 nd semester, Department of Biotechnology and Bioinformatics Laboratory of Nano-Biotechnology and Artificial Bioengineering Proteomics 2 nd semester, 2013 1 Text book Principles of Proteomics by R. M. Twyman, BIOS Scientific Publications Other Reference books 1) Proteomics by C. David O Connor and B. David Hames, Scion Publishing

More information

An Incremental Approach to Model Checking Progress Properties

An Incremental Approach to Model Checking Progress Properties An Incremental Approach to Model Checking Progress Properties Aaron Bradley Fabio Somenzi Zyad Hassan Yan Zhang Department of Electrical, Computer, and Energy Engineering University of Colorado at Boulder

More information

Ultrametric Automata with One Head Versus Multihead Nondeterministic Automata

Ultrametric Automata with One Head Versus Multihead Nondeterministic Automata Ultrametric Automata with One Head Versus Multihead Nondeterministic Automata Maksims Dimitrijevs and Irina Ščeguļnaja University of Latvia, Faculty of Computing, Raiņa bulvāris 19, Riga, LV-1586, Latvia

More information

SOLVING STOCHASTIC PERT NETWORKS EXACTLY USING HYBRID BAYESIAN NETWORKS

SOLVING STOCHASTIC PERT NETWORKS EXACTLY USING HYBRID BAYESIAN NETWORKS SOLVING STOCHASTIC PERT NETWORKS EXACTLY USING HYBRID BAYESIAN NETWORKS Esma Nur Cinicioglu and Prakash P. Shenoy School of Business University of Kansas, Lawrence, KS 66045 USA esmanur@ku.edu, pshenoy@ku.edu

More information

Bayesian Models in Machine Learning

Bayesian Models in Machine Learning Bayesian Models in Machine Learning Lukáš Burget Escuela de Ciencias Informáticas 2017 Buenos Aires, July 24-29 2017 Frequentist vs. Bayesian Frequentist point of view: Probability is the frequency of

More information

Computational Biology: Basics & Interesting Problems

Computational Biology: Basics & Interesting Problems Computational Biology: Basics & Interesting Problems Summary Sources of information Biological concepts: structure & terminology Sequencing Gene finding Protein structure prediction Sources of information

More information

Approximate inference for stochastic dynamics in large biological networks

Approximate inference for stochastic dynamics in large biological networks MID-TERM REVIEW Institut Henri Poincaré, Paris 23-24 January 2014 Approximate inference for stochastic dynamics in large biological networks Ludovica Bachschmid Romano Supervisor: Prof. Manfred Opper Artificial

More information

Statistical analysis of microarray data: a Bayesian approach

Statistical analysis of microarray data: a Bayesian approach Biostatistics (003), 4, 4,pp. 597 60 Printed in Great Britain Statistical analysis of microarray data: a Bayesian approach RAPHAEL GTTARD University of Washington, Department of Statistics, Box 3543, Seattle,

More information