Molecular Programming Models. Based on notes by Dave Doty

Size: px
Start display at page:

Download "Molecular Programming Models. Based on notes by Dave Doty"

Transcription

1 Molecular Programming Models Based on notes by Dave Doty

2 Outline Stable predicate decidability Stably computable predicates == semilinear predicates (and stably computable func<ons == semilinear func<ons) Time complexity via a stochas<c model

3 CRNs: Predicate computa<on example ini#al state: (n1, n2) (n = n1 + n2) predicate: n2 < n1-2? reac#ons: X1 + X1 Y + X1 X2 + Y U + U

4 CRNs: Predicate computa<on example ini#al state: (n1, n2) (n = n1 + n2) predicate: n2 < n1-2? reac#ons: X1 + X1 Y + X1 (produce n1 1 Y s) X2 + Y U + U yes-voter species Y, no-voter species X2

5 CRNs: Predicate computa<on example More examples: n is odd n1 < n2

6 CRNs: Predicate computa<on Let C = (Λ,R) be a CRN with input species X 1,, X k Some species of Λ are yes-voters Some species of Λ are no-voters An input configura#on i is one in which the counts of all but the input species is 0 We ll denote i(x i ) by n i (ini<al count of species X i ), and let n = n 1, + n n k

7 CRNs: Predicate computa<on For a configura<on c, let φ(c) be 1 if c contains yes-voters but no no-voters 0 if c contains no-voters but no yes-voters undefined otherwise A configura#on o is output stable if φ(o) is defined, and for all c such that o è c, φ(o) = φ (c)

8 CRNs: Predicate computa<on Let ψ: N k à {0,1} be a predicate We say that C computes ψ if for all input configura<ons i, i è c implies that c è o, where o is output stable and o(y) = ψ(n 1, n 2,, n k ) Equivalently, C decides set A where (n 1, n 2,, n k ) is in A iff ψ(n 1, n 2,, n k ) = 1

9 CRNs: Predicate computa<on Let s be a configura<on in which only non-input species may have counts > 0 A CRN decider with ini#al context s is just like a CRN decider, except that on any input i, the ini<al configura<on is i + s

10 CRNs: Predicate computa<on Claim: Threshold sets and mod sets are stably decidable by CRNs Threshold set X: for some constants b, a 1, a 2,, a d Z, Mod set X: for some constants a 1, a 2,, a d Z, b, c N

11 CRNs: Predicate computa<on Claim: The predicates that are stably decidable by CRNs are closed under union, intersec<on and complement

12 CRNs: Stably decidable predicates A set A in N k is linear if there are vectors b, u 1,, u p in N k such that A set is semilinear if it is a finite union of linear sets

13 CRNs: Stably decidable predicates Claim: The stably decidable predicates are exactly the semilinear sets This follows from a characteriza<on (by Ginsberg and Spanier) of semilinear sets as the union, intersec<on and complement of sets that are either threshold sets or mod sets Similarly, the stably decidable func<ons are exactly the semilinear func<ons Angluin, Aspnes, Eisenstat, Stably computable predicates are semi-linear, PODC, 2006

14 CRNs: Stochas<c (kine<c) model

15 CRNs: Stochas<c (kine<c) model So far: we ve developed intui<on about what's stably decidable vs undecidable Next, we d like to dis<nguish between predicates that can, or cannot, be decided quickly For this we ll use a stochas<c model of reac<on rates (rather than a mass ac<on model)

16 CRNs: Stochas<c (kine<c) model Mass ac<on models (first order differen<al equa<ons) assume that evolu<on of a molecular system is con<nuous and determinis<c: not suitable for modeling small molecular quan<<es not suitable for predic<ng distribu<on of molecular counts over <me Stochas<c kine<c models avoid these piialls

17 CRNs: Stochas<c (kine<c) model Fix a CRN C and a configura<on c the <me for a given reac<on (r,p) is exponen<ally distributed with some rate (propensity) prop(r,p) prop(r,p) depends on volume v, molecular counts of reactants (and rate constant) we'll assume that the volume is propor<onal to the sum of counts of species in c (typically, this is Theta(n) where n is the ini<al sum of counts of input species)

18 CRNs: Stochas<c (kine<c) model fix a configura<on c, let v be the volume propensity of reac<on (r,p): reac<on type (r,p) propensity(r,p) Xi c(xi) Xi + Xj c(xi). c(xj) / v Xi + Xi c(xi). c(xi -1) / 2v the probability that (r,p) occurs next is prop(r,p)/ (rʹ,pʹ) prop(rʹ,pʹ) the expected #me for a reac<on is 1/ (r,p ) prop(rʹ,pʹ)

19 CRNs: Expected run<me analysis We'll assume that the volume is (propor<onal to) n, the sum of counts of input species, since in our examples the total number of species will always remain within a constant factor of the number of input species

20 Summary CRNs can stably decide exactly the semilinear predicates A stochas<c model is used to model reac<on likelihoods

21 Next classes Time complexity of CRN algorithms The semilinear predicates can be decided with probability 1 of correctness what if a small probability of error is allowed? Lower bounds

Compu&ng with Chemical Reac&on Networks. Nikhil Gopalkrishnan

Compu&ng with Chemical Reac&on Networks. Nikhil Gopalkrishnan Compu&ng with Chemical Reac&on Networks Nikhil Gopalkrishnan The programming language of chemical kinetics Use the language of coupled chemical reactions prescriptively as a programming language for engineering

More information

PSPACE, NPSPACE, L, NL, Savitch's Theorem. More new problems that are representa=ve of space bounded complexity classes

PSPACE, NPSPACE, L, NL, Savitch's Theorem. More new problems that are representa=ve of space bounded complexity classes PSPACE, NPSPACE, L, NL, Savitch's Theorem More new problems that are representa=ve of space bounded complexity classes Outline for today How we'll count space usage Space bounded complexity classes New

More information

Mediated Population Protocols

Mediated Population Protocols Othon Michail Paul Spirakis Ioannis Chatzigiannakis Research Academic Computer Technology Institute (RACTI) July 2009 Michail, Spirakis, Chatzigiannakis 1 / 25 Outline I Population Protocols 1 Population

More information

Speed faults in computation by chemical reaction networks

Speed faults in computation by chemical reaction networks Speed faults in computation by chemical reaction networks Ho-Lin Chen Rachel Cummings David Doty David Soloveichik Abstract Chemical reaction networks (CRNs) formally model chemistry in a well-mixed solution.

More information

Deterministic Function Computation with Chemical Reaction Networks

Deterministic Function Computation with Chemical Reaction Networks Deterministic Function Computation with Chemical Reaction Networks Ho-Lin Chen David Doty David Soloveichik Abstract Chemical reaction networks (CRNs) formally model chemistry in a well-mixed solution.

More information

Speed faults in computation by chemical reaction networks

Speed faults in computation by chemical reaction networks Speed faults in computation by chemical reaction networks Ho-Lin Chen Rachel Cummings David Doty David Soloveichik Abstract Chemical reaction networks (CRNs) formally model chemistry in a well-mixed solution.

More information

Part 2. Representation Learning Algorithms

Part 2. Representation Learning Algorithms 53 Part 2 Representation Learning Algorithms 54 A neural network = running several logistic regressions at the same time If we feed a vector of inputs through a bunch of logis;c regression func;ons, then

More information

Least Mean Squares Regression. Machine Learning Fall 2017

Least Mean Squares Regression. Machine Learning Fall 2017 Least Mean Squares Regression Machine Learning Fall 2017 1 Lecture Overview Linear classifiers What func?ons do linear classifiers express? Least Squares Method for Regression 2 Where are we? Linear classifiers

More information

CPSC 506: Complexity of Computa5on

CPSC 506: Complexity of Computa5on CPSC 506: Complexity of Computa5on On the founda5ons of our field, connec5ons between Science and Compu5ng, where our field might be headed in the future CPSC 506 MW 9-10:30, DMP 101 cs.ubc.ca/~condon/cpsc506/

More information

arxiv: v2 [cs.et] 10 Jul 2017

arxiv: v2 [cs.et] 10 Jul 2017 Democratic, Existential, and Consensus-Based Output Conventions in Stable Computation by Chemical Reaction Networks Robert Brijder 1, David Doty 2, and David Soloveichik 3 1 Hasselt University, Diepenbeek,

More information

Stable Leader Election in Population Protocols Requires Linear Time

Stable Leader Election in Population Protocols Requires Linear Time Stable Leader Election in Population Protocols Requires Linear Time David Doty 1, and David Soloveichik 2, 1 University of California, Davis, Davis, CA, USA, doty@ucdavis.edu 2 University of Texas at Austin,

More information

Calorimetry POGIL.notebook. December 06, 2012 POGIL ACTIVITY. Calorimetry Measurement of Heat Energy. Why?

Calorimetry POGIL.notebook. December 06, 2012 POGIL ACTIVITY. Calorimetry Measurement of Heat Energy. Why? POGIL ACTIVITY Calorimetry Measurement of Heat Energy Why? The amount of heat energy released or absorbed by a chemical or physical change can be measured using an instrument called a calorimeter. This

More information

Example 3.3 Moving-average filter

Example 3.3 Moving-average filter 3.3 Difference Equa/ons for Discrete-Time Systems A Discrete-/me system can be modeled with difference equa3ons involving current, past, or future samples of input and output signals Example 3.3 Moving-average

More information

Probability 1 computation with chemical reaction networks

Probability 1 computation with chemical reaction networks Probability 1 computation with chemical reaction networks Rachel Cummings David Doty David Soloveichik Abstract The computational power of stochastic chemical reaction networks (CRNs) varies significantly

More information

Probability 1 computation with chemical reaction networks

Probability 1 computation with chemical reaction networks Probability 1 computation with chemical reaction networks Rachel Cummings David Doty David Soloveichik Abstract The computational power of stochastic chemical reaction networks (CRNs) varies significantly

More information

Computational Models for Wireless Sensor Networks: A Survey

Computational Models for Wireless Sensor Networks: A Survey Computational Models for Wireless Sensor Networks: A Survey Apostolos Filippas 2, Stavros Nikolaou 2, Andreas Pavlogiannis 2, Othon Michail 1,2, Ioannis Chatzigiannakis 1,2, and Paul G. Spirakis 1,2 1

More information

CHAPTER 6 : LITERATURE REVIEW

CHAPTER 6 : LITERATURE REVIEW CHAPTER 6 : LITERATURE REVIEW Chapter : LITERATURE REVIEW 77 M E A S U R I N G T H E E F F I C I E N C Y O F D E C I S I O N M A K I N G U N I T S A B S T R A C T A n o n l i n e a r ( n o n c o n v e

More information

P E R E N C O - C H R I S T M A S P A R T Y

P E R E N C O - C H R I S T M A S P A R T Y L E T T I C E L E T T I C E I S A F A M I L Y R U N C O M P A N Y S P A N N I N G T W O G E N E R A T I O N S A N D T H R E E D E C A D E S. B A S E D I N L O N D O N, W E H A V E T H E P E R F E C T R

More information

Op#mal Control of Nonlinear Systems with Temporal Logic Specifica#ons

Op#mal Control of Nonlinear Systems with Temporal Logic Specifica#ons Op#mal Control of Nonlinear Systems with Temporal Logic Specifica#ons Eric M. Wolff 1 Ufuk Topcu 2 and Richard M. Murray 1 1 Caltech and 2 UPenn University of Michigan October 1, 2013 Autonomous Systems

More information

Bellman s Curse of Dimensionality

Bellman s Curse of Dimensionality Bellman s Curse of Dimensionality n- dimensional state space Number of states grows exponen

More information

Elici%ng Informa%on from the Crowd a Part of the EC 13 Tutorial on Social Compu%ng and User- Generated Content

Elici%ng Informa%on from the Crowd a Part of the EC 13 Tutorial on Social Compu%ng and User- Generated Content Elici%ng Informa%on from the Crowd a Part of the EC 13 Tutorial on Social Compu%ng and User- Generated Content Yiling Chen Harvard University June 16, 2013 Roadmap Elici%ng informa%on for events with verifiable

More information

Electronic Structure Calcula/ons: Density Func/onal Theory. and. Predic/ng Cataly/c Ac/vity

Electronic Structure Calcula/ons: Density Func/onal Theory. and. Predic/ng Cataly/c Ac/vity Electronic Structure Calcula/ons: Density Func/onal Theory and Predic/ng Cataly/c Ac/vity Review Examples of experiments that do not agree with classical physics: Photoelectric effect Photons and the quan/za/on

More information

The Color Glass Condensate: Theory, Experiment and the Future

The Color Glass Condensate: Theory, Experiment and the Future The Color Glass Condensate: Theory, Experiment and the Future Physics Issues: What is the high energy limit of strong interac?ons? How do we compute the gluon and quark distribu?ons relevant for asympto?cally

More information

Introduc)on to Fuel Cells

Introduc)on to Fuel Cells Introduc)on to Fuel Cells Anode (oxida)on loss of electrons): 2H 2 à 4H + +4e - Cathode (reduc-on gain of electrons) O 2 +4H + +4e - à 2H 2 O Overall reac)on (redox): 2H 2 + O 2 à 2H 2 O We will par)cularly

More information

DART Tutorial Sec'on 1: Filtering For a One Variable System

DART Tutorial Sec'on 1: Filtering For a One Variable System DART Tutorial Sec'on 1: Filtering For a One Variable System UCAR The Na'onal Center for Atmospheric Research is sponsored by the Na'onal Science Founda'on. Any opinions, findings and conclusions or recommenda'ons

More information

Monadic Predicate Logic is Decidable. Boolos et al, Computability and Logic (textbook, 4 th Ed.)

Monadic Predicate Logic is Decidable. Boolos et al, Computability and Logic (textbook, 4 th Ed.) Monadic Predicate Logic is Decidable Boolos et al, Computability and Logic (textbook, 4 th Ed.) These slides use A instead of E instead of & instead of - instead of Nota>on Equality statements are atomic

More information

Compe&&ve Kine&c Isotope Effects

Compe&&ve Kine&c Isotope Effects Compe&&ve Kine&c Isotope Effects Absolute Rates: - - - measure rate of H vs. D in separate flasks observa&on of primary KIE is unambiguous evidence for rate- determining C- H cleavage subject to rela&vely

More information

Black Ninjas in the Dark: Formal Analysis of Population Protocols

Black Ninjas in the Dark: Formal Analysis of Population Protocols Black Ninjas in the Dark: Formal Analysis of Population Protocols Deaf Black Ninjas in the Dark Deaf Black Ninjas in the Dark Deaf Black Ninjas in the Dark Deaf Black Ninjas in the Dark Deaf Black Ninjas

More information

A mul&scale autocorrela&on func&on for anisotropy studies

A mul&scale autocorrela&on func&on for anisotropy studies A mul&scale autocorrela&on func&on for anisotropy studies Mario Scuderi 1, M. De Domenico, H Lyberis and A. Insolia 1 Department of Physics and Astronomy & INFN Catania University ITALY DAA2011 Erice,

More information

MA/CS 109 Lecture 7. Back To Exponen:al Growth Popula:on Models

MA/CS 109 Lecture 7. Back To Exponen:al Growth Popula:on Models MA/CS 109 Lecture 7 Back To Exponen:al Growth Popula:on Models Homework this week 1. Due next Thursday (not Tuesday) 2. Do most of computa:ons in discussion next week 3. If possible, bring your laptop

More information

T i t l e o f t h e w o r k : L a M a r e a Y o k o h a m a. A r t i s t : M a r i a n o P e n s o t t i ( P l a y w r i g h t, D i r e c t o r )

T i t l e o f t h e w o r k : L a M a r e a Y o k o h a m a. A r t i s t : M a r i a n o P e n s o t t i ( P l a y w r i g h t, D i r e c t o r ) v e r. E N G O u t l i n e T i t l e o f t h e w o r k : L a M a r e a Y o k o h a m a A r t i s t : M a r i a n o P e n s o t t i ( P l a y w r i g h t, D i r e c t o r ) C o n t e n t s : T h i s w o

More information

Introduction to Particle Filters for Data Assimilation

Introduction to Particle Filters for Data Assimilation Introduction to Particle Filters for Data Assimilation Mike Dowd Dept of Mathematics & Statistics (and Dept of Oceanography Dalhousie University, Halifax, Canada STATMOS Summer School in Data Assimila5on,

More information

Introduc)on to Ar)ficial Intelligence

Introduc)on to Ar)ficial Intelligence Introduc)on to Ar)ficial Intelligence Lecture 10 Probability CS/CNS/EE 154 Andreas Krause Announcements! Milestone due Nov 3. Please submit code to TAs! Grading: PacMan! Compiles?! Correct? (Will clear

More information

Be#er Generaliza,on with Forecasts. Tom Schaul Mark Ring

Be#er Generaliza,on with Forecasts. Tom Schaul Mark Ring Be#er Generaliza,on with Forecasts Tom Schaul Mark Ring Which Representa,ons? Type: Feature- based representa,ons (state = feature vector) Quality 1: Usefulness for linear policies Quality 2: Generaliza,on

More information

7. Quantum Monte Carlo (QMC)

7. Quantum Monte Carlo (QMC) Molecular Simulations with Chemical and Biological Applications (Part I) 7. Quantum Monte Carlo (QMC) Dr. Mar(n Steinhauser 1 HS 2014 Molecular Simula(ons with Chemical and Biological Applica(ons 1 Introduc5on

More information

CH 302 Unit 3 Exam Review NUCLEAR, KINETICS, INORGANIC

CH 302 Unit 3 Exam Review NUCLEAR, KINETICS, INORGANIC CH 302 Unit 3 Exam Review NUCLEAR, KINETICS, INORGANIC Learning ObjecDves - Nuclear Explain the macroscopic observables associated with Understand and explain the concept of isotopic stability nuclear

More information

n CS 160 or CS122 n Sets and Functions n Propositions and Predicates n Inference Rules n Proof Techniques n Program Verification n CS 161

n CS 160 or CS122 n Sets and Functions n Propositions and Predicates n Inference Rules n Proof Techniques n Program Verification n CS 161 Discrete Math at CSU (Rosen book) Sets and Functions (Rosen, Sections 2.1,2.2, 2.3) TOPICS Discrete math Set Definition Set Operations Tuples 1 n CS 160 or CS122 n Sets and Functions n Propositions and

More information

Please give details of your answer. A direct answer without explanation is not counted.

Please give details of your answer. A direct answer without explanation is not counted. Please give details of your answer. A direct answer without explanation is not counted. Your answers must be in English. Please carefully read problem statements. During the exam you are not allowed to

More information

Pedro Alexandrino Fernandes, Dep. Chemistry & Biochemistry, University of Porto, Portugal

Pedro Alexandrino Fernandes, Dep. Chemistry & Biochemistry, University of Porto, Portugal Pedro Alexandrino Fernandes, Dep. Chemistry & Biochemistry, University of Porto, Portugal pedro.fernandes@fc.up.pt 1. Introduc3on Intermolecular Associa3ons 1. Introduc3on What type of forces govern these

More information

Decision Problems with TM s. Lecture 31: Halting Problem. Universe of discourse. Semi-decidable. Look at following sets: CSCI 81 Spring, 2012

Decision Problems with TM s. Lecture 31: Halting Problem. Universe of discourse. Semi-decidable. Look at following sets: CSCI 81 Spring, 2012 Decision Problems with TM s Look at following sets: Lecture 31: Halting Problem CSCI 81 Spring, 2012 Kim Bruce A TM = { M,w M is a TM and w L(M)} H TM = { M,w M is a TM which halts on input w} TOTAL TM

More information

CSCI 1010 Models of Computa3on. Lecture 11 Proving Languages NP-Complete

CSCI 1010 Models of Computa3on. Lecture 11 Proving Languages NP-Complete CSCI 1010 Models of Computa3on Lecture 11 Proving Languages NP-Complete Overview P-3me reduc3ons Composi3on of P-3me reduc3ons Reduc3on from CIRCUIT SAT to SAT SAT is NP-complete. 3-SAT is NP-complete.

More information

Comments on Black Hole Interiors

Comments on Black Hole Interiors Comments on Black Hole Interiors Juan Maldacena Ins6tute for Advanced Study Conserva6ve point of view Expansion parameter = geff 2 ld 2 p r D 2 h 1 S Informa6on seems to be lost perturba6vely. n point

More information

Exponen'al growth and differen'al equa'ons

Exponen'al growth and differen'al equa'ons Exponen'al growth and differen'al equa'ons But first.. Thanks for the feedback! Feedback about M102 Which of the following do you find useful? 70 60 50 40 30 20 10 0 How many resources students typically

More information

Decision Trees Lecture 12

Decision Trees Lecture 12 Decision Trees Lecture 12 David Sontag New York University Slides adapted from Luke Zettlemoyer, Carlos Guestrin, and Andrew Moore Machine Learning in the ER Physician documentation Triage Information

More information

Energy. On the ground, the ball has no useful poten:al or kine:c energy. It cannot do anything.

Energy. On the ground, the ball has no useful poten:al or kine:c energy. It cannot do anything. Energy What is energy? It can take many forms but a good general defini:on is that energy is the capacity to perform work or transfer heat. In other words, the more energy something has, the more things

More information

Graphical Models. Lecture 10: Variable Elimina:on, con:nued. Andrew McCallum

Graphical Models. Lecture 10: Variable Elimina:on, con:nued. Andrew McCallum Graphical Models Lecture 10: Variable Elimina:on, con:nued Andrew McCallum mccallum@cs.umass.edu Thanks to Noah Smith and Carlos Guestrin for some slide materials. 1 Last Time Probabilis:c inference is

More information

Streaming - 2. Bloom Filters, Distinct Item counting, Computing moments. credits:www.mmds.org.

Streaming - 2. Bloom Filters, Distinct Item counting, Computing moments. credits:www.mmds.org. Streaming - 2 Bloom Filters, Distinct Item counting, Computing moments credits:www.mmds.org http://www.mmds.org Outline More algorithms for streams: 2 Outline More algorithms for streams: (1) Filtering

More information

Machine learning for Dynamic Social Network Analysis

Machine learning for Dynamic Social Network Analysis Machine learning for Dynamic Social Network Analysis Manuel Gomez Rodriguez Max Planck Ins7tute for So;ware Systems UC3M, MAY 2017 Interconnected World SOCIAL NETWORKS TRANSPORTATION NETWORKS WORLD WIDE

More information

The Rules. The Math Game. More Rules. Teams. 1. Slope of tangent line. Are you ready??? 10/24/17

The Rules. The Math Game. More Rules. Teams. 1. Slope of tangent line. Are you ready??? 10/24/17 The Rules The Math Game Four Teams 1-2 players per team at the buzzers each =me. First to buzz in gets to answer Q. Correct answer: 1 point for your team, and con=nue playing Incorrect answer/ no answer/

More information

Molecular Dynamics. Molecules in motion

Molecular Dynamics. Molecules in motion Molecular Dynamics Molecules in motion 1 Molecules in mo1on Molecules are not sta1c, but move all the 1me Source: h9p://en.wikipedia.org/wiki/kine1c_theory 2 Gasses, liquids and solids Gasses, liquids

More information

Algorithms, Lecture 3 on NP : Nondeterminis7c Polynomial Time

Algorithms, Lecture 3 on NP : Nondeterminis7c Polynomial Time Algorithms, Lecture 3 on NP : Nondeterminis7c Polynomial Time Last week: Defined Polynomial Time Reduc7ons: Problem X is poly 7me reducible to Y X P Y if can solve X using poly computa7on and a poly number

More information

Logis&c Regression. Robot Image Credit: Viktoriya Sukhanova 123RF.com

Logis&c Regression. Robot Image Credit: Viktoriya Sukhanova 123RF.com Logis&c Regression These slides were assembled by Eric Eaton, with grateful acknowledgement of the many others who made their course materials freely available online. Feel free to reuse or adapt these

More information

A set is an unordered collection of objects.

A set is an unordered collection of objects. Section 2.1 Sets A set is an unordered collection of objects. the students in this class the chairs in this room The objects in a set are called the elements, or members of the set. A set is said to contain

More information

The Rigid Rotor Problem: A quantum par7cle confined to a sphere Spherical Harmonics. Reading: McIntyre 7.6

The Rigid Rotor Problem: A quantum par7cle confined to a sphere Spherical Harmonics. Reading: McIntyre 7.6 The Rigid Rotor Problem: A quantum par7cle confined to a sphere Spherical Harmonics Reading: McIntyre 7.6 Legendre s equa7on (m = 0) The series must be finite! If the series is not finite, the polynomial

More information

Computation in Networks of Passively Mobile Finite-State Sensors

Computation in Networks of Passively Mobile Finite-State Sensors Distributed Computing manuscript No. (will be inserted by the editor) Dana Angluin James Aspnes Zoë Diamadi Michael J. Fischer René Peralta Computation in Networks of Passively Mobile Finite-State Sensors

More information

Introduc)on to Ar)ficial Intelligence

Introduc)on to Ar)ficial Intelligence Introduc)on to Ar)ficial Intelligence Lecture 13 Approximate Inference CS/CNS/EE 154 Andreas Krause Bayesian networks! Compact representa)on of distribu)ons over large number of variables! (OQen) allows

More information

Definition: Let S and T be sets. A binary relation on SxT is any subset of SxT. A binary relation on S is any subset of SxS.

Definition: Let S and T be sets. A binary relation on SxT is any subset of SxT. A binary relation on S is any subset of SxS. 4 Functions Before studying functions we will first quickly define a more general idea, namely the notion of a relation. A function turns out to be a special type of relation. Definition: Let S and T be

More information

There are problems that cannot be solved by computer programs (i.e. algorithms) even assuming unlimited time and space.

There are problems that cannot be solved by computer programs (i.e. algorithms) even assuming unlimited time and space. Undecidability There are problems that cannot be solved by computer programs (i.e. algorithms) even assuming unlimited time and space. Proved by Alan Turing in 1936 What is a computer program/algorithm?

More information

Announcements. Topics: Homework: - sec0ons 1.2, 1.3, and 2.1 * Read these sec0ons and study solved examples in your textbook!

Announcements. Topics: Homework: - sec0ons 1.2, 1.3, and 2.1 * Read these sec0ons and study solved examples in your textbook! Announcements Topics: - sec0ons 1.2, 1.3, and 2.1 * Read these sec0ons and study solved examples in your textbook! Homework: - review lecture notes thoroughly - work on prac0ce problems from the textbook

More information

On Finding Planted Cliques and Solving Random Linear Equa9ons. Math Colloquium. Lev Reyzin UIC

On Finding Planted Cliques and Solving Random Linear Equa9ons. Math Colloquium. Lev Reyzin UIC On Finding Planted Cliques and Solving Random Linear Equa9ons Math Colloquium Lev Reyzin UIC 1 random graphs 2 Erdős- Rényi Random Graphs G(n,p) generates graph G on n ver9ces by including each possible

More information

MA 777: Topics in Mathematical Biology

MA 777: Topics in Mathematical Biology MA 777: Topics in Mathematical Biology David Murrugarra Department of Mathematics, University of Kentucky http://www.math.uky.edu/~dmu228/ma777/ Spring 2018 David Murrugarra (University of Kentucky) Lecture

More information

Rankine- Hugoniot Equa0ons and Detona0ons. Forman A. Williams UCSD

Rankine- Hugoniot Equa0ons and Detona0ons. Forman A. Williams UCSD Rankine- Hugoniot Equa0ons and Detona0ons Forman A. Williams UCSD Steady, Planar, Exothermic Reac0on Fronts To ask what kinds of steady, planar reac0on fronts may exist, derive the overall conserva0on

More information

Least Squares Parameter Es.ma.on

Least Squares Parameter Es.ma.on Least Squares Parameter Es.ma.on Alun L. Lloyd Department of Mathema.cs Biomathema.cs Graduate Program North Carolina State University Aims of this Lecture 1. Model fifng using least squares 2. Quan.fica.on

More information

Some thoughts on linearity, nonlinearity, and partial separability

Some thoughts on linearity, nonlinearity, and partial separability Some thoughts on linearity, nonlinearity, and partial separability Paul Hovland Argonne Na0onal Laboratory Joint work with Boyana Norris, Sri Hari Krishna Narayanan, Jean Utke, Drew Wicke Argonne Na0onal

More information

Undecidability of the validity problem

Undecidability of the validity problem Undecidability of the validity problem We prove the undecidability of the validity problem for formulas of predicate logic with equality. Recall: there is an algorithm that given a formula of predicate

More information

The DFT. Star+ng from Chapter 3, DFT of atoms and molecules, Parr & Lee 1989

The DFT. Star+ng from Chapter 3, DFT of atoms and molecules, Parr & Lee 1989 The DFT Star+ng from Chapter 3, DFT of atoms and molecules, Parr & Lee 1989 DFT- Thomas- Fermi model for atoms The theory showing how the N- electron wave func+on depending on 3N coordinates can be replaced

More information

Week 12, Lecture 2 Nuclear Synthesis

Week 12, Lecture 2 Nuclear Synthesis Week 12, Lecture 2 Nuclear Synthesis Nuclear Reac*ons in Space - - Overview - - Observa

More information

Bidirected edge-maximality of power graphs of finite cyclic groups

Bidirected edge-maximality of power graphs of finite cyclic groups Bidirected edge-maximality of power graphs of finite cyclic groups Brian Curtin 1 Gholam Reza Pourgholi 2 1 Department of Mathematics and Statistics University of South Florida 2 School of Mathematics,

More information

CSE446: Linear Regression Regulariza5on Bias / Variance Tradeoff Winter 2015

CSE446: Linear Regression Regulariza5on Bias / Variance Tradeoff Winter 2015 CSE446: Linear Regression Regulariza5on Bias / Variance Tradeoff Winter 2015 Luke ZeElemoyer Slides adapted from Carlos Guestrin Predic5on of con5nuous variables Billionaire says: Wait, that s not what

More information

State Space Representa,ons and Search Algorithms

State Space Representa,ons and Search Algorithms State Space Representa,ons and Search Algorithms CS171, Fall 2016 Introduc,on to Ar,ficial Intelligence Prof. Alexander Ihler Reading: R&N 3.1-3.4 Architectures for Intelligence Search? Determine how to

More information

by Yurii Khomskii There is a weaker notion called semi-representability:

by Yurii Khomskii There is a weaker notion called semi-representability: Gödel s Incompleteness Theorem by Yurii Khomskii We give three different proofs of Gödel s First Incompleteness Theorem. All three proofs are essentially variations of one another, but some people may

More information

CSE 373: Data Structures and Algorithms Pep Talk; Algorithm Analysis. Riley Porter Winter 2017

CSE 373: Data Structures and Algorithms Pep Talk; Algorithm Analysis. Riley Porter Winter 2017 CSE 373: Data Structures and Algorithms Pep Talk; Algorithm Analysis Riley Porter Announcements Op4onal Java Review Sec4on: PAA A102 Tuesday, January 10 th, 3:30-4:30pm. Any materials covered will be posted

More information

1991 Mathematics Subject Classification. 03B10, 68Q70.

1991 Mathematics Subject Classification. 03B10, 68Q70. Theoretical Informatics and Applications Informatique Théorique et Applications Will be set by the publisher DECIDING WHETHER A RELATION DEFINED IN PRESBURGER LOGIC CAN BE DEFINED IN WEAKER LOGICS Christian

More information

Machine Learning and Data Mining. Linear regression. Prof. Alexander Ihler

Machine Learning and Data Mining. Linear regression. Prof. Alexander Ihler + Machine Learning and Data Mining Linear regression Prof. Alexander Ihler Supervised learning Notation Features x Targets y Predictions ŷ Parameters θ Learning algorithm Program ( Learner ) Change µ Improve

More information

CMPSCI 250: Introduction to Computation. Lecture #11: Equivalence Relations David Mix Barrington 27 September 2013

CMPSCI 250: Introduction to Computation. Lecture #11: Equivalence Relations David Mix Barrington 27 September 2013 CMPSCI 250: Introduction to Computation Lecture #11: Equivalence Relations David Mix Barrington 27 September 2013 Equivalence Relations Definition of Equivalence Relations Two More Examples: Universal

More information

First-Order Logic (FOL)

First-Order Logic (FOL) First-Order Logic (FOL) Also called Predicate Logic or Predicate Calculus 2. First-Order Logic (FOL) FOL Syntax variables x, y, z, constants a, b, c, functions f, g, h, terms variables, constants or n-ary

More information

Math 312/ AMS 351 (Fall 17) Sample Questions for Final

Math 312/ AMS 351 (Fall 17) Sample Questions for Final Math 312/ AMS 351 (Fall 17) Sample Questions for Final 1. Solve the system of equations 2x 1 mod 3 x 2 mod 7 x 7 mod 8 First note that the inverse of 2 is 2 mod 3. Thus, the first equation becomes (multiply

More information

CS 6140: Machine Learning Spring What We Learned Last Week 2/26/16

CS 6140: Machine Learning Spring What We Learned Last Week 2/26/16 Logis@cs CS 6140: Machine Learning Spring 2016 Instructor: Lu Wang College of Computer and Informa@on Science Northeastern University Webpage: www.ccs.neu.edu/home/luwang Email: luwang@ccs.neu.edu Sign

More information

Unit 7 Exponential Functions. Mrs. Valen+ne Math III

Unit 7 Exponential Functions. Mrs. Valen+ne Math III Unit 7 Exponential Functions Mrs. Valen+ne Math III 7.1 Exponential Functions Graphing an Exponen.al Func.on Exponen+al Func+on: a func+on in the form y = ab x, where a 0, b > 0 and b 1 Domain is all real

More information

CSE 473: Ar+ficial Intelligence

CSE 473: Ar+ficial Intelligence CSE 473: Ar+ficial Intelligence Hidden Markov Models Luke Ze@lemoyer - University of Washington [These slides were created by Dan Klein and Pieter Abbeel for CS188 Intro to AI at UC Berkeley. All CS188

More information

Chapter 7 Conserva.on of Energy (cont d)

Chapter 7 Conserva.on of Energy (cont d) Chapter 7 Conserva.on of Energy (cont d) Mechanical energy conserva.on Examples Work by non conserva.ve forces March 4, 2010 Recollect: Conserva.on of Energy If only conserva.ve forces are present, the

More information

Glasma to plasma: classical coherence, quantum decoherence & thermaliza7on in the li8le Bang. Raju Venugopalan

Glasma to plasma: classical coherence, quantum decoherence & thermaliza7on in the li8le Bang. Raju Venugopalan Glasma to plasma: classical coherence, quantum decoherence & thermaliza7on in the li8le Bang Raju Venugopalan Lecture iv, UCT, February 2012 Outline of lectures Lecture I: QCD and the Quark- Gluon Plasma

More information

CSE 105 THEORY OF COMPUTATION

CSE 105 THEORY OF COMPUTATION CSE 105 THEORY OF COMPUTATION Spring 2018 http://cseweb.ucsd.edu/classes/sp18/cse105-ab/ Today's learning goals Sipser Ch 4.1 Explain what it means for a problem to be decidable. Justify the use of encoding.

More information

Bayesian networks Lecture 18. David Sontag New York University

Bayesian networks Lecture 18. David Sontag New York University Bayesian networks Lecture 18 David Sontag New York University Outline for today Modeling sequen&al data (e.g., =me series, speech processing) using hidden Markov models (HMMs) Bayesian networks Independence

More information

Online Cryptography Course. Block ciphers. What is a block cipher? Dan Boneh

Online Cryptography Course. Block ciphers. What is a block cipher? Dan Boneh Online Cryptography Course Block ciphers What is a block cipher? Block ciphers: crypto work horse n bits PT Block n bits E, D CT Block Key k bits Canonical examples: 1. 3DES: n= 64 bits, k = 168 bits 2.

More information

CSE 105 THEORY OF COMPUTATION

CSE 105 THEORY OF COMPUTATION CSE 105 THEORY OF COMPUTATION "Winter" 2018 http://cseweb.ucsd.edu/classes/wi18/cse105-ab/ Today's learning goals Sipser Ch 4.1 Explain what it means for a problem to be decidable. Justify the use of encoding.

More information

Computational Issues in BSM Theories -- Past, Present and Future

Computational Issues in BSM Theories -- Past, Present and Future Computational Issues in BSM Theories -- Past, Present and Future Meifeng Lin Computa0onal Science Center Brookhaven Na0onal Laboratory Field Theore0c Computer Simula0ons for Par0cle Physics And Condensed

More information

Physics 2203, Fall 2011 Modern Physics

Physics 2203, Fall 2011 Modern Physics Physics 2203, Fall 2011 Modern Physics. Friday, Nov. 2 nd, 2012. Energy levels in Nitrogen molecule Sta@s@cal Physics: Quantum sta@s@cs: Ch. 15 in our book. Notes from Ch. 10 in Serway Announcements Second

More information

Raymond A. Serway Chris Vuille. Chapter Seven. Rota9onal Mo9on and The Law of Gravity

Raymond A. Serway Chris Vuille. Chapter Seven. Rota9onal Mo9on and The Law of Gravity Raymond A. Serway Chris Vuille Chapter Seven Rota9onal Mo9on and The Law of Gravity Rota9onal Mo9on An important part of everyday life Mo9on of the Earth Rota9ng wheels Angular mo9on Expressed in terms

More information

CSE 105 THEORY OF COMPUTATION

CSE 105 THEORY OF COMPUTATION CSE 105 THEORY OF COMPUTATION Spring 2016 http://cseweb.ucsd.edu/classes/sp16/cse105-ab/ Today's learning goals Sipser Ch 4.1, 5.1 Define reductions from one problem to another. Use reductions to prove

More information

I. Energy. - power which may be translated into mo8on, overcoming resistance, or effec8ng physical change; the ability to do work.

I. Energy. - power which may be translated into mo8on, overcoming resistance, or effec8ng physical change; the ability to do work. I. Energy - power which may be translated into mo8on, overcoming resistance, or effec8ng physical change; the ability to do work. A. Work response to a force moving an object some distance W=F x D Joules

More information

Unit 4: Electrochemistry UNIFYING ELECTROCHEMISTRY, FREE ENERGY, & EQUILIBRIUM

Unit 4: Electrochemistry UNIFYING ELECTROCHEMISTRY, FREE ENERGY, & EQUILIBRIUM Unit 4: Electrochemistry UNIFYING ELECTROCHEMISTRY, FREE ENERGY, & EQUILIBRIUM Goals for Today 1. Describe fully the rela2onship between electrical poten2al (ε) and free energy ( G) ΔG = nfε 2. Describe

More information

Limits of Computability

Limits of Computability Limits of Computability Wolfgang Schreiner Wolfgang.Schreiner@risc.jku.at Research Institute for Symbolic Computation (RISC) Johannes Kepler University, Linz, Austria http://www.risc.jku.at Wolfgang Schreiner

More information

Probability and Structure in Natural Language Processing

Probability and Structure in Natural Language Processing Probability and Structure in Natural Language Processing Noah Smith Heidelberg University, November 2014 Introduc@on Mo@va@on Sta@s@cal methods in NLP arrived ~20 years ago and now dominate. Mercer was

More information

CSCI 360 Introduc/on to Ar/ficial Intelligence Week 2: Problem Solving and Op/miza/on. Instructor: Wei-Min Shen

CSCI 360 Introduc/on to Ar/ficial Intelligence Week 2: Problem Solving and Op/miza/on. Instructor: Wei-Min Shen CSCI 360 Introduc/on to Ar/ficial Intelligence Week 2: Problem Solving and Op/miza/on Instructor: Wei-Min Shen Today s Lecture Search Techniques (review & con/nue) Op/miza/on Techniques Home Work 1: descrip/on

More information

arxiv: v3 [cs.dc] 16 Apr 2017

arxiv: v3 [cs.dc] 16 Apr 2017 Polylogarithmic-Time Leader Election in Population Protocols Dan Alistarh Microsoft Research daalista@microsoft.com Rati Gelashvili MIT gelash@mit.edu arxiv:150.0575v3 [cs.dc] 16 Apr 017 Abstract Population

More information

Theory of Computation

Theory of Computation Thomas Zeugmann Hokkaido University Laboratory for Algorithmics http://www-alg.ist.hokudai.ac.jp/ thomas/toc/ Lecture 14: Applications of PCP Goal of this Lecture Our goal is to present some typical undecidability

More information

Graphical Models. Lecture 3: Local Condi6onal Probability Distribu6ons. Andrew McCallum

Graphical Models. Lecture 3: Local Condi6onal Probability Distribu6ons. Andrew McCallum Graphical Models Lecture 3: Local Condi6onal Probability Distribu6ons Andrew McCallum mccallum@cs.umass.edu Thanks to Noah Smith and Carlos Guestrin for some slide materials. 1 Condi6onal Probability Distribu6ons

More information

NP-Complete Reductions 2

NP-Complete Reductions 2 x 1 x 1 x 2 x 2 x 3 x 3 x 4 x 4 12 22 32 CS 447 11 13 21 23 31 33 Algorithms NP-Complete Reductions 2 Prof. Gregory Provan Department of Computer Science University College Cork 1 Lecture Outline NP-Complete

More information