Maximum entropy & maximum entropy production in biological systems: survival of the likeliest?

Size: px
Start display at page:

Download "Maximum entropy & maximum entropy production in biological systems: survival of the likeliest?"

Transcription

1 Maxmum entropy & maxmum entropy producton n bologcal systems: survval of the lkelest? Roderck Dewar Research School of Bology The Australan Natonal Unversty, Canberra Informaton and Entropy n Bologcal Systems 8 10 Aprl 2015, NIMBIOS

2 Maxmum Entropy (MaxEnt)

3 Maxmum (relatve) entropy: Maxmse H p ln p p q C w.r.t. p subject to qe q e x x p p x 1 X constrants (C) What s the ratonale for MaxEnt? p C nformaton theory (least based ) p C combnatorcs of sample frequences (most lkely )

4 MaxEnt: the combnatoral ratonale N ndependent observatons M possble outcomes for each observaton, = 1.M q = pror probablty of outcome Outcome observed n tmes frequency dstrbuton lm N 1 ln Pr Pr n N 1 n N! M p ln p q M n q 1 n! p n N = relatve entropy of p and q p The MaxEnt dstrbuton C s by far the most lkely long-term frequency dstrbuton of outcomes, among all those dstrbutons consstent wth gven constrants C (transparent connecton to observatons)

5 The predcton challenge n bology: bologcal systems are complex, open, non-equlbrum energy n matter n energy out matter out many nternal degrees of freedom Statstcal mechancs: Some (many?) detals of the underlyng dynamcs are rrelevant for makng predctons at larger scales

6 statstcal mechancs Shannon Boltzmann Gbbs maxmum (relatve) entropy detaled dynamcs x(t) Jaynes most lkely p(xkey dynamcal constrants )

7 Maxmum (relatve) entropy: Maxmse H p ln p p q C w.r.t. p subject to qe q e x x p p x 1 X constrants (C) What do the constrants represent? nformaton theory: C = what we know statstcal mechancs: C = the relevant dynamcs (key resource constrants, steady-state balance )

8 The role of MaxEnt n statstcal mechancs MaxEnt as a statstcal selecton prncple Known constrants C most lkely p(xc) MaxEnt as a tool for dentfyng the relevant dynamcs (C) Guess constrants C most lkely p(xc) observed p(x) fracton of tme system s n state x

9 Combnng mechansm and drft* n ecology Bertram & Dewar (2015) Relevant dynamcs C + MaxEnt most lkely p(xc) mechansm drft* * n the bologcal sense!

10 MaxEnt: a non-neutral, resource-based approach Dewar & Porté (2008), Bertram & Dewar (2013, 2015) mechansm drft Speces per capta resource use r Smax Speces abundances n Smax MaxEnt p(n 1, n 2. n Smax R) ( Bose-Ensten) r 2 n 2 r 1 Area constrant (hard) : Smax 1 n 1 Mean annual resource balance : (mean use = mean supply) n a Smax 1 A n r R unfes dfferent macroecologcal patterns: SAD s energy equvalence dversty-productvty dversty-stablty

11 The statstcal mechancs of savannas 3 1 f r Bertram & Dewar (2013) r tree > r grass > r bare 95% 5% R For gven R what s most lkely p( f tree, f grass )? mean H 2 O supply, R (mm yr -1 )

12 Maxmum Entropy Producton (MEP)

13

14 Paltrdge (1978): 10-zone energy balance model N pole SW LW S pole T Maxmze EP 10 LW 1 SW T 9 X 1 1 T 1 1 T entropy producton (t s not!) subject only to steady-state energy balance

15 Merdonal heat transport (PW) Paltrdge (1978): 1D model obs. MaxEP Herbert & Pallard (2013): 2D model MEP IPSL-CM4 lattude

16 MEP applcatons across physcs & bology Paltrdge (1978) Malkus (2003) Man & Naylor (2008) some ntrgung successes, but what does t mean? Dewar et al (2006) Juretć et al (2003) Dewar (2010) Martyushev et al (2000)

17 Some potentally msleadng statements about Maxmum Entropy Producton MEP s a corollary to the second law (ds unverse /dt 0) whch states that S unverse ncreases as fast as possble MEP means that, over tme, EP approaches a maxmum n the steady-state

18 MEP as a statstcal stablty crteron for non-equlbrum statonary states R D p p ln 0 p R wth equalty ff p p R D s a generc measure of rreversblty / tme-reversal symmetry breakng / dstance from equlbrum d Fluctuaton theorem (follows from defnton of d ): p( d) p( d) d e If p(d) = N(D,σ 2 ): 2 2D CV D 1 D s mnmal when D s maxmal Use MaxEnt to construct p : D depends on the constrants C

19 Chemcal entropy producton (kg m -2 yr -1 ) Tree Physol. 32, (2012) MEP mmcs tradtonal maxmum ftness models ; β = carbon-use effcency Fne-root bomass, R (kg m -2 )

20 Evolutonary optmsaton of Rubsco: Earth s most abundant proten Enzyme state Enzyme knetcs Knetc desgn k = (k 1, k 2 k 10 ) Apply MaxEnt to p(, k) p( k) p( k) CO 2 carboxylaton, v C oxygenaton, v O O 2 p( k) e H ( k) p( k)ln p( k) EP(k) v C v ln v C C H ( k ) v O v ln v O O Maxmse smultaneously w.r.t. k 6 & k 3

21 EP and H Evolutonary optmsaton of Rubsco: Earth s most abundant proten Enzyme knetcs MaxEnt & MEP CO 2 carboxylaton, v C 10 k 3 = 6 mm -1 s -1 H oxygenaton, v O O 2 5 EP k 6 (mm -1 s -1 )

22 k cat,c / K C (mm -1 s -1 ) k cat,o / K O (mm -1 s -1 ) K C (μm) k cat,c (s -1 ) Rubsco adaptaton to dfferent kcatc (s-1) v s S CO 2 /O 2 envronments hgh CO 2 /O low CO 2 /O Specfcty, S C/O kcatc/kc (mm-1 s-1) v s S Specfcty, S C/O MaxEnt & MEP predctons default parameters k 7 1/10 k 4 1/ Dewar et al. (n prep.) Specfcty, S C/O Specfcty, S C/O

23 J net (s -1 ) F 0 F 1 -ATP synthase : Nature s smallest rotary motor Net ATP synthess vs. proton drvng force MaxEnt & MEP Transthylakod pmf, Δμ H+ (ph unts) Dewar, Juretc & Zupanovc (2006)

24 Evoluton of ATP-synthase knetcs MaxEnt & MEP predct optmal angular poston for ATP synthess close to observed (0.6) optmal gearng rato (H + /ATP) 1 / pmf J net maxmally senstve to pmf hgh free-energy converson effcency (69%) wthn the expermental range (50 80%) observed knetc desgn of ATP synthase consstent wth most lkely desgn

25 K C (μm) Optmal trat adaptaton to changng constrants (C 1 C 2 ): survval of the lkelest MaxEnt: C 1 most lkely p(xc 1 ) 100 most lkely p(xc 2 ) C MEP: max stablty? (cf. P-V-T gas laws) Specfcty, S C/O

26 Where next? Theory Bass of MEP Non-statonary behavour Applcatons Ecologcal nteractons: r r j Food webs Plant adaptatons (e.g. leaf stomatal responses)

Thermodynamics and statistical mechanics in materials modelling II

Thermodynamics and statistical mechanics in materials modelling II Course MP3 Lecture 8/11/006 (JAE) Course MP3 Lecture 8/11/006 Thermodynamcs and statstcal mechancs n materals modellng II A bref résumé of the physcal concepts used n materals modellng Dr James Ellott.1

More information

and Statistical Mechanics Material Properties

and Statistical Mechanics Material Properties Statstcal Mechancs and Materal Propertes By Kuno TAKAHASHI Tokyo Insttute of Technology, Tokyo 15-855, JAPA Phone/Fax +81-3-5734-3915 takahak@de.ttech.ac.jp http://www.de.ttech.ac.jp/~kt-lab/ Only for

More information

Energy, Entropy, and Availability Balances Phase Equilibria. Nonideal Thermodynamic Property Models. Selecting an Appropriate Model

Energy, Entropy, and Availability Balances Phase Equilibria. Nonideal Thermodynamic Property Models. Selecting an Appropriate Model Lecture 4. Thermodynamcs [Ch. 2] Energy, Entropy, and Avalablty Balances Phase Equlbra - Fugactes and actvty coeffcents -K-values Nondeal Thermodynamc Property Models - P-v-T equaton-of-state models -

More information

University of Washington Department of Chemistry Chemistry 453 Winter Quarter 2015

University of Washington Department of Chemistry Chemistry 453 Winter Quarter 2015 Lecture 2. 1/07/15-1/09/15 Unversty of Washngton Department of Chemstry Chemstry 453 Wnter Quarter 2015 We are not talkng about truth. We are talkng about somethng that seems lke truth. The truth we want

More information

Looking at the Earth system from a thermodynamic perspective

Looking at the Earth system from a thermodynamic perspective «Feedbacks in the Earth System: the state-of-the-art» GREENCYCLES II Summer School, Peyresq, 15-24 May 2011 Looking at the Earth system from a thermodynamic perspective Roderick Dewar Research School of

More information

Lecture 14: Forces and Stresses

Lecture 14: Forces and Stresses The Nuts and Bolts of Frst-Prncples Smulaton Lecture 14: Forces and Stresses Durham, 6th-13th December 2001 CASTEP Developers Group wth support from the ESF ψ k Network Overvew of Lecture Why bother? Theoretcal

More information

Motion Perception Under Uncertainty. Hongjing Lu Department of Psychology University of Hong Kong

Motion Perception Under Uncertainty. Hongjing Lu Department of Psychology University of Hong Kong Moton Percepton Under Uncertanty Hongjng Lu Department of Psychology Unversty of Hong Kong Outlne Uncertanty n moton stmulus Correspondence problem Qualtatve fttng usng deal observer models Based on sgnal

More information

CIE4801 Transportation and spatial modelling Trip distribution

CIE4801 Transportation and spatial modelling Trip distribution CIE4801 ransportaton and spatal modellng rp dstrbuton Rob van Nes, ransport & Plannng 17/4/13 Delft Unversty of echnology Challenge the future Content What s t about hree methods Wth specal attenton for

More information

CHAPTER 7 ENERGY BALANCES SYSTEM SYSTEM. * What is energy? * Forms of Energy. - Kinetic energy (KE) - Potential energy (PE) PE = mgz

CHAPTER 7 ENERGY BALANCES SYSTEM SYSTEM. * What is energy? * Forms of Energy. - Kinetic energy (KE) - Potential energy (PE) PE = mgz SYSTM CHAPTR 7 NRGY BALANCS 1 7.1-7. SYSTM nergy & 1st Law of Thermodynamcs * What s energy? * Forms of nergy - Knetc energy (K) K 1 mv - Potental energy (P) P mgz - Internal energy (U) * Total nergy,

More information

An Improved Model for the Droplet Size Distribution in Sprays Developed From the Principle of Entropy Generation maximization

An Improved Model for the Droplet Size Distribution in Sprays Developed From the Principle of Entropy Generation maximization ILASS Amercas, 9 th Annual Conference on Lqud Atomzaton and Spray Systems, oronto, Canada, May 6 An Improved Model for the Droplet Sze Dstrbuton n Sprays Developed From the Prncple of Entropy Generaton

More information

Genomics & Computational Biology. Section 10: Metabolic Networks

Genomics & Computational Biology. Section 10: Metabolic Networks Genomcs & Computatonal Bology Secton : Metabolc Networs Lan Zhang and Xaoxa (Nna) Ln Nov. 5 th, 3 Metabolc Networs Why study bologcal networs? Genomcs and proteomcs tell us the parts of the cell, but they

More information

Chapter 7 Channel Capacity and Coding

Chapter 7 Channel Capacity and Coding Wreless Informaton Transmsson System Lab. Chapter 7 Channel Capacty and Codng Insttute of Communcatons Engneerng atonal Sun Yat-sen Unversty Contents 7. Channel models and channel capacty 7.. Channel models

More information

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification E395 - Pattern Recognton Solutons to Introducton to Pattern Recognton, Chapter : Bayesan pattern classfcaton Preface Ths document s a soluton manual for selected exercses from Introducton to Pattern Recognton

More information

Review of Classical Thermodynamics

Review of Classical Thermodynamics Revew of Classcal hermodynamcs Physcs 4362, Lecture #1, 2 Syllabus What s hermodynamcs? 1 [A law] s more mpressve the greater the smplcty of ts premses, the more dfferent are the knds of thngs t relates,

More information

Lecture 4. Macrostates and Microstates (Ch. 2 )

Lecture 4. Macrostates and Microstates (Ch. 2 ) Lecture 4. Macrostates and Mcrostates (Ch. ) The past three lectures: we have learned about thermal energy, how t s stored at the mcroscopc level, and how t can be transferred from one system to another.

More information

Basic concepts and definitions in multienvironment

Basic concepts and definitions in multienvironment Basc concepts and defntons n multenvronment data: G, E, and GxE Marcos Malosett, Danela Bustos-Korts, Fred van Eeuwk, Pter Bma, Han Mulder Contents The basc concepts: ntroducton and defntons Phenotype,

More information

Communication with AWGN Interference

Communication with AWGN Interference Communcaton wth AWG Interference m {m } {p(m } Modulator s {s } r=s+n Recever ˆm AWG n m s a dscrete random varable(rv whch takes m wth probablty p(m. Modulator maps each m nto a waveform sgnal s m=m

More information

Physics 607 Exam 1. ( ) = 1, Γ( z +1) = zγ( z) x n e x2 dx = 1. e x2

Physics 607 Exam 1. ( ) = 1, Γ( z +1) = zγ( z) x n e x2 dx = 1. e x2 Physcs 607 Exam 1 Please be well-organzed, and show all sgnfcant steps clearly n all problems. You are graded on your wor, so please do not just wrte down answers wth no explanaton! Do all your wor on

More information

Fokker-Planck Equation and Thermodynamic System Analysis

Fokker-Planck Equation and Thermodynamic System Analysis Entropy 15, 17, 763-771; do:1.339/e17763 Artcle OPEN ACCESS entropy ISSN 199-43 www.mdp.com/ournal/entropy Fokker-Planck Equaton and Thermodynamc System Analyss Umberto Luca 1,, * and Ganpero Gervno, 1

More information

Lecture 3: Boltzmann distribution

Lecture 3: Boltzmann distribution Lecture 3: Boltzmann dstrbuton Statstcal mechancs: concepts Ams: Dervaton of Boltzmann dstrbuton: Basc postulate of statstcal mechancs. All states equally lkely. Equal a-pror probablty: Statstcal vew of

More information

STATISTICAL MECHANICAL ENSEMBLES 1 MICROSCOPIC AND MACROSCOPIC VARIABLES PHASE SPACE ENSEMBLES. CHE 524 A. Panagiotopoulos 1

STATISTICAL MECHANICAL ENSEMBLES 1 MICROSCOPIC AND MACROSCOPIC VARIABLES PHASE SPACE ENSEMBLES. CHE 524 A. Panagiotopoulos 1 CHE 54 A. Panagotopoulos STATSTCAL MECHACAL ESEMBLES MCROSCOPC AD MACROSCOPC ARABLES The central queston n Statstcal Mechancs can be phrased as follows: f partcles (atoms, molecules, electrons, nucle,

More information

P R. Lecture 4. Theory and Applications of Pattern Recognition. Dept. of Electrical and Computer Engineering /

P R. Lecture 4. Theory and Applications of Pattern Recognition. Dept. of Electrical and Computer Engineering / Theory and Applcatons of Pattern Recognton 003, Rob Polkar, Rowan Unversty, Glassboro, NJ Lecture 4 Bayes Classfcaton Rule Dept. of Electrcal and Computer Engneerng 0909.40.0 / 0909.504.04 Theory & Applcatons

More information

Lecture 7: Boltzmann distribution & Thermodynamics of mixing

Lecture 7: Boltzmann distribution & Thermodynamics of mixing Prof. Tbbtt Lecture 7 etworks & Gels Lecture 7: Boltzmann dstrbuton & Thermodynamcs of mxng 1 Suggested readng Prof. Mark W. Tbbtt ETH Zürch 13 März 018 Molecular Drvng Forces Dll and Bromberg: Chapters

More information

Introduction to Statistical Methods

Introduction to Statistical Methods Introducton to Statstcal Methods Physcs 4362, Lecture #3 hermodynamcs Classcal Statstcal Knetc heory Classcal hermodynamcs Macroscopc approach General propertes of the system Macroscopc varables 1 hermodynamc

More information

Predictive Analytics : QM901.1x Prof U Dinesh Kumar, IIMB. All Rights Reserved, Indian Institute of Management Bangalore

Predictive Analytics : QM901.1x Prof U Dinesh Kumar, IIMB. All Rights Reserved, Indian Institute of Management Bangalore Sesson Outlne Introducton to classfcaton problems and dscrete choce models. Introducton to Logstcs Regresson. Logstc functon and Logt functon. Maxmum Lkelhood Estmator (MLE) for estmaton of LR parameters.

More information

Maximum Likelihood Estimation

Maximum Likelihood Estimation Multple sequence algnment Parwse sequence algnment ( and ) Substtuton matrces Database searchng Maxmum Lelhood Estmaton Observaton: Data, D (HHHTHHTH) What process generated ths data? Alternatve hypothess:

More information

5.60 Thermodynamics & Kinetics Spring 2008

5.60 Thermodynamics & Kinetics Spring 2008 MIT OpenCourseWare http://ocw.mt.edu 5.60 Thermodynamcs & Knetcs Sprng 2008 For nformaton about ctng these materals or our Terms of Use, vst: http://ocw.mt.edu/terms. 5.60 Sprng 2008 Lecture #29 page 1

More information

Lecture 10. Reading: Notes and Brennan Chapter 5

Lecture 10. Reading: Notes and Brennan Chapter 5 Lecture tatstcal Mechancs and Densty of tates Concepts Readng: otes and Brennan Chapter 5 Georga Tech C 645 - Dr. Alan Doolttle C 645 - Dr. Alan Doolttle Georga Tech How do electrons and holes populate

More information

Optimal information storage in noisy synapses under resource constraints

Optimal information storage in noisy synapses under resource constraints Optmal nformaton storage n nosy synapses under resource constrants Lav arshney MIT Jesper Sjöström Brandes, UCL London Dmtr Mtya Chklovsk Cold Sprng Harbor Laboratory Modfcatons of synaptc connectons store

More information

The Gaussian classifier. Nuno Vasconcelos ECE Department, UCSD

The Gaussian classifier. Nuno Vasconcelos ECE Department, UCSD he Gaussan classfer Nuno Vasconcelos ECE Department, UCSD Bayesan decson theory recall that we have state of the world X observatons g decson functon L[g,y] loss of predctng y wth g Bayes decson rule s

More information

Randomness and Computation

Randomness and Computation Randomness and Computaton or, Randomzed Algorthms Mary Cryan School of Informatcs Unversty of Ednburgh RC 208/9) Lecture 0 slde Balls n Bns m balls, n bns, and balls thrown unformly at random nto bns usually

More information

3.1 ML and Empirical Distribution

3.1 ML and Empirical Distribution 67577 Intro. to Machne Learnng Fall semester, 2008/9 Lecture 3: Maxmum Lkelhood/ Maxmum Entropy Dualty Lecturer: Amnon Shashua Scrbe: Amnon Shashua 1 In the prevous lecture we defned the prncple of Maxmum

More information

Statistical Mechanics of a Collisionless System Based on Maximum Entropy Principle

Statistical Mechanics of a Collisionless System Based on Maximum Entropy Principle Statstcal Mechancs of a Collsonless System Based on Maxmum Entropy Prncple Tadas K. Nakamura Fuku Prefectural Unversty, Fuku 910-1195, Japan ABSTRACT The statstcal equlbrum state of a collsonless system

More information

ISSN: ISO 9001:2008 Certified International Journal of Engineering and Innovative Technology (IJEIT) Volume 3, Issue 1, July 2013

ISSN: ISO 9001:2008 Certified International Journal of Engineering and Innovative Technology (IJEIT) Volume 3, Issue 1, July 2013 ISSN: 2277-375 Constructon of Trend Free Run Orders for Orthogonal rrays Usng Codes bstract: Sometmes when the expermental runs are carred out n a tme order sequence, the response can depend on the run

More information

Using Immune Genetic Algorithm to Optimize BP Neural Network and Its Application Peng-fei LIU1,Qun-tai SHEN1 and Jun ZHI2,*

Using Immune Genetic Algorithm to Optimize BP Neural Network and Its Application Peng-fei LIU1,Qun-tai SHEN1 and Jun ZHI2,* Advances n Computer Scence Research (ACRS), volume 54 Internatonal Conference on Computer Networks and Communcaton Technology (CNCT206) Usng Immune Genetc Algorthm to Optmze BP Neural Network and Its Applcaton

More information

Quantum Statistical Mechanics

Quantum Statistical Mechanics Chapter 8 Quantum Statstcal Mechancs 8.1 Mcrostates For a collecton of N partcles the classcal mcrostate of the system s unquely specfed by a vector (q, p) (q 1...q N, p 1...p 3N )(q 1...q 3N,p 1...p 3N

More information

25 Reprogramming of metabolic systems by altering gene expression

25 Reprogramming of metabolic systems by altering gene expression 25 Reprogrammng of metabolc systems by alterng gene expresson E. Klpp 1, H.-G. Holzhütter 2 and R. Henrch 1 1 Insttute of Bology, Theoretcal Bophyscs, Humboldt-Unversty Berln, Invaldenstr. 42, 10115 Berln,

More information

Lecture 15 Statistical Analysis in Biomaterials Research

Lecture 15 Statistical Analysis in Biomaterials Research 3.05/BE.340 Lecture 5 tatstcal Analyss n Bomaterals Research. Ratonale: Why s statstcal analyss needed n bomaterals research? Many error sources n measurements on lvng systems! Eamples of Measured Values

More information

Why BP Works STAT 232B

Why BP Works STAT 232B Why BP Works STAT 232B Free Energes Helmholz & Gbbs Free Energes 1 Dstance between Probablstc Models - K-L dvergence b{ KL b{ p{ = b{ ln { } p{ Here, p{ s the eact ont prob. b{ s the appromaton, called

More information

See Book Chapter 11 2 nd Edition (Chapter 10 1 st Edition)

See Book Chapter 11 2 nd Edition (Chapter 10 1 st Edition) Count Data Models See Book Chapter 11 2 nd Edton (Chapter 10 1 st Edton) Count data consst of non-negatve nteger values Examples: number of drver route changes per week, the number of trp departure changes

More information

10.40 Appendix Connection to Thermodynamics and Derivation of Boltzmann Distribution

10.40 Appendix Connection to Thermodynamics and Derivation of Boltzmann Distribution 10.40 Appendx Connecton to Thermodynamcs Dervaton of Boltzmann Dstrbuton Bernhardt L. Trout Outlne Cannoncal ensemble Maxmumtermmethod Most probable dstrbuton Ensembles contnued: Canoncal, Mcrocanoncal,

More information

Quantum and Classical Information Theory with Disentropy

Quantum and Classical Information Theory with Disentropy Quantum and Classcal Informaton Theory wth Dsentropy R V Ramos rubensramos@ufcbr Lab of Quantum Informaton Technology, Department of Telenformatc Engneerng Federal Unversty of Ceara - DETI/UFC, CP 6007

More information

Entropic Dynamics: an Inference Approach to Time and Quantum Theory

Entropic Dynamics: an Inference Approach to Time and Quantum Theory Entropc Dynamcs: an Inference Approach to Tme and Quantum Theory Arel Catcha Department of hyscs Unversty at Albany - SUNY EmQM-13 Venna, 10/013 Queston: Do the laws of hyscs reflect Laws of Nature? Or...

More information

Problem Points Score Total 100

Problem Points Score Total 100 Physcs 450 Solutons of Sample Exam I Problem Ponts Score 1 8 15 3 17 4 0 5 0 Total 100 All wor must be shown n order to receve full credt. Wor must be legble and comprehensble wth answers clearly ndcated.

More information

Cell Biology. Lecture 1: 10-Oct-12. Marco Grzegorczyk. (Gen-)Regulatory Network. Microarray Chips. (Gen-)Regulatory Network. (Gen-)Regulatory Network

Cell Biology. Lecture 1: 10-Oct-12. Marco Grzegorczyk. (Gen-)Regulatory Network. Microarray Chips. (Gen-)Regulatory Network. (Gen-)Regulatory Network 5.0.202 Genetsche Netzwerke Wntersemester 202/203 ell ology Lecture : 0-Oct-2 Marco Grzegorczyk Gen-Regulatory Network Mcroarray hps G G 2 G 3 2 3 metabolte metabolte Gen-Regulatory Network Gen-Regulatory

More information

EGR 544 Communication Theory

EGR 544 Communication Theory EGR 544 Communcaton Theory. Informaton Sources Z. Alyazcoglu Electrcal and Computer Engneerng Department Cal Poly Pomona Introducton Informaton Source x n Informaton sources Analog sources Dscrete sources

More information

STATISTICAL MECHANICS

STATISTICAL MECHANICS STATISTICAL MECHANICS Thermal Energy Recall that KE can always be separated nto 2 terms: KE system = 1 2 M 2 total v CM KE nternal Rgd-body rotaton and elastc / sound waves Use smplfyng assumptons KE of

More information

Robustness of the Second Law of Thermodynamics under Generalizations of the Maximum Entropy Method

Robustness of the Second Law of Thermodynamics under Generalizations of the Maximum Entropy Method Robustness of the Second Law of Thermodynamcs under Generalzatons of the Maxmum Entropy Method Sumyosh Abe Stefan Thurner SFI WORKING PAPER: 2007-08-023 SFI Workng Papers contan accounts of scentfc work

More information

Chapter 7 Channel Capacity and Coding

Chapter 7 Channel Capacity and Coding Chapter 7 Channel Capacty and Codng Contents 7. Channel models and channel capacty 7.. Channel models Bnary symmetrc channel Dscrete memoryless channels Dscrete-nput, contnuous-output channel Waveform

More information

Physics 5153 Classical Mechanics. Principle of Virtual Work-1

Physics 5153 Classical Mechanics. Principle of Virtual Work-1 P. Guterrez 1 Introducton Physcs 5153 Classcal Mechancs Prncple of Vrtual Work The frst varatonal prncple we encounter n mechancs s the prncple of vrtual work. It establshes the equlbrum condton of a mechancal

More information

Decision-making and rationality

Decision-making and rationality Reslence Informatcs for Innovaton Classcal Decson Theory RRC/TMI Kazuo URUTA Decson-makng and ratonalty What s decson-makng? Methodology for makng a choce The qualty of decson-makng determnes success or

More information

Logistic Regression. CAP 5610: Machine Learning Instructor: Guo-Jun QI

Logistic Regression. CAP 5610: Machine Learning Instructor: Guo-Jun QI Logstc Regresson CAP 561: achne Learnng Instructor: Guo-Jun QI Bayes Classfer: A Generatve model odel the posteror dstrbuton P(Y X) Estmate class-condtonal dstrbuton P(X Y) for each Y Estmate pror dstrbuton

More information

Probability Theory. The nth coefficient of the Taylor series of f(k), expanded around k = 0, gives the nth moment of x as ( ik) n n!

Probability Theory. The nth coefficient of the Taylor series of f(k), expanded around k = 0, gives the nth moment of x as ( ik) n n! 8333: Statstcal Mechancs I Problem Set # 3 Solutons Fall 3 Characterstc Functons: Probablty Theory The characterstc functon s defned by fk ep k = ep kpd The nth coeffcent of the Taylor seres of fk epanded

More information

Chapter 3 and Chapter 4

Chapter 3 and Chapter 4 Chapter 3 and Chapter 4 Chapter 3 Energy 3. Introducton:Work Work W s energy transerred to or rom an object by means o a orce actng on the object. Energy transerred to the object s postve work, and energy

More information

CS47300: Web Information Search and Management

CS47300: Web Information Search and Management CS47300: Web Informaton Search and Management Probablstc Retreval Models Prof. Chrs Clfton 7 September 2018 Materal adapted from course created by Dr. Luo S, now leadng Albaba research group 14 Why probabltes

More information

CHEMICAL REACTIONS AND DIFFUSION

CHEMICAL REACTIONS AND DIFFUSION CHEMICAL REACTIONS AND DIFFUSION A.K.A. NETWORK THERMODYNAMICS BACKGROUND Classcal thermodynamcs descrbes equlbrum states. Non-equlbrum thermodynamcs descrbes steady states. Network thermodynamcs descrbes

More information

arxiv: v1 [physics.comp-ph] 20 Nov 2018

arxiv: v1 [physics.comp-ph] 20 Nov 2018 arxv:8.08530v [physcs.comp-ph] 20 Nov 208 Internatonal Journal of Modern Physcs C c World Scentfc Publshng Company Valdty of the Molecular-Dynamcs-Lattce-Gas Global Equlbrum Dstrbuton Functon M. Reza Parsa

More information

Statistical mechanics handout 4

Statistical mechanics handout 4 Statstcal mechancs handout 4 Explan dfference between phase space and an. Ensembles As dscussed n handout three atoms n any physcal system can adopt any one of a large number of mcorstates. For a quantum

More information

Grand canonical Monte Carlo simulations of bulk electrolytes and calcium channels

Grand canonical Monte Carlo simulations of bulk electrolytes and calcium channels Grand canoncal Monte Carlo smulatons of bulk electrolytes and calcum channels Thess of Ph.D. dssertaton Prepared by: Attla Malascs M.Sc. n Chemstry Supervsor: Dr. Dezső Boda Unversty of Pannona Insttute

More information

Computational Biology Lecture 8: Substitution matrices Saad Mneimneh

Computational Biology Lecture 8: Substitution matrices Saad Mneimneh Computatonal Bology Lecture 8: Substtuton matrces Saad Mnemneh As we have ntroduced last tme, smple scorng schemes lke + or a match, - or a msmatch and -2 or a gap are not justable bologcally, especally

More information

Information-Geometric Studies on Neuronal Spike Trains

Information-Geometric Studies on Neuronal Spike Trains Computatonal Neuroscence ESPRC Workshop --Warwck Informaton-Geometrc Studes on Neuronal Spke Trans Shun-ch Amar Shun-ch Amar RIKEN Bran Scence Insttute Mathematcal Neuroscence Unt Neural Frng x1 x2 x3

More information

Prediction of steady state input multiplicities for the reactive flash separation using reactioninvariant composition variables

Prediction of steady state input multiplicities for the reactive flash separation using reactioninvariant composition variables Insttuto Tecnologco de Aguascalentes From the SelectedWorks of Adran Bonlla-Petrcolet 2 Predcton of steady state nput multplctes for the reactve flash separaton usng reactonnvarant composton varables Jose

More information

...Thermodynamics. If Clausius Clapeyron fails. l T (v 2 v 1 ) = 0/0 Second order phase transition ( S, v = 0)

...Thermodynamics. If Clausius Clapeyron fails. l T (v 2 v 1 ) = 0/0 Second order phase transition ( S, v = 0) If Clausus Clapeyron fals ( ) dp dt pb =...Thermodynamcs l T (v 2 v 1 ) = 0/0 Second order phase transton ( S, v = 0) ( ) dp = c P,1 c P,2 dt Tv(β 1 β 2 ) Two phases ntermngled Ferromagnet (Excess spn-up

More information

and V is a p p positive definite matrix. A normal-inverse-gamma distribution.

and V is a p p positive definite matrix. A normal-inverse-gamma distribution. OSR Journal of athematcs (OSR-J) e-ssn: 78-578, p-ssn: 39-765X. Volume 3, ssue 3 Ver. V (ay - June 07), PP 68-7 www.osrjournals.org Comparng The Performance of Bayesan And Frequentst Analyss ethods of

More information

Temperature. Chapter Heat Engine

Temperature. Chapter Heat Engine Chapter 3 Temperature In prevous chapters of these notes we ntroduced the Prncple of Maxmum ntropy as a technque for estmatng probablty dstrbutons consstent wth constrants. In Chapter 9 we dscussed the

More information

Outline. Unit Eight Calculations with Entropy. The Second Law. Second Law Notes. Uses of Entropy. Entropy is a Property.

Outline. Unit Eight Calculations with Entropy. The Second Law. Second Law Notes. Uses of Entropy. Entropy is a Property. Unt Eght Calculatons wth Entropy Mechancal Engneerng 370 Thermodynamcs Larry Caretto October 6, 010 Outlne Quz Seven Solutons Second law revew Goals for unt eght Usng entropy to calculate the maxmum work

More information

Lawrence Berkeley National Laboratory Lawrence Berkeley National Laboratory

Lawrence Berkeley National Laboratory Lawrence Berkeley National Laboratory Lawrence Berkeley Natonal Laboratory Lawrence Berkeley Natonal Laboratory Ttle Beyond Boltzmann-Gbbs statstcs: Maxmum entropy hyperensembles out-ofequlbrum Permalnk https://escholarshp.org/uc/tem/5ds7g4rp

More information

Open Systems: Chemical Potential and Partial Molar Quantities Chemical Potential

Open Systems: Chemical Potential and Partial Molar Quantities Chemical Potential Open Systems: Chemcal Potental and Partal Molar Quanttes Chemcal Potental For closed systems, we have derved the followng relatonshps: du = TdS pdv dh = TdS + Vdp da = SdT pdv dg = VdP SdT For open systems,

More information

Multiscale Mesoscopic Entropy of Driven Macroscopic Systems

Multiscale Mesoscopic Entropy of Driven Macroscopic Systems Entropy 2013, 15, 5053-5064; do:10.3390/e15115053 Artcle OPEN ACCESS entropy ISSN 1099-4300 www.mdp.com/journal/entropy Multscale Mesoscopc Entropy of Drven Macroscopc Systems Mroslav Grmela 1, *, Guseppe

More information

4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA

4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA 4 Analyss of Varance (ANOVA) 5 ANOVA 51 Introducton ANOVA ANOVA s a way to estmate and test the means of multple populatons We wll start wth one-way ANOVA If the populatons ncluded n the study are selected

More information

Physics 240: Worksheet 30 Name:

Physics 240: Worksheet 30 Name: (1) One mole of an deal monatomc gas doubles ts temperature and doubles ts volume. What s the change n entropy of the gas? () 1 kg of ce at 0 0 C melts to become water at 0 0 C. What s the change n entropy

More information

Copyright (C) 2008 David K. Levine This document is an open textbook; you can redistribute it and/or modify it under the terms of the Creative

Copyright (C) 2008 David K. Levine This document is an open textbook; you can redistribute it and/or modify it under the terms of the Creative Copyrght (C) 008 Davd K. Levne Ths document s an open textbook; you can redstrbute t and/or modfy t under the terms of the Creatve Commons Attrbuton Lcense. Compettve Equlbrum wth Pure Exchange n traders

More information

Comparison of Regression Lines

Comparison of Regression Lines STATGRAPHICS Rev. 9/13/2013 Comparson of Regresson Lnes Summary... 1 Data Input... 3 Analyss Summary... 4 Plot of Ftted Model... 6 Condtonal Sums of Squares... 6 Analyss Optons... 7 Forecasts... 8 Confdence

More information

U-Pb Geochronology Practical: Background

U-Pb Geochronology Practical: Background U-Pb Geochronology Practcal: Background Basc Concepts: accuracy: measure of the dfference between an expermental measurement and the true value precson: measure of the reproducblty of the expermental result

More information

Title: Radiative transitions and spectral broadening

Title: Radiative transitions and spectral broadening Lecture 6 Ttle: Radatve transtons and spectral broadenng Objectves The spectral lnes emtted by atomc vapors at moderate temperature and pressure show the wavelength spread around the central frequency.

More information

Topics on Statistical Mechanics TCMM Lecture Notes

Topics on Statistical Mechanics TCMM Lecture Notes Topcs on Statstcal Mechancs TCMM Lecture otes Fernando Fernandes Department of Chemstry and Bochemstry, Faculty of Scences, Unversty of Lsbon, Portugal Emal: fslva@fc.ul.pt A short revew of basc concepts

More information

Computational issues surrounding the management of an ecological food web

Computational issues surrounding the management of an ecological food web Computatonal ssues surroundng the management of an ecologcal food web Wllam J M Probert, Eve McDonald-Madden, Nathale Peyrard, Régs Sabbadn AIGM 12, ECAI2012 Montpeller, France Ratonale Ecology has many

More information

Performance of Different Algorithms on Clustering Molecular Dynamics Trajectories

Performance of Different Algorithms on Clustering Molecular Dynamics Trajectories Performance of Dfferent Algorthms on Clusterng Molecular Dynamcs Trajectores Chenchen Song Abstract Dfferent types of clusterng algorthms are appled to clusterng molecular dynamcs trajectores to get nsght

More information

Determination of Structure and Formation Conditions of Gas Hydrate by Using TPD Method and Flash Calculations

Determination of Structure and Formation Conditions of Gas Hydrate by Using TPD Method and Flash Calculations nd atonal Iranan Conference on Gas Hydrate (ICGH) Semnan Unersty Determnaton of Structure and Formaton Condtons of Gas Hydrate by Usng TPD Method and Flash Calculatons H. Behat Rad, F. Varamnan* Department

More information

3. Be able to derive the chemical equilibrium constants from statistical mechanics.

3. Be able to derive the chemical equilibrium constants from statistical mechanics. Lecture #17 1 Lecture 17 Objectves: 1. Notaton of chemcal reactons 2. General equlbrum 3. Be able to derve the chemcal equlbrum constants from statstcal mechancs. 4. Identfy how nondeal behavor can be

More information

MAXIMUM A POSTERIORI TRANSDUCTION

MAXIMUM A POSTERIORI TRANSDUCTION MAXIMUM A POSTERIORI TRANSDUCTION LI-WEI WANG, JU-FU FENG School of Mathematcal Scences, Peng Unversty, Bejng, 0087, Chna Center for Informaton Scences, Peng Unversty, Bejng, 0087, Chna E-MIAL: {wanglw,

More information

Statistical Evaluation of WATFLOOD

Statistical Evaluation of WATFLOOD tatstcal Evaluaton of WATFLD By: Angela MacLean, Dept. of Cvl & Envronmental Engneerng, Unversty of Waterloo, n. ctober, 005 The statstcs program assocated wth WATFLD uses spl.csv fle that s produced wth

More information

8/25/17. Data Modeling. Data Modeling. Data Modeling. Patrice Koehl Department of Biological Sciences National University of Singapore

8/25/17. Data Modeling. Data Modeling. Data Modeling. Patrice Koehl Department of Biological Sciences National University of Singapore 8/5/17 Data Modelng Patrce Koehl Department of Bologcal Scences atonal Unversty of Sngapore http://www.cs.ucdavs.edu/~koehl/teachng/bl59 koehl@cs.ucdavs.edu Data Modelng Ø Data Modelng: least squares Ø

More information

EPR Paradox and the Physical Meaning of an Experiment in Quantum Mechanics. Vesselin C. Noninski

EPR Paradox and the Physical Meaning of an Experiment in Quantum Mechanics. Vesselin C. Noninski EPR Paradox and the Physcal Meanng of an Experment n Quantum Mechancs Vesseln C Nonnsk vesselnnonnsk@verzonnet Abstract It s shown that there s one purely determnstc outcome when measurement s made on

More information

Balance Control in Interactive Motion

Balance Control in Interactive Motion Balance Control n Interactve Moton by Yuanfeng Zhu Drected By Professor Mchael Neff & Professor Bernd Hamann What s Interactve Moton? Fghtng Game Acton Game A knd of acton occurs as two or more objects

More information

Lecture 6 More on Complete Randomized Block Design (RBD)

Lecture 6 More on Complete Randomized Block Design (RBD) Lecture 6 More on Complete Randomzed Block Desgn (RBD) Multple test Multple test The multple comparsons or multple testng problem occurs when one consders a set of statstcal nferences smultaneously. For

More information

Chemical Equilibrium. Chapter 6 Spontaneity of Reactive Mixtures (gases) Taking into account there are many types of work that a sysem can perform

Chemical Equilibrium. Chapter 6 Spontaneity of Reactive Mixtures (gases) Taking into account there are many types of work that a sysem can perform Ths chapter deals wth chemcal reactons (system) wth lttle or no consderaton on the surroundngs. Chemcal Equlbrum Chapter 6 Spontanety of eactve Mxtures (gases) eactants generatng products would proceed

More information

Physics 141. Lecture 14. Frank L. H. Wolfs Department of Physics and Astronomy, University of Rochester, Lecture 14, Page 1

Physics 141. Lecture 14. Frank L. H. Wolfs Department of Physics and Astronomy, University of Rochester, Lecture 14, Page 1 Physcs 141. Lecture 14. Frank L. H. Wolfs Department of Physcs and Astronomy, Unversty of Rochester, Lecture 14, Page 1 Physcs 141. Lecture 14. Course Informaton: Lab report # 3. Exam # 2. Mult-Partcle

More information

PHY688, Statistical Mechanics

PHY688, Statistical Mechanics Department of Physcs & Astronomy 449 ESS Bldg. Stony Brook Unversty January 31, 2017 Nuclear Astrophyscs James.Lattmer@Stonybrook.edu Thermodynamcs Internal Energy Densty and Frst Law: ε = E V = Ts P +

More information

Outline. Communication. Bellman Ford Algorithm. Bellman Ford Example. Bellman Ford Shortest Path [1]

Outline. Communication. Bellman Ford Algorithm. Bellman Ford Example. Bellman Ford Shortest Path [1] DYNAMIC SHORTEST PATH SEARCH AND SYNCHRONIZED TASK SWITCHING Jay Wagenpfel, Adran Trachte 2 Outlne Shortest Communcaton Path Searchng Bellmann Ford algorthm Algorthm for dynamc case Modfcatons to our algorthm

More information

The Feynman path integral

The Feynman path integral The Feynman path ntegral Aprl 3, 205 Hesenberg and Schrödnger pctures The Schrödnger wave functon places the tme dependence of a physcal system n the state, ψ, t, where the state s a vector n Hlbert space

More information

Thermodynamics II. Department of Chemical Engineering. Prof. Kim, Jong Hak

Thermodynamics II. Department of Chemical Engineering. Prof. Kim, Jong Hak Thermodynamcs II Department of Chemcal Engneerng Prof. Km, Jong Hak Soluton Thermodynamcs : theory Obectve : lay the theoretcal foundaton for applcatons of thermodynamcs to gas mxture and lqud soluton

More information

Measurement of Radiation: Exposure. Purpose. Quantitative description of radiation

Measurement of Radiation: Exposure. Purpose. Quantitative description of radiation Measurement of Radaton: Exposure George Starkschall, Ph.D. Department of Radaton Physcs U.T. M.D. Anderson Cancer Center Purpose To ntroduce the concept of radaton exposure and to descrbe and evaluate

More information

Winter 2008 CS567 Stochastic Linear/Integer Programming Guest Lecturer: Xu, Huan

Winter 2008 CS567 Stochastic Linear/Integer Programming Guest Lecturer: Xu, Huan Wnter 2008 CS567 Stochastc Lnear/Integer Programmng Guest Lecturer: Xu, Huan Class 2: More Modelng Examples 1 Capacty Expanson Capacty expanson models optmal choces of the tmng and levels of nvestments

More information

Wilbur and Ague 4 WILBUR AND AGUE; APPENDIX DR1. Two-dimensional chemical maps as well as chemical profiles were done at 15 kv using

Wilbur and Ague 4 WILBUR AND AGUE; APPENDIX DR1. Two-dimensional chemical maps as well as chemical profiles were done at 15 kv using DR2006139 Wlbur and Ague 4 WILBUR AND AGUE; APPENDIX DR1 MINERAL ANALYSES Two-dmensonal chemcal maps as well as chemcal profles were done at 15 kv usng the JEOL JXA-8600 electron mcroprobe at Yale Unversty

More information

Entropy generation in a chemical reaction

Entropy generation in a chemical reaction Entropy generaton n a chemcal reacton E Mranda Área de Cencas Exactas COICET CCT Mendoza 5500 Mendoza, rgentna and Departamento de Físca Unversdad aconal de San Lus 5700 San Lus, rgentna bstract: Entropy

More information

Thermodynamics General

Thermodynamics General Thermodynamcs General Lecture 1 Lecture 1 s devoted to establshng buldng blocks for dscussng thermodynamcs. In addton, the equaton of state wll be establshed. I. Buldng blocks for thermodynamcs A. Dmensons,

More information

Text S1: Detailed proofs for The time scale of evolutionary innovation

Text S1: Detailed proofs for The time scale of evolutionary innovation Text S: Detaled proofs for The tme scale of evolutonary nnovaton Krshnendu Chatterjee Andreas Pavloganns Ben Adlam Martn A. Nowak. Overvew and Organzaton We wll present detaled proofs of all our results.

More information

Externalities in wireless communication: A public goods solution approach to power allocation. by Shrutivandana Sharma

Externalities in wireless communication: A public goods solution approach to power allocation. by Shrutivandana Sharma Externaltes n wreless communcaton: A publc goods soluton approach to power allocaton by Shrutvandana Sharma SI 786 Tuesday, Feb 2, 2006 Outlne Externaltes: Introducton Plannng wth externaltes Power allocaton:

More information

VQ widely used in coding speech, image, and video

VQ widely used in coding speech, image, and video at Scalar quantzers are specal cases of vector quantzers (VQ): they are constraned to look at one sample at a tme (memoryless) VQ does not have such constrant better RD perfomance expected Source codng

More information