Stochastic Processes at Single-molecule and Single-cell levels Hao Ge haoge@pu.edu.cn Beijing International Center for Mathematical Research 2 Biodynamic Optical Imaging Center Peing University, China http://bicmr.pu.edu.cn/personal/gehao/
BICMR: Beijing International Center for Mathematical Research
BIOPIC: Biodynamic Optical Imaging Center
Which ind of physical/chemical processes can be described by stochastic processes? Mesoscopic scale (time and space) Single-molecule and single-cell (subcellular) dynamics Marovian v.s. Non-Marovian
Example: Perrin s experiment (2D Brownian motion) Single particle trajectories Multiple particle (final positions) r What s the probability distribution function here? <r 2 >= 4Dt J. Perrin (870-942) Nobel Prize in 926 Ann. Chim. Phys. VIII 8, 5-4 (909) Annalen der Physi 7, 549 560 (905) A.Einstein (879-955) Nobel Prize in 92
Example2: Single-molecule experiments Single Ion channel Single-molecule enzyme inetics E. Neher and B. Saman Nobel Prize in 99 Lu, et al. Science (998)
Example3: Single-cell dynamics (in vivo) Eldar, A. and Elowitz, M. Nature (200) Choi, et al. Science (2008)
The simplest three-state example: single-molecule enzyme inetics
Reversible Michaelis-Menten enzyme inetics Two reversible Michaelis-Menten reactions Ge, H.: J. Phys. Chem. B (2008) Ge, H., Qian, M. and Qian, H.: Phys. Rep. (202) Kinetic scheme of a simple reversible enzyme. From the perspective of a single enzyme molecule, the reaction is unimolecular and cyclic.
From concentration to probability Pseudo-first order reaction constants 0 0 = [ ] [ ] S = 3 3 P The evolution of probability distribution Reactant E 3 0-3 [P] S P EP - 0 [S] -2 Product 2 ES [S] and [P] held constant
Gillespie algorithm (Exact simulation) Generate two random numbers for each step: r and r 2. Purely Analytical
Simulated turnover traces of a single molecule S P ν (t) Min, et al. Nano Lett, (2005) Ge, H.: J. Phys. Chem. B (2008) ν + ( t) : S P ν ( t) : P S the number of occurrences of forward and bacward cycles up to time t
Steady-state cycle fluxes and nonequilibrium steady state J ss = ν ( t) lim t t = [ S] VS V KmS [ S] + + K ms [ P] KmP [ P] K P mp = J ss + J ss. Ge, H.: JPCB (2008) Ge, H., Qian, M. and Qian,H.: Phys. Rep. (202) Michaelis-Menten inetics J ss + ν + ( t) lim = t t + [ S] VS KmS [ S] [ P] + K K ss = ms mp ; J ν ( t) = lim = t t + [ P] VP KmP [ S] [ P] + K K 0 ss 23[ S] J + Chemical potential difference: µ = BT ln = ln( ) 0 BT ss [ P] J 2 3 ms J mp ss. = 0 µ = 0
Waiting cycle times S 2 3 2 3-3 -2-0 2 3 E ES EP E ES EP E P - -2-3 - -2-3 The inetic scheme for computing the waiting cycle times, which also serves for molecular motors. T = J ss + + J ss ; T + = J ss + ; T = J ss.
Generalized Haldane equality P E ( T = t T+ < T ) = PE ( T = t T < T+ ). Superposed distributions! Average time course of forward and bacward steps Carter, N. J.; Cross, R. A. Nature (2005) Waiting cycle time T is independent of whether the enzyme completes a forward cycle or a bacward cycle, although the probability weight of these two cycles might be rather different. Ge, H.: J. Phys. Chem. B (2008); J. Phys. A (202) Jia, et al. (205); Ge, et al. (205)
Nonequilibrium steady state Ge, H., et al. Phys. Rep. (202) 3 2 3 2 B P S T log = = µ µ µ ) ( ) ( + + + < = = < = T T t T P T T t T P E E Ge, H. J. Phys. Chem. B (2008); J. Phys. A (202) Generalized Haldane Equality Fluctuation theorem of fluctuating chemical wor T n E E B e n t W P n t W P µ µ µ = = = ) ) ( ( ) ) ( ( ) ( = T t W B e Second law in terms of equality Free energy conservation 0 T log epr 3 2 3 2 B = Entropy production: Free energy dissipation Free energy input µ S µ P µ = 0. m Equilibriu = µ Traditional Second law ( ) ( ) µ ν = t t W
Two-state model of central dogma without feedbac Help to uncover the mechanism of transcriptional burst
Central Dogma Copy numbers in a single cell Bacteria Euaryotic cells DNA or 2 ~2 mrna A few - 0 3 Protein - 0 4-0 6
Transcriptional burst under induced condition Golding et al. Cell (2005)
Regulation of gene expression All are not the mechanism of transcriptional burst under induced condition
DNA topology and transcriptional burst Anchored DNA segment High-throughput in-vitro experiments Levens and Larson: Cell (204) (preview) Shasha et al. Cell (204)
Supercoiling accumulation and gyrase activity β Gene OFF Gene ON mrna ø α γ Shasha et al. Cell (204)
Gene states Two-state model without feedbac Gene ON Gene OFF β Gene OFF Gene ON mrna ø α Chemical master equation The mean-field deterministic model has only one stable fixed point! 0 n 0 n n+ γ 2γ ( n +)γ β α β α β α β α γ 2γ Copy number of mrna ( n +)γ γ n+
Poisson distribution with a spie at zero When α,β<<,γ, then.,! ) ( ) ( ) ( ; (0) (0) (0) 2 2 + = + = + + + = + = n n e n p n p n p e p p p n γ β α β β α α β α β γ γ Poisson distribution with a spie (bimodal) Duty cycle ratio
Transcriptional burst under induced condition Shasha et al. Cell (204)
Two-state model of central dogma with positive feedbac A rate formula for stochastic phenotype transition in an intermediate region of gene-state switching
Central Dogma Copy numbers in a single cell Bacteria Euaryotic cells DNA or 2 ~2 mrna A few - 0 3 Protein - 0 4-0 6 Not enough attention has been paid to this fact.
Regulation of gene expression An example of gene circuit with positive feedbac: Lac operon
Bimodal distributions in biology: multiple phenotypic states Ferrell, J. and Machleder, E. Science (998) Choi, et al., Science (2008) To, T. and Maheshri, N. Science (200)
Two-state model with positive feedbac n = max large γ
Mean-field deterministic model with positive feedbac g( x) x γ dx dt = g( x) γx x = n n max Sigmoidal influx flux Stable Off-state Unstable threshold Stable On-state 0.9 Bifurcation diagram g * * ( x ) = γx x * 0.8 0.7 0.6 0.5 ON state Influx g(x) Outflux γx 0.4 0.3 0.2 OFF state Flux-balance plot x 0. 0 0 5 0 5 20 25 30 /K eq
Interconversion of different phenotypic states How to quantify the transition rates between different phenotypic states, provided their existence? Choi, et al., Science (2008) Gupta, et al., Cell (20)
Recall Langevin dynamics and Kramers rate formula Chemical reaction activated by diffusional fluctuations + ǂ ω ω γ 2π Uǂ a BT ( η is large) = e γ = η m P. Langevin (872-946) 2 d x dt m 2 f f f ( x) du dx = η + dx dt ( t) = 0; 2( t) = 2η BT ; ( t) f ( s) = 0,s t. f ( t) U U 2 ( x) mω ( x x ) ǂ2 2 ( x) mω ( x xǂ),x around x. ǂ S ǂ = 2 2 B a ln ω ǂ κ = γ a 2 ωah 2π T B,x around x A ; H.A. Kramers (894-952)
From single chemical reaction to biochemical networs (biology) Single chemical reaction Physical state of atoms Conformational state The state of system Emergent state at a higher level Molecular copy number Phenotypic state Single cell: biochemical networ Chemical master equation (CME) dp dt M M ( X, t) = r ( X ν ) P( X ν, t) r ( X ) P( X, t) j= j j j j= j Max Delbruc(906-98) Nobel Prize in 969
Three time scales and three different scenarios ( i) : cell cycle ( γ ) ( ii) : gene - state switching ( f, hn( n ) ( iii) : synthesis rate of protein ( ) ) When stochastic gene-state switching is extremely rapid Ao, et al. (2004); ( i ) ( iii ) ( ii ) Huang, et al. (200) When stochastic gene-state switching is extremely slow Qian, et al. (2009); ( ii ) ( i ) ( iii ) Wolynes, et al. (2005) When stochastic gene-state switching is relatively slow Wolynes, et al. (2005); ( i ) ( ii ) ( iii ) Ge, et al. (205) When the time scales of (ii) and (iii) are comparable Assaf, et al. (20); ( i ) ( ii )( iii ) Li, et al. (204)
Ubiquitous bursty dynamics and relatively slow gene-state switching Eldar, A. and Elowitz, M. Nature (200) Cai, et al. Science (2006) Golding et al. Cell (2005) Suter, et al. Science (20)
Start from the full Chemical Master Equation description n = max γ large The analytical results introduced here can be applied to any self-regulating module of a single gene, while the methodology is valid for a much more general context.
(A) x * 0.9 0.8 0.7 0.6 0.5 0.4 0.3 0.2 0. A single-molecule fluctuatingrate model is derived, f, h >> γ Continuous Mean-field limit Bifurcation diagram OFF state dx dt = g( x) Rescaled dynamics ON state γx 0 0 5 0 5 20 25 30 (B) dx dt 2 hx >> f, h, γ Fluctuating-rate model dx dt = = n max n 2 max γx f x = γx n n max /K eq Ge, H., Qian, H. and Xie, X.S., PRL (205)
Nonequilibrium landscape function emerges dx dt = g( x) γx Dynamics in the mean field limit model Landscape function Φ ( x) ( x) e ss 0 p0 ~ Φ 0 6 4 2 0-2 Stable (OFF) 0.73 Unstable Stable (ON) d Φ 0 dx ( x) = n max 2 f hx + 2 γx γx n max 0.725 analog to energy function at equilibrium case -4-6 -8-0 0.72 0.75 0.7 0.705 0.7 0.695 0.69 0.0 0.005 0.0 0.05 0.02 x -2 0 0. 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 x Ge, H., Qian, H. and Xie, X.S., PRL (205)
Rate formulae Gene-state switching is relatively slow Gene-state switching is extremely slow Barrier crossing n max e 0 Φ ǂ 0 n max n max n max n max Ge, H., Qian, H. and Xie, X.S., PRL (205) linearly depend on gene-state switching rates Wolynes, et al. PNAS (2005)
A recent example: HIV therapy (activator + noise enhancer) 0 Φ e 0 Φ = Φ~ 0 off 0 on off Activator: increasing on, lower the barrier Noise enhancer: Decreasing both on and off, further lower the barrier Weinberger group, Science (204) Significantly increasing the transition rate
Compared to previous rate formulae for bursty dynamics Eldar, A. and Elowitz, M. Nature (200) Cai, et al. Science (2006) Burst size b f γx Max γ off f If ( x) dφ 0, x dx b x ǂ 0 e xǂ x b off Walcza,et al.,pnas (2005);Choi, et al.,jmb (200);Ge,H.,Qian,H.and Xie, X.S.,PRL (205)
If assuming the extremely rapid gene-state switching Reduced CME d Φ dx ( x) g( x) = n max ln γx ( ) Φ ( x) x e ss p Ge, H., Qian, H. and Xie, X.S., PRL (205)
Barrier-crossing rate formula e Φ ǂ A is more stable B is more stable Possible reverse of relative stability Ge, H., Qian, H. and Xie, X.S., PRL (205)
Even local fluctuations can be different ~ Φ 0 6 4 p i '' * * Φ ( x ) Φ ( x) e e i ( x )( x x ) i / 2 = ~ Φ 4 3.5 2, i,2 2 3 0-2 -4-6 -8-0 -0.5055 0.73-0.506 0.725-0.5065 0.72-0.507 0.75-0.5075 0.5 0.7-0.508 0.705 0-0.5085 0.7-0.509 0.695-0.5095-0.5 0.69 0.0 0.005 0.0 0.05 0.02-0.5 x 0.0 0.005 0.0 0.05 0.02-2 0 0. 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 x 2.5 2.5 x - 0 0. 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 x Ge, H., Qian, H. and Xie, X.S., PRL (205)
Kramers formula for the diffusion approximation of CME K v 0 v v 2 E E* 0E* E* 2E* 3E* (N-)E* NE* The mean-field dynamics goes downhill along both functions, but the predicted relative P w 0 w w stability of phenotypic states can 2 be opposite! dx * = v( x) w( x) x = [E ] dt Φ CME Landscape functions associated with rate formulae w( x) w dx Φ = 2 v( x) w + = ln DA ( x) v( x) ( x) v( x) dx Walcza, et al., PNAS (2005); Ao, P., Genet Genomics (2009); Wang, et al. Biophys. J. (200); Zhou, et al., JRSI (202); Vellela, M. and Qian, H., JRSI (2009); Ge, H. and Qian, H., JRSI (20)
Landscape perspective for cellular dynamics Uninduced E. coli Induced Pluripotent State Waddington, The Strategy of Genes, 957 Fibroblasts Blood Pancreas Liver Differentiated State
Any essential difference between these two levels? Physics e β Chemistry(single reaction) Given a priori E b Equilibrium A B Φ e ǂ Emergent from dynamics Phenotype 2 Nonequilibrium Phenotype Chemistry (reaction system) Biology
Multistability and different time scales Conformation(Phenotype) 3 3-3 -2 2 - Conformation(Phenotype) Conformation(Phenotype) 2
local landscapes and Kramers rate formula V ij i ij ji j V ji ij Constructed locally = T ij ji = T ji Phenotypic subspace ij ji 0 ij 0 ji e e ω V ij ω V ji, ω >>, ω >> Driving force: µ ω ij = log ω ij ji V ji V ij log ω p p ss j ss i µ µ 2 + µ 23 + 3 > 0
Multistability: local-global conflictions Ge, H. and Qian, H.: Chaos (202) 3-2 The emergent Marovian jumping process being nonequilibrium is equivalent to the discontinuity of the local landscapes (time symmetry breaing). Global landscape: from stationary distribution Just cut and glue on the local landscapes (having non-derivative points).
Summary Due to the advance of single-molecule techniques, stochastic modeling and computation will become more and more useful and popular. Three-state model of single-molecule inetics at nonequilibrium steady state exhibits rich cyclic dynamics and an unexpected equality emerges, followed by fluctuation theorems. Two-state model of central dogma at single-cell level helps to uncover the mechanism of transcriptional burst, and propose a rate formula between phenotypic states at an intermediate region.
Acnowledgement Prof. Min Qian Peing University Prof. Hong Qian University of Washington Prof. Sunney Xiaoliang Xie Harvard University Peing University Fundings: NSFC, MOE of PRC
Thans for your attention!