arxiv: v6 [cond-mat.stat-mech] 7 May 2018

Transcription

1 Stochastic thermoynamic interpretation of information geometry Sosuke Ito RIES, Hokkaio University, N20 W10, Kita-ku, Sapporo, Hokkaio , Japan Date: May 8, 2018 arxiv: v6 [con-mat.stat-mech] 7 May 2018 In recent years, the unifie theory of information an thermoynamics has been intensively iscusse in the context of stochastic thermoynamics. The unifie theory reveals that information theory woul be useful to unerstan non-stationary ynamics of systems far from equilibrium. In this letter, we have foun a new link between stochastic thermoynamics an information theory well known as information geometry. By applying this link, an information geometric inequality can be interprete as a thermoynamic uncertainty relationship between spee an thermoynamic cost. We have numerically applie an information geometric inequality to a thermoynamic moel of biochemical enzyme reaction. PACS numbers: k, y, a, Ln, a The crucial relationship between thermoynamics an information theory has been well stuie in last ecaes [1]. Historically, thermoynamic-informational links ha been iscusse in the context of the secon law of thermoynamics an the paraox of Maxwell s emon [2]. Recently, several stuies have newly reveale thermoynamic interpretations of informational quantities such as the Kullback-Leibler ivergence [3], mutual information [4 6], the transfer entropy an information flow [7 19]. The above interpretations of informational quantities are base on the theory of stochastic thermoynamics [20, 21], which mainly focus on the entropy prouction in stochastic ynamics of small systems far from equilibrium. Information thermoynamic relationship has been attracte not only in terms of Maxwell s emon, but also in terms of geometry [22 28]. Inee, ifferential geometric interpretations of thermoynamics have been iscusse especially in a near-equilibrium system [22, 29 34]. Moreover, the technique of ifferential geometry in information theory, well known as information geometry [35], has receive remarkable attention in the fiel of neuroscience, signal processing, quantum mechanics, an machine learning [36 38]. In spite of the eep link between information an thermoynamics, the irect connection between thermoynamics an information geometry has been elusive especially for non-stationary an non-equilibrium ynamics. For example, G. E. Crooks iscovere a link between thermoynamics an information geometry [22, 32] base on the Gibbs ensemble, an then his iscussion is only vali for a near-equilibrium system. In this letter, we iscover a funamental link between information geometry an thermoynamics base on stochastic thermoynamics for the master equation. We mainly report two inequalities erive thanks to information geometry, an interpret them within the theory of stochastic thermoynamics. The first inequality connects the environmental entropy change rate to the mean change of the local thermoynamic force rate. The secon inequality can be interprete as a kin of thermoynamic uncertainty relationships or thermoynamic trae-off relationships [39 51] between spee of a transition from one state to another an thermoynamic cost relate to the entropy change of thermal s in a nearequilibrium system. We numerically illustrate these two inequalities on a moel of biochemical enzyme reaction. Stochastic thermoynamics. To clarify a link between stochastic thermoynamics an information geometry, we here start with the formalism of stochastic thermoynamics for the master equation [20, 21], that is also known as the Schnakenberg network theory [52, 53]. We here consier a n + 1-states system. We assume that transitions between states are inuce by n - multiple thermal s. The master equation for the probability 0, n 1 to fin the state at x {0,1,...,n} is given by n p x ν1 x 0, 1 where is the transition rate from x to x inuce by ν-th thermal. We assume a non-zero value of the transition rate > 0 for any x x. We also assume the conition 0, 2 or equivalently x x < 0, which leas to the conservation of probability n / 0. This equation 2 inicates that the master equation is then given by the thermoynamic flux from the state x to x [52], J ν : Wν Wν, 3 n p x ν1 x 0 J ν. 4

2 2 If ynamics are reversible i.e., J ν 0 for any x, x an ν, the system is sai to be in thermoynamic equilibrium. If we consier the conjugate thermoynamic force F ν : ln[wν ]ln[wν ], 5 thermoynamic equilibrium is equivalently given by F ν 0 for any x, x an ν. In stochastic thermoynamics [21], we treat the entropychangeofthermalanhesysteminastochastic way. In the transition from x to x, the stochastic entropy change of ν-th thermal is efine as σ ν : ln Wν, 6 an the stochastic entropy change of the system is efine as the stochastic Shannon entropy change σ sys : ln ln, 7 respectively. The thermoynamic force is then given by the sum of entropy changes in the transition from x to x inuce by ν-th thermal F ν σ sys σν +. This fact implies that the system is in equilibrium if the sum of entropy changes is zero for any transitions. The total entropy prouction rate Σ tot is given by the sum of the proucts of thermoynamic forces an fluxes over possible transitions. To simplify notations, we introuce the set of irecte eges E {x x,ν 0 x < x n,1 ν n } which enotes the set of all possible transitions between two states. The total entropy prouction rate is then given by Σ tot :,ν E J ν Fν F, 8 where a parenthesis is efine as A :,ν E Jν Aν foranyfunctionofegeaν. Because signs of the thermoynamic force F ν an the flux J ν are same, the total entropy prouction rate is non-negative F σ + σ sys 0, 9 that is well known as the secon law of thermoynamics. Information geometry. Next, we introuce information theory well known as information geometry [35]. In this letter, we only consier the iscrete istribution group p p 0,p 1,...,p n, 0, an n 1. This iscrete istribution group gives the n-imensional manifol S n, because the iscrete istribution is given by n+1 parameters p 0,p 1,...,p n uner the constraint n 1. To introuce a geometry on the manifol S n, we conventionally consier the Kullback-Leibler FIG. 1: color online. Schematic of information geometry on the manifol S 2. The manifol S 2 leas to the sphere surface of raius 2 see also SI. The statistical length L is boune by the shortest length D 2θ 2cos 1 r ini r fin. ivergence [55] between two istributions p an p p 0,p 1,...,p n efine as D KL p p : ln p. 10 x Thesquareofthelineelement sisefineastheseconorer Taylor series of the Kullback-Leibler ivergence s 2 : 2 2D KL p p+p, 11 where p p 0,p 1,...,p n is the infinitesimal isplacement that satisfies n 0. This square of the line element is irectly relate to the Fisher information metric [54] see also Supplementary Information SI. The manifol S n leas to the geometry of the n-sphere surface of raius 2 see also Fig. 1, because the square of the line element is also given by s 2 n 2r x 2 uner the constraint r r x 2 1 where r is the unit vector efine as r r 0,r 1,...,r n : p 0, p 1,..., p n an enotes the inner prouct. The statistical length L [56, 57] s L : s, 12 from the initial state r ini to the final state r fin is then boune by L 2cos 1 r ini r fin : Dr ini ;r fin, 13 because Dr ini ;r fin 2θ is the shortest length between r ini an r fin on the n-sphere surface of raius 2, where θ is the angle between r ini an r fin given by the inner prouct r ini r fin cosθ. Stochastic thermoynamics of information geometry. We here iscuss a relationship between the line element

3 3 an conventional observables of stochastic thermoynamics, which gives a stochastic thermoynamic interpretation of information geometric quantities. By using the master equation 1 an efinitions of the line element an thermoynamic quantities Eqs. 5, 6 an 11, we obtain stochastic thermoynamic expressions of s 2 / 2 see also SI, s 2 n 2 σ 1 n ν1 x 0 F efν Equation15 implies that geometric ynamics are riven by the thermoynamic factor exp[f ν ], that is well iscusse in the context of stochastic thermoynamics especially in the context of the fluctuation theorem [58 63]. The time evolution of the line element s 2 / 2 is irectly relate to the expecte value of the time erivative of the rate-weighte thermoynamic factor efν. Another expression Eq. 16 gives a stochastic thermoynamic interpretation of information geometry, especially in case of a near-equilibrium system. The conition of an equilibrium system is given by F ν 0 for any x, x an ν. Then, the square of the line element is given by the entropy change in thermal s s 2 σ in a near-equilibrium system. For example, in a near-equilibrium system, the probability istribution is assume to be the canonical istribution expβφ H x, where φ : β 1 ln[ n expβh x] is thehelmholtz freeenergy, β istheinversetemperatureanh x isthehamiltonianof the system in the state x. To consier a near-equilibrium transition, we assumethat β anh x canepen on time. From s 2 [ σ F] σ sys, we obtain s 2 σ sys β H in a near equilibrium system, where H : H x H x is the Hamiltonian change from the state x to x. Because β H can be consiere as the entropy change of thermal σ, an expression s 2 β H for the canonical istribution is consistent with a near equilibrium expression s 2 σ. We also iscuss the secon orer expansion of s 2 / 2 for the thermoynamic force in SI, base on the linear irreversible thermoynamics [52]. Our iscussion implies that the square of the line element or the Fisher information metric for the thermoynamic forces is relate to the Onsager coefficients. Due to the Cramér- Rao boun [54, 55], the Onsager coefficients are irectly connecte to a lower boun of the variance of unbiase estimator for parameters riven by the thermoynamic force. Due to the non-negativity of the square of line element s 2 / 2 0, we have a thermoynamic inequality σ F. 17 The equality hols if the system is in a stationary state, i.e., / 0 for any x. This result 17 implies that the change of the thermoynamic force rate is transferre to the environmental entropy change rate. The ifference σ / F/ 0 can be interprete as loss in the entropy change rate transfer ue to the nonstationarity. If the environmental entropy change oes not change in time i.e., σ ν / 0 for any x an x, the thermoynamic force change tens to ecrease i.e., F/ 0 in a transition. We stress that a mathematical property of the thermoynamic force in this result is ifferent from the secon law of thermoynamics F 0. From Eq. 16, the statistical length L τ 0 s/ from time t 0 to t τ is given by L tτ t0 σ F. 18 We then obtain the following thermoynamic inequality from Eqs. 13 an 18, tτ σ F Dr0;rτ. 19 t0 The equality hols if the path of transient ynamics is a geoesic line on the manifol S n. This inequality gives a geometric constraint of the entropy change rate transfer in a transition between two probability istributions p0 an pτ. Thermoynamic uncertainty. We finally reach to a thermoynamic uncertainty relationship between spee an thermoynamic cost. We here consier the action C : 1/2 tτ t0 s2 / 2 from time t 0 to t τ. From Eq. 16, the action C is given by C 1 tτ [ σ 2 t0 F ]. 20 Especillay in case of a near-equilibrium system, the action C is given by C σ /2. If we assume the canonical istribution, we have C β H/2. Even for a system far from equilibrium, we can consier the action as a total amount of loss in the entropychange rate transfer. Therefore, the action can be interprete as thermoynamic cost. Due to the Cauchy-Schwarz inequality τ 0 τ 0 s/2 τ 0 s/2 [22], we obtain a thermoynamic uncertainty relationship between spee τ an thermoynamic cost C τ L2 2C. 21

4 4 FIG. 2: color online. Numerical calculation of thermoynamic quantities in the three states moel of enzyme reaction. We numerically shows the non-negativity of s 2 / 2 0 an s 2 / 2 F/ + σ / in the graph. We also show the total entropy change rate F 0. We note that F/ is not equal to F/. The equality hols if spee of ynamics s 2 / 2 oes not epen on time. By using the inequality 13, we also have a weaker boun τ [Dr0;rτ] C In a transition from r0 to rτ r0, thermoynamic cost C shoul be large if the transition time τ is small. In case of a near-equilibrium system, we have 2C σ or 2C β H, an then the inequality is similar to the quantum spee limit that is iscusse in quantum mechanics [37]. We stress that this result is base on stochastic thermoynamics, not on quantum mechanics. The inequality 22 gives the ratio between timeaverage thermoynamic cost 2C/τ an square of the velocity on manifol [Dr0;rτ]/τ 2. Then, this ratio η : [Dr0;rτ] τC quantifies an efficiency for power to spee conversion. Due to the inequality 22 an its non-negativity, the efficiency η satisfies 0 η 1, where η 1 η 0 implies high low efficiency. Three states moel of enzyme reaction. We numerically illustrate thermoynamic inequalities of information geometry by using a thermoynamic moel of biochemical reaction. We here consier a three states moel see also SI that represents a chemical reaction A+B FIG. 3: color online. Numerical calculation of the thermoynamic uncertainty relationship in the three states moel of enzyme reaction. We numerically shows the geometric inequality L Dr0; rτ, the thermoynamic uncertainty relationship τ L 2 /2C [Dr0;rτ] 2 /2C, an the efficiency η in the graph. AB with enzyme X, A+X AX, 24 A+B AB, 25 AX +B AB +X. 26 We here consier the probability istribution of states x A,AX,AB. We assume that the system is attache to a single heat n 1 with inverse temperature β. The master equation is given by Eq. 1, where the transition rates are suppose to be W 1 A AX k AX+[X], W 1 AX A k AX+e β µax, W 1 A AB k AB+[B], W 1 AB A k AB+e β µab, W 1 AX AB k +[B], W 1 AB AX k +e β µ [X], 27 [X] [B] is the concentration of X B, k AX+, k AB+, an k + are reaction rate constants, an µ AX, µ AB, an µ are the chemical potential ifferences. In this moel, the entropy change of σ ν is given by this chemical potential ifference see also SI [64]. In a numerical simulation, we set k AX+ k AB+ k + 1, β µ AX 1, β µ AB 0.5, an β µ 2. We assume that the time evolution of the concentrations is given by [X] tan 1 ω X t, [B] tan 1 ω B t with ω X 1 an ω B 2, which means that the concentrations [X] an [B] perform as control parameters. At time t 0, we set the initial probability istribution as p A,p AX,p AB ,0.0001,

5 5 In Fig. 2, we numerically show the inequality σ / F/. We check that this inequality oes not coincie with the secon law of thermoynamics F 0. We also check the thermoynamic uncertainty relationship τ L 2 /2C in Fig. 3. Because the path from the initial istribution p A,p AX,p AB , , to the final istribution is close to the geoesic line, the thermoynamic uncertainty relationship gives a tight boun of the transition time τ. Conclusion. In this letter, we reveal a link betweenstochasticthermoynamicquantitiesj, F, σ sys, σ aninformationgeometricquantitiess 2, L, D, C. Because the theory of information geometry is applicable to various fiels of science such as neuroscience, signal processing, machine learning an quantum mechanics, this link woul help us to unerstan a thermoynamic aspect of such a topic. The trae-off relationship between spee an thermoynamic cost Eq. 22 woul be helpful to unerstan biochemical reactions an gives a new insight into recent stuies of the relationship between information an thermoynamics in biochemical processes [7, 42, 65 69]. ACKNOWLEDGEMENT I am grateful to Shumpei Yamamoto for iscussions of stochastic thermoynamics for the master equation, to Naoto Shiraishi, Keiji Saito, Hal Tasaki, an Shin- Ichi Sasa for iscussions of thermoynamic uncertainty relationships, to Schuyler B. Nicholson for iscussion of information geometry an thermoynamics, an to Pieter rein ten Wole for iscussions of thermoynamics in a chemical reaction. We also thank Tamiki Komatsuzaki to acknowlege my major contribution of this work an allow me to submit this manuscript alone. I mentione that, after my submission of the first version of this manuscript on arxiv [70], I hear that SchuylerB. Nicholson inepenently iscovere a similar result such as Eq. 16 [71]. I thank Sebastian Gol, Matteo Polettini, Taro Toyoizumi, an Hiroyasu Tajima for valuable comments on the manuscript. This research is supporte by JSPS KAKENHI Grant No. JP16K [1] Parrono, J. M., Horowitz, J. M., & Sagawa, T. Thermoynamics of information. Nature physics, 112, [2] Leff, H. S., & Rex, A. F. Es.. Maxwell s emon: entropy, information, computing Princeton University Press [3] Kawai, R., J. M. R. Parrono, & Christian Van en Broeck. Dissipation: The phase-space perspective. Physical Review Letters, 988, [4] Sagawa, T., & Uea, M. Generalize Jarzynski equality uner nonequilibrium feeback control. Physical Review Letters, 1049, [5] Still, S., Sivak, D.A., Bell, A.J., &Crooks, G.E. Thermoynamics of preiction. Physical Review Letters, 10912, [6] Sagawa, T., & Uea, M. Fluctuation theorem with information exchange: role of correlations in stochastic thermoynamics. Physical Review Letters, 10918, [7] Ito, S., & Sagawa, T. Information thermoynamics on causal networks. Physical Review Letters, 11118, [8] Hartich, D., Barato, A. C., & Seifert, U. Stochastic thermoynamics of bipartite systems: transfer entropy inequalities an a Maxwells emon interpretation. Journal of Statistical Mechanics: Theory an Experiment P [9] Hartich, D., Barato, A. C., & Seifert, U. Sensory capacity: An information theoretical measure of the performance of a sensor. Physical Review E, 932, [10] Spinney, R. E., Lizier, J. T., & Prokopenko, M. Transfer entropy in physical systems an the arrow of time. Physical Review E, 942, [11] Ito, S. Backwar transfer entropy: Informational measure for etecting hien Markov moels an its interpretations in thermoynamics, gambling an causality. Scientific reports, 6, [12] Crooks, G. E., & Still, S. E. Marginal an conitional secon laws of thermoynamics. arxiv preprint arxiv: [13] Allahveryan, A. E., Janzing, D., & Mahler, G. Thermoynamic efficiency of information an heat flow. Journal of Statistical Mechanics: Theory an Experiment, 2009 P [14] Horowitz, J. M., & Esposito, M.. Thermoynamics with continuous information flow. Physical Review X, 43, [15] Horowitz, J. M., & Sanberg, H. Secon-law-like inequalities with information an their interpretations. New Journal of Physics, 1612, [16] Shiraishi, N., & Sagawa, T. Fluctuation theorem for partially maske nonequilibrium ynamics. Physical Review E, 911, [17] Shiraishi, N., Ito, S., Kawaguchi, K., & Sagawa, T. Role of measurement-feeback separation in autonomous Maxwell s emons. New Journal of Physics, 174, [18] Yamamoto, S., Ito, S., Shiraishi, N., & Sagawa, T. Linear irreversible thermoynamics an Onsager reciprocity for information-riven engines. Physical Review E, 945, [19] Gol, S., & Seifert, U. Stochastic thermoynamics of learning. Physical Review Letters, 1181, [20] Sekimoto, K. Stochastic energetics. Springer, [21] Seifert, U. Stochastic thermoynamics, fluctuation theorems an molecular machines. Reports on Progress in Physics, 7512, [22] Crooks, G. E. Measuring thermoynamic length. Physical Review Letters, 9910, [23] Ewar, F. H., & Crooks, G. E. Length of time s arrow. Physical Review Letters, 1019, [24] Polettini, M., & Esposito, M. Nonconvexity of the relative entropy for Markov ynamics: A Fisher information

6 6 approach. Physical Review E, 881, [25] Tajima, H., & Hayashi, M. Finite-size effect on optimal efficiency of heat engines. Physical Review E, 961, ; Tajima, H., & Hayashi, M. Refine Carnot s Theorem; Asymptotics of Thermoynamics with Finite-Size Heat Baths. arxiv: v [26] Shimazaki, H., Neural Engine Hypothesis. Dynamic Neuroscience. Springer, Cham, ; Shimazaki, H., Neurons as an Information-theoretic Engine. arxiv: v [27] Nicholson, S. B., & Kim, E. J. Investigation of the statistical istance to reach stationary istributions. Physics Letters A, 3793, [28] Lahiri, S., Sohl-Dickstein, J., & Ganguli, S. A universal traeoff between power, precision an spee in physical communication. arxiv preprint arxiv: [29] Weinhol, F. Metric geometry of equilibrium thermoynamics. The Journal of Chemical Physics, 636, [30] Ruppeiner, G. Thermoynamics: A Riemannian geometric moel. Physical Review A, 204, [31] Salamon, P., & Berry, R. S. Thermoynamic length an issipate availability. Physical Review Letters, 5113, [32] Sivak, D. A., & Crooks, G. E. Thermoynamic metrics an optimal paths. Physical Review Letters, 10819, [33] Machta, B. B. Dissipation boun for thermoynamic control. Physical Review Letters, 11526, [34] Rotskoff, G. M., Crooks, G. E., & Vanen-Eijnen, E. Geometric approach to optimal nonequilibrium control: Minimizing issipation in nanomagnetic spin systems. Physical Review E, 951, [35] Amari, S. I., & Nagaoka, H. Methos of information geometry. American Mathematical Soc., [36] Oizumi, M., Tsuchiya, N., & Amari, S. I. Unifie framework for information integration base on information geometry. Proceeings of the National Acaemy of Sciences, 11351, [37] Pires, D. P., Cianciaruso, M., Céleri, L. C., Aesso, G., & Soares-Pinto, D. O. Generalize geometric quantum spee limits. Physical Review X, 62, [38] Amari, S. I. Information geometry an its applications. Springer Japan, [39] Uffink, J., & van Lith, J. Thermoynamic uncertainty relations. Founations of physics, 295, [40] Lan, G., Sartori, P., Neumann, S., Sourjik, V., & Tu, Y. The energy-spee-accuracy trae-off in sensory aaptation. Nature physics, 85, [41] Govern, C. C., & ten Wole, P. R. Optimal resource allocation in cellular sensing systems. Proceeings of the National Acaemy of Sciences, 11149, [42] Ito, S., & Sagawa, T. Maxwell s emon in biochemical signal transuction with feeback loop. Nature communications, 6, [43] Barato, A. C., & Seifert, U. Thermoynamic uncertainty relation for biomolecular processes. Physical Review Letters, 11415, [44] Gingrich, T. R., Horowitz, J. M., Perunov, N., & Englan, J. L. Dissipation bouns all steay-state current fluctuations. Physical Review Letters, 11612, [45] Shiraishi, N., Saito, K., & Tasaki, H. Universal traeoff relation between power an efficiency for heat engines. Physical Review Letters, 11719, [46] Pietzonka, P., Barato, A. C., & Seifert, U. Universal bouns on current fluctuations. Physical Review E, 935, [47] Barato, A. C., & Seifert, U. Cost an precision of Brownian clocks. Physical Review X, 64, [48] Horowitz, J. M., & Gingrich, T. R. Proof of the finitetime thermoynamic uncertainty relation for steay-state currents. Physical Review E, 962, [49] Proesmans, K., & Van en Broeck, C. Discrete-time thermoynamic uncertainty relation. EPL Europhysics Letters, 1192, [50] Maes, C. Frenetic bouns on the entropy prouction. Physical Review Letters , [51] Dechant, A., & Sasa, S. I. Current fluctuations an transport efficiency for general Langevin systems. arxiv preprint arxiv: [52] Schnakenberg, J. Network theory of microscopic an macroscopic behavior of master equation systems. Reviews of Moern physics, 484, [53] Anrieux, D., & Gaspar, P. Fluctuation theorem for currents an Schnakenberg network theory. Journal of statistical physics, 1271, [54] Rao, C. R. Information an the accuracy attainable in the estimation of statistical parameters. In Breakthroughs in statistics pp Springer New York, [55] Cover, T. M., & Thomas, J. A. Elements of information theory. John Wiley & Sons, [56] Wootters, W. K. Statistical istance an Hilbert space. Physical Review D, 232, [57] Braunstein, S. L., & Caves, C. M. Statistical istance an the geometry of quantum states. Physical Review Letters, 7222, [58] Jarzynski, C. Nonequilibrium equality for free energy ifferences. Physical Review Letters, 7814, [59] Crooks, G. E. Entropy prouction fluctuation theorem an the nonequilibrium work relation for free energy ifferences. Physical Review E, 603, [60] Evans, D. J., & Searles, D. J. The fluctuation theorem. Avances in Physics, 517, [61] Seifert, U. Entropy prouction along a stochastic trajectory an an integral fluctuation theorem. Physical Review Letters, 954, [62] Esposito, M., & Van en Broeck, C. Three faces of the secon law. I. Master equation formulation. Physical Review E, 821, [63] Esposito, M., & Van en Broeck, C. Three etaile fluctuation theorems. Physical Review Letters, 1049, [64] Schmiel, T., & Seifert, U. Stochastic thermoynamics of chemical reaction networks. The Journal of chemical physics, 1264, [65] Barato, A. C., Hartich, D., & Seifert, U Efficiency of cellular information processing. New Journal of Physics, 1610, [66] Sartori, P., Granger, L., Lee, C. F., & Horowitz, J. M. Thermoynamic costs of information processing in sensory aaptation. PLoS computational biology, 1012, e [67] Bo, S., Del Giuice, M., & Celani, A. Thermoynamic limits to information harvesting by sensory systems. Journal of Statistical Mechanics: Theory an Experiment, P [68] Oulrige, T. E., Govern, C. C., & ten Wole, P. R.

7 7 Thermoynamics of computational copying in biochemical systems. Physical Review X, 72, [69] McGrath, T., Jones, N. S., ten Wole, P. R., & Oulrige, T. E. Biochemical machines for the interconversion of mutual information an work. Physical Review Letters, 1182, [70] Ito, S. Stochastic Thermoynamic Interpretation of Information Geometry. arxiv preprint arxiv: v [71] Nicholson, S. B. Uncertainty scars an the istance from equilibrium. arxiv preprint arxiv: SUPPLEMENTARY INFORMATION I. Intuitive proof of the fact that the manifol S 2 gives the sphere surface of raius 2 We here intuitively show the fact that the manifol S 2 gives the sphere surface of raius 2. The set of probability p p 0,p 1,p 2 satisfies the normalization 2 1. The square of the line element s is given by s We here introuce the polar coorinate system φ,ψ where p 0 cosψ 2, p 1 sinψ 2 cosφ 2, p 2 sinψ 2 sinφ 2. We can check that the normalization 2 1 hols. By using the polar coorinate system, p 0,p 1,p 2 is given by p 0 2cosψsinψψ, p 1 2cosψsinψcosφ 2 ψ 2cosφsinφsinψ 2 φ, an p 2 2cosψsinψsinφ 2 ψ +2cosφsinφsinψ 2 φ. From Eq. 28, we then obtain s 2 4[sinψ 2 +cosψ 2 cosφ 2 +cosψ 2 sinφ 2 ]ψ 2 +0 φψ+4[sinφ 2 sinψ 2 +cosφ 2 sinψ 2 ]φ [ψ 2 +sinψ 2 φ 2 ]. Because the metric of the sphere surface of raius R is given by s 2 R 2 [ψ 2 + sinψ 2 φ 2 ], the manifol S 2 gives the sphere surface of raius R II. Detaile erivation of Eqs. 15 an 16 in the main text We here iscuss the etaile erivation of Eqs. 15 an 16 in the main text, an the relationship between the square of the line element an the Fisher information metric. By using the efinition of the thermoynamic force F ν : ln[wν ]ln[wν ], the master equation is given by n p x ν1 x 0 e Fν. 30 From Eqs. 28, 30 an n 2 / 2 0, we obtain an expression Eq. 15 in the main text, s 2 n 2 1 p x px px px n ν1 x efν. 31

8 Let E[A] : n Ax be the expecte value of any function Ax, an Ax : n n ν1 x 0 Wν Aν be the rate-weighte expecte value of any function of ege A ν with a fixe initial state x, respectively. By using these notation, the result 31 can be rewritten as 8 s 2 [ ] 2 E ef. 32 We here mention that a parenthesis in the main text is given by A E [ A ] if A ν is an anti-symmetric function A ν Aν. Because the thermoynamic force is an anti-symmetric function Fν Fν, the total entropy prouction rate is given by Σ tot E [ F ]. We also carefully mention that the expecte value of e F gives E[e F ] n n n x 0 Wν 0, compare to the integral fluctuation theorem eftraj traj 1 with the ν1 entropy prouction of trajectories F traj an the ensemble average of trajectories traj [1, 2]. If the system is in a stationary state, i.e., / 0 for any x, we have [ ] E ef ] E [e F From Eq. 31, we also obtain s 2 n 2 n n ν1 x 0 ν1 x 0 efν Fν e Fν n ν1 x 0 Wν e Fν. 34 The first term is calculate as follows n ν1 x 0 ν1 x 0 ν1 Fν e Fν x,x x>x,ν E J ν Fν Fν Fν F ν1 x,x x >x Fν, 35

9 9 where we use F ν Fν an Fν 0. The secon term is also calculate as follows n ν1 x 0 ν1 x 0 ν1 x,x x x ν1 ν1 ν1 x,x x x ν1 Wν e Fν x,x x>x x,x x x Wν n Wν ν1 n Wν + n lnwν + σν x,x x>x,ν E J ν σν n σν ν1 σ ν1 ν1 x,x x x 1 Wν x x Wν lnwν σν x,x x>x, 36 where we use x x, σν σ ν an σν 0. By using F ν σν + σsys, we obtain an expression s 2 2 σ F σ sys. 37 Let λ 1,...,λ n be the set of parameters such as control parameters. We also obtain the efinition of the Fisher information metric [3] [ ] lnp lnp g ij E λ i λ j [ lnpx λ i ] lnpx λ j 38

10 from the result 37, s 2 2 σ,ν E ν1 [ n n F J ν [ 1 ν 1 x 0x 0 ν1 x 0 2 lnpx n n i1 j1 i1 1 ] [ 1 W ν x p x 1 x ] ln λ i λ i 2 ν 1 x 0 W ν x x W ν x x ] λ i g λ j ij, 39 where we use n Wν 0 an the master equation / n ν1 with the following calculation about the Fisher information metric s 2 ln 2 n lnpx λ i λ i i n x 0 Wν. This result is consistent g ij λ i λ j. 40 n n i1 j1 III. Linear irreversible thermoynamic interpretation of information geometry We here iscuss a stochastic thermoynamic interpretation of information geometry in a near-equilibirum system, where the entropy prouction rate is given by the secon orer expansion for the thermoynamic flow or the thermoynamic force. This secon orer expansion is well known as linear irreversible thermoynamics [4]. If we assume F ν 0, we have Jν 0. Thus, we have a linear expansion of thermoynamic force Fν in terms of the thermoynamic flow J ν for a near-equilibrium conition i.e., Fν 0 for any x an x F ν ln α ν 1+ Jν Jν α ν : 1 +ojν p x ν F, We call this coefficient α ν as the Onsager coefficient of the ege x x,ν. The symmetry of the coefficient α ν αν hols ue to the conition Fν 0. If we consier the Kirchhoff s current law in a stationary state, the linear combination of the coefficient α ν leas to the Onsager coefficient [4]. Let {C 1,...,C m } be the cycle basis of the Markov network for the master equation. The thermoynamic force of the cycle FC i is efine as FC i,ν E S{x x,ν},c i F ν 43

11 11 where 1 {x x,ν} C i S{x x,ν},c i 1 {x x,ν} C i otherwise The thermoynamic flow of the cycle JC i is efine as m S{x x,ν},c i JC i. 45 J ν i1 We then obtain the linear relationship FC j m i1 L jijc i or JC j m coefficient i1 L1 ji FC i with the Onsager L ij,ν E α ν S{x x,ν},c i S{x x,ν},c j, 46 for a near-equilibrium conition, the secon law of thermoynamics 0 Σ tot,ν E,ν E i1 J ν Fν m m JC i FC i, i1 m j1 i1 m j1 i1 m L ij JC i JC j, m S{x x,ν},c i JC i F ν L 1 ij FC ifc j, 47 an the Onsager reciprocal relationship L ij L ji. This result gives the secon orer expansion of the entropy prouction rate Σ tot for the thermoynamic flow J or the thermoynamic force F in a stationary state. For m 2, the secon law of thermoynamics L 11 FC 1 2 +L 22 FC L 12 FC 1 FC 2 0 is then given by L 11 0, L 22 0, an L 11 L 22 L Here we newly consier the secon orer expansion of s 2 for the thermoynamic flow J or the thermoynamic force F in linear irreversible thermoynamics. In a near-equilibrium system, the square of line element s is calculate

12 12 as follows σ s 2 sys,ν E,ν E 2 [ J ν 1 J ν,ν E ν 1 x 0,ν E ν 1 x 0 [ 1 ν1 ν 1 x 0x 0 n ν1 J ν 1 ] 2 ν 1 x 0 [ J ν 1 [ ν 1 x 0x 0 J ν x x 1 [ 1 J ν x p x 1 x J ν x p x 1 x [ ] J ν Jν x x F ν Fν x x α ν α ν x x 2 ] ν 1 x 0 ] J ν x x 2 ] J ν x x 2 J ν x x ] We here consier the situation that the time evolution of control parameters λ x,x,ν x is riven by the thermoynamic force F νx λ x,x,ν x/. The square of line element can be written by the following Fisher information metric s 2 g x,x,ν xy,y,ν y ν x1 x 0 ν y1 y0y 0 δ xy α νx α νy y y g x,x,ν xy,y,ν yλ x,x,ν xλ y,y,ν y This result implies that the Fisher information metric for control parameters λ x,x,ν x riven by the thermoynamic force F νx λ x,x,ν x/ is relate to the Onsager coefficients of the ege α νx for a near-equilibrium conition. Because the Cramér-Rao boun [3, 5] implies that the variance of unbiase estimator is boune by the inverse of this Fisher information metric, the Onsager coefficients of the ege α νx gives a lower boun of the variance of unbiase estimator for control parameters riven by the thermoynamic forces in a near-equilibrium system. IV. Detail of the three states moel of enzyme reaction Stochastic thermoynamics for the master equation is applicable to a moel of chemical reaction [64]. We here iscuss the thermoynamic etail of the three states moel of enzyme reaction iscusse in the main text. The master equation for Eq. 27 in the main text is given by p A k AX+ [X]+k AB+ [B]p A +k AB p AB +k AX p AX, p AB k AB+ [B]p A k AB +k [X]p AB +k + [B]p AX, p AX k AX+ [X]p A +k [X]p AB k AX +k + [B]p AX, 51

13 13 where k, k AB an k AX are given by the chemical potential ifferences ln k AX+ k AX β µ AX, ln k AB+ k AB β µ AB, ln k + k β µ. 52 We here assume that the sum of the concentrations [A] + [AB] + [AX] n A is constant. The probabilities istributions p A, p AB, an p AX correspon to the fractions of p A [A]/n A, p AB [AB]/n A an p AX [AX]/n A, respectively. From the master equation 51, we obtain the rate equations of enzyme reaction which correspons to the following enzyme reaction [A] k AX+ [X]+k AB+ [B][A]+k AB [AB]+k AX [AX], [AB] k AB+ [B][A]k AB +k [X][AB]+k + [B][AX], [AX] k AX+ [X][A]+k [X][AB]k AX +k + [B][AX]. 53 A+X AX, A+B AB, AX +B AB +X, 54 where A is substrate, X is enzyme, AX is enzyme-substrate complex, an AB is prouct. In this moel, the stochastic entropy changes of thermal are also calculate as σ 1 A AB β µ AB +ln[b], σ 1 AB AX β µln[b]+ln[x], σ 1 AX A β µ AX ln[x], 55 which are the conventional efinitions of the stochastic entropy changes of a thermal. In this moel, the cycle basis is given by one cycle {C 1 A AB AX A}. If the chemical potential change in a cycle C 1 has non-zero value, i.e., µ cyc : µ AB µ µ AX 0, the system in a stationary state is riven by the thermoynamic force of the cycle FC 1 F 1 A AB +F1 AB AX +F1 AX A β µ cyc. In a numerical calculation, we set β µ cyc Then we consier non-equilibrium an non-stationary ynamics in a numerical calculation. [1] Seifert, U. Entropy prouction along a stochastic trajectory an an integral fluctuation theorem. Physical review letters, 954, [2] Esposito, M., & Van en Broeck, C. Three etaile fluctuation theorems. Physical review letters, 1049, [3] Cover, T. M., & Thomas, J. A. Elements of information theory. John Wiley & Sons, [4] Schnakenberg, J. Network theory of microscopic an macroscopic behavior of master equation systems. Reviews of Moern physics, 484, [5] Rao, C. R. Information an the accuracy attainable in the estimation of statistical parameters. In Breakthroughs in statistics pp Springer New York, [6] Schmiel, T., & Seifert, U. Stochastic thermoynamics of chemical reaction networks. The Journal of chemical physics, 1264,