Dually Flat Geometries in the State Space of Statistical Models

Similar documents
Statistical physics models belonging to the generalised exponential family

The q-exponential family in statistical physics

Chapter 2 Exponential Families and Mixture Families of Probability Distributions

1. Geometry of the unit tangent bundle

AN AFFINE EMBEDDING OF THE GAMMA MANIFOLD

PHYS 352 Homework 2 Solutions

Relativity Discussion

1 The fundamental equation of equilibrium statistical mechanics. 3 General overview on the method of ensembles 10

June 21, Peking University. Dual Connections. Zhengchao Wan. Overview. Duality of connections. Divergence: general contrast functions

Curved Spacetime I. Dr. Naylor

How to recognise a conformally Einstein metric?

Estimators, escort probabilities, and φ-exponential families in statistical physics

Information geometry of Bayesian statistics

General Relativity and Cosmology Mock exam

An Outline of (Classical) Statistical Mechanics and Related Concepts in Machine Learning

THEODORE VORONOV DIFFERENTIAL GEOMETRY. Spring 2009

[S R (U 0 ɛ 1 ) S R (U 0 ɛ 2 ]. (0.1) k B

Tensors, and differential forms - Lecture 2

Information Geometry of Positive Measures and Positive-Definite Matrices: Decomposable Dually Flat Structure

Gravitation: Tensor Calculus

where (E) is the partition function of the uniform ensemble. Recalling that we have (E) = E (E) (E) i = ij x (E) j E = ij ln (E) E = k ij ~ S E = kt i

Read carefully the instructions on the answer book and make sure that the particulars required are entered on each answer book.

F -Geometry and Amari s α Geometry on a Statistical Manifold

+ dxk. dt 2. dt Γi km dxm. . Its equations of motion are second order differential equations. with intitial conditions

Invariant Nonholonomic Riemannian Structures on Three-Dimensional Lie Groups

Minimal timelike surfaces in a certain homogeneous Lorentzian 3-manifold II

(# = %(& )(* +,(- Closed system, well-defined energy (or e.g. E± E/2): Microcanonical ensemble

4.7 The Levi-Civita connection and parallel transport

Perelman s Dilaton. Annibale Magni (TU-Dortmund) April 26, joint work with M. Caldarelli, G. Catino, Z. Djadly and C.

Exam TFY4230 Statistical Physics kl Wednesday 01. June 2016

Contact Symmetries and Hamiltonian Thermodynamics

1 First and second variational formulas for area

On the existence of isoperimetric extremals of rotation and the fundamental equations of rotary diffeomorphisms

General Relativity and Differential

Mathematical Relativity, Spring 2017/18 Instituto Superior Técnico

DIFFERENTIAL GEOMETRY. LECTURE 12-13,

Hessian Riemannian Gradient Flows in Convex Programming

Curvature homogeneity of type (1, 3) in pseudo-riemannian manifolds

Self-dual conformal gravity

Problem 1, Lorentz transformations of electric and magnetic

Week 6: Differential geometry I

Introduction to Differential Geometry

Übungen zu RT2 SS (4) Show that (any) contraction of a (p, q) - tensor results in a (p 1, q 1) - tensor.

Thermodynamics of phase transitions

PAPER 309 GENERAL RELATIVITY

Applications of Fisher Information

Tutorial General Relativity

Information geometry of mirror descent

Properties of the boundary rg flow

UNIVERSITY OF DUBLIN

From holonomy reductions of Cartan geometries to geometric compactifications

Chapter 3. Riemannian Manifolds - I. The subject of this thesis is to extend the combinatorial curve reconstruction approach to curves

Transport Continuity Property

Isometries, Local Isometries, Riemannian Coverings and Submersions, Killing Vector Fields

Tensor Calculus, Part 2

Information geometry of the power inverse Gaussian distribution

Georgia Tech PHYS 6124 Mathematical Methods of Physics I

Subriemannian geodesics - an introduction

Differential Geometry II Lecture 1: Introduction and Motivation

Manifold Monte Carlo Methods

MATH DIFFERENTIAL GEOMETRY. Contents

Information Theory and Predictability Lecture 6: Maximum Entropy Techniques

Exercise 1 (Formula for connection 1-forms) Using the first structure equation, show that

Introduction to Information Geometry

DIFFERENTIAL GEOMETRY, LECTURE 16-17, JULY 14-17

Appendix to Lecture 2

A brief introduction to Semi-Riemannian geometry and general relativity. Hans Ringström

i=1 n i, the canonical probabilities of the micro-states [ βǫ i=1 e βǫn 1 n 1 =0 +Nk B T Nǫ 1 + e ǫ/(k BT), (IV.75) E = F + TS =

NEW LIFTS OF SASAKI TYPE OF THE RIEMANNIAN METRICS

PAPER 52 GENERAL RELATIVITY

On isometries of Finsler manifolds

Tensor Analysis in Euclidean Space

Information geometry for bivariate distribution control

Riemannian Curvature Functionals: Lecture I

An Information Geometric Perspective on Active Learning

CALCULUS ON MANIFOLDS. 1. Riemannian manifolds Recall that for any smooth manifold M, dim M = n, the union T M =

Some aspects of the Geodesic flow

Left-invariant Einstein metrics

Practice Qualifying Exam Questions, Differentiable Manifolds, Fall, 2009.

L 2 Geometry of the Symplectomorphism Group

arxiv: v1 [cs.lg] 17 Aug 2018

UNIVERSITY OF OSLO Faculty of Mathematics and Natural Sciences

Constraints on Fluid Dynamics From Equilibrium Partition Func

Phase transitions for particles in R 3

Syllabus. May 3, Special relativity 1. 2 Differential geometry 3

arxiv:cond-mat/ v1 [cond-mat.stat-mech] 12 Jan 2006

Physics 236a assignment, Week 2:

Choice of Riemannian Metrics for Rigid Body Kinematics

U = γkt N. is indeed an exact one form. Thus there exists a function U(S, V, N) so that. du = T ds pdv. U S = T, U V = p

The general reason for approach to thermal equilibrium of macroscopic quantu

Symplectic and Kähler Structures on Statistical Manifolds Induced from Divergence Functions

Random dynamical systems with microstructure

Theorem. In terms of the coordinate frame, the Levi-Civita connection is given by:

GLASGOW Paolo Lorenzoni

Complete integrability of geodesic motion in Sasaki-Einstein toric spaces

Classical differential geometry of two-dimensional surfaces

Tensors - Lecture 4. cos(β) sin(β) sin(β) cos(β) 0

I. HARTLE CHAPTER 8, PROBLEM 2 (8 POINTS) where here an overdot represents d/dλ, must satisfy the geodesic equation (see 3 on problem set 4)

Geometry of almost-product (pseudo-)riemannian manifold. manifolds and the dynamics of the observer. Aneta Wojnar

Before you begin read these instructions carefully.

Transcription:

1/ 12 Dually Flat Geometries in the State Space of Statistical Models Jan Naudts Universiteit Antwerpen ECEA, November 2016 J. Naudts, Dually Flat Geometries in the State Space of Statistical Models. In Proceedings of the 3rd Int. Electron. Conf. Entropy Appl., 1 10 November 2016; Sciforum Electronic Conference Series, Vol. 3, A004 (2016); doi:10.3390/ecea-3-a004.

2/ 12 Outline 1. A manifold of equilibrium states 2. Dually flat geometries 3. Thermodynamic length 4. The ideal gas 5. Conclusions

3/ 12 1. A manifold of equilibrium states Application of differential geometry to thermodynamics initiated by Weinhold (1975) Metric space (Hilbert space) spanned by extensive variables X i such as internal energy, total magnetization, number of particles,... Present work: uses canonical ensemble of statistical mechanics. Relevant potential: Φ = log Z, (Z is the partition sum) instead of energy, entropy, free energy,... Scalar product defines metric tensor g: g ij = X i, X j. Ruppeiner (1979) The metric tensor g is determined by fluctuations + correlations. Riemannian curvature, determined by g, implies interactions. No curvature for the ideal gas model.

4/ 12 Boltzmann-Gibbs distribution p(x) = 1 Z e β[h(x) hm(x)] H(x) is Hamiltonian, M(x) is total magnetization β is inverse temperature, h is external magnetic field Z = Z(β, h) the normalization. Statistics: the BG distribution belongs to the exponential family because it can be written into the form p θ (x) = exp(θ k F k (x) Φ(θ)). θ 1 = β, F 1 (x) = H(x), θ 2 = βh, F 2 (x) = M(x), Φ(θ) = log Z(β, h). Derivatives of Φ(θ) yield expectation values: k Φ(θ) = F k θ.

5/ 12 The p θ (x) form a differentiable manifold M. The variables X k with X k = F k F k θ span a tangent plane. The obvious scalar product is U, V θ = dx p θ (x)u(x)v(x). The metric tensor g is given by g ij (θ) = X i, X j. The Christoffel symbols are defined by Γ k ij = 1 2 gks ( i g sj + j g is s g ij ), They determine the Riemannian curvature of the manifold.

6/ 12 2. Dually flat geometries Geometry: metric tensor g(θ) plus geodesics Geodesics are solutions of Euler-Lagrange eq. θ k +ω k ij θ i θ j = 0. The coefficients ω k ij determine the connection. Riemannian curvature : Levi-Civita connection : ω = Γ (Amari 1985) A model belonging to the exponential family has dually flat geometries ω = 0 and ω = 2Γ. Duality of connections is related to the duality known from thermodynamics. Replacing acceleration Γ by 2Γ removes any curvature. This holds when using the canonical coordinates θ k of the exponential family.

7/ 12 Thermodynamic duality: two potentials S(U) and Φ(β) satisfy ds du = β and dφ dβ = U. Entropy S(U) is the Legendre transform of Φ(β) (Massieu 1869). Several variables: η i and θ j are dual coordinates: η i = Φ θ i = F i θ and θ j = S η j. Φ(θ) and S(η) are dual potentials: Φ(θ) = sup{s(η)+θ k η k }, and η S(η) = inf θ {Φ(θ) θk η k }.

8/ 12 3. Thermodynamic length Geodesics for ω = 0: θ k (t) = (1 t)θ k (t = 0)+tθ k (t = 1). Geodesics for ω = 2Γ: θ k (t) = θ k [(1 t)η(t = 0)+tη(t = 1)], with θ[η] inverse function of η(θ). Thermodynamic length: integrate ds = g ij θ i θ j along geodesic. Easy calculation when coordinates known in which the geodesic is a straight line.

9/ 12 4. The ideal gas Probability density for x in n-particle phase space f(x, n) = 1 Z e β(hn(x) µn). β is inverse temperature, µ is chemical potential, H n is Hamiltonian for n free particles, enclosed in volume V. Let θ 1 = β/β 0, θ 2 = βµ, F 1 (x, n) = H n (x), F 2 (x, n) = n. ideal gas model belongs to the exponential family. Calculations ) 3/2, ( Φ(β,µ) = log Z = V V 0 e βµ β0 β with numerical constants V 0, β 0. N n = Φ(β,µ) ideal gas law βpv = N where p is pressure.

10/ 12 η 1 = 3 Φ and η 2θ 1 2 = Φ. ( 15 g(θ) = 1 3 ) Φ 4θ 1 2 θ 1 3 2 θ 1. Christoffel symbols: ( ) Γ 1 5/2θ 1 1/2 = and Γ 2 = 1/2 0 ( 15/8[θ 1 ] 2 0 0 1/2 ). Riemannian curvature vanishes. Tedious calculation.

11/ 12 Example of ω = 0 geodesic: isotherm: β is kept constant, µ varies linearly. Thermodynamic length = 2 N (2) N (1) Example of ω = 2Γ geodesic: pv is kept constant, N varies linearly. Thermodynamic length proportional to change in N.

12/ 12 5. Conclusions Application of differential geometry to thermodynamics is considered here for models belonging to the exponential family. Amari s dually flat geometries are also meaningful in a thermodynamical context. Future work: application to models of interacting particles.