Events4th International Electronic Conference on Entropy and Its Applications
Published
This submission belongs to the session b. Information and Complexity of the event 4th International Electronic Conference on Entropy and Its Applications
Published date
20 Nov, 2017
Citation
Mikhail Prokopenko, Relating Fisher information and thermodynamic cost of near-equilibrium computation, in Proceedings of 4th International Electronic Conference on Entropy and Its Applications, 21 November–1 December 2017, MDPI: Basel, Switzerland, doi: 10.3390/ecea-4-05027
Share
Email
Facebook
Twitter
LinkedIn

Relating Fisher information and thermodynamic cost of near-equilibrium computation

image
1. Centre for Complex Systems, The University of Sydney
Abstract

A recently developed framework of information dynamics systematically studies the phenomenon of computation and information processing in complex systems, relating it to critical phenomena, e.g., phase transitions and the edge of chaos. It has been conjectured that at the edge of chaos the distributed computation exhibits a high level of complexity. However, it remains unclear how such complexity is related to physical fluxes which are observed and studied during phase transitions. We consider several examples of near-equilibrium computation (e.g., random Boolean networks and collective motion) as thermodynamic phenomena.  Specifically, we consider the dynamical model of collective motion which undergoes a kinetic phase transition over parameters that control the particles’ alignment: from a “disordered motion” phase, in which particles keep changing direction but occupy a fairly stable collective space, to a “coherent motion” phase, in which particles cohesively move towards a common direction. The control parameters that we consider are the alignment strength among particles and the number of nearest neighbours affecting a particle’s alignment.  This analysis allows us to contrast Fisher information with the curvature of the system's entropy. During the phase transition, where the configuration entropy of the system decreases, the sensitivity of the distributed computation diverges. Overall, the comparison highlights the balancing role of the sensitivity and the uncertainty of computation when the system fluctuates near equilibrium, quantifying the thermodynamic cost of this computation.

Keywords
Fisher information
information thermodynamics
distributed computation
near-equilibrium computation
complexity
collective motion
phase transitions
the edge of chaos
entropy
thermodynamic cost
Manuscript
Poster
Mikhail Prokopenko.pdf
The role of information in complex systems -- Self-organisation in stem cells and glass formers
Using Entropy to Unify Mechanics and Thermodynamics