• ### Time Dependent Saddle Node Bifurcation: Breaking Time and the Point of No Return in a Non-Autonomous Model of Critical Transitions(1611.09542)

Jan. 3, 2019 math.DS, q-bio.QM
There is a growing awareness that catastrophic phenomena in biology and medicine can be mathematically represented in terms of saddle-node bifurcations. In particular, the term tipping', or critical transition has in recent years entered the discourse of the general public in relation to ecology, medicine, and public health. The saddle-node bifurcation and its associated theory of catastrophe as put forth by Thom and Zeeman has seen applications in a wide range of fields including molecular biophysics, mesoscopic physics, and climate science. In this paper, we investigate a simple model of a non-autonomous system with a time-dependent parameter $p(\tau)$ and its corresponding dynamic' (time-dependent) saddle-node bifurcation by the modern theory of non-autonomous dynamical systems. We show that the actual point of no return for a system undergoing tipping can be significantly delayed in comparison to the {\em breaking time} $\hat{\tau}$ at which the corresponding autonomous system with a time-independent parameter $p_{a}= p(\hat{\tau})$ undergoes a bifurcation. A dimensionless parameter $\alpha=\lambda p_0^3V^{-2}$ is introduced, in which $\lambda$ is the curvature of the autonomous saddle-node bifurcation according to parameter $p(\tau)$, which has an initial value of $p_{0}$ and a constant rate of change $V$. We find that the breaking time $\hat{\tau}$ is always less than the actual point of no return $\tau^*$ after which the critical transition is irreversible; specifically, the relation $\tau^*-\hat{\tau}\simeq 2.338(\lambda V)^{-\frac{1}{3}}$ is analytically obtained. For a system with a small $\lambda V$, there exists a significant window of opportunity $(\hat{\tau},\tau^*)$ during which rapid reversal of the environment can save the system from catastrophe.
• ### Stochastic Dynamics II: Finite Random Dynamical Systems, Linear Representation, and Entropy Production(1804.08174)

April 22, 2018 math.PR, math.DS, physics.data-an
We study finite state random dynamical systems (RDS) and their induced Markov chains (MC) as stochastic models for complex dynamics. The linear representation of deterministic maps in RDS are matrix-valued random variables whose expectations correspond to the transition matrix of the MC. The instantaneous Gibbs entropy, Shannon-Khinchin entropy per step, and the entropy production rate of the MC are discussed. These three concepts as key anchor points in stochastic dynamics, characterize respectively the uncertainties of the system at instant time $t$, the randomness generated per step, and the dynamical asymmetry with respect to time reversal. The entropy production rate, expressed in terms of the cycle distributions, has found an expression in terms of the probability of the deterministic maps with the single attractor in the maximum entropy RDS. For finite RDS with invertible transformations, the non-negative entropy production rate of its MC is bounded above by the Kullback-Leibler divergence of the probability of the deterministic maps with respect to its time-reversal dual probability.
• ### Grand canonical diffusion-influenced reactions: a stochastic theory with applications to multiscale reaction-diffusion simulations(1804.07743)

Smoluchowski's model for diffusion-influenced reactions (A+B -> C) can be formulated within two frameworks: the probabilistic-based approach for a pair A,B of reacting particles; and the concentration-based approach for systems in contact with a bath that generates a concentration gradient of B particles that interact with A. Although these two approaches are mathematically similar, it is not straightforward to establish a precise mathematical relationship between them. Determining this relationship is essential to derive particle-based numerical methods that are quantitatively consistent with bulk concentration dynamics. In this work, we determine the relationship between the two approaches by introducing the grand canonical Smoluchowski master equation (GC-SME), which consists of a continuous-time Markov chain that models an arbitrary number of B particles, each one of them following Smoluchowski's probabilistic dynamics. We show the GC-SME recovers the concentration-based approach by taking either the hydrodynamic or the large copy number limit, resembling Kurtz's limiting behavior for the chemical master equation. In addition, we show the GC-SME provides a clear statistical mechanical interpretation of the concentration-based approach and yields an emergent chemical potential for nonequilibrium, spatially inhomogeneous reaction processes. We further exploit the GC-SME robust framework to accurately derive multiscale/hybrid numerical methods that couple particle-based reaction-diffusion simulations with bulk concentration descriptions, as described in detail through two computational implementations.
• ### Relaxation rates of gene expression kinetics reveal the feedback signs of autoregulatory gene networks(1803.01123)

The transient response to a stimulus and subsequent recovery to a steady state are the fundamental characteristics of a living organism. Here we study the relaxation kinetics of autoregulatory gene networks based on the chemical master equation model of single-cell stochastic gene expression with nonlinear feedback regulation. We report a novel relation between the rate of relaxation, characterized by the spectral gap of the Markov model, and the feedback sign of the underlying gene circuit. When a network has no feedback, the relaxation rate is exactly the decaying rate of the protein. We further show that positive feedback always slows down the relaxation kinetics while negative feedback always speeds it up. Numerical simulations demonstrate that this relation provides a possible method to infer the feedback topology of autoregulatory gene networks by using time-series data of gene expression.
• ### ZOOpt: Toolbox for Derivative-Free Optimization(1801.00329)

Feb. 6, 2018 cs.LG, stat.ML
Recent advances of derivative-free optimization allow efficient approximating the global optimal solutions of sophisticated functions, such as functions with many local optima, non-differentiable and non-continuous functions. This article describes the ZOOpt (https://github.com/eyounx/ZOOpt) toolbox that provides efficient derivative-free solvers and are designed easy to use. ZOOpt provides a Python package for single-thread optimization, and a light-weighted distributed version with the help of the Julia language for Python described functions. ZOOpt toolbox particularly focuses on optimization problems in machine learning, addressing high-dimensional, noisy, and large-scale problems. The toolbox is being maintained toward ready-to-use tool in real-world machine learning tasks.
• ### Estimate exponential memory decay in Hidden Markov Model and its applications(1710.06078)

Oct. 17, 2017 stat.ME, stat.ML
Inference in hidden Markov model has been challenging in terms of scalability due to dependencies in the observation data. In this paper, we utilize the inherent memory decay in hidden Markov models, such that the forward and backward probabilities can be carried out with subsequences, enabling efficient inference over long sequences of observations. We formulate this forward filtering process in the setting of the random dynamical system and there exist Lyapunov exponents in the i.i.d random matrices production. And the rate of the memory decay is known as $\lambda_2-\lambda_1$, the gap of the top two Lyapunov exponents almost surely. An efficient and accurate algorithm is proposed to numerically estimate the gap after the soft-max parametrization. The length of subsequences $B$ given the controlled error $\epsilon$ is $B=\log(\epsilon)/(\lambda_2-\lambda_1)$. We theoretically prove the validity of the algorithm and demonstrate the effectiveness with numerical examples. The method developed here can be applied to widely used algorithms, such as mini-batch stochastic gradient method. Moreover, the continuity of Lyapunov spectrum ensures the estimated $B$ could be reused for the nearby parameter during the inference.
• ### Kinematic Basis of Emergent Energetic Descriptions of General Stochastic Dynamics(1704.01828)

Sept. 20, 2017 math-ph, math.MP, physics.gen-ph
We show a stochastic, kinematic description of a dynamics has a hidden energetic and thermodynamic structure. An energy function $\varphi(x)$ emerges as the limit of the generalized free energy of the stochastic dynamics with vanishing noise. In terms of the $\varphi$ and its orthogonal field $\gamma(x)\perp\nabla\varphi$, a general vector field $b(x)$ is decomposed into $-D(x)\nabla\varphi+\gamma$, where $\nabla\cdot\big(\omega(x)\gamma(x)\big)=-\nabla\omega D(x)\nabla\varphi$, $D(x)$ and $\omega(x)$ represent the local geometry and density in the state space at $x$. $\varphi(x)$ and $\omega(x)$ are interpreted as the emergent energy and degeneracy of the motion, with energy balance equation $d\varphi(x(t))/dt=\gamma D^{-1}\gamma-b D^{-1} b$. The partition function and J. W. Gibbs' method of statistical ensemble change naturally arise. The present theory provides a mathematical basis for P. W. Anderson's emergent behavior in the hierarchical structure of science.
• ### Emergent Behavior in Single-cell Stochastic Gene Expression(1708.05938)

Single-cell gene expression is inherently stochastic, its emergent behavior can be defined in terms of the chemical master equation describing the evolution of the mRNA and protein copy numbers as the latter $N\rightarrow\infty$. We establish two types of "macroscopic limits": the Kurtz limit is consistent with the classical chemical kinetics, while the L\'evy limit provides a theoretical foundation for an empirical equation proposed in [Phys. Rev. Lett. 97:168302, 2006]. Furthermore, we clarify the biochemical implications and ranges of applicability for various macroscopic limits and calculate a comprehensive analytic expression for the protein concentration distribution in autoregulatory gene networks. The relationship between our work and modern population genetics is discussed.
• ### Dynamic Looping of a Free-Draining Polymer(1704.04361)

Oct. 26, 2017 cond-mat.soft
We revisit the celebrated Wilemski-Fixman (WF) treatment for the looping time of a free-draining polymer. The WF theory introduces a sink term into the Fokker-Planck equation for the $3(N+1)$-dimensional Ornstein-Uhlenbeck process of the polymer dynamics, which accounts for the appropriate boundary condition due to the formation of a loop. The assumption for WF theory is considerably relaxed. A perturbation method approach is developed that justifies and generalizes the previous results using either a Delta sink or a Heaviside sink. For both types of sinks, we show that under the condition of a small dimensionless $\epsilon$, the ratio of capture radius to the Kuhn length, we are able to systematically produce all known analytical and asymptotic results obtained by other methods. This includes most notably the transition regime between the $N^2$ scaling of Doi, and $N\sqrt{N}/\epsilon$ scaling of Szabo, Schulten, and Schulten. The mathematical issue at play is the non-uniform convergence of $\epsilon\to 0$ and $N\to\infty$, the latter being an inherent part of the theory of a Gaussian polymer. Our analysis yields a novel term in the analytical expression for the looping time with small $\epsilon$, which is previously unknown. Monte Carlo numerical simulations corroborate the analytical findings. The systematic method developed here can be applied to other systems modeled by multi-dimensional Smoluchowski equations.
• ### A framework towards understanding mesoscopic phenomena: Emergent unpredictability, symmetry breaking and dynamics across scales(1310.5585)

Nov. 3, 2016 cond-mat.stat-mech
By integrating 4 lines of thoughts: symmetry breaking originally advanced by Anderson, bifurcation from nonlinear dynamics, Landau's theory of phase transition, and the mechanism of emergent rare events studied by Kramers, we introduce a possible framework for understanding mesoscopic dynamics that links (i) fast lower level microscopic motions, (ii) movements within each basin at the mid-level, and (iii) higher-level rare transitions between neighboring basins, which have rates that decrease exponentially with the size of the system. In this mesoscopic framework, multiple attractors arise as emergent properties of the nonlinear systems. The interplay between the stochasticity and nonlinearity leads to successive jump-like transitions among different basins. We argue each transition is a dynamic symmetry breaking, with the potential of exhibiting Thom-Zeeman catastrophe as well as phase transition with the breakdown of ergodicity (e.g., cell differentiation). The slow-time dynamics of the nonlinear mesoscopic system is not deterministic, rather it is a discrete stochastic jump process. The existence of these discrete states and the Markov transitions among them are both emergent phenomena. This emergent stochastic jump dynamics then serves as the stochastic element for the nonlinear dynamics of a higher level aggregates on an even larger spatial and slower time scales (e.g., evolution). This description captures the hierarchical structure outlined by Anderson and illustrates two distinct types of limit of a mesoscopic dynamics: A long-time ensemble thermodynamics in terms of time $t$ tending infinity followed by the size of the system $N$ tending infinity, and a short-time trajectory steady state with $N$ tending infinity followed by $t$ tending infinity. With these limits, symmetry breaking and cusp catastrophe are two perspectives of the same mesoscopic system on different time scales.
• ### A Discrete Stochastic Formulation for Reversible Bimolecular Reactions via Diffusion Encounter(1511.08798)

Oct. 12, 2016 cond-mat.stat-mech
The classical models for irreversible diffusion-influenced reactions can be derived by introducing absorbing boundary conditions to over-damped continuous Brownian motion (BM) theory. As there is a clear corresponding stochastic process, the mathematical description takes both Kolmogorov forward equation for the evolution of the probability distribution function and the stochastic sample trajectories. This dual description is a fundamental characteristic of stochastic processes and allows simple particle based simulations to accurately match the expected statistical behavior. However, in the traditional theory using the back-reaction boundary condition to model reversible reactions with geminate recombinations, several subtleties arise: it is unclear what the underlying stochastic process is, which causes complications in producing accurate simulations; and it is non-trivial how to perform an appropriate discretization for numerical computations. In this work, we derive a discrete stochastic model that recovers the classical models and their boundary conditions in the continuous limit. In the case of reversible reactions, we recover the back-reaction boundary condition, unifying the back-reaction approach with those of current simulation packages. Furthermore, all the complications encountered in the continuous models become trivial in the discrete model. Our formulation brings to attention the question: With computations in mind, can we develop a discrete reaction kinetics model that is more fundamental than its continuous counterpart?
• ### Mathematical Formalism of Nonequilibrium Thermodynamics for Nonlinear Chemical Reaction Systems with General Rate Law(1604.07115)

This paper studies a mathematical formalism of nonequilibrium thermodynamics for chemical reaction models with $N$ species, $M$ reactions, and general rate law. We establish a mathematical basis for J. W. Gibbs' macroscopic chemical thermodynamics under G. N. Lewis' kinetic law of entire equilibrium (detailed balance in nonlinear chemistry kinetics). In doing so, the equilibrium thermodynamics is then naturally generalized to nonequilibrium settings without detailed balance. The kinetic models are represented by a Markovian jumping process. A generalized macroscopic chemical free energy function and its associated balance equation with nonnegative source and sink are the major discoveries. The proof is based on the large deviation principle of this type of Markov processes. A general fluctuation dissipation theorem for stochastic reaction kinetics is also proved. The mathematical theory illustrates how a novel macroscopic dynamic law can emerges from the mesoscopic kinetics in a multi-scale system.
• ### Nonlinear Stochastic Dynamics of Complex Systems, II: Potential of Entropic Force in Markov Systems with Nonequilibrium Steady State, Generalized Gibbs Function and Criticality(1605.08071)

In this paper we revisit the notion of the "minus logarithm of stationary probability" as a generalized potential in nonequilibrium systems and attempt to illustrate its central role in an axiomatic approach to stochastic nonequilibrium thermodynamics of complex systems. It is demonstrated that this quantity arises naturally through both monotonicity results of Markov processes and as the rate function when a stochastic process approaches a deterministic limit. We then undertake a more detailed mathematical analysis of the consequences of this quantity, culminating in a necessary and sufficient condition for the criticality of stochastic systems. This condition is then discussed in the context of recent results about criticality in biological systems
• ### Nonlinear Stochastic Dynamics of Complex Systems, III: Noneqilibrium Thermodynamics of Self-Replication Kinetics(1606.02391)

We briefly review the recently developed, Markov process based isothermal chemical thermodynamics for nonlinear, driven mesoscopic kinetic systems. Both the instantaneous Shannon entropy {\boldmath $S[p_{\alpha}(t)]$} and relative entropy {\boldmath $F[p_{\alpha}(t)]$}, defined based on probability distribution {\boldmath $\{p_{\alpha}(t)\}$}, play prominent roles. The theory is general; and as a special case when a chemical reaction system is situated in an equilibrium environment, it agrees perfectly with Gibbsian chemical thermodynamics: {\boldmath $k_BS$} and {\boldmath $k_BTF$} become thermodynamic entropy and free energy, respectively. We apply this theory to a fully reversible autocatalytic reaction kinetics, represented by a Delbr\"{u}ck-Gillespie process, in a chemostatic nonequilibrium environment. The open, driven chemical system serves as an archetype for biochemical self-replication. The significance of {\em thermodynamically consistent} kinetic coarse-graining is emphasized. In a kinetic system where death of a biological organism is treated as the reversal of its birth, the meaning of mathematically emergent "dissipation", which is not related to the heat measured in terms of {\boldmath $k_BT$}, remains to be further investigated.
• ### Nonlinear Stochastic Dynamics of Complex Systems, I: A Chemical Reaction Kinetic Perspective with Mesoscopic Nonequilibrium Thermodynamics(1605.08070)

We distinguish a mechanical representation of the world in terms of point masses with positions and momenta and the chemical representation of the world in terms of populations of different individuals, each with intrinsic stochasticity, but population wise with statistical rate laws in their syntheses, degradations, spatial diffusion, individual state transitions, and interactions. Such a formal kinetic system in a small volume $V$, like a single cell, can be rigorously treated in terms of a Markov process describing its nonlinear kinetics as well as nonequilibrium thermodynamics at a mesoscopic scale. We introduce notions such as open, driven chemical systems, entropy production, free energy dissipation, etc. Then in the macroscopic limit, we illustrate how two new "laws", in terms of a generalized free energy of the mesoscopic stochastic dynamics, emerge. Detailed balance and complex balance are two special classes of "simple" nonlinear kinetics. Phase transition is intrinsically related to multi-stability and saddle-node bifurcation phenomenon, in the limits of time $t\rightarrow\infty$ and system's size $V\rightarrow\infty$. Using this approach, we re-articulate the notion of inanimate equilibrium branch of a system and nonequilibrium state of a living matter, as originally proposed by Nicolis and Prigogine, and seek a logic consistency between this viewpoint and that of P. W. Anderson and J. J. Hopfield's in which macroscopic law emerges through symmetry breaking.
• ### Nonequilibrium Thermodynamic Formalism of Nonlinear Chemical Reaction Systems with Waage-Guldberg's Law of Mass Action(1601.03158)

April 26, 2016 physics.chem-ph
Macroscopic entropy production $\sigma^{(tot)}$ in the general nonlinear isothermal chemical reaction system with mass action kinetics is decomposed into a free energy dissipation and a house-keeping heat: $\sigma^{(tot)}=\sigma^{(fd)}+\sigma^{(hk)}$; $\sigma^{(fd)}=-\rd A/\rd t$, where $A$ is a generalized free energy function. This yields a novel nonequilibrium free energy balance equation $\rd A/\rd t=-\sigma^{(tot)}+\sigma^{(hk)}$, which is on a par with celebrated entropy balance equation $\rd S/\rd t=\sigma^{(tot)}+\eta^{(ex)}$ where $\eta^{(ex)}$ is the rate of entropy exchange with the environment.For kinetic systems with complex balance, $\sigma^{(fd)}$ and $\sigma^{(hk)}$ are the macroscopic limits of stochastic free energy dissipation and house-keeping heat, which are both nonnegative, in the Delbr\"uck-Gillespie description of the stochastic chemical kinetics.Therefore, we show that a full kinetic and thermodynamic theory of chemical reaction systems that transcends mesoscopic and macroscopic levels emerges.
• ### Entropy Production in Mesoscopic Stochastic Thermodynamics: Nonequilibrium Kinetic Cycles Driven by Chemical Potentials, Temperatures, and Mechanical Forces(1601.04018)

Jan. 15, 2016 cond-mat.stat-mech
Nonequilibrium thermodynamics (NET) investigates processes in systems out of global equilibrium. On a mesoscopic level, it provides a statistical dynamic description of various complex phenomena such as chemical reactions, ion transport, diffusion, thermochemical, thermomechanical and mechanochemical fluxes. In the present review, we introduce a mesoscopic stochastic formulation of NET by analyzing entropy production in several simple examples. The fundamental role of nonequilibrium steady-state cycle kinetics is emphasized. The statistical mechanics of Onsager's reciprocal relations in this context is elucidated. Chemomechanical, thermomechanical, and enzyme-catalyzed thermochemical energy transduction processes are discussed. It is argued that mesoscopic stochastic NET provides a rigorous mathematical basis of fundamental concepts needed for understanding complex processes in chemistry, physics and biology, and which is also relevant for nanoscale technological advances.
• ### Mesoscopic Kinetic Basis of Macroscopic Chemical Thermodynamics: A Mathematical Theory(1601.03159)

From a mathematical model that describes a complex chemical kinetic system of $N$ species and $M$ elementrary reactions in a rapidly stirred vessel of size $V$ as a Markov process, we show that a macroscopic chemical thermodynamics emerges as $V\rightarrow\infty$. The theory is applicable to linear and nonlinear reactions, closed systems reaching chemical equilibrium, or open, driven systems approaching to nonequilibrium steady states. A generalized mesoscopic free energy gives rise to a macroscopic chemical energy function $\varphi^{ss}(\vx)$ where $\vx=(x_1,\cdots,x_N)$ are the concentrations of the $N$ chemical species. The macroscopic chemical dynamics $\vx(t)$ satisfies two emergent laws: (1) $(\rd/\rd t)\varphi^{ss}[\vx(t)]\le 0$, and (2)$(\rd/\rd t)\varphi^{ss}[\vx(t)]=\text{cmf}(\vx)-\sigma(\vx)$ where entropy production rate $\sigma\ge 0$ represents the sink for the chemical energy, and chemical motive force $\text{cmf}\ge 0$ is non-zero if the system is driven under a sustained nonequilibrium chemostat. For systems with detailed balance $\text{cmf}=0$, and if one assumes the law of mass action,$\varphi^{ss}(\vx)$ is precisely the Gibbs' function $\sum_{i=1}^N x_i\big[\mu_i^o+\ln x_i\big]$ for ideal solutions. For a class of kinetic systems called complex balanced, which include many nonlinear systems as well as many simple open, driven chemical systems, the $\varphi^{ss}(\vx)$, with global minimum at $\vx^*$, has the generic form $\sum_{i=1}^N x_i\big[\ln(x_i/x_i^*)-x_i+x_i^*\big]$,which has been known in chemical kinetic literature.Macroscopic emergent "laws" are independent of the details of the underlying kinetics. This theory provides a concrete example from chemistry showing how a dynamic macroscopic law can emerge from the kinetics at a level below.
• ### A Thermodynamic Theory of Ecology: Helmholtz Theorem for Lotka-Volterra Equation, Extended Conservation Law, and Stochastic Predator-Prey Dynamics(1405.4311)

We carry out mathematical analyses, {\em \`{a} la} Helmholtz's and Boltzmann's 1884 studies of monocyclic Newtonian dynamics, for the Lotka-Volterra (LV) equation exhibiting predator-prey oscillations. In doing so a novel "thermodynamic theory" of ecology is introduced. An important feature, absent in the classical mechanics, of ecological systems is a natural stochastic population dynamic formulation of which the deterministic equation (e.g., the LV equation studied) is the infinite population limit. Invariant density for the stochastic dynamics plays a central role in the deterministic LV dynamics. We show how the conservation law along a single trajectory extends to incorporate both variations in a model parameter $\alpha$ and in initial conditions: Helmholtz's theorem establishes a broadly valid conservation law in a class of ecological dynamics. We analyze the relationships among mean ecological activeness $\theta$, quantities characterizing dynamic ranges of populations $\mathcal{A}$ and $\alpha$, and the ecological force $F_{\alpha}$. The analyses identify an entire orbit as a stationary ecology, and establish the notion of "equation of ecological states". Studies of the stochastic dynamics with finite populations show the LV equation as the robust, fast cyclic underlying behavior. The mathematical narrative provides a novel way of capturing long-term dynamical behaviors with an emergent {\em conservative ecology}.
• ### Stochastic phenotype transition of a single cell in an intermediate region of gene-state switching(1312.6776)

Oct. 27, 2015 q-bio.MN
Multiple phenotypic states often arise in a single cell with different gene-expression states that undergo transcription regulation with positive feedback. Recent experiments have shown that at least in E. coli, the gene state switching can be neither extremely slow nor exceedingly rapid as many previous theoretical treatments assumed. Rather it is in the intermediate region which is difficult to handle mathematically.Under this condition, from a full chemical-master-equation description we derive a model in which the protein copy-number, for a given gene state, follow a deterministic mean-field description while the protein synthesis rates fluctuate due to stochastic gene-state switching. The simplified kinetics yields a nonequilibrium landscape function, which, similar to the energy function for equilibrium fluctuation, provides the leading orders of fluctuations around each phenotypic state, as well as the transition rates between the two phenotypic states. This rate formula is analogous to Kramers theory for chemical reactions. The resulting behaviors are significantly different from the two limiting cases studied previously.
• ### Stochastic Free Energies, Conditional Probability and Legendre Transform for Ensemble Change(1112.3075)

This work extends a recently developed mathematical theory of thermodynamics for Markov processes with, and more importantly, without detailed balance. We show that the Legendre transform in connection to ensemble changes in Gibbs' statistical mechanics can be derived from the stochastic theory. We consider the joint probability $p_{XY}$ of two random variables X and Y and the conditional probability $p_{X|Y=y^*}$, with $y^*=<Y>$ according to $p_{XY}$. The stochastic free energies of the XY system (fluctuating Y ensemble) and the $X|Y$ system (fixed Y ensemble) are related by the chain rule for relative entropy. In the thermodynamic limit, defined as $V,Y\to\infty$ (where one assumes Y as an extensive quantity, while V denotes the system size parameter), the marginal probability obeys $p_Y(y)\to \exp(-V\phi(z))$ with $z=y/V$. A conjugate variable $\mu=-\phi(z)/z$ naturally emerges from this result. The stochastic free energies of the fluctuating and fixed ensembles are then related by $F_{XY}=F_{X|Y=y^*}-\mu y^*$, with $\mu=\partial F_{X|Y=y}/\partial y$. The time evolutions for the two free energies are the same: $d[F_{XY}(t)]/dt=\partial [F_{X|Y=y^*(t)}(t)]/ \partial t$. This mathematical theory is applied to systems with fixed and fluctuating number of identical independent random variables (idea gas), as well as to microcanonical systems with uniform stationary probability.
• ### Thermodynamics of the General Diffusion Process: Equilibrium Supercurrent and Nonequilibrium Driven Circulation with Dissipation(1412.5925)

Unbalanced probability circulation, which yields cyclic motions in phase space, is the defining characteristics of a stationary diffusion process without detailed balance. In over-damped soft matter systems, such behavior is a hallmark of the presence of a sustained external driving force accompanied with dissipations. In an under-damped and strongly correlated system, however, cyclic motions are often the consequences of a conservative dynamics. In the present paper, we give a novel interpretation of a class of diffusion processes with stationary circulation in terms of a Maxwell-Boltzmann equilibrium in which cyclic motions are on the level set of stationary probability density function thus non-dissipative, e.g., a supercurrent. This implies an orthogonality between stationary circulation $J^{ss}(x)$ and the gradient of stationary probability density $f^{ss}(x)>0$. A sufficient and necessary condition for the orthogonality is a decomposition of the drift $b(x)=j(x)+ D(x)\nabla\varphi(x)$ where $\nabla\cdot j(x)=0$ and $j(x)$ $\cdot\nabla\varphi(x)=0$. Stationary processes with Maxwell-Boltzmann equilibrium has an underlying conservative dynamics $\dot{x}= j(x)\equiv$ $\big(f^{ss}(x)\big)^{-1}J^{ss}(x)$, and a first integral $\varphi(x)\equiv-\ln f^{ss}(x)=$ const, akin to a Hamiltonian system. At all time, an instantaneous free energy balance equation exists for a given diffusion system; and an extended energy conservation law among a family of diffusion processes with different parameter $\alpha$ can be established via a Helmholtz theorem. For the general diffusion process without the orthogonality, a nonequilibrium cycle emerges, which consists of external driven $\varphi$-ascending steps and spontaneous $\varphi$-descending movements, alternated with iso-$\varphi$ motions. The theory presented here provides a rich mathematical narrative for complex mesoscopic dynamics.
• ### Universal Ideal Behavior and Macroscopic Work Relation of Linear Irreversible Stochastic Thermodynamics(1503.06232)

We revisit the Ornstein-Uhlenbeck (OU) process as the fundamental mathematical description of linear irreversible phenomena, with fluctuations, near an equilibrium. By identifying the underlying circulating dynamics in a stationary process as the natural generalization of classical conservative mechanics, a bridge between a family of OU processes with equilibrium fluctuations and thermodynamics is established through the celebrated Helmholtz theorem. The Helmholtz theorem provides an emergent macroscopic "equation of state" of the entire system, which exhibits a universal ideal thermodynamic behavior. Fluctuating macroscopic quantities are studied from the stochastic thermodynamic point of view and a non-equilibrium work relation is obtained in the macroscopic picture, which may facilitate experimental study and application of the equalities due to Jarzynski, Crooks, and Hatano and Sasa.
• ### Fitness and entropy production in a cell population dynamics with epigenetic phenotype switching(1309.1898)

Aug. 1, 2014 q-bio.PE
Motivated by recent understandings in the stochastic natures of gene expression, biochemical signaling, and spontaneous reversible epigenetic switchings, we study a simple deterministic cell population dynamics in which subpopulations grow with different rates and individual cells can bi-directionally switch between a small number of different epigenetic phenotypes. Two theories in the past, the population dynamics and thermodynamics of master equations, separatedly defined two important concepts in mathematical terms: the {\em fitness} in the former and the (non-adiabatic) {\em entropy production} in the latter. Both play important roles in the evolution of the cell population dynamics. The switching sustains the variations among the subpopulation growth thus continuous natural selection. As a form of Price's equation, the fitness increases with ($i$) natural selection through variations and $(ii)$ a positive covariance between the per capita growth and switching, which represents a Lamarchian-like behavior. A negative covariance balances the natural selection in a fitness steady state | "the red queen" scenario. At the same time the growth keeps the proportions of subpopulations away from the "intrinsic" switching equilibrium of individual cells, thus leads to a continous entropy production. A covariance, between the per capita growth rate and the "chemical potential" of subpopulation, counter-acts the entropy production. Analytical results are obtained for the limiting cases of growth dominating switching and vice versa.
• ### Fluorescence Correlation Spectroscopy and Nonlinear Stochastic Reaction-Diffusion(1406.3432)

June 16, 2014 physics.bio-ph, q-bio.SC
The currently existing theory of fluorescence correlation spectroscopy(FCS) is based on the linear fluctuation theory originally developed by Einstein, Onsager, Lax, and others as a phenomenological approach to equilibrium fluctuations in bulk solutions. For mesoscopic reaction-diffusion systems with nonlinear chemical reactions among a small number of molecules, a situation often encountered in single-cell biochemistry, it is expected that FCS time correlation functions of a reaction-diffusion system can deviate from the classic results of Elson and Magde. We first discuss this nonlinear effect for reaction systems without diffusion. For nonlinear stochastic reaction-diffusion systems here are no closed solutions; therefore, stochastic Monte-Carlo simulations are carried out. We show that the deviation is small for a simple bimolecular reaction; the most significant deviations occur when the number of molecules is small and of the same order. Our results show that current linear FCS theory could be adequate for measurements on biological systems that contain many other sources of uncertainties. At the same time it provides a framework for future measurements of nonlinear, fluctuating chemical reactions with high-precision FCS. Extending Delbr\"uck-Gillespie's theory for stochastic nonlinear reactions with rapidly stirring to reaction-diffusion systems provides a mesoscopic model for chemical and biochemical reactions at nanometric and mesoscopic level such as a single biological cell.