
There is a growing awareness that catastrophic phenomena in biology and
medicine can be mathematically represented in terms of saddlenode
bifurcations. In particular, the term `tipping', or critical transition has in
recent years entered the discourse of the general public in relation to
ecology, medicine, and public health. The saddlenode bifurcation and its
associated theory of catastrophe as put forth by Thom and Zeeman has seen
applications in a wide range of fields including molecular biophysics,
mesoscopic physics, and climate science. In this paper, we investigate a simple
model of a nonautonomous system with a timedependent parameter $p(\tau)$ and
its corresponding `dynamic' (timedependent) saddlenode bifurcation by the
modern theory of nonautonomous dynamical systems. We show that the actual
point of no return for a system undergoing tipping can be significantly delayed
in comparison to the {\em breaking time} $\hat{\tau}$ at which the
corresponding autonomous system with a timeindependent parameter $p_{a}=
p(\hat{\tau})$ undergoes a bifurcation. A dimensionless parameter
$\alpha=\lambda p_0^3V^{2}$ is introduced, in which $\lambda$ is the curvature
of the autonomous saddlenode bifurcation according to parameter $p(\tau)$,
which has an initial value of $p_{0}$ and a constant rate of change $V$. We
find that the breaking time $\hat{\tau}$ is always less than the actual point
of no return $\tau^*$ after which the critical transition is irreversible;
specifically, the relation $\tau^*\hat{\tau}\simeq 2.338(\lambda
V)^{\frac{1}{3}}$ is analytically obtained. For a system with a small $\lambda
V$, there exists a significant window of opportunity $(\hat{\tau},\tau^*)$
during which rapid reversal of the environment can save the system from
catastrophe.

We study finite state random dynamical systems (RDS) and their induced Markov
chains (MC) as stochastic models for complex dynamics. The linear
representation of deterministic maps in RDS are matrixvalued random variables
whose expectations correspond to the transition matrix of the MC. The
instantaneous Gibbs entropy, ShannonKhinchin entropy per step, and the entropy
production rate of the MC are discussed. These three concepts as key anchor
points in stochastic dynamics, characterize respectively the uncertainties of
the system at instant time $t$, the randomness generated per step, and the
dynamical asymmetry with respect to time reversal. The entropy production rate,
expressed in terms of the cycle distributions, has found an expression in terms
of the probability of the deterministic maps with the single attractor in the
maximum entropy RDS. For finite RDS with invertible transformations, the
nonnegative entropy production rate of its MC is bounded above by the
KullbackLeibler divergence of the probability of the deterministic maps with
respect to its timereversal dual probability.

Smoluchowski's model for diffusioninfluenced reactions (A+B > C) can be
formulated within two frameworks: the probabilisticbased approach for a pair
A,B of reacting particles; and the concentrationbased approach for systems in
contact with a bath that generates a concentration gradient of B particles that
interact with A. Although these two approaches are mathematically similar, it
is not straightforward to establish a precise mathematical relationship between
them. Determining this relationship is essential to derive particlebased
numerical methods that are quantitatively consistent with bulk concentration
dynamics. In this work, we determine the relationship between the two
approaches by introducing the grand canonical Smoluchowski master equation
(GCSME), which consists of a continuoustime Markov chain that models an
arbitrary number of B particles, each one of them following Smoluchowski's
probabilistic dynamics. We show the GCSME recovers the concentrationbased
approach by taking either the hydrodynamic or the large copy number limit,
resembling Kurtz's limiting behavior for the chemical master equation. In
addition, we show the GCSME provides a clear statistical mechanical
interpretation of the concentrationbased approach and yields an emergent
chemical potential for nonequilibrium, spatially inhomogeneous reaction
processes. We further exploit the GCSME robust framework to accurately derive
multiscale/hybrid numerical methods that couple particlebased
reactiondiffusion simulations with bulk concentration descriptions, as
described in detail through two computational implementations.

The transient response to a stimulus and subsequent recovery to a steady
state are the fundamental characteristics of a living organism. Here we study
the relaxation kinetics of autoregulatory gene networks based on the chemical
master equation model of singlecell stochastic gene expression with nonlinear
feedback regulation. We report a novel relation between the rate of relaxation,
characterized by the spectral gap of the Markov model, and the feedback sign of
the underlying gene circuit. When a network has no feedback, the relaxation
rate is exactly the decaying rate of the protein. We further show that positive
feedback always slows down the relaxation kinetics while negative feedback
always speeds it up. Numerical simulations demonstrate that this relation
provides a possible method to infer the feedback topology of autoregulatory
gene networks by using timeseries data of gene expression.

Recent advances of derivativefree optimization allow efficient approximating
the global optimal solutions of sophisticated functions, such as functions with
many local optima, nondifferentiable and noncontinuous functions. This
article describes the ZOOpt (https://github.com/eyounx/ZOOpt) toolbox that
provides efficient derivativefree solvers and are designed easy to use. ZOOpt
provides a Python package for singlethread optimization, and a lightweighted
distributed version with the help of the Julia language for Python described
functions. ZOOpt toolbox particularly focuses on optimization problems in
machine learning, addressing highdimensional, noisy, and largescale problems.
The toolbox is being maintained toward readytouse tool in realworld machine
learning tasks.

Inference in hidden Markov model has been challenging in terms of scalability
due to dependencies in the observation data. In this paper, we utilize the
inherent memory decay in hidden Markov models, such that the forward and
backward probabilities can be carried out with subsequences, enabling efficient
inference over long sequences of observations. We formulate this forward
filtering process in the setting of the random dynamical system and there exist
Lyapunov exponents in the i.i.d random matrices production. And the rate of the
memory decay is known as $\lambda_2\lambda_1$, the gap of the top two Lyapunov
exponents almost surely. An efficient and accurate algorithm is proposed to
numerically estimate the gap after the softmax parametrization. The length of
subsequences $B$ given the controlled error $\epsilon$ is
$B=\log(\epsilon)/(\lambda_2\lambda_1)$. We theoretically prove the validity
of the algorithm and demonstrate the effectiveness with numerical examples. The
method developed here can be applied to widely used algorithms, such as
minibatch stochastic gradient method. Moreover, the continuity of Lyapunov
spectrum ensures the estimated $B$ could be reused for the nearby parameter
during the inference.

We show a stochastic, kinematic description of a dynamics has a hidden
energetic and thermodynamic structure. An energy function $\varphi(x)$ emerges
as the limit of the generalized free energy of the stochastic dynamics with
vanishing noise. In terms of the $\varphi$ and its orthogonal field
$\gamma(x)\perp\nabla\varphi$, a general vector field $b(x)$ is decomposed into
$D(x)\nabla\varphi+\gamma$, where
$\nabla\cdot\big(\omega(x)\gamma(x)\big)=\nabla\omega D(x)\nabla\varphi$,
$D(x)$ and $\omega(x)$ represent the local geometry and density in the state
space at $x$. $\varphi(x)$ and $\omega(x)$ are interpreted as the emergent
energy and degeneracy of the motion, with energy balance equation
$d\varphi(x(t))/dt=\gamma D^{1}\gammab D^{1} b$. The partition function and
J. W. Gibbs' method of statistical ensemble change naturally arise. The present
theory provides a mathematical basis for P. W. Anderson's emergent behavior in
the hierarchical structure of science.

Singlecell gene expression is inherently stochastic, its emergent behavior
can be defined in terms of the chemical master equation describing the
evolution of the mRNA and protein copy numbers as the latter
$N\rightarrow\infty$. We establish two types of "macroscopic limits": the Kurtz
limit is consistent with the classical chemical kinetics, while the L\'evy
limit provides a theoretical foundation for an empirical equation proposed in
[Phys. Rev. Lett. 97:168302, 2006]. Furthermore, we clarify the biochemical
implications and ranges of applicability for various macroscopic limits and
calculate a comprehensive analytic expression for the protein concentration
distribution in autoregulatory gene networks. The relationship between our work
and modern population genetics is discussed.

We revisit the celebrated WilemskiFixman (WF) treatment for the looping time
of a freedraining polymer. The WF theory introduces a sink term into the
FokkerPlanck equation for the $3(N+1)$dimensional OrnsteinUhlenbeck process
of the polymer dynamics, which accounts for the appropriate boundary condition
due to the formation of a loop. The assumption for WF theory is considerably
relaxed. A perturbation method approach is developed that justifies and
generalizes the previous results using either a Delta sink or a Heaviside sink.
For both types of sinks, we show that under the condition of a small
dimensionless $\epsilon$, the ratio of capture radius to the Kuhn length, we
are able to systematically produce all known analytical and asymptotic results
obtained by other methods. This includes most notably the transition regime
between the $N^2$ scaling of Doi, and $N\sqrt{N}/\epsilon$ scaling of Szabo,
Schulten, and Schulten. The mathematical issue at play is the nonuniform
convergence of $\epsilon\to 0$ and $N\to\infty$, the latter being an inherent
part of the theory of a Gaussian polymer. Our analysis yields a novel term in
the analytical expression for the looping time with small $\epsilon$, which is
previously unknown. Monte Carlo numerical simulations corroborate the
analytical findings. The systematic method developed here can be applied to
other systems modeled by multidimensional Smoluchowski equations.

By integrating 4 lines of thoughts: symmetry breaking originally advanced by
Anderson, bifurcation from nonlinear dynamics, Landau's theory of phase
transition, and the mechanism of emergent rare events studied by Kramers, we
introduce a possible framework for understanding mesoscopic dynamics that links
(i) fast lower level microscopic motions, (ii) movements within each basin at
the midlevel, and (iii) higherlevel rare transitions between neighboring
basins, which have rates that decrease exponentially with the size of the
system. In this mesoscopic framework, multiple attractors arise as emergent
properties of the nonlinear systems. The interplay between the stochasticity
and nonlinearity leads to successive jumplike transitions among different
basins. We argue each transition is a dynamic symmetry breaking, with the
potential of exhibiting ThomZeeman catastrophe as well as phase transition
with the breakdown of ergodicity (e.g., cell differentiation). The slowtime
dynamics of the nonlinear mesoscopic system is not deterministic, rather it is
a discrete stochastic jump process. The existence of these discrete states and
the Markov transitions among them are both emergent phenomena. This emergent
stochastic jump dynamics then serves as the stochastic element for the
nonlinear dynamics of a higher level aggregates on an even larger spatial and
slower time scales (e.g., evolution). This description captures the
hierarchical structure outlined by Anderson and illustrates two distinct types
of limit of a mesoscopic dynamics: A longtime ensemble thermodynamics in terms
of time $t$ tending infinity followed by the size of the system $N$ tending
infinity, and a shorttime trajectory steady state with $N$ tending infinity
followed by $t$ tending infinity. With these limits, symmetry breaking and cusp
catastrophe are two perspectives of the same mesoscopic system on different
time scales.

The classical models for irreversible diffusioninfluenced reactions can be
derived by introducing absorbing boundary conditions to overdamped continuous
Brownian motion (BM) theory. As there is a clear corresponding stochastic
process, the mathematical description takes both Kolmogorov forward equation
for the evolution of the probability distribution function and the stochastic
sample trajectories. This dual description is a fundamental characteristic of
stochastic processes and allows simple particle based simulations to accurately
match the expected statistical behavior. However, in the traditional theory
using the backreaction boundary condition to model reversible reactions with
geminate recombinations, several subtleties arise: it is unclear what the
underlying stochastic process is, which causes complications in producing
accurate simulations; and it is nontrivial how to perform an appropriate
discretization for numerical computations. In this work, we derive a discrete
stochastic model that recovers the classical models and their boundary
conditions in the continuous limit. In the case of reversible reactions, we
recover the backreaction boundary condition, unifying the backreaction
approach with those of current simulation packages. Furthermore, all the
complications encountered in the continuous models become trivial in the
discrete model. Our formulation brings to attention the question: With
computations in mind, can we develop a discrete reaction kinetics model that is
more fundamental than its continuous counterpart?

This paper studies a mathematical formalism of nonequilibrium thermodynamics
for chemical reaction models with $N$ species, $M$ reactions, and general rate
law. We establish a mathematical basis for J. W. Gibbs' macroscopic chemical
thermodynamics under G. N. Lewis' kinetic law of entire equilibrium (detailed
balance in nonlinear chemistry kinetics). In doing so, the equilibrium
thermodynamics is then naturally generalized to nonequilibrium settings without
detailed balance. The kinetic models are represented by a Markovian jumping
process. A generalized macroscopic chemical free energy function and its
associated balance equation with nonnegative source and sink are the major
discoveries. The proof is based on the large deviation principle of this type
of Markov processes. A general fluctuation dissipation theorem for stochastic
reaction kinetics is also proved. The mathematical theory illustrates how a
novel macroscopic dynamic law can emerges from the mesoscopic kinetics in a
multiscale system.

In this paper we revisit the notion of the "minus logarithm of stationary
probability" as a generalized potential in nonequilibrium systems and attempt
to illustrate its central role in an axiomatic approach to stochastic
nonequilibrium thermodynamics of complex systems. It is demonstrated that this
quantity arises naturally through both monotonicity results of Markov processes
and as the rate function when a stochastic process approaches a deterministic
limit. We then undertake a more detailed mathematical analysis of the
consequences of this quantity, culminating in a necessary and sufficient
condition for the criticality of stochastic systems. This condition is then
discussed in the context of recent results about criticality in biological
systems

We briefly review the recently developed, Markov process based isothermal
chemical thermodynamics for nonlinear, driven mesoscopic kinetic systems. Both
the instantaneous Shannon entropy {\boldmath $S[p_{\alpha}(t)]$} and relative
entropy {\boldmath $F[p_{\alpha}(t)]$}, defined based on probability
distribution {\boldmath $\{p_{\alpha}(t)\}$}, play prominent roles. The theory
is general; and as a special case when a chemical reaction system is situated
in an equilibrium environment, it agrees perfectly with Gibbsian chemical
thermodynamics: {\boldmath $k_BS$} and {\boldmath $k_BTF$} become thermodynamic
entropy and free energy, respectively. We apply this theory to a fully
reversible autocatalytic reaction kinetics, represented by a
Delbr\"{u}ckGillespie process, in a chemostatic nonequilibrium environment.
The open, driven chemical system serves as an archetype for biochemical
selfreplication. The significance of {\em thermodynamically consistent}
kinetic coarsegraining is emphasized. In a kinetic system where death of a
biological organism is treated as the reversal of its birth, the meaning of
mathematically emergent "dissipation", which is not related to the heat
measured in terms of {\boldmath $k_BT$}, remains to be further investigated.

We distinguish a mechanical representation of the world in terms of point
masses with positions and momenta and the chemical representation of the world
in terms of populations of different individuals, each with intrinsic
stochasticity, but population wise with statistical rate laws in their
syntheses, degradations, spatial diffusion, individual state transitions, and
interactions. Such a formal kinetic system in a small volume $V$, like a single
cell, can be rigorously treated in terms of a Markov process describing its
nonlinear kinetics as well as nonequilibrium thermodynamics at a mesoscopic
scale. We introduce notions such as open, driven chemical systems, entropy
production, free energy dissipation, etc. Then in the macroscopic limit, we
illustrate how two new "laws", in terms of a generalized free energy of the
mesoscopic stochastic dynamics, emerge. Detailed balance and complex balance
are two special classes of "simple" nonlinear kinetics. Phase transition is
intrinsically related to multistability and saddlenode bifurcation
phenomenon, in the limits of time $t\rightarrow\infty$ and system's size
$V\rightarrow\infty$. Using this approach, we rearticulate the notion of
inanimate equilibrium branch of a system and nonequilibrium state of a living
matter, as originally proposed by Nicolis and Prigogine, and seek a logic
consistency between this viewpoint and that of P. W. Anderson and J. J.
Hopfield's in which macroscopic law emerges through symmetry breaking.

Macroscopic entropy production $\sigma^{(tot)}$ in the general nonlinear
isothermal chemical reaction system with mass action kinetics is decomposed
into a free energy dissipation and a housekeeping heat:
$\sigma^{(tot)}=\sigma^{(fd)}+\sigma^{(hk)}$; $\sigma^{(fd)}=\rd A/\rd t$,
where $A$ is a generalized free energy function. This yields a novel
nonequilibrium free energy balance equation $\rd A/\rd
t=\sigma^{(tot)}+\sigma^{(hk)}$, which is on a par with celebrated entropy
balance equation $\rd S/\rd t=\sigma^{(tot)}+\eta^{(ex)}$ where $\eta^{(ex)}$
is the rate of entropy exchange with the environment.For kinetic systems with
complex balance, $\sigma^{(fd)}$ and $\sigma^{(hk)}$ are the macroscopic limits
of stochastic free energy dissipation and housekeeping heat, which are both
nonnegative, in the Delbr\"uckGillespie description of the stochastic chemical
kinetics.Therefore, we show that a full kinetic and thermodynamic theory of
chemical reaction systems that transcends mesoscopic and macroscopic levels
emerges.

Nonequilibrium thermodynamics (NET) investigates processes in systems out of
global equilibrium. On a mesoscopic level, it provides a statistical dynamic
description of various complex phenomena such as chemical reactions, ion
transport, diffusion, thermochemical, thermomechanical and mechanochemical
fluxes. In the present review, we introduce a mesoscopic stochastic formulation
of NET by analyzing entropy production in several simple examples. The
fundamental role of nonequilibrium steadystate cycle kinetics is emphasized.
The statistical mechanics of Onsager's reciprocal relations in this context is
elucidated. Chemomechanical, thermomechanical, and enzymecatalyzed
thermochemical energy transduction processes are discussed. It is argued that
mesoscopic stochastic NET provides a rigorous mathematical basis of fundamental
concepts needed for understanding complex processes in chemistry, physics and
biology, and which is also relevant for nanoscale technological advances.

From a mathematical model that describes a complex chemical kinetic system of
$N$ species and $M$ elementrary reactions in a rapidly stirred vessel of size
$V$ as a Markov process, we show that a macroscopic chemical thermodynamics
emerges as $V\rightarrow\infty$. The theory is applicable to linear and
nonlinear reactions, closed systems reaching chemical equilibrium, or open,
driven systems approaching to nonequilibrium steady states. A generalized
mesoscopic free energy gives rise to a macroscopic chemical energy function
$\varphi^{ss}(\vx)$ where $\vx=(x_1,\cdots,x_N)$ are the concentrations of the
$N$ chemical species. The macroscopic chemical dynamics $\vx(t)$ satisfies two
emergent laws: (1) $(\rd/\rd t)\varphi^{ss}[\vx(t)]\le 0$, and (2)$(\rd/\rd
t)\varphi^{ss}[\vx(t)]=\text{cmf}(\vx)\sigma(\vx)$ where entropy production
rate $\sigma\ge 0$ represents the sink for the chemical energy, and chemical
motive force $\text{cmf}\ge 0$ is nonzero if the system is driven under a
sustained nonequilibrium chemostat. For systems with detailed balance
$\text{cmf}=0$, and if one assumes the law of mass action,$\varphi^{ss}(\vx)$
is precisely the Gibbs' function $\sum_{i=1}^N x_i\big[\mu_i^o+\ln x_i\big]$
for ideal solutions. For a class of kinetic systems called complex balanced,
which include many nonlinear systems as well as many simple open, driven
chemical systems, the $\varphi^{ss}(\vx)$, with global minimum at $\vx^*$, has
the generic form $\sum_{i=1}^N x_i\big[\ln(x_i/x_i^*)x_i+x_i^*\big]$,which has
been known in chemical kinetic literature.Macroscopic emergent "laws" are
independent of the details of the underlying kinetics. This theory provides a
concrete example from chemistry showing how a dynamic macroscopic law can
emerge from the kinetics at a level below.

We carry out mathematical analyses, {\em \`{a} la} Helmholtz's and
Boltzmann's 1884 studies of monocyclic Newtonian dynamics, for the
LotkaVolterra (LV) equation exhibiting predatorprey oscillations. In doing so
a novel "thermodynamic theory" of ecology is introduced. An important feature,
absent in the classical mechanics, of ecological systems is a natural
stochastic population dynamic formulation of which the deterministic equation
(e.g., the LV equation studied) is the infinite population limit. Invariant
density for the stochastic dynamics plays a central role in the deterministic
LV dynamics. We show how the conservation law along a single trajectory extends
to incorporate both variations in a model parameter $\alpha$ and in initial
conditions: Helmholtz's theorem establishes a broadly valid conservation law in
a class of ecological dynamics. We analyze the relationships among mean
ecological activeness $\theta$, quantities characterizing dynamic ranges of
populations $\mathcal{A}$ and $\alpha$, and the ecological force $F_{\alpha}$.
The analyses identify an entire orbit as a stationary ecology, and establish
the notion of "equation of ecological states". Studies of the stochastic
dynamics with finite populations show the LV equation as the robust, fast
cyclic underlying behavior. The mathematical narrative provides a novel way of
capturing longterm dynamical behaviors with an emergent {\em conservative
ecology}.

Multiple phenotypic states often arise in a single cell with different
geneexpression states that undergo transcription regulation with positive
feedback. Recent experiments have shown that at least in E. coli, the gene
state switching can be neither extremely slow nor exceedingly rapid as many
previous theoretical treatments assumed. Rather it is in the intermediate
region which is difficult to handle mathematically.Under this condition, from a
full chemicalmasterequation description we derive a model in which the
protein copynumber, for a given gene state, follow a deterministic meanfield
description while the protein synthesis rates fluctuate due to stochastic
genestate switching. The simplified kinetics yields a nonequilibrium landscape
function, which, similar to the energy function for equilibrium fluctuation,
provides the leading orders of fluctuations around each phenotypic state, as
well as the transition rates between the two phenotypic states. This rate
formula is analogous to Kramers theory for chemical reactions. The resulting
behaviors are significantly different from the two limiting cases studied
previously.

This work extends a recently developed mathematical theory of thermodynamics
for Markov processes with, and more importantly, without detailed balance. We
show that the Legendre transform in connection to ensemble changes in Gibbs'
statistical mechanics can be derived from the stochastic theory. We consider
the joint probability $p_{XY}$ of two random variables X and Y and the
conditional probability $p_{XY=y^*}$, with $y^*=<Y>$ according to $p_{XY}$.
The stochastic free energies of the XY system (fluctuating Y ensemble) and the
$XY$ system (fixed Y ensemble) are related by the chain rule for relative
entropy. In the thermodynamic limit, defined as $V,Y\to\infty$ (where one
assumes Y as an extensive quantity, while V denotes the system size parameter),
the marginal probability obeys $p_Y(y)\to \exp(V\phi(z))$ with $z=y/V$. A
conjugate variable $\mu=\phi(z)/z$ naturally emerges from this result. The
stochastic free energies of the fluctuating and fixed ensembles are then
related by $F_{XY}=F_{XY=y^*}\mu y^*$, with $\mu=\partial F_{XY=y}/\partial
y$. The time evolutions for the two free energies are the same:
$d[F_{XY}(t)]/dt=\partial [F_{XY=y^*(t)}(t)]/ \partial t$. This mathematical
theory is applied to systems with fixed and fluctuating number of identical
independent random variables (idea gas), as well as to microcanonical systems
with uniform stationary probability.

Unbalanced probability circulation, which yields cyclic motions in phase
space, is the defining characteristics of a stationary diffusion process
without detailed balance. In overdamped soft matter systems, such behavior is
a hallmark of the presence of a sustained external driving force accompanied
with dissipations. In an underdamped and strongly correlated system, however,
cyclic motions are often the consequences of a conservative dynamics. In the
present paper, we give a novel interpretation of a class of diffusion processes
with stationary circulation in terms of a MaxwellBoltzmann equilibrium in
which cyclic motions are on the level set of stationary probability density
function thus nondissipative, e.g., a supercurrent. This implies an
orthogonality between stationary circulation $J^{ss}(x)$ and the gradient of
stationary probability density $f^{ss}(x)>0$. A sufficient and necessary
condition for the orthogonality is a decomposition of the drift $b(x)=j(x)+
D(x)\nabla\varphi(x)$ where $\nabla\cdot j(x)=0$ and $j(x)$
$\cdot\nabla\varphi(x)=0$. Stationary processes with MaxwellBoltzmann
equilibrium has an underlying conservative dynamics $\dot{x}= j(x)\equiv$
$\big(f^{ss}(x)\big)^{1}J^{ss}(x)$, and a first integral $\varphi(x)\equiv\ln
f^{ss}(x)=$ const, akin to a Hamiltonian system. At all time, an instantaneous
free energy balance equation exists for a given diffusion system; and an
extended energy conservation law among a family of diffusion processes with
different parameter $\alpha$ can be established via a Helmholtz theorem. For
the general diffusion process without the orthogonality, a nonequilibrium cycle
emerges, which consists of external driven $\varphi$ascending steps and
spontaneous $\varphi$descending movements, alternated with iso$\varphi$
motions. The theory presented here provides a rich mathematical narrative for
complex mesoscopic dynamics.

We revisit the OrnsteinUhlenbeck (OU) process as the fundamental
mathematical description of linear irreversible phenomena, with fluctuations,
near an equilibrium. By identifying the underlying circulating dynamics in a
stationary process as the natural generalization of classical conservative
mechanics, a bridge between a family of OU processes with equilibrium
fluctuations and thermodynamics is established through the celebrated Helmholtz
theorem. The Helmholtz theorem provides an emergent macroscopic "equation of
state" of the entire system, which exhibits a universal ideal thermodynamic
behavior. Fluctuating macroscopic quantities are studied from the stochastic
thermodynamic point of view and a nonequilibrium work relation is obtained in
the macroscopic picture, which may facilitate experimental study and
application of the equalities due to Jarzynski, Crooks, and Hatano and Sasa.

Motivated by recent understandings in the stochastic natures of gene
expression, biochemical signaling, and spontaneous reversible epigenetic
switchings, we study a simple deterministic cell population dynamics in which
subpopulations grow with different rates and individual cells can
bidirectionally switch between a small number of different epigenetic
phenotypes. Two theories in the past, the population dynamics and
thermodynamics of master equations, separatedly defined two important concepts
in mathematical terms: the {\em fitness} in the former and the (nonadiabatic)
{\em entropy production} in the latter. Both play important roles in the
evolution of the cell population dynamics. The switching sustains the
variations among the subpopulation growth thus continuous natural selection. As
a form of Price's equation, the fitness increases with ($i$) natural selection
through variations and $(ii)$ a positive covariance between the per capita
growth and switching, which represents a Lamarchianlike behavior. A negative
covariance balances the natural selection in a fitness steady state  "the red
queen" scenario. At the same time the growth keeps the proportions of
subpopulations away from the "intrinsic" switching equilibrium of individual
cells, thus leads to a continous entropy production. A covariance, between the
per capita growth rate and the "chemical potential" of subpopulation,
counteracts the entropy production. Analytical results are obtained for the
limiting cases of growth dominating switching and vice versa.

The currently existing theory of fluorescence correlation spectroscopy(FCS)
is based on the linear fluctuation theory originally developed by Einstein,
Onsager, Lax, and others as a phenomenological approach to equilibrium
fluctuations in bulk solutions. For mesoscopic reactiondiffusion systems with
nonlinear chemical reactions among a small number of molecules, a situation
often encountered in singlecell biochemistry, it is expected that FCS time
correlation functions of a reactiondiffusion system can deviate from the
classic results of Elson and Magde. We first discuss this nonlinear effect for
reaction systems without diffusion. For nonlinear stochastic reactiondiffusion
systems here are no closed solutions; therefore, stochastic MonteCarlo
simulations are carried out. We show that the deviation is small for a simple
bimolecular reaction; the most significant deviations occur when the number of
molecules is small and of the same order. Our results show that current linear
FCS theory could be adequate for measurements on biological systems that
contain many other sources of uncertainties. At the same time it provides a
framework for future measurements of nonlinear, fluctuating chemical reactions
with highprecision FCS. Extending Delbr\"uckGillespie's theory for stochastic
nonlinear reactions with rapidly stirring to reactiondiffusion systems
provides a mesoscopic model for chemical and biochemical reactions at
nanometric and mesoscopic level such as a single biological cell.