
We consider a discretetime LinearQuadraticGaussian (LQG) control problem
in which Massey's directed information from the observed output of the plant to
the control input is minimized while required control performance is
attainable. This problem arises in several different contexts, including joint
encoder and controller design for datarate minimization in networked control
systems. We show that the optimal control law is a LinearGaussian randomized
policy. We also identify the state space realization of the optimal policy,
which can be synthesized by an efficient algorithm based on semidefinite
programming. Our structural result indicates that the filtercontroller
separation principle from the LQG control theory, and the sensorfilter
separation principle from the zerodelay ratedistortion theory for
GaussMarkov sources hold simultaneously in the considered problem. A
connection to the datarate theorem for meansquare stability by Nair and Evans
is also established.

We consider a class of nonlinear dynamics on a graph that contains and
generalizes various models from network systems and control and study
convergence to uniform agreement states using gradient methods. In particular,
under the assumption of detailed balance, we provide a method to formulate the
governing ODE system in gradient descent form of sumseparable energy
functions, which thus represent a class of Lyapunov functions; this class
coincides with Csisz\'{a}r's information divergences. Our approach bases on a
transformation of the original problem to a masspreserving transport problem
and it reflects a littlenoticed general structure result for passive network
synthesis obtained by B.D.O. Anderson and P.J. Moylan in 1975. The proposed
gradient formulation extends known gradient results in dynamical systems
obtained recently by M. Erbar and J. Maas in the context of porous medium
equations. Furthermore, we exhibit a novel relationship between inhomogeneous
Markov chains and passive nonlinear circuits through gradient systems, and
show that passivity of resistor elements is equivalent to strict convexity of
sumseparable stored energy. Eventually, we discuss our results at the
intersection of Markov chains and network systems under sinusoidal coupling.

Sequential ratedistortion (SRD) theory provides a framework for studying the
fundamental tradeoff between datarate and dataquality in realtime
communication systems. In this paper, we consider the SRD problem for
multidimensional timevarying GaussMarkov processes under meansquare
distortion criteria. We first revisit the sensorestimator separation
principle, which asserts that considered SRD problem is equivalent to a joint
sensor and estimator design problem in which datarate of the sensor output is
minimized while the estimator's performance satisfies the distortion criteria.
We then show that the optimal joint design can be performed by semidefinite
programming. A semidefinite representation of the corresponding SRD function is
obtained. Implications of the obtained result in the context of zerodelay
source coding theory and applications to networked control theory are also
discussed.

In this theoretical study, we determine the maximum amount of work
extractable in finite time by a demon performing continuous measurements on a
quadratic Hamiltonian system subjected to thermal fluctuations, in terms of the
information extracted from the system. This is in contrast to many recent
studies that focus on demons' maximizing the extracted work over received
information, and operate close to equilibrium. The maximum work demon is found
to apply a highgain continuous feedback using a KalmanBucy estimate of the
system state. A simple and concrete electrical implementation of the feedback
protocol is proposed, which allows for analytic expressions of the flows of
energy and entropy inside the demon. This let us show that any implementation
of the demon must necessarily include an external power source, which we prove
both from classical thermodynamics arguments and from a version of Landauer's
memory erasure argument extended to nonequilibrium linear systems.

Given the possibility of communication systems failing catastrophically, we
investigate limits to communicating over channels that fail at random times.
These channels are finitestate semiMarkov channels. We show that
communication with arbitrarily small probability of error is not possible.
Making use of results in finite blocklength channel coding, we determine
sequences of blocklengths that optimize transmission volume communicated at
fixed maximum message error probabilities. We provide a partial ordering of
communication channels. A dynamic programming formulation is used to show the
structural result that channel state feedback does not improve performance.