
Synaptic connections between neurons in the brain are dynamic because of
continuously ongoing spine dynamics, axonal sprouting, and other processes. In
fact, it was recently shown that the spontaneous synapseautonomous component
of spine dynamics is at least as large as the component that depends on the
history of pre and postsynaptic neural activity. These data are inconsistent
with common models for network plasticity, and raise the questions how neural
circuits can maintain a stable computational function in spite of these
continuously ongoing processes, and what functional uses these ongoing
processes might have. Here, we present a rigorous theoretical framework for
these seemingly stochastic spine dynamics and rewiring processes in the context
of rewardbased learning tasks. We show that spontaneous synapseautonomous
processes, in combination with reward signals such as dopamine, can explain the
capability of networks of neurons in the brain to configure themselves for
specific computational tasks, and to compensate automatically for later changes
in the network or task. Furthermore we show theoretically and through computer
simulations that stable computational performance is compatible with
continuously ongoing synapseautonomous changes. After reaching good
computational performance it causes primarily a slow drift of network
architecture and dynamics in taskirrelevant dimensions, as observed for neural
activity in motor cortex and other areas. On the more abstract level of
reinforcement learning the resulting model gives rise to an understanding of
rewarddriven network plasticity as continuous sampling of network
configurations.

The reliable and precise generation of quantum unitary transformations is
essential to the realization of a number of fundamental objectives, such as
quantum control and quantum information processing. Prior work has explored the
optimal control problem of generating such unitary transformations as a surface
optimization problem over the quantum control landscape, defined as a metric
for realizing a desired unitary transformation as a function of the control
variables. It was found that under the assumption of nondissipative and
controllable dynamics, the landscape topology is trapfree, implying that any
reasonable optimization heuristic should be able to identify globally optimal
solutions. The present work is a control landscape analysis incorporating
specific constraints in the Hamiltonian corresponding to certain dynamical
symmetries in the underlying physical system. It is found that the presence of
such symmetries does not destroy the trapfree topology. These findings expand
the class of quantum dynamical systems on which control problems are
intrinsically amenable to solution by optimal control.

A quantum control landscape is defined as the physical objective as a
function of the control variables to be optimized. Analyzing the topology of
these landscapes is important for understanding the origins of the increasing
number of laboratory successes in the optimal control of quantum processes.
This paper proposes a simple scheme to compute the characteristics of the
critical topology of the quantum ensemble control landscapes for observables,
showing that the set of disjoint critical submanifolds onetoone corresponds
to a finite number of contingency tables that solely depend on the degeneracy
structure of the eigenvalues of the initial system density matrix and the
observable to be controlled. The landscape characteristics can be calculated as
functions of the table entries, including the dimensions and the numbers of
positive and negative eigenvalues of the Hessian quadratic form of each of the
connected components of the critical submanifolds. Typical examples are given
to illustrate the effectiveness of this method.

A quantum control landscape is defined as the observable as a function(al) of
the system control variables. Such landscapes were introduced to provide a
basis to understand the increasing number of successful experiments controlling
quantum dynamics phenomena. This paper extends the concept to encompass the
broader context of the environment having an influence. For the case that the
open system dynamics are fully controllable, it is shown that the control
landscape for open systems can be lifted to the analysis of an equivalent
auxiliary landscape of a closed composite system that contains the
environmental interactions. This inherent connection can be analyzed to provide
relevant information about the topology of the original open system landscape.
Application to the optimization of an observable expectation value reveals the
same landscape simplicity observed in former studies on closed systems. In
particular, no false suboptimal traps exist in the system control landscape
when seeking to optimize an observable, even in the presence of complex
environments. Moreover, a quantitative study of the control landscape of a
system interacting with a thermal environment shows that the enhanced
controllability attainable with open dynamics significantly broadens the range
of the achievable observable values over the control landscape.