Synaptic plasticity is implemented and controlled through over thousand different types of molecules in the postsynaptic density and presynaptic boutons that assume a staggering array of different states through phosporylation and other mechanisms. One of the most prominent molecule in the postsynaptic density is CaMKII, that is described in molecular biology as a "memory molecule" that can integrate through auto-phosporylation Ca-influx signals on a relatively large time scale of dozens of seconds. The functional impact of this memory mechanism is largely unknown. We show that the experimental data on the specific role of CaMKII activation in dopamine-gated spine consolidation suggest a general functional role in speeding up reward-guided search for network configurations that maximize reward expectation. Our theoretical analysis shows that stochastic search could in principle even attain optimal network configurations by emulating one of the most well-known nonlinear optimization methods, simulated annealing. But this optimization is usually impeded by slowness of stochastic search at a given temperature. We propose that CaMKII contributes a momentum term that substantially speeds up this search. In particular, it allows the network to overcome saddle points of the fitness function. The resulting improved stochastic policy search can be understood on a more abstract level as Hamiltonian sampling, which is known to be one of the most efficient stochastic search methods.

Neuromorphic hardware tends to pose limits on the connectivity of deep networks that one can run on them. But also generic hardware and software implementations of deep learning run more efficiently for sparse networks. Several methods exist for pruning connections of a neural network after it was trained without connectivity constraints. We present an algorithm, DEEP R, that enables us to train directly a sparsely connected neural network. DEEP R automatically rewires the network during supervised training so that connections are there where they are most needed for the task, while its total number is all the time strictly bounded. We demonstrate that DEEP R can be used to train very sparse feedforward and recurrent neural networks on standard benchmark tasks with just a minor loss in performance. DEEP R is based on a rigorous theoretical foundation that views rewiring as stochastic sampling of network configurations from a posterior.

Synaptic connections between neurons in the brain are dynamic because of continuously ongoing spine dynamics, axonal sprouting, and other processes. In fact, it was recently shown that the spontaneous synapse-autonomous component of spine dynamics is at least as large as the component that depends on the history of pre- and postsynaptic neural activity. These data are inconsistent with common models for network plasticity, and raise the questions how neural circuits can maintain a stable computational function in spite of these continuously ongoing processes, and what functional uses these ongoing processes might have. Here, we present a rigorous theoretical framework for these seemingly stochastic spine dynamics and rewiring processes in the context of reward-based learning tasks. We show that spontaneous synapse-autonomous processes, in combination with reward signals such as dopamine, can explain the capability of networks of neurons in the brain to configure themselves for specific computational tasks, and to compensate automatically for later changes in the network or task. Furthermore we show theoretically and through computer simulations that stable computational performance is compatible with continuously ongoing synapse-autonomous changes. After reaching good computational performance it causes primarily a slow drift of network architecture and dynamics in task-irrelevant dimensions, as observed for neural activity in motor cortex and other areas. On the more abstract level of reinforcement learning the resulting model gives rise to an understanding of reward-driven network plasticity as continuous sampling of network configurations.

From August to November 2014 the Rosetta orbiter has performed an extensive observation campaign aimed at the characterization of 67P/CG nucleus properties and to the selection of the Philae landing site. The campaign led to the production of a global map of the illuminated portion of 67P/CG nucleus. During this prelanding phase the comet's heliocentric distance decreased from 3.62 to 2.93 AU while Rosetta was orbiting around the nucleus at distances between 100 to 10 km. VIRTIS-M, the Visible and InfraRed Thermal Imaging Spectrometer - Mapping channel (Coradini et al. 2007) onboard the orbiter, has acquired 0.25-5.1 micron hyperspectral data of the entire illuminated surface, e.g. the north hemisphere and the equatorial regions, with spatial resolution between 2.5 and 25 m/pixel. I/F spectra have been corrected for thermal emission removal in the 3.5-5.1 micron range and for surface's photometric response. The resulting reflectance spectra have been used to compute several Cometary Spectral Indicators (CSI): single scattering albedo at 0.55 micron, 0.5-0.8 micron and 1.0-2.5 micron spectral slopes, 3.2 micron organic material and 2.0 micron water ice band parameters (center, depth) with the aim to map their spatial distribution on the surface and to study their temporal variability as the nucleus moved towards the Sun. Indeed, throughout the investigated period, the nucleus surface shows a significant increase of the single scattering albedo along with a decrease of the 0.5-0.8 and 1.0-2.5 micron spectral slopes, indicating a flattening of the reflectance. We attribute the origin of this effect to the partial removal of the dust layer caused by the increased contribution of water sublimation to the gaseous activity as comet crossed the frost-line.

General results from statistical learning theory suggest to understand not only brain computations, but also brain plasticity as probabilistic inference. But a model for that has been missing. We propose that inherently stochastic features of synaptic plasticity and spine motility enable cortical networks of neurons to carry out probabilistic inference by sampling from a posterior distribution of network configurations. This model provides a viable alternative to existing models that propose convergence of parameters to maximum likelihood values. It explains how priors on weight distributions and connection probabilities can be merged optimally with learned experience, how cortical networks can generalize learned information so well to novel experiences, and how they can compensate continuously for unforeseen disturbances of the network. The resulting new theory of network plasticity explains from a functional perspective a number of experimental data on stochastic aspects of synaptic plasticity that previously appeared to be quite puzzling.