
Primary visual cortex (V1) is the first stage of cortical image processing,
and a major effort in systems neuroscience is devoted to understanding how it
encodes information about visual stimuli. Within V1, many neurons respond
selectively to edges of a given preferred orientation: these are known as
simple or complex cells, and they are wellstudied. Other neurons respond to
localized centersurround image features. Still others respond selectively to
certain image stimuli, but the specific features that excite them are unknown.
Moreover, even for the simple and complex cells the bestunderstood V1
neurons it is challenging to predict how they will respond to natural image
stimuli. Thus, there are important gaps in our understanding of how V1 encodes
images. To fill this gap, we train deep convolutional neural networks to
predict the firing rates of V1 neurons in response to natural image stimuli,
and find that 15% of these neurons are within 10% of their theoretical limit of
predictability. For these well predicted neurons, we invert the predictor
network to identify the image features (receptive fields) that cause the V1
neurons to spike. In addition to those with previouslycharacterized receptive
fields (Gabor wavelet and centersurround), we identify neurons that respond
predictably to higherlevel textural image features that are not localized to
any particular region of the image.

Sensory neurons give highly variable responses to stimulation, which can
limit the amount of stimulus information available to downstream circuits. Much
work has investigated the factors that affect the amount of information encoded
in these population responses, leading to insights about the role of
covariability among neurons, tuning curve shape, etc. However, the
informativeness of neural responses is not the only relevant feature of
population codes; of potentially equal importance is how robustly that
information propagates to downstream structures. For instance, to quantify the
retina's performance, one must consider not only the informativeness of the
optic nerve responses, but also the amount of information that survives the
spikegenerating nonlinearity and noise corruption in the next stage of
processing, the lateral geniculate nucleus. Our study identifies the set of
covariance structures for the upstream cells that optimize the ability of
information to propagate through noisy, nonlinear circuits. Within this optimal
family are covariances with "differential correlations", which are known to
reduce the information encoded in neural population activities. Thus,
covariance structures that maximize information in neural population codes, and
those that maximize the ability of this information to propagate, can be very
different.

While recent recordings from neural populations show beyondpairwise, or
higherorder correlations (HOC), we have little understanding of how HOC arise
from network interactions and of how they impact encoded information. Here, we
show that input nonlinearities imply HOC in spinglasstype statistical models.
We then discuss one such model with parameterized pairwise and higherorder
interactions, revealing conditions under which beyondpairwise interactions
increase the mutual information between a given stimulus type and the
population responses. For jointly Gaussian stimuli, coding performance is
improved by shaping output HOC only when neural firing rates are constrained to
be low. For stimuli with skewed probability distributions (like natural image
luminances), performance improves for all firing rates. Our work suggests
surprising connections between nonlinear integration of neural inputs, stimulus
statistics, and normative theories of population coding. Moreover, it suggests
that the inclusion of beyondpairwise interactions could improve the
performance of Boltzmann machines for machine learning and signal processing
applications.

Which statistical features of spiking activity matter for how stimuli are
encoded in neural populations? A vast body of work has explored how firing
rates in individual cells and correlations in the spikes of cell pairs impact
coding. But little is known about how higherorder correlations, which describe
simultaneous firing in triplets and larger ensembles of cells, impact encoded
stimulus information. Here, we take a first step toward closing this gap. We
vary triplet correlations in small (~10 cell) neural populations while keeping
single cell and pairwise statistics fixed at typically reported values. For
each value of triplet correlations, we estimate the performance of the neural
population on a twostimulus discrimination task. We identify a predominant way
that such triplet correlations can strongly enhance coding: if triplet
correlations differ for the two stimuli, they skew the response distributions
of the two stimuli apart from each other, separating them and making them
easier to distinguish. This coding benefit does not occur when both stimuli
elicit similar triplet correlations. These results indicate that higherorder
correlations could have a strong effect on population coding. Finally, we
calculate how many samples are necessary to accurately measure spiking
correlations of this type, providing an estimate of the necessary recording
times in experiments.

Over repeat presentations of the same stimulus, sensory neurons show variable
responses. This "noise" is typically correlated between pairs of cells, and a
question with rich history in neuroscience is how these noise correlations
impact the population's ability to encode the stimulus. Here, we consider a
very general setting for population coding, investigating how information
varies as a function of noise correlations, with all other aspects of the
problem  neural tuning curves, etc.  held fixed. This work yields unifying
insights into the role of noise correlations. These are summarized in the form
of theorems, and illustrated with numerical examples involving neurons with
diverse tuning curves. Our main contributions are as follows.
(1) We generalize previous results to prove a sign rule (SR)  if noise
correlations between pairs of neurons have opposite signs vs. their signal
correlations, then coding performance will improve compared to the independent
case. This holds for three different metrics of coding performance, and for
arbitrary tuning curves and levels of heterogeneity. This generality is true
for our other results as well.
(2) As also pointed out in the literature, the SR does not provide a
necessary condition for good coding. We show that a diverse set of correlation
structures can improve coding. Many of these violate the SR, as do
experimentally observed correlations. There is structure to this diversity: we
prove that the optimal correlation structures must lie on boundaries of the
possible set of noise correlations.
(3) We provide a novel set of necessary and sufficient conditions, under
which the coding performance (in the presence of noise) will be as good as it
would be if there were no noise present at all.

The opacity of typical objects in the world results in occlusion  an
important property of natural scenes that makes inference of the full
3dimensional structure of the world challenging. The relationship between
occlusion and lowlevel image statistics has been hotly debated in the
literature, and extensive simulations have been used to determine whether
occlusion is responsible for the ubiquitously observed powerlaw power spectra
of natural images. To deepen our understanding of this problem, we have
analytically computed the 2 and 4point functions of a generalized "dead
leaves" model of natural images with parameterized object transparency.
Surprisingly, transparency alters these functions only by a multiplicative
constant, so long as object diameters follow a power law distribution. For
other object size distributions, transparency more substantially affects the
lowlevel image statistics. We propose that the universality of power law power
spectra for both natural scenes and radiological medical images  formed by
the transmission of xrays through partially transparent tissue  stems from
power law object size distributions, independent of object opacity.

Sparse coding algorithms trained on natural images can accurately predict the
features that excite visual cortical neurons, but it is not known whether such
codes can be learned using biologically realistic plasticity rules. We have
developed a biophysically motivated spiking network, relying solely on
synaptically local information, that can predict the full diversity of V1
simple cell receptive field shapes when trained on natural images. This
represents the first demonstration that sparse coding principles, operating
within the constraints imposed by cortical architecture, can successfully
reproduce these receptive fields. We further prove, mathematically, that
sparseness and decorrelation are the key ingredients that allow for
synaptically local plasticity rules to optimize a cooperative, linear
generative image model formed by the neural representation. Finally, we discuss
several interesting emergent properties of our network, with the intent of
bridging the gap between theoretical and experimental studies of visual cortex.

A prey animal surveying its environment must decide whether there is a
dangerous predator present or not. If there is, it may flee. Flight has an
associated cost, so the animal should not flee if there is no danger. However,
the prey animal cannot know the state of its environment with certainty, and is
thus bound to make some errors. We formulate a probabilistic automaton model of
a prey animal's life and use it to compute the optimal escape decision
strategy, subject to the animal's uncertainty. The uncertainty is a major
factor in determining the decision strategy: only in the presence of
uncertainty do economic factors (like mating opportunities lost due to flight)
influence the decision. We performed computer simulations and found that
\emph{in silico} populations of animals subject to predation evolve to display
the strategies predicted by our model, confirming our choice of objective
function for our analytic calculations. To the best of our knowledge, this is
the first theoretical study of escape decisions to incorporate the effects of
uncertainty, and to demonstrate the correctness of the objective function used
in the model.

Future weak lensing surveys will map the evolution of matter perturbations
and gravitational potentials, yielding a new test of general relativity on
cosmic scales. They will probe the relations between matter overdensities,
local curvature, and the Newtonian potential. These relations can be modified
in alternative gravity theories or by the effects of massive neutrinos or
exotic dark energy fluids. We introduce two functions of time and scale which
account for any such modifications in the linear regime. We use a principal
component analysis to find the eigenmodes of these functions that cosmological
data will constrain. The number of constrained modes gives a modelindependent
forecast of how many parameters describing deviations from general relativity
could be constrained, along with $w(z)$. The modes' scale and time dependence
tell us which theoretical models will be better tested.

In alternative theories of gravity, designed to produce cosmic acceleration
at the current epoch, the growth of large scale structure can be modified. We
study the potential of upcoming and future tomographic surveys such as DES and
LSST, with the aid of CMB and supernovae data, to detect departures from the
growth of cosmic structure expected within General Relativity. We employ
parametric forms to quantify the potential time and scaledependent variation
of the effective gravitational constant, and the differences between the two
Newtonian potentials. We then apply the Fisher matrix technique to forecast the
errors on the modified growth parameters from galaxy clustering, weak lensing,
CMB, and their crosscorrelations across multiple photometric redshift bins. We
find that even with conservative assumptions about the data, DES will produce
nontrivial constraints on modified growth, and that LSST will do significantly
better.