
Sparse sensor placement is a central challenge in the efficient
characterization of complex systems when the cost of acquiring and processing
data is high. Leading sparse sensing methods typically exploit either spatial
or temporal correlations, but rarely both. This work introduces a new sparse
sensor optimization that is designed to leverage the rich spatiotemporal
coherence exhibited by many systems. Our approach is inspired by the remarkable
performance of flying insects, which use a few embedded strainsensitive
neurons to achieve rapid and robust flight control despite large gust
disturbances. Specifically, we draw on nature to identify targeted
neuralinspired sensors on a flapping wing to detect body rotation. This task
is particularly challenging as the rotational twisting mode is three
ordersofmagnitude smaller than the flapping modes. We show that nonlinear
filtering in time, built to mimic strainsensitive neurons, is essential to
detect rotation, whereas instantaneous measurements fail. Optimized sparse
sensor placement results in efficient classification with approximately ten
sensors, achieving the same accuracy and noise robustness as full measurements
consisting of hundreds of sensors. Sparse sensing with neural inspired encoding
establishes a new paradigm in hyperefficient, embodied sensing of
spatiotemporal data and sheds light on principles of biological sensing for
agile flight control.

Optimal sensor placement is a central challenge in the design, prediction,
estimation, and control of highdimensional systems. Highdimensional states
can often leverage a latent lowdimensional representation, and this inherent
compressibility enables sparse sensing. This article explores optimized sensor
placement for signal reconstruction based on a tailored library of features
extracted from training data. Sparse point sensors are discovered using the
singular value decomposition and QR pivoting, which are two ubiquitous matrix
computations that underpin modern linear dimensionality reduction. Sparse
sensing in a tailored basis is contrasted with compressed sensing, a universal
signal recovery method in which an unknown signal is reconstructed via a sparse
representation in a universal basis. Although compressed sensing can recover a
wider class of signals, we demonstrate the benefits of exploiting known
patterns in data with optimized sensing. In particular, drastic reductions in
the required number of sensors and improved reconstruction are observed in
examples ranging from facial images to fluid vorticity fields. Principled
sensor placement may be critically enabling when sensors are costly and
provides faster state estimation for lowlatency, highbandwidth control.
MATLAB code is provided for all examples.

Understanding the interplay of order and disorder in chaotic systems is a
central challenge in modern quantitative science. We present a universal,
datadriven decomposition of chaos as an intermittently forced linear system.
This work combines Takens' delay embedding with modern Koopman operator theory
and sparse regression to obtain linear representations of strongly nonlinear
dynamics. The result is a decomposition of chaotic dynamics into a linear model
in the leading delay coordinates with forcing by low energy delay coordinates;
we call this the Hankel alternative view of Koopman (HAVOK) analysis. This
analysis is applied to the canonical Lorenz system, as well as to realworld
examples such as the Earth's magnetic field reversal, and data from
electrocardiogram, electroencephalogram, and measles outbreaks. In each case,
the forcing statistics are nonGaussian, with long tails corresponding to rare
events that trigger intermittent switching and bursting phenomena; this forcing
is highly predictive, providing a clear signature that precedes these events.
Moreover, the activity of the forcing signal demarcates large coherent regions
of phase space where the dynamics are approximately linear from those that are
strongly nonlinear.

Neural correlates of movement planning onset and direction may be present in
human electrocorticography in the signal dynamics of both motor and nonmotor
cortical regions. We use a threestage model of jPCA reducedrank hidden Markov
model (jPCARRHMM), regularized shrunkencentroid discriminant analysis (RDA),
and LASSO regression to extract directionsensitive planning information and
movement onset in an upperlimb 3D isometric force task in a human subject.
This mode achieves a relatively high true positive forceonset prediction rate
of 60% within 250ms, and an abovechance 36% accuracy (17% chance) in
predicting one of six planned 3D directions of isometric force using
premovement signals. We also find directiondistinguishing information up to
400ms before force onset in the premovement signals, captured by electrodes
placed over the limbipsilateral dorsal premotor regions. This approach can
contribute to more accurate decoding of higherlevel movement goals, at earlier
timescales, and inform sensor placement. Our results also contribute to further
understanding of the spatiotemporal features of human motor planning.

In this work, we explore finitedimensional linear representations of
nonlinear dynamical systems by restricting the Koopman operator to an invariant
subspace. The Koopman operator is an infinitedimensional linear operator that
evolves observable functions of the statespace of a dynamical system [Koopman
1931, PNAS]. Dominant terms in the Koopman expansion are typically computed
using dynamic mode decomposition (DMD). DMD uses linear measurements of the
state variables, and it has recently been shown that this may be too
restrictive for nonlinear systems [Williams et al. 2015, JNLS]. Choosing
nonlinear observable functions to form an invariant subspace where it is
possible to obtain linear models, especially those that are useful for control,
is an open challenge.
Here, we investigate the choice of observable functions for Koopman analysis
that enable the use of optimal linear control techniques on nonlinear problems.
First, to include a cost on the state of the system, as in linear quadratic
regulator (LQR) control, it is helpful to include these states in the
observable subspace, as in DMD. However, we find that this is only possible
when there is a single isolated fixed point, as systems with multiple fixed
points or more complicated attractors are not globally topologically conjugate
to a finitedimensional linear system, and cannot be represented by a
finitedimensional linear Koopman subspace that includes the state. We then
present a datadriven strategy to identify relevant observable functions for
Koopman analysis using a new algorithm to determine terms in a dynamical system
by sparse regression of the data in a nonlinear function space [Brunton et al.
2015, arxiv]; we show how this algorithm is related to DMD. Finally, we
demonstrate how to design optimal control laws for nonlinear systems using
techniques from linear optimal control on Koopman invariant subspaces.

Fully automated decoding of human activities and intentions from direct
neural recordings is a tantalizing challenge in braincomputer interfacing.
Most ongoing efforts have focused on training decoders on specific, stereotyped
tasks in laboratory settings. Implementing braincomputer interfaces (BCIs) in
natural settings requires adaptive strategies and scalable algorithms that
require minimal supervision. Here we propose an unsupervised approach to
decoding neural states from human brain recordings acquired in a naturalistic
context. We demonstrate our approach on continuous longterm
electrocorticographic (ECoG) data recorded over many days from the brain
surface of subjects in a hospital room, with simultaneous audio and video
recordings. We first discovered clusters in highdimensional ECoG recordings
and then annotated coherent clusters using speech and movement labels extracted
automatically from audio and video recordings. To our knowledge, this
represents the first time techniques from computer vision and speech processing
have been used for natural ECoG decoding. Our results show that our
unsupervised approach can discover distinct behaviors from ECoG data, including
moving, speaking and resting. We verify the accuracy of our approach by
comparing to manual annotations. Projecting the discovered cluster centers back
onto the brain, this technique opens the door to automated functional brain
mapping in natural settings.

There is a broad need in the neuroscience community to understand and
visualize largescale recordings of neural activity, big data acquired by tens
or hundreds of electrodes simultaneously recording dynamic brain activity over
minutes to hours. Such dynamic datasets are characterized by coherent patterns
across both space and time, yet existing computational methods are typically
restricted to analysis either in space or in time separately. Here we report
the adaptation of dynamic mode decomposition (DMD), an algorithm originally
developed for the study of fluid physics, to largescale neuronal recordings.
DMD is a modal decomposition algorithm that describes highdimensional dynamic
data using coupled spatialtemporal modes; the resulting analysis combines key
features of performing principal components analysis (PCA) in space and power
spectral analysis in time. The algorithm scales easily to very large numbers of
simultaneously acquired measurements. We validated the DMD approach on
subdural electrode array recordings from human subjects performing a known
motor activation task. Next, we leveraged DMD in combination with machine
learning to develop a novel method to extract sleep spindle networks from the
same subjects. We suggest that DMD is generally applicable as a powerful method
in the analysis and understanding of largescale recordings of neural activity.