
We consider estimating the parametric components of semiparametric multiple
index models in a highdimensional and nonGaussian setting. Such models form a
rich class of nonlinear models with applications to signal processing, machine
learning and statistics. Our estimators leverage the score function based first
and secondorder Stein's identities and do not require the covariates to
satisfy Gaussian or elliptical symmetry assumptions common in the literature.
Moreover, to handle score functions and responses that are heavytailed, our
estimators are constructed via carefully thresholding their empirical
counterparts. We show that our estimator achieves nearoptimal statistical rate
of convergence in several settings. We supplement our theoretical results via
simulation experiments that confirm the theory.

We consider the problem of \emph{fully decentralized} multiagent
reinforcement learning (MARL), where the agents are located at the nodes of a
timevarying communication network. Specifically, we assume that the reward
functions of the agents might correspond to different tasks, and are only known
to the corresponding agent. Moreover, each agent makes individual decisions
based on both the information observed locally and the messages received from
its neighbors over the network. Within this setting, the collective goal of the
agents is to maximize the globally averaged return over the network through
exchanging information with their neighbors. To this end, we propose two
decentralized actorcritic algorithms with function approximation, which are
applicable to largescale MARL problems where both the number of states and the
number of agents are massively large. Under the decentralized structure, the
actor step is performed individually by each agent with no need to infer the
policies of others. For the critic step, we propose a consensus update via
communication over the network. Our algorithms are fully incremental and can be
implemented in an online fashion. Convergence analyses of the algorithms are
provided when the value functions are approximated within the class of linear
functions. Extensive simulation results with both linear and nonlinear function
approximations are presented to validate the proposed algorithms. Our work
appears to be the first study of fully decentralized MARL algorithms for
networked agents with function approximation, with provable convergence
guarantees.

We study parameter estimation and asymptotic inference for sparse nonlinear
regression. More specifically, we assume the data are given by $y = f( x^\top
\beta^* ) + \epsilon$, where $f$ is nonlinear. To recover $\beta^*$, we propose
an $\ell_1$regularized leastsquares estimator. Unlike classical linear
regression, the corresponding optimization problem is nonconvex because of the
nonlinearity of $f$. In spite of the nonconvexity, we prove that under mild
conditions, every stationary point of the objective enjoys an optimal
statistical rate of convergence. In addition, we provide an efficient algorithm
that provably converges to a stationary point. We also access the uncertainty
of the obtained estimator. Specifically, based on any stationary point of the
objective, we construct valid hypothesis tests and confidence intervals for the
low dimensional components of the highdimensional parameter $\beta^*$.
Detailed numerical results are provided to back up our theory.

We propose a new class of semiparametric exponential family graphical models
for the analysis of high dimensional mixed data. Different from the existing
mixed graphical models, we allow the nodewise conditional distributions to be
semiparametric generalized linear models with unspecified base measure
functions. Thus, one advantage of our method is that it is unnecessary to
specify the type of each node and the method is more convenient to apply in
practice. Under the proposed model, we consider both problems of parameter
estimation and hypothesis testing in high dimensions. In particular, we propose
a symmetric pairwise score test for the presence of a single edge in the graph.
Compared to the existing methods for hypothesis tests, our approach takes into
account of the symmetry of the parameters, such that the inferential results
are invariant with respect to the different parametrizations of the same edge.
Thorough numerical simulations and a real data example are provided to back up
our results.