We have previously proposed the partial quantile regression (PQR) prediction
procedure for functional linear model by using partial quantile covariance
techniques and developed the simple partial quantile regression (SIMPQR)
algorithm to efficiently extract PQR basis for estimating functional
coefficients. However, although the PQR approach is considered as an attractive
alternative to projections onto the principal component basis, there are
certain limitations to uncovering the corresponding asymptotic properties
mainly because of its iterative nature and the non-differentiability of the
quantile loss function. In this article, we propose and implement an
alternative formulation of partial quantile regression (APQR) for functional
linear model by using block relaxation method and finite smoothing techniques.
The proposed reformulation leads to insightful results and motivates new
theory, demonstrating consistency and establishing convergence rates by
applying advanced techniques from empirical process theory. Two simulations and
two real data from ADHD-200 sample and ADNI are investigated to show the
superiority of our proposed methods.
In this manuscript, we study quantile regression in partial functional linear
model where response is scalar and predictors include both scalars and multiple
functions. Wavelet basis are adopted to better approximate functional slopes
while effectively detect local features. The sparse group lasso penalty is
imposed to select important functional predictors while capture shared
information among them. The estimation problem can be reformulated into a
standard second-order cone program and then solved by an interior point method.
We also give a novel algorithm by using alternating direction method of
multipliers (ADMM) which was recently employed by many researchers in solving
penalized quantile regression problems. The asymptotic properties such as the
convergence rate and prediction error bound have been established. Simulations
and a real data from ADHD-200 fMRI data are investigated to show the
superiority of our proposed method.
We propose a prediction procedure for the functional linear quantile
regression model by using partial quantile covariance techniques and develop a
simple partial quantile regression (SIMPQR) algorithm to efficiently extract
partial quantile regression (PQR) basis for estimating functional coefficients.
We further extend our partial quantile covariance techniques to functional
composite quantile regression (CQR) defining partial composite quantile
covariance. There are three major contributions. (1) We define partial quantile
covariance between two scalar variables through linear quantile regression. We
compute PQR basis by sequentially maximizing the partial quantile covariance
between the response and projections of functional covariates. (2) In order to
efficiently extract PQR basis, we develop a SIMPQR algorithm analogous to
simple partial least squares (SIMPLS). (3) Under the homoscedasticity
assumption, we extend our techniques to partial composite quantile covariance
and use it to find the partial composite quantile regression (PCQR) basis. The
SIMPQR algorithm is then modified to obtain the SIMPCQR algorithm. Two
simulation studies show the superiority of our proposed methods. Two real data
from ADHD-200 sample and ADNI are analyzed using our proposed methods.
The use of quantiles to obtain insights about multivariate data is addressed.
It is argued that incisive insights can be obtained by considering directional
quantiles, the quantiles of projections. Directional quantile envelopes are
proposed as a way to condense this kind of information; it is demonstrated that
they are essentially halfspace (Tukey) depth levels sets, coinciding for
elliptic distributions (in particular multivariate normal) with density
contours. Relevant questions concerning their indexing, the possibility of the
reverse retrieval of directional quantile information, invariance with respect
to affine transformations, and approximation/asymptotic properties are studied.
It is argued that the analysis in terms of directional quantiles and their
envelopes offers a straightforward probabilistic interpretation and thus
conveys a concrete quantitative meaning; the directional definition can be
adapted to elaborate frameworks, like estimation of extreme quantiles and
directional quantile regression, the regression of depth contours on
covariates. The latter facilitates the construction of multivariate growth
charts---the question that motivated all the development.
Maximum likelihood estimation of a log-concave probability density is
formulated as a convex optimization problem and shown to have an equivalent
dual formulation as a constrained maximum Shannon entropy problem. Closely
related maximum Renyi entropy estimators that impose weaker concavity
restrictions on the fitted density are also considered, notably a minimum
Hellinger discrepancy estimator that constrains the reciprocal of the
square-root of the density to be concave. A limiting form of these estimators
constrains solutions to the class of quasi-concave densities.
Discussion of "Multivariate quantiles and multiple-output regression
quantiles: From $L_1$ optimization to halfspace depth" by M. Hallin, D.
Paindaveine and M. Siman [arXiv:1002.4486]