
The annihilating filterbased lowrank Hanel matrix approach (ALOHA) is one
of the stateoftheart compressed sensing approaches that directly
interpolates the missing kspace data using lowrank Hankel matrix completion.
Inspired by the recent mathematical discovery that links deep neural networks
to Hankel matrix decomposition using datadriven framelet basis, here we
propose a fully datadriven deep learning algorithm for kspace interpolation.
Our network can be also easily applied to nonCartesian kspace trajectories by
simply adding an additional regridding layer. Extensive numerical experiments
show that the proposed deep learning method significantly outperforms the
existing imagedomain deep learning approaches.

Quantitative susceptibility mapping (QSM) inevitably suffers from streaking
artifacts caused by zeros on the conical surface of the dipole kernel in
kspace. This work proposes a novel and accurate QSM reconstruction method
based on a direct kspace interpolation approach, avoiding problems of over
smoothing and streaking artifacts. Inspired by the recent theory of
annihilating filterbased lowrank Hankel matrix approach (ALOHA), QSM
reconstruction problem is formulated as deconvolution problem under lowrank
Hankel matrix constraint in the kspace. To reduce the computational complexity
and the memory requirement, the problem is formulated as successive
reconstruction of 2D planes along three independent axes of the 3D phase
image in Fourier domain. Extensive experiments were performed to verify and
compare the proposed method with existing QSM reconstruction methods. The
proposed ALOHAQSM effectively reduced streaking artifacts and accurately
estimated susceptibility values in deep gray matter structures, compared to the
existing QSM methods. Our suggested ALOHAQSM algorithm successfully solves the
threedimensional QSM dipole inversion problem without additional anatomical
information or prior assumption and provides good image quality and
quantitative accuracy.

Accelerated magnetic resonance (MR) scan acquisition with compressed sensing
(CS) and parallel imaging is a powerful method to reduce MR imaging scan time.
However, many reconstruction algorithms have high computational costs. To
address this, we investigate deep residual learning networks to remove aliasing
artifacts from artifact corrupted images. The proposed deep residual learning
networks are composed of magnitude and phase networks that are separately
trained. If both phase and magnitude information are available, the proposed
algorithm can work as an iterative kspace interpolation algorithm using
framelet representation. When only magnitude data is available, the proposed
approach works as an image domain postprocessing algorithm. Even with strong
coherent aliasing artifacts, the proposed network successfully learned and
removed the aliasing artifacts, whereas current parallel and CS reconstruction
methods were unable to remove these artifacts. Comparisons using single and
multiple coil show that the proposed residual network provides good
reconstruction results with orders of magnitude faster computational time than
existing compressed sensing methods. The proposed deep learning framework may
have a great potential for accelerated MR reconstruction by generating accurate
results immediately.

Xray computed tomography (CT) using sparse projection views is a recent
approach to reduce the radiation dose. However, due to the insufficient
projection views, an analytic reconstruction approach using the filtered back
projection (FBP) produces severe streaking artifacts. Recently, deep learning
approaches using large receptive field neural networks such as UNet have
demonstrated impressive performance for sparse view CT reconstruction.
However, theoretical justification is still lacking. Inspired by the recent
theory of deep convolutional framelets, the main goal of this paper is,
therefore, to reveal the limitation of UNet and propose new multiresolution
deep learning schemes. In particular, we show that the alternative U Net
variants such as dual frame and the tight frame UNets satisfy the socalled
frame condition which make them better for effective recovery of high frequency
edges in sparse view CT. Using extensive experiments with real patient data
set, we demonstrate that the new network architectures provide better
reconstruction performance.

Model based iterative reconstruction (MBIR) algorithms for lowdose Xray CT
are computationally expensive. To address this problem, we recently proposed a
deep convolutional neural network (CNN) for lowdose Xray CT and won the
second place in 2016 AAPM LowDose CT Grand Challenge. However, some of the
texture were not fully recovered. To address this problem, here we propose a
novel frameletbased denoising algorithm using wavelet residual network which
synergistically combines the expressive power of deep learning and the
performance guarantee from the frameletbased denoising algorithms. The new
algorithms were inspired by the recent interpretation of the deep convolutional
neural network (CNN) as a cascaded convolution framelet signal representation.
Extensive experimental results confirm that the proposed networks have
significantly improved performance and preserves the detail texture of the
original images.

An inverse elastic source problem with sparse measurements is of concern. A
generic mathematical framework is proposed which incorporates a low
dimensional manifold regularization in the conventional source reconstruction
algorithms thereby enhancing their performance with sparse datasets. It is
rigorously established that the proposed framework is equivalent to the
socalled \emph{deep convolutional framelet expansion} in machine learning
literature for inverse problems. Apposite numerical examples are furnished to
substantiate the efficacy of the proposed framework.

Recently, deep learning approaches with various network architectures have
achieved significant performance improvement over existing iterative
reconstruction methods in various imaging problems. However, it is still
unclear why these deep learning architectures work for specific inverse
problems. To address these issues, here we show that the longsearchedfor
missing link is the convolution framelets for representing a signal by
convolving local and nonlocal bases. The convolution framelets was originally
developed to generalize the theory of lowrank Hankel matrix approaches for
inverse problems, and this paper further extends the idea so that we can obtain
a deep neural network using multilayer convolution framelets with perfect
reconstruction (PR) under rectilinear linear unit nonlinearity (ReLU). Our
analysis also shows that the popular deep network components such as residual
block, redundant filter channels, and concatenated ReLU (CReLU) do indeed help
to achieve the PR, while the pooling and unpooling layers should be augmented
with highpass branches to meet the PR condition. Moreover, by changing the
number of filter channels and bias, we can control the shrinkage behaviors of
the neural network. This discovery leads us to propose a novel theory for deep
convolutional framelets neural network. Using numerical experiments with
various inverse problems, we demonstrated that our deep convolution framelets
network shows consistent improvement over existing deep architectures.This
discovery suggests that the success of deep learning is not from a magical
power of a blackbox, but rather comes from the power of a novel signal
representation using nonlocal basis combined with datadriven local basis,
which is indeed a natural extension of classical signal processing theory.

Purpose: The radial kspace trajectory is a wellestablished sampling
trajectory used in conjunction with magnetic resonance imaging. However, the
radial kspace trajectory requires a large number of radial lines for
highresolution reconstruction. Increasing the number of radial lines causes
longer acquisition time, making it more difficult for routine clinical use. On
the other hand, if we reduce the number of radial lines, streaking artifact
patterns are unavoidable. To solve this problem, we propose a novel deep
learning approach with domain adaptation to restore highresolution MR images
from undersampled kspace data.
Methods: The proposed deep network removes the streaking artifacts from the
artifact corrupted images. To address the situation given the limited available
data, we propose a domain adaptation scheme that employs a pretrained network
using a large number of xray computed tomography (CT) or synthesized radial MR
datasets, which is then finetuned with only a few radial MR datasets.
Results: The proposed method outperforms existing compressed sensing
algorithms, such as the total variation and PRFOCUSS methods. In addition, the
calculation time is several orders of magnitude faster than the total variation
and PRFOCUSS methods.Moreover, we found that pretraining using CT or MR data
from similar organ data is more important than pretraining using data from the
same modality for different organ.
Conclusion: We demonstrate the possibility of a domainadaptation when only a
limited amount of MR data is available. The proposed method surpasses the
existing compressed sensing algorithms in terms of the image quality and
computation time.

For homeland and transportation security applications, 2D Xray explosive
detection system (EDS) have been widely used, but they have limitations in
recognizing 3D shape of the hidden objects. Among various types of 3D computed
tomography (CT) systems to address this issue, this paper is interested in a
stationary CT using fixed Xray sources and detectors. However, due to the
limited number of projection views, analytic reconstruction algorithms produce
severe streaking artifacts. Inspired by recent success of deep learning
approach for sparse view CT reconstruction, here we propose a novel image and
sinogram domain deep learning architecture for 3D reconstruction from very
sparse view measurement. The algorithm has been tested with the real data from
a prototype 9view dual energy stationary CT EDS carryon baggage scanner
developed by GEMSS Medical Systems, Korea, which confirms the superior
reconstruction performance over the existing approaches.

Interior tomography for the regionofinterest (ROI) imaging has advantages
of using a small detector and reducing Xray radiation dose. However, standard
analytic reconstruction suffers from severe cupping artifacts due to existence
of null space in the truncated Radon transform. Existing penalized
reconstruction methods may address this problem but they require extensive
computations due to the iterative reconstruction. Inspired by the recent deep
learning approaches to lowdose and sparse view CT, here we propose a deep
learning architecture that removes null space signals from the FBP
reconstruction. Experimental results have shown that the proposed method
provides nearperfect reconstruction with about 710 dB improvement in PSNR
over existing methods in spite of significantly reduced runtime complexity.

Due to the potential risk of inducing cancers, radiation dose of Xray CT
should be reduced for routine patient scanning. However, in lowdose Xray CT,
severe artifacts usually occur due to photon starvation, beamhardening, etc,
which decrease the reliability of diagnosis. Thus, high quality reconstruction
from lowdose Xray CT data has become one of the important research topics in
CT community. Conventional modelbased denoising approaches are, however,
computationally very expensive, and image domain denoising approaches hardly
deal with CT specific noise patterns. To address these issues, we propose an
algorithm using a deep convolutional neural network (CNN), which is applied to
wavelet transform coefficients of lowdose CT images. Specifically, by using a
directional wavelet transform for extracting directional component of artifacts
and exploiting the intra and interband correlations, our deep network can
effectively suppress CT specific noises. Moreover, our CNN is designed to have
various types of residual learning architecture for faster network training and
better denoising. Experimental results confirm that the proposed algorithm
effectively removes complex noise patterns of CT images, originated from the
reduced Xray dose. In addition, we show that wavelet domain CNN is efficient
in removing the noises from lowdose CT compared to an image domain CNN. Our
results were rigorously evaluated by several radiologists and won the second
place award in 2016 AAPM LowDose CT Grand Challenge. To the best of our
knowledge, this work is the first deep learning architecture for lowdose CT
reconstruction that has been rigorously evaluated and proven for its efficacy.

Compressed sensing provided a dataacquisition paradigm for sparse signals.
Remarkably, it has been shown that practical algorithms provide robust recovery
from noisy linear measurements acquired at a near optimal sampling rate. In
many realworld applications, a signal of interest is typically sparse not in
the canonical basis but in a certain transform domain, such as wavelets or the
finite difference. The theory of compressed sensing was extended to the
analysis sparsity model but known extensions are limited to specific choices of
sensing matrix and sparsifying transform. In this paper, we propose a unified
theory for robust recovery of sparse signals in a general transform domain by
convex programming. In particular, our results apply to general acquisition and
sparsity models and show how the number of measurements for recovery depends on
properties of measurement and sparsifying transforms. Moreover, we also provide
extensions of our results to the scenarios where the atoms in the transform has
varying incoherence parameters and the unknown signal exhibits a structured
sparsity pattern. In particular, for the partial Fourier recovery of sparse
signals over a circulant transform, our main results suggest a uniformly random
sampling. Numerical results demonstrate that the variable density random
sampling by our main results provides superior recovery performance over known
sampling strategies.

The latest deep learning approaches perform better than the stateoftheart
signal processing approaches in various image restoration tasks. However, if an
image contains many patterns and structures, the performance of these CNNs is
still inferior. To address this issue, here we propose a novel feature space
deep residual learning algorithm that outperforms the existing residual
learning. The main idea is originated from the observation that the performance
of a learning algorithm can be improved if the input and/or label manifolds can
be made topologically simpler by an analytic mapping to a feature space. Our
extensive numerical studies using denoising experiments and NTIRE singleimage
superresolution (SISR) competition demonstrate that the proposed feature space
residual learning outperforms the existing stateoftheart approaches.
Moreover, our algorithm was ranked third in NTIRE competition with 510 times
faster computational time compared to the top ranked teams. The source code is
available on page : https://github.com/iorism/CNN.git

Generative Adversarial Nets (GANs) represent an important milestone for
effective generative models, which has inspired numerous variants seemingly
different from each other. One of the main contributions of this paper is to
reveal a unified geometric structure in GAN and its variants. Specifically, we
show that the adversarial generative model training can be decomposed into
three geometric steps: separating hyperplane search, discriminator parameter
update away from the separating hyperplane, and the generator update along the
normal vector direction of the separating hyperplane. This geometric intuition
reveals the limitations of the existing approaches and leads us to propose a
new formulation called geometric GAN using SVM separating hyperplane that
maximizes the margin. Our theoretical analysis shows that the geometric GAN
converges to a Nash equilibrium between the discriminator and generator. In
addition, extensive numerical results show that the superior performance of
geometric GAN.

Limitedangle computed tomography (CT) is often used in clinical applications
such as Carm CT for interventional imaging. However, CT images from limited
angles suffers from heavy artifacts due to incomplete projection data. Existing
iterative methods require extensive calculations but can not deliver
satisfactory results. Based on the observation that the artifacts from limited
angles have some directional property and are globally distributed, we propose
a novel multiscale wavelet domain residual learning architecture, which
compensates for the artifacts. Experiments have shown that the proposed method
effectively eliminates artifacts, thereby preserving edge and global structures
of the image.

Model based iterative reconstruction (MBIR) algorithms for lowdose Xray CT
are computationally complex because of the repeated use of the forward and
backward projection. Inspired by this success of deep learning in computer
vision applications, we recently proposed a deep convolutional neural network
(CNN) for lowdose Xray CT and won the second place in 2016 AAPM LowDose CT
Grand Challenge. However, some of the texture are not fully recovered, which
was unfamiliar to some radiologists. To cope with this problem, here we propose
a direct residual learning approach on directional wavelet domain to solve this
problem and to improve the performance against previous work. In particular,
the new network estimates the noise of each input wavelet transform, and then
the denoised wavelet coefficients are obtained by subtracting the noise from
the input wavelet transform bands. The experimental results confirm that the
proposed network has significantly improved performance, preserving the detail
texture of the original images.

Purpose: Compressed sensing MRI (CSMRI) from single and parallel coils is
one of the powerful ways to reduce the scan time of MR imaging with performance
guarantee. However, the computational costs are usually expensive. This paper
aims to propose a computationally fast and accurate deep learning algorithm for
the reconstruction of MR images from highly downsampled kspace data.
Theory: Based on the topological analysis, we show that the data manifold of
the aliasing artifact is easier to learn from a uniform subsampling pattern
with additional lowfrequency kspace data. Thus, we develop deep aliasing
artifact learning networks for the magnitude and phase images to estimate and
remove the aliasing artifacts from highly accelerated MR acquisition.
Methods: The aliasing artifacts are directly estimated from the distorted
magnitude and phase images reconstructed from subsampled kspace data so that
we can get an aliasingfree images by subtracting the estimated aliasing
artifact from corrupted inputs. Moreover, to deal with the globally distributed
aliasing artifact, we develop a multiscale deep neural network with a large
receptive field.
Results: The experimental results confirm that the proposed deep artifact
learning network effectively estimates and removes the aliasing artifacts.
Compared to existing CS methods from single and multicoli data, the proposed
network shows minimal errors by removing the coherent aliasing artifacts.
Furthermore, the computational time is by order of magnitude faster.
Conclusion: As the proposed deep artifact learning network immediately
generates accurate reconstruction, it has great potential for clinical
applications.

A robust algorithm is proposed to reconstruct the spatial support and the
Lam\'e parameters of multiple inclusions in a homogeneous background elastic
material using a few measurements of the displacement field over a finite
collection of boundary points. The algorithm does not require any linearization
or iterative update of Green's function but still allows very accurate
reconstruction. The breakthrough comes from a novel interpretation of
LippmannSchwinger type integral representation of the displacement field in
terms of unknown densities having common sparse support on the location of
inclusions. Accordingly, the proposed algorithm consists of a twostep
approach. First, the localization problem is recast as a joint sparse recovery
problem that renders the densities and the inclusion support simultaneously.
Then, a noise robust constrained optimization problem is formulated for the
reconstruction of elastic parameters. An efficient algorithm is designed for
numerical implementation using the Multiple Sparse Bayesian Learning (MSBL)
for joint sparse recovery problem and the Constrained Split Augmented
Lagrangian Shrinkage Algorithm (CSALSA) for the constrained optimization
problem. The efficacy of the proposed framework is manifested through extensive
numerical simulations. To the best of our knowledge, this is the first
algorithm tailored for parameter reconstruction problems in elastic media using
highly undersampled data in the sense of Nyquist rate.

The concept of scattering coefficients has played a pivotal role in a broad
range of inverse scattering and imaging problems in acoustic, and
electromagnetic media. In view of their promising applications in inverse
problems related to mathematical imaging and elastic cloaking, the notion of
elastic scattering coefficients of an inclusion is presented from the
perspective of boundary layer potentials and a few properties are discussed. A
reconstruction algorithm is developed and analyzed for extracting the elastic
scattering coefficients from multistatic response measurements of the
scattered field in order to cater to inverse scattering problems. The decay
rate, stability and error analyses, and the estimate of maximal resolving order
in terms of the signaltonoise ratio are discussed. Moreover,
scatteringcoefficientsvanishing structures are designed and their utility for
enhancement of nearly elastic cloaking is elucidated.

Recently, compressed sensing (CS) computed tomography (CT) using sparse
projection views has been extensively investigated to reduce the potential risk
of radiation to patient. However, due to the insufficient number of projection
views, an analytic reconstruction approach results in severe streaking
artifacts and CSbased iterative approach is computationally very expensive. To
address this issue, here we propose a novel deep residual learning approach for
sparse view CT reconstruction. Specifically, based on a novel persistent
homology analysis showing that the manifold of streaking artifacts is
topologically simpler than original ones, a deep residual learning architecture
that estimates the streaking artifacts is developed. Once a streaking artifact
image is estimated, an artifactfree image can be obtained by subtracting the
streaking artifacts from the input image. Using extensive experiments with real
patient data set, we confirm that the proposed residual learning provides
significantly better image reconstruction performance with several orders of
magnitude faster computational speed.

While the recent theory of compressed sensing provides an opportunity to
overcome the Nyquist limit in recovering sparse signals, a solution approach
usually takes a form of inverse problem of the unknown signal, which is
crucially dependent on specific signal representation. In this paper, we
propose a drastically different twostep Fourier compressive sampling framework
in continuous domain that can be implemented as a measurement domain
interpolation, after which a signal reconstruction can be done using classical
analytic reconstruction methods. The main idea is originated from the
fundamental duality between the sparsity in the primary space and the
lowrankness of a structured matrix in the spectral domain, which shows that a
lowrank interpolator in the spectral domain can enjoy all the benefit of
sparse recovery with performance guarantees. Most notably, the proposed
lowrank interpolation approach can be regarded as a generalization of recent
spectral compressed sensing to recover large class of finite rate of
innovations (FRI) signals at near optimal sampling rate. Moreover, for the case
of cardinal representation, we can show that the proposed lowrank
interpolation will benefit from inherent regularization and the optimal
incoherence parameter. Using the powerful dual certificates and golfing scheme,
we show that the new framework still achieves the nearoptimal sampling rate
for general class of FRI signal recovery, and the sampling rate can be further
reduced for the class of cardinal splines. Numerical results using various type
of FRI signals confirmed that the proposed lowrank interpolation approach has
significant better phase transition than the conventional CS approaches.

Parallel MRI (pMRI) and compressed sensing MRI (CSMRI) have been considered
as two distinct reconstruction problems. Inspired by recent kspace
interpolation methods, an annihilating filter based lowrank Hankel matrix
approach (ALOHA) is proposed as a general framework for sparsitydriven kspace
interpolation method which unifies pMRI and CSMRI. Specifically, our framework
is based on the fundamental duality between the transform domain sparsity in
the primary space and the lowrankness of weighted Hankel matrix in the
reciprocal space, which converts pMRI and CSMRI to a kspace interpolation
problem using structured matrix completion. Using theoretical results from the
latest compressed sensing literatures, we showed that the required sampling
rates for ALOHA may achieve the optimal rate. Experimental results with in vivo
data for single/multicoil imaging as well as dynamic imaging confirmed that
the proposed method outperforms the stateoftheart pMRI and CSMRI.

Recently, so called annihilating filerbased low rank Hankel matrix (ALOHA)
approach was proposed as a powerful image inpainting method. Based on the
observation that smoothness or textures within an image patch corresponds to
sparse spectral components in the frequency domain, ALOHA exploits the
existence of annihilating filters and the associated rankdeficient Hankel
matrices in the image domain to estimate the missing pixels. By extending this
idea, here we propose a novel impulse noise removal algorithm using sparse +
low rank decomposition of an annihilating filterbased Hankel matrix. The new
approach, what we call the robust ALOHA, is motivated by the observation that
an image corrupted with impulse noises has intact pixels; so the impulse noises
can be modeled as sparse components, whereas the underlying image can be still
modeled using a lowrank Hankel structured matrix. To solve the sparse + low
rank decomposition problem, we propose an alternating direction method of
multiplier (ADMM) method with initial factorized matrices coming from low rank
matrix fitting (LMaFit) algorithm. To adapt the local image statistics that
have distinct spectral distributions, the robust ALOHA is applied patch by
patch. Experimental results from two types of impulse noises  random valued
impulse noises and salt/pepper noises  for both single channel and
multichannel color images demonstrate that the robust ALOHA outperforms the
existing algorithms up to 8dB in terms of the peak signal to noise ratio
(PSNR).

The multiple measurement vector problem (MMV) is a generalization of the
compressed sensing problem that addresses the recovery of a set of jointly
sparse signal vectors. One of the important contributions of this paper is to
reveal that the seemingly least related stateofart MMV joint sparse recovery
algorithms  MSBL (multiple sparse Bayesian learning) and subspacebased
hybrid greedy algorithms  have a very important link. More specifically, we
show that replacing the $\log\det(\cdot)$ term in MSBL by a rank proxy that
exploits the spark reduction property discovered in subspacebased joint sparse
recovery algorithms, provides significant improvements. In particular, if we
use the Schatten$p$ quasinorm as the corresponding rank proxy, the global
minimiser of the proposed algorithm becomes identical to the true solution as
$p \rightarrow 0$. Furthermore, under the same regularity conditions, we show
that the convergence to a local minimiser is guaranteed using an alternating
minimization algorithm that has closed form expressions for each of the
minimization steps, which are convex. Numerical simulations under a variety of
scenarios in terms of SNR, and condition number of the signal amplitude matrix
demonstrate that the proposed algorithm consistently outperforms MSBL and
other stateofthe art algorithms.

The purpose of this paper is to propose a noniterative method for the
inverse conductivity problem of recovering multiple small anomalies from the
boundary measurements. When small anomalies are buried in a conducting object,
the electric potential values inside the object can be expressed by integrals
of densities with a common sparse support on the location of anomalies. Based
on this integral expression, we formulate the reconstruction problem of small
anomalies as a joint sparse recovery and present an efficient noniterative
recovery algorithm of small anomalies. Furthermore, we also provide a slightly
modified algorithm to reconstruct an extended anomaly. We validate the
effectiveness of the proposed algorithm over the linearized method and the
MUSIC algorithm by numerical simulations.