• ### Towards Easier and Faster Sequence Labeling for Natural Language Processing: A Search-based Probabilistic Online Learning Framework (SAPO)(1503.08381)

Nov. 19, 2018 cs.AI, cs.LG
There are two major approaches for sequence labeling. One is the probabilistic gradient-based methods such as conditional random fields (CRF) and neural networks (e.g., RNN), which have high accuracy but drawbacks: slow training, and no support of search-based optimization (which is important in many cases). The other is the search-based learning methods such as structured perceptron and margin infused relaxed algorithm (MIRA), which have fast training but also drawbacks: low accuracy, no probabilistic information, and non-convergence in real-world tasks. We propose a novel and "easy" solution, a search-based probabilistic online learning method, to address most of those issues. The method is "easy", because the optimization algorithm at the training stage is as simple as the decoding algorithm at the test stage. This method searches the output candidates, derives probabilities, and conducts efficient online learning. We show that this method with fast training and theoretical guarantee of convergence, which is easy to implement, can support search-based optimization and obtain top accuracy. Experiments on well-known tasks show that our method has better accuracy than CRF and BiLSTM\footnote{The SAPO code is released at \url{https://github.com/lancopku/SAPO}.}.
• ### UnrealStereo: Controlling Hazardous Factors to Analyze Stereo Vision(1612.04647)

Sept. 6, 2018 cs.CV
A reliable stereo algorithm is critical for many robotics applications. But textureless and specular regions can easily cause failure by making feature matching difficult. Understanding whether an algorithm is robust to these hazardous regions is important. Although many stereo benchmarks have been developed to evaluate performance, it is hard to quantify the effect of hazardous regions in real images because the location and severity of these regions are unknown. In this paper, we develop a synthetic image generation tool enabling to control hazardous factors, such as making objects more specular or transparent, to produce hazardous regions at different degrees. The densely controlled sampling strategy in virtual worlds enables to effectively stress test stereo algorithms by varying the types and degrees of the hazard. We generate a large synthetic image dataset with automatically computed hazardous regions and analyze algorithms on these regions. The observations from synthetic images are further validated by annotating hazardous regions in real-world datasets Middlebury and KITTI (which gives a sparse sampling of the hazards). Our synthetic image generation tool is based on a game engine Unreal Engine 4 and will be open-source along with the virtual scenes in our experiments. Many publicly available realistic game contents can be used by our tool to provide an enormous resource for development and evaluation of algorithms.
• ### Quantum limit transport and destruction of the Weyl nodes in TaAs(1704.06944)

June 13, 2018 cond-mat.str-el
Weyl fermions are a new ingredient for correlated states of electronic matter. A key difficulty has been that real materials also contain non-Weyl quasiparticles, and disentangling the experimental signatures has proven challenging. We use magnetic fields up to 95 tesla to drive the Weyl semimetal TaAs far into its quantum limit (QL), where only the purely chiral 0th Landau levels (LLs) of the Weyl fermions are occupied. We find the electrical resistivity to be nearly independent of magnetic field up to 50 tesla: unusual for conventional metals but consistent with the chiral anomaly for Weyl fermions. Above 50 tesla we observe a two-order-of-magnitude increase in resistivity, indicating that a gap opens in the chiral LLs. Above 80 tesla we observe strong ultrasonic attenuation below 2 kelvin, suggesting a mesoscopically-textured state of matter. These results point the way to inducing new correlated states of matter in the QL of Weyl semimetals.
• ### Multifractal Study of Quasiparticle Localization in Disordered Superconductors(1707.04597)

June 7, 2018 cond-mat.dis-nn
The thermal metal to thermal insulator transition due to random disorder is studied in the context of the symmetries of the Bogoliubov de Gennes Hamiltonian. We focus on a three dimensional system with gapless s-wave pairing that possesses time reversal and spin rotational symmetry. The quasiparticle excitations (bogolons) undergo a metal insulator transition as the disorder increases. We determine the critical disorder strength and correlation exponent first by the transfer matrix method (TMM). We then apply a multifractal finite sized scaling (MFSS) of the bogolon wavefunction obtained from large scale diagonalization of the Hamiltonian and obtain the critical disorder strength and exponent, in agreement with those found by TMM.
• ### Regularizing Output Distribution of Abstractive Chinese Social Media Text Summarization for Improved Semantic Consistency(1805.04033)

May 10, 2018 cs.CL
Abstractive text summarization is a highly difficult problem, and the sequence-to-sequence model has shown success in improving the performance on the task. However, the generated summaries are often inconsistent with the source content in semantics. In such cases, when generating summaries, the model selects semantically unrelated words with respect to the source content as the most probable output. The problem can be attributed to heuristically constructed training data, where summaries can be unrelated to the source content, thus containing semantically unrelated words and spurious word correspondence. In this paper, we propose a regularization approach for the sequence-to-sequence model and make use of what the model has learned to regularize the learning objective to alleviate the effect of the problem. In addition, we propose a practical human evaluation method to address the problem that the existing automatic evaluation method does not evaluate the semantic consistency with the source content properly. Experimental results demonstrate the effectiveness of the proposed approach, which outperforms almost all the existing models. Especially, the proposed approach improves the semantic consistency by 4\% in terms of human evaluation.
• ### N2RPP: An Adversarial Network to Rebuild Plantar Pressure for ACLD Patients(1805.02825)

May 8, 2018 cs.CV
Foot is a vital part of human, and lots of valuable information is embedded. Plantar pressure is one of which contains this information and it describes human walking features. It is proved that once one has trouble with lower limb, the distribution of plantar pressure will change to some degree. Plantar pressure can be converted into images according to some simple standards. In this paper, we take full advantage of these plantar pressure images for medical usage. We present N2RPP, a generative adversarial network (GAN) based method to rebuild plantar pressure images of anterior cruciate ligament deficiency (ACLD) patients from low dimension features, which are extracted from an autoencoder. Through the result of experiments, the extracted features are a useful representation to describe and rebuild plantar pressure images. According to N2RPP's results, we find out that there are several noteworthy differences between normal people and patients. This can provide doctors a rough direction of adjusting plantar pressure to a better distribution to reduce patients' sore and pain during the rehabilitation treatment for ACLD.
• ### Cosmological Model Independent Time Delay Method(1805.02586)

May 8, 2018 gr-qc, astro-ph.CO
To avoid the free $n$ problem in Lorentz invariance violation (LIV) test, we present the Cosmological Model Independent Time Delay (CMITD) method. We reconstruct LIV parameters by using observational luminosity distance instead of cosmological model. The luminosity distance data and the time delay data from Gamma-ray bursts (GRBs) are taken for test example. The results of our method have the same order of errors as the ones dependent on $\Lambda$CDM cosmological model.
• ### Structure-sensitive Multi-scale Deep Neural Network for Low-Dose CT Denoising(1805.00587)

May 4, 2018 cs.AI, cs.CV
Computed tomography (CT) is a popular medical imaging modality in clinical applications. At the same time, the x-ray radiation dose associated with CT scans raises public concerns due to its potential risks to the patients. Over the past years, major efforts have been dedicated to the development of Low-Dose CT (LDCT) methods. However, the radiation dose reduction compromises the signal-to-noise ratio (SNR), leading to strong noise and artifacts that down-grade CT image quality. In this paper, we propose a novel 3D noise reduction method, called Structure-sensitive Multi-scale Generative Adversarial Net (SMGAN), to improve the LDCT image quality. Specifically, we incorporate three-dimensional (3D) volumetric information to improve the image quality. Also, different loss functions for training denoising models are investigated. Experiments show that the proposed method can effectively preserve structural and texture information from normal-dose CT (NDCT) images, and significantly suppress noise and artifacts. Qualitative visual assessments by three experienced radiologists demonstrate that the proposed method retrieves more detailed information, and outperforms competing methods.
• ### Benefit of Joint DOA and Delay Estimation with Application to Indoor Localization in WiFi and 5G(1804.00486)

May 2, 2018 cs.IT, math.IT
Accurate indoor localization has long been a challenging problem due to the presence of multipath. Joint direction-of-arrival (DOA) and time delay (TD) estimation is a promising technique for accurate indoor Localization in next generation WiFi and 5G, as it has the capability of separating the line-of-sight (LOS) signal from multipath signals in the TD space. Although the benefit of joint DOA and TD estimation over DOA-only estimation has been empirically shown long ago, it has not been theoretically justified yet. In this paper, we provide a theoretical proof of the benefit of joint DOA and TD estimation over DOA-only estimation. Further, experimental results with simulated WiFi setting have been provided to demonstrate the theoretical finding. Matlab code is available at \textbf{https://github.com/FWen/JADE.git}.
• ### Algebraic dual polynomials for the equivalence of curl-curl problems(1805.00114)

April 30, 2018 math.NA
In this paper we will consider two curl-curl equation in two dimensions. One curl-curl problem for a scalar quantity $F$ and one problem for a vector field $\bf{E}$. For Dirichlet boundary conditions $\bf{n} \times \bf{E} =$ $\hat{E}_{\dashv}$ on $\bf{E}$ and Neumann boundary conditions $\bf{n} \times \mbox{curl}$ $F=\hat{E}_{\dashv}$, we expect the solutions to satisfy $\bf{E}=\mbox{curl}$ $F$. When we use algebraic dual polynomial representations, these identities continue to hold at the discrete level. Equivalence will be proved and illustrated with a computational example.
• ### 3D Convolutional Encoder-Decoder Network for Low-Dose CT via Transfer Learning from a 2D Trained Network(1802.05656)

April 29, 2018 cs.CV
Low-dose computed tomography (CT) has attracted a major attention in the medical imaging field, since CT-associated x-ray radiation carries health risks for patients. The reduction of CT radiation dose, however, compromises the signal-to-noise ratio, and may compromise the image quality and the diagnostic performance. Recently, deep-learning-based algorithms have achieved promising results in low-dose CT denoising, especially convolutional neural network (CNN) and generative adversarial network (GAN). This article introduces a Contracting Path-based Convolutional Encoder-decoder (CPCE) network in 2D and 3D configurations within the GAN framework for low-dose CT denoising. A novel feature of our approach is that an initial 3D CPCE denoising model can be directly obtained by extending a trained 2D CNN and then fine-tuned to incorporate 3D spatial information from adjacent slices. Based on the transfer learning from 2D to 3D, the 3D network converges faster and achieves a better denoising performance than that trained from scratch. By comparing the CPCE with recently published methods based on the simulated Mayo dataset and the real MGH dataset, we demonstrate that the 3D CPCE denoising model has a better performance, suppressing image noise and preserving subtle structures.
• ### Native point defects of semiconducting layered Bi2O2Se(1712.00532)

April 24, 2018 cond-mat.mtrl-sci
Bi2O2Se is an emerging semiconducting, air-stable layered material (Nat. Nanotechnol. 2017, 12, 530; Nano Lett. 2017, 17, 3021), potentially exceeding MoS2 and phosphorene in electron mobility and rivalling typical Van der Waals stacked layered materials in the next-generation high-speed and low-power electronics. Holding the promise of functional versatility, it is arousing rapidly growing interest from various disciplines, including optoelectronics, thermoelectronics and piezoelectronics. In this work, we comprehensively study the electrical properties of the native point defects in Bi2O2Se, as an essential step toward understanding the fundamentals of this material. The defect landscapes dependent on both Fermi energy and the chemical potentials of atomic constituents are investigated. Along with the bulk defect analysis, a complementary inspection of the surface properties, within the simple context of charge neutrality level model, elucidates the observed n-type characteristics of Bi2O2Se based FETs. This work provides important guide to engineer the defects of Bi2O2Se for desired properties, which is key to the successful application of this emerging layered material.
• ### Rational Solutions of High-Order Algebraic Ordinary Differential Equations(1709.04174)

April 22, 2018 cs.SC
We consider algebraic ordinary differential equations (AODEs) and study their polynomial and rational solutions. A sufficient condition for an AODE to have a degree bound for its polynomial solutions is presented. An AODE satisfying this condition is called \emph{noncritical}. We prove that usual low order classes of AODEs are noncritical. For rational solutions, we determine a class of AODEs, which are called \emph{maximally comparable}, such that the poles of their rational solutions are recognizable from their coefficients. This generalizes a fact from linear AODEs, that the poles of their rational solutions are the zeros of the corresponding highest coefficient. An algorithm for determining all rational solutions, if there is any, of certain maximally comparable AODEs, which covers $78.54\%$ AODEs from a standard differential equations collection by Kamke, is presented.
• ### A Grouping Based Cooperative Driving Strategy for CAVs Merging Problems(1804.01250)

April 4, 2018 cs.SY
In general, there are two kinds of cooperative driving strategies, planning based strategy and ad hoc negotiation based strategy, for connected and automated vehicles (CAVs) merging problems. The planning based strategy aims to find the global optimal passing order, but it is time-consuming when the number of considered vehicles is large. In contrast, the ad hoc negotiation based strategy runs fast, but it always finds a local optimal solution. In this paper, we propose a grouping based cooperative driving strategy to make a good tradeoff between time consumption and coordination performance. The key idea is to fix the passing orders for some vehicles whose inter-vehicle headways are small enough (e.g., smaller than the pre-selected grouping threshold). From the viewpoint of optimization, this method reduces the size of the solution space. A brief analysis shows that the sub-optimal passing order found by the grouping based strategy has a high probability to be close to the global optimal passing order, if the grouping threshold is appropriately chosen. A series of simulation experiments are carried out to validate that the proposed strategy can yield a satisfied coordination performance with less time consumption and is promising to be used in practice.
• ### SampleAhead: Online Classifier-Sampler Communication for Learning from Synthesized Data(1804.00248)

April 1, 2018 cs.CV
State-of-the-art techniques of artificial intelligence, in particular deep learning, are mostly data-driven. However, collecting and manually labeling a large scale dataset is both difficult and expensive. A promising alternative is to introduce synthesized training data, so that the dataset size can be significantly enlarged with little human labor. But, this raises an important problem in active vision: given an {\bf infinite} data space, how to effectively sample a {\bf finite} subset to train a visual classifier? This paper presents an approach for learning from synthesized data effectively. The motivation is straightforward -- increasing the probability of seeing difficult training data. We introduce a module named {\bf SampleAhead} to formulate the learning process into an online communication between a {\em classifier} and a {\em sampler}, and update them iteratively. In each round, we adjust the sampling distribution according to the classification results, and train the classifier using the data sampled from the updated distribution. Experiments are performed by introducing synthesized images rendered from ShapeNet models to assist PASCAL3D+ classification. Our approach enjoys higher classification accuracy, especially in the scenario of a limited number of training samples. This demonstrates its efficiency in exploring the infinite data space.
• ### Finite horizon risk-sensitive continuous-time Markov decision processes with unbounded transition and cost rates(1803.09580)

March 26, 2018 math.OC
We consider a risk-sensitive continuous-time Markov decision process over a finite time duration. Under the conditions that can be satisfied by unbounded transition and cost rates, we show the existence of an optimal policy, and the existence and uniqueness of the solution to the optimality equation out of a class of possibly unbounded functions, to which the Feynman-Kac formula was also justified to hold.
• ### Formal Power Series Solutions of Algebraic Ordinary Differential Equations(1803.09646)

March 26, 2018 cs.SC
In this paper, we consider nonlinear algebraic ordinary differential equations (AODEs) and study their formal power series solutions. Our method is inherited from Lemma 2.2 in [J. Denef and L. Lipshitz, \textit{Power series solutions of algebraic differential equations}, Mathematische Annalen, \textbf{267}(1984), 213-238] for expressing high order derivatives of a differential polynomial via their lower order ones. By a careful computation, we give an explicit formula for the expression. As an application, we give a method for determining the existence of a formal power series solution with given first coefficients. We define a class of certain differential polynomials in which our method works properly, which is called \textit{non-vanishing}. A statistical investigation shows that many differential polynomials in the literature are non-vanishing.
• ### The Strong Decays of $P-$wave Mixing Heavy-Light $1^+$ States(1803.06822)

March 19, 2018 hep-ph
Many $P-$wave mixing heavy-light $1^+$ states have not been discovered by experiment, some of them have been discovered but without the information of width, or with large uncertainty widths. In this paper, we study the strong decays of $P-$wave mixing heavy-light $1^+$ states $D^0$, $D^\pm$, $D_s^\pm$, $B^0$, $B^\pm$ and $B_s$ by the improved Bethe-Salpeter(B-S) method in two conditions of mixing angle $\theta$: one is $\theta=35.3^\circ$; another is considering the correction to mixing angle $\theta=35.3^\circ+\theta_1$. And we get some valuable predictions of the strong decay widths: $\Gamma(D_1^{\prime0})=232$ MeV, $\Gamma(D_1^0)=21.5$ MeV, $\Gamma(D_1^{\prime\pm})=232$ MeV, $\Gamma(D_1^\pm)=21.5$ MeV, $\Gamma(D_{s1}^{\prime\pm})=0.0101$ MeV, $\Gamma(D_{s1}^{\pm})=0.950$ MeV, $\Gamma(B_1^{\prime\pm})=263$ MeV, $\Gamma(B_1^{\pm})=16.8$ MeV, $\Gamma(B_{s1}^{\prime})=0.01987$ MeV and $\Gamma(B_{s1})=0.412$ MeV. We find that the decay widths of $D_{s1}^{\pm}$ and $B_{s1}$ are very sensitive to the mixing angle. And our results will provide the theoretical assistance by the future experiments.
• ### Impulsive Control for G-AIMD Dynamics with Relaxed and Hard Constraints(1803.07127)

March 19, 2018 cs.NI, math.OC
Motivated by various applications from Internet congestion control to power control in smart grids and electric vehicle charging, we study Generalized Additive Increase Multiplicative Decrease (G-AIMD) dynamics under impulsive control in continuous time with the time average alpha-fairness criterion. We first show that the control under relaxed constraints can be described by a threshold. Then, we propose a Whittle-type index heuristic for the hard constraint problem. We prove that in the homogeneous case the index policy is asymptotically optimal when the number of users is large.
• ### Few-View CT Reconstruction with Group-Sparsity Regularization(1803.01546)

March 5, 2018 physics.med-ph, eess.IV
Classical total variation (TV) based iterative reconstruction algorithms assume that the signal is piecewise smooth, which causes reconstruction results to suffer from the over-smoothing effect. To address this problem, this work presents a novel computed tomography (CT) reconstruction method for the few-view problem called the group-sparsity regularization-based simultaneous algebraic reconstruction technique (GSR-SART). Group-based sparse representation, which utilizes the concept of a group as the basic unit of sparse representation instead of a patch, is introduced as the image domain prior regularization term to eliminate the over-smoothing effect. By grouping the nonlocal patches into different clusters with similarity measured by Euclidean distance, the sparsity and nonlocal similarity in a single image are simultaneously explored. The split Bregman iteration algorithm is applied to obtain the numerical scheme. Experimental results demonstrate that our method both qualitatively and quantitatively outperforms several existing reconstruction methods, including filtered back projection, expectation maximization, SART, and TV-based projections onto convex sets.
• ### Stronger generalization bounds for deep nets via a compression approach(1802.05296)

Feb. 28, 2018 cs.LG
Deep nets generalize well despite having more parameters than the number of training samples. Recent works try to give an explanation using PAC-Bayes and Margin-based analyses, but do not as yet result in sample complexity bounds better than naive parameter counting. The current paper shows generalization bounds that're orders of magnitude better in practice. These rely upon new succinct reparametrizations of the trained net --- a compression that is explicit and efficient. These yield generalization bounds via a simple compression-based framework introduced here. Our results also provide some theoretical justification for widespread empirical success in compressing deep nets. Analysis of correctness of our compression relies upon some newly identified \textquotedblleft noise stability\textquotedblright properties of trained deep nets, which are also experimentally verified. The study of these properties and resulting generalization bounds are also extended to convolutional nets, which had eluded earlier attempts on proving generalization.
• ### Optimal Impulse Control of Dynamical Systems(1802.09809)

Feb. 27, 2018 math.OC
Using the tools of the Markov Decision Processes, we justify the dynamic programming approach to the optimal impulse control of deterministic dynamical systems. We prove the equivalence of the integral and differential forms of the optimality equation. The theory is illustrated by an example from mathematical epidemiology. The developed methods can be also useful for the study of piecewise deterministic Markov processes.
• ### Not-So-Random Features(1710.10230)

Feb. 27, 2018 cs.LG, stat.ML
We propose a principled method for kernel learning, which relies on a Fourier-analytic characterization of translation-invariant or rotation-invariant kernels. Our method produces a sequence of feature maps, iteratively refining the SVM margin. We provide rigorous guarantees for optimality and generalization, interpreting our algorithm as online equilibrium-finding dynamics in a certain two-player min-max game. Evaluations on synthetic and real-world datasets demonstrate scalability and consistent improvements over related random features-based methods.
• ### Desingularization in the $q$-Weyl algebra(1801.04160)

Feb. 25, 2018 cs.SC
In this paper, we study the desingularization problem in the first $q$-Weyl algebra. We give an order bound for desingularized operators, and thus derive an algorithm for computing desingularized operators in the first $q$-Weyl algebra. Moreover, an algorithm is presented for computing a generating set of the first $q$-Weyl closure of a given $q$-difference operator. As an application, we certify that several instances of the colored Jones polynomial are Laurent polynomial sequences by computing the corresponding desingularized operator.
• ### Mimetic Spectral Element Method for Anisotropic Diffusion(1802.04597)

Feb. 13, 2018 math.NA
This paper addresses the topological structure of steady, anisotropic, inhomogeneous diffusion problems. Two discrete formulations: a) mixed and b) direct formulations are discussed. Differential operators are represented by sparse incidence matrices, while weighted mass matrices play the role of metric-dependent Hodge matrices. The resulting mixed formulations are point-wise divergence-free if the right hand side function f = 0. The method is inf-sup stable and displays optimal convergence on orthogonal and non-affine grids.