• ### Intelligent Identification of Two-Dimensional Structure by Machine-Learning Optical Microscopy(1803.02062)

March 6, 2018 cond-mat.mtrl-sci
Two-dimensional (2D) materials and their heterostructures, with wafer-scale synthesis methods and fascinating properties, have attracted numerous interest and triggered revolutions of corresponding device applications. However, facile methods to realize accurate, intelligent and large-area characterizations of these 2D structures are still highly desired. Here, we report a successful application of machine-learning strategy in the optical identification of 2D structure. The machine-learning optical identification method (MOI method) endows optical microscopy with intelligent insight into the characteristic colour information in the optical photograph. Experimental results indicate that the MOI method enables accurate, intelligent and large-area characterizations of graphene, molybdenum disulphide (MoS2) and their heterostructures, including identifications of the thickness, the existence of impurities, and even the stacking order. Thanks to the convergence of artificial intelligence and nanoscience, this intelligent identification method can certainly promote the fundamental research and wafer-scale device application of 2D structures.
• ### Magic-angle graphene superlattices: a new platform for unconventional superconductivity(1803.02342)

The understanding of strongly-correlated materials, and in particular unconventional superconductors, has puzzled physicists for decades. Such difficulties have stimulated new research paradigms, such as ultra-cold atom lattices for simulating quantum materials. Here we report on the realization of intrinsic unconventional superconductivity in a 2D superlattice created by stacking two graphene sheets with a small twist angle. For angles near $1.1^\circ$, the first `magic' angle, twisted bilayer graphene (TBG) exhibits ultra-flat bands near charge neutrality, which lead to correlated insulating states at half-filling. Upon electrostatic doping away from these correlated insulating states, we observe tunable zero-resistance states with a critical temperature $T_c$ up to 1.7 K. The temperature-density phase diagram shows similarities with that of the cuprates, including superconducting domes. Moreover, quantum oscillations indicate small Fermi surfaces near the correlated insulating phase, in analogy with under-doped cuprates. The relative high $T_c$, given such small Fermi surface (corresponding to a record-low 2D carrier density of $10^{11} \textrm{cm}^{-2}$ , renders TBG among the strongest coupling superconductors, in a regime close to the BCS-BEC crossover. These novel results establish TBG as the first purely carbon-based 2D superconductor and as a highly tunable platform to investigate strongly-correlated phenomena, which could lead to insights into the physics of high-$T_c$ superconductors and quantum spin liquids.
• ### Matrix-product structure of constacyclic codes over finite chain rings $\mathbb{F}_{p^m}[u]/\langle u^e\rangle$(1803.01095)

March 3, 2018 cs.IT, math.IT
Let $m,e$ be positive integers, $p$ a prime number, $\mathbb{F}_{p^m}$ be a finite field of $p^m$ elements and $R=\mathbb{F}_{p^m}[u]/\langle u^e\rangle$ which is a finite chain ring. For any $\omega\in R^\times$ and positive integers $k, n$ satisfying ${\rm gcd}(p,n)=1$, we prove that any $(1+\omega u)$-constacyclic code of length $p^kn$ over $R$ is monomially equivalent to a matrix-product code of a nested sequence of $p^k$ cyclic codes with length $n$ over $R$ and a $p^k\times p^k$ matrix $A_{p^k}$ over $\mathbb{F}_p$. Using the matrix-product structures, we give an iterative construction of every $(1+\omega u)$-constacyclic code by $(1+\omega u)$-constacyclic codes of shorter lengths over $R$.
• ### Negacyclic codes over the local ring $\mathbb{Z}_4[v]/\langle v^2+2v\rangle$ of oddly even length and their Gray images(1803.00467)

Feb. 28, 2018 cs.IT, math.IT
Let $R=\mathbb{Z}_{4}[v]/\langle v^2+2v\rangle=\mathbb{Z}_{4}+v\mathbb{Z}_{4}$ ($v^2=2v$) and $n$ be an odd positive integer. Then $R$ is a local non-principal ideal ring of $16$ elements and there is a $\mathbb{Z}_{4}$-linear Gray map from $R$ onto $\mathbb{Z}_{4}^2$ which preserves Lee distance and orthogonality. First, a canonical form decomposition and the structure for any negacyclic code over $R$ of length $2n$ are presented. From this decomposition, a complete classification of all these codes is obtained. Then the cardinality and the dual code for each of these codes are given, and self-dual negacyclic codes over $R$ of length $2n$ are presented. Moreover, all $23\cdot(4^p+5\cdot 2^p+9)^{\frac{2^{p}-2}{p}}$ negacyclic codes over $R$ of length $2M_p$ and all $3\cdot(4^p+5\cdot 2^p+9)^{\frac{2^{p-1}-1}{p}}$ self-dual codes among them are presented precisely, where $M_p=2^p-1$ is a Mersenne prime. Finally, $36$ new and good self-dual $2$-quasi-twisted linear codes over $\mathbb{Z}_4$ with basic parameters $(28,2^{28}, d_L=8,d_E=12)$ and of type $2^{14}4^7$ and basic parameters $(28,2^{28}, d_L=6,d_E=12)$ and of type $2^{16}4^6$ which are Gray images of self-dual negacyclic codes over $R$ of length $14$ are listed.
• ### Correlated Insulator Behaviour at Half-Filling in Magic Angle Graphene Superlattices(1802.00553)

Van der Waals (vdW) heterostructures are an emergent class of metamaterials comprised of vertically stacked two-dimensional (2D) building blocks, which provide us with a vast tool set to engineer their properties on top of the already rich tunability of 2D materials. One of the knobs, the twist angle between different layers, plays a crucial role in the ultimate electronic properties of a vdW heterostructure and does not have a direct analog in other systems such as MBE-grown semiconductor heterostructures. For small twist angles, the moir\'e pattern produced by the lattice misorientation creates a long-range modulation. So far, the study of the effect of twist angles in vdW heterostructures has been mostly concentrated in graphene/hexagonal boron nitride (h-BN) twisted structures, which exhibit relatively weak interlayer interaction due to the presence of a large bandgap in h-BN. Here we show that when two graphene sheets are twisted by an angle close to the theoretically predicted 'magic angle', the resulting flat band structure near charge neutrality gives rise to a strongly-correlated electronic system. These flat bands exhibit half-filling insulating phases at zero magnetic field, which we show to be a Mott-like insulator arising from electrons localized in the moir\'e superlattice. These unique properties of magic-angle twisted bilayer graphene (TwBLG) open up a new playground for exotic many-body quantum phases in a 2D platform made of pure carbon and without magnetic field. The easy accessibility of the flat bands, the electrical tunability, and the bandwidth tunability though twist angle may pave the way towards more exotic correlated systems, such as unconventional superconductors or quantum spin liquids.
• ### Satellite-relayed intercontinental quantum network(1801.04418)

Jan. 13, 2018 quant-ph
We perform decoy-state quantum key distribution between a low-Earth-orbit satellite and multiple ground stations located in Xinglong, Nanshan, and Graz, which establish satellite-to-ground secure keys with ~kHz rate per passage of the satellite Micius over a ground station. The satellite thus establishes a secure key between itself and, say, Xinglong, and another key between itself and, say, Graz. Then, upon request from the ground command, Micius acts as a trusted relay. It performs bitwise exclusive OR operations between the two keys and relays the result to one of the ground stations. That way, a secret key is created between China and Europe at locations separated by 7600 km on Earth. These keys are then used for intercontinental quantum-secured communication. This was on the one hand the transmission of images in a one-time pad configuration from China to Austria as well as from Austria to China. Also, a videoconference was performed between the Austrian Academy of Sciences and the Chinese Academy of Sciences, which also included a 280 km optical ground connection between Xinglong and Beijing. Our work points towards an efficient solution for an ultralong-distance global quantum network, laying the groundwork for a future quantum internet.
• ### Bell Test Over Extremely High-Loss Channels: Towards Distributing Entangled Photon Pairs Between Earth and Moon(1712.03204)

Dec. 8, 2017 quant-ph
Quantum entanglement was termed "spooky action at a distance" in the well-known paper by Einstein, Podolsky, and Rosen. Entanglement is expected to be distributed over longer and longer distances in both practical applications and fundamental research into the principles of nature. Here, we present a proposal for distributing entangled photon pairs between the Earth and Moon using a Lagrangian point at a distance of 1.28 light seconds. One of the most fascinating features in this long-distance distribution of entanglement is that we can perform Bell test with human supply the random measurement settings and record the results while still maintaining space-like intervals. To realize a proof-of-principle experiment, we develop an entangled photon source with 1 GHz generation rate, about 2 orders of magnitude higher than previous results. Violation of the Bell's inequality was observed under a total simulated loss of 103 dB with measurement settings chosen by two experimenters. This demonstrates the feasibility of such long-distance Bell test over extremely high-loss channels, paving the way for the ultimate test of the foundations of quantum mechanics.
• ### High speed self-testing quantum random number generation without detection loophole(1709.06779)

Sept. 20, 2017 quant-ph
Quantum mechanics provides means of generating genuine randomness that is impossible with deterministic classical processes. Remarkably, the unpredictability of randomness can be certified in a self-testing manner that is independent of implementation devices. Here, we present an experimental demonstration of self-testing quantum random number generation based on an detection-loophole free Bell test with entangled photons. In the randomness analysis, without the assumption of independent identical distribution, we consider the worst case scenario that the adversary launches the most powerful attacks against quantum adversary. After considering statistical fluctuations and applying an 80 Gb $\times$ 45.6 Mb Toeplitz matrix hashing, we achieve a final random bit rate of 114 bits/s, with a failure probability less than $10^{-5}$. Such self-testing random number generators mark a critical step towards realistic applications in cryptography and fundamental physics tests.
• ### Matrix-product structure of repeated-root constacyclic codes over finite fields(1705.08819)

Aug. 29, 2017 cs.IT, math.IT
For any prime number $p$, positive integers $m, k, n$ satisfying ${\rm gcd}(p,n)=1$ and $\lambda_0\in \mathbb{F}_{p^m}^\times$, we prove that any $\lambda_0^{p^k}$-constacyclic code of length $p^kn$ over the finite field $\mathbb{F}_{p^m}$ is monomially equivalent to a matrix-product code of a nested sequence of $p^k$ $\lambda_0$-constacyclic codes with length $n$ over $\mathbb{F}_{p^m}$.
• ### Population Density-based Hospital Recommendation with Mobile LBS Big Data(1708.00759)

Aug. 2, 2017 cs.SI
The difficulty of getting medical treatment is one of major livelihood issues in China. Since patients lack prior knowledge about the spatial distribution and the capacity of hospitals, some hospitals have abnormally high or sporadic population densities. This paper presents a new model for estimating the spatiotemporal population density in each hospital based on location-based service (LBS) big data, which would be beneficial to guiding and dispersing outpatients. To improve the estimation accuracy, several approaches are proposed to denoise the LBS data and classify people by detecting their various behaviors. In addition, a long short-term memory (LSTM) based deep learning is presented to predict the trend of population density. By using Baidu large-scale LBS logs database, we apply the proposed model to 113 hospitals in Beijing, P. R. China, and constructed an online hospital recommendation system which can provide users with a hospital rank list basing the real-time population density information and the hospitals' basic information such as hospitals' levels and their distances. We also mine several interesting patterns from these LBS logs by using our proposed system.
• ### Satellite-Based Entanglement Distribution Over 1200 kilometers(1707.01339)

Long-distance entanglement distribution is essential both for foundational tests of quantum physics and scalable quantum networks. Owing to channel loss, however, the previously achieved distance was limited to ~100 km. Here, we demonstrate satellite-based distribution of entangled photon pairs to two locations separated by 1203 km on the Earth, through satellite-to-ground two-downlink with a sum of length varies from 1600 km to 2400 km. We observe a survival of two-photon entanglement and a violation of Bell inequality by 2.37+/-0.09 under strict Einstein locality conditions. The obtained effective link efficiency at 1200 km in this work is over 12 orders of magnitude higher than the direct bidirectional transmission of the two photons through the best commercial telecommunication fibers with a loss of 0.16 dB/km.
• ### Satellite-to-ground quantum key distribution(1707.00542)

Quantum key distribution (QKD) uses individual light quanta in quantum superposition states to guarantee unconditional communication security between distant parties. In practice, the achievable distance for QKD has been limited to a few hundred kilometers, due to the channel loss of fibers or terrestrial free space that exponentially reduced the photon rate. Satellite-based QKD promises to establish a global-scale quantum network by exploiting the negligible photon loss and decoherence in the empty out space. Here, we develop and launch a low-Earth-orbit satellite to implement decoy-state QKD with over kHz key rate from the satellite to ground over a distance up to 1200 km, which is up to 20 orders of magnitudes more efficient than that expected using an optical fiber (with 0.2 dB/km loss) of the same length. The establishment of a reliable and efficient space-to-ground link for faithful quantum state transmission constitutes a key milestone for global-scale quantum networks.
• ### Direct Counterfactual Communication with Single Photons(1403.5082)

June 5, 2017 quant-ph
Intuition from our everyday lives gives rise to the belief that information exchanged between remote parties is carried by physical particles. Surprisingly, in a recent theoretical study [Salih H, Li ZH, Al-Amri M, Zubairy MS (2013) Phys Rev Lett 110:170502], quantum mechanics was found to allow for communication, even without the actual transmission of physical particles. From the viewpoint of communication, this mystery stems from a (nonintuitive) fundamental concept in quantum mechanics wave-particle duality. All particles can be described fully by wave functions. To determine whether light appears in a channel, one refers to the amplitude of its wave function. However, in counterfactual communication, information is carried by the phase part of the wave function. Using a single-photon source, we experimentally demonstrate the counterfactual communication and successfully transfer a monochrome bitmap from one location to another by using a nested version of the quantum Zeno effect.
• ### Random number generation with cosmic photons(1611.07126)

March 23, 2017 quant-ph
Random numbers are indispensable for a variety of applications ranging from testing physics foundation to information encryption. In particular, nonlocality tests provide a strong evidence to our current understanding of nature -- quantum mechanics. All the random number generators (RNG) used for the existing tests are constructed locally, making the test results vulnerable to the freedom-of-choice loophole. We report an experimental realization of RNGs based on the arrival time of cosmic photons. The measurement outcomes (raw data) pass the standard NIST statistical test suite. We present a realistic design to employ these RNGs in a Bell test experiment, which addresses the freedom-of-choice loophole.
• ### The Gray image of constacyclic codes over the finite chain ring $F_{p^m}[u]/\langle u^k\rangle$(1610.01471)

March 15, 2017 cs.IT, math.IT
Let $\mathbb{F}_{p^m}$ be a finite field of cardinality $p^m$, where $p$ is a prime, and $k, N$ be any positive integers. We denote $R_k=F_{p^m}[u]/\langle u^k\rangle =F_{p^m}+uF_{p^m}+\ldots+u^{k-1}F_{p^m}$ ($u^k=0$) and $\lambda=a_0+a_1u+\ldots+a_{k-1}u^{k-1}$ where $a_0, a_1,\ldots, a_{k-1}\in F_{p^m}$ satisfying $a_0\neq 0$ and $a_1=1$. Let $r$ be a positive integer satisfying $p^{r-1}+1\leq k\leq p^r$. We defined a Gray map from $R_k$ to $F_{p^m}^{p^r}$ first, then prove that the Gray image of any linear $\lambda$-constacyclic code over $R_k$ of length $N$ is a distance invariant linear $a_0^{p^r}$-constacyclic code over $F_{p^m}$ of length $p^rN$. Furthermore, the generator polynomials for each linear $\lambda$-constacyclic code over $R_k$ of length $N$ and its Gray image are given respectively. Finally, some optimal constacyclic codes over $F_{3}$ and $F_{5}$ are constructed.
• ### On a class of constacyclic codes over the non-principal ideal ring $\mathbb{Z}_{p^s}+u\mathbb{Z}_{p^s}$(1703.00761)

March 2, 2017 cs.IT, math.IT
$(1+pw)$-constacyclic codes of arbitrary length over the non-principal ideal ring $\mathbb{Z}_{p^s} +u\mathbb{Z}_{p^s}$ are studied, where $p$ is a prime, $w\in \mathbb{Z}_{p^s}^{\times}$ and $s$ an integer satisfying $s\geq 2$. First, the structure of any $(1+pw)$-constacyclic code over $\mathbb{Z}_{p^s} +u\mathbb{Z}_{p^s}$ are presented. Then enumerations for the number of all codes and the number of codewords in each code, and the structure of dual codes for these codes are given, respectively. Then self-dual $(1+2w)$-constacyclic codes over $\mathbb{Z}_{2^s} +u\mathbb{Z}_{2^s}$ are investigated, where $w=2^{s-2}-1$ or $2^{s-1}-1$ if $s\geq 3$, and $w=1$ if $s=2$.
• ### Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation(1609.08144)

Oct. 8, 2016 cs.AI, cs.CL, cs.LG
Neural Machine Translation (NMT) is an end-to-end learning approach for automated translation, with the potential to overcome many of the weaknesses of conventional phrase-based translation systems. Unfortunately, NMT systems are known to be computationally expensive both in training and in translation inference. Also, most NMT systems have difficulty with rare words. These issues have hindered NMT's use in practical deployments and services, where both accuracy and speed are essential. In this work, we present GNMT, Google's Neural Machine Translation system, which attempts to address many of these issues. Our model consists of a deep LSTM network with 8 encoder and 8 decoder layers using attention and residual connections. To improve parallelism and therefore decrease training time, our attention mechanism connects the bottom layer of the decoder to the top layer of the encoder. To accelerate the final translation speed, we employ low-precision arithmetic during inference computations. To improve handling of rare words, we divide words into a limited set of common sub-word units ("wordpieces") for both input and output. This method provides a good balance between the flexibility of "character"-delimited models and the efficiency of "word"-delimited models, naturally handles translation of rare words, and ultimately improves the overall accuracy of the system. Our beam search technique employs a length-normalization procedure and uses a coverage penalty, which encourages generation of an output sentence that is most likely to cover all the words in the source sentence. On the WMT'14 English-to-French and English-to-German benchmarks, GNMT achieves competitive results to state-of-the-art. Using a human side-by-side evaluation on a set of isolated simple sentences, it reduces translation errors by an average of 60% compared to Google's phrase-based production system.
• ### Complete classification of $(\delta+\alpha u^2)$-constacyclic codes over $\mathbb{F}_{2^m}[u]/\langle u^4\rangle$ of oddly even length(1609.06065)

Sept. 20, 2016 cs.IT, math.IT
Let $\mathbb{F}_{2^m}$ be a finite field of cardinality $2^m$, $R=\mathbb{F}_{2^m}[u]/\langle u^4\rangle)$ and $n$ is an odd positive integer. For any $\delta,\alpha\in \mathbb{F}_{2^m}^{\times}$, ideals of the ring $R[x]/\langle x^{2n}-(\delta+\alpha u^2)\rangle$ are identified as $(\delta+\alpha u^2)$-constacyclic codes of length $2n$ over $R$. In this paper, an explicit representation and enumeration for all distinct $(\delta+\alpha u^2)$-constacyclic codes of length $2n$ over $R$ are presented.
• ### Left dihedral codes over Galois rings ${\rm GR}(p^2,m)$(1609.04083)

Sept. 14, 2016 cs.IT, math.IT, math.RA
Let $D_{2n}=\langle x,y\mid x^n=1, y^2=1, yxy=x^{-1}\rangle$ be a dihedral group, and $R={\rm GR}(p^2,m)$ be a Galois ring of characteristic $p^2$ and cardinality $p^{2m}$ where $p$ is a prime. Left ideals of the group ring $R[D_{2n}]$ are called left dihedral codes over $R$ of length $2n$, and abbreviated as left $D_{2n}$-codes over $R$. Let ${\rm gcd}(n,p)=1$ in this paper. Then any left $D_{2n}$-code over $R$ is uniquely decomposed into a direct sum of concatenated codes with inner codes ${\cal A}_i$ and outer codes $C_i$, where ${\cal A}_i$ is a cyclic code over $R$ of length $n$ and $C_i$ is a skew cyclic code of length $2$ over an extension Galois ring or principal ideal ring of $R$, and a generator matrix and basic parameters for each outer code $C_i$ is given. Moreover, a formula to count the number of these codes is obtained, the dual code for each left $D_{2n}$-code is determined and all self-dual left $D_{2n}$-codes and self-orthogonal left $D_{2n}$-codes over $R$ are presented, respectively.
• ### Constacyclic codes of length $p^sn$ over $\mathbb{F}_{p^m}+u\mathbb{F}_{p^m}$(1512.01406)

Dec. 4, 2015 cs.IT, math.IT
Let $\mathbb{F}_{p^m}$ be a finite field of cardinality $p^m$ and $R=\mathbb{F}_{p^m}[u]/\langle u^2\rangle=\mathbb{F}_{p^m}+u\mathbb{F}_{p^m}$ $(u^2=0)$, where $p$ is a prime and $m$ is a positive integer. For any $\lambda\in \mathbb{F}_{p^m}^{\times}$, an explicit representation for all distinct $\lambda$-constacyclic codes over $R$ of length $p^sn$ is given by a canonical form decomposition for each code, where $s$ and $n$ are positive integers satisfying ${\rm gcd}(p,n)=1$. For any such code, using its canonical form decomposition the representation for the dual code of the code is provided. Moreover, representations for all distinct negacyclic codes and their dual codes of length $p^sn$ over $R$ are obtained, and self-duality for these codes are determined. Finally, all distinct self-dual negacyclic codes over $\mathbb{F}_5+u\mathbb{F}_5$ of length $2\cdot 5^s\cdot 3^t$ are listed for any positive integer $t$.
• ### Cyclic codes over $\mathbb{F}_{2^m}[u]/\langle u^k\rangle$ of oddly even length(1511.05413)

Nov. 17, 2015 cs.IT, math.IT
Let $\mathbb{F}_{2^m}$ be a finite field of characteristic $2$ and $R=\mathbb{F}_{2^m}[u]/\langle u^k\rangle=\mathbb{F}_{2^m} +u\mathbb{F}_{2^m}+\ldots+u^{k-1}\mathbb{F}_{2^m}$ ($u^k=0$) where $k\in \mathbb{Z}^{+}$ satisfies $k\geq 2$. For any odd positive integer $n$, it is known that cyclic codes over $R$ of length $2n$ are identified with ideals of the ring $R[x]/\langle x^{2n}-1\rangle$. In this paper, an explicit representation for each cyclic code over $R$ of length $2n$ is provided and a formula to count the number of codewords in each code is given. Then a formula to calculate the number of cyclic codes over $R$ of length $2n$ is obtained. Moreover, the dual code of each cyclic code and self-dual cyclic codes over $R$ of length $2n$ are investigated. (AAECC-1522)
• ### On $(\alpha+u\beta)$-constacyclic codes of length $p^sn$ over $\mathbb{F}_{p^m}+u\mathbb{F}_{p^m}$(1511.02743)

Nov. 10, 2015 cs.IT, math.IT
Let $\mathbb{F}_{p^m}$ be a finite field of cardinality $p^m$ and $R=\mathbb{F}_{p^m}[u]/\langle u^2\rangle=\mathbb{F}_{p^m}+u\mathbb{F}_{p^m}$ $(u^2=0)$, where $p$ is an odd prime and $m$ is a positive integer. For any $\alpha,\beta\in \mathbb{F}_{p^m}^{\times}$, the aim of this paper is to represent all distinct $(\alpha+u\beta)$-constacyclic codes over $R$ of length $p^sn$ and their dual codes, where $s$ is a nonnegative integer and $n$ is a positive integer satisfying ${\rm gcd}(p,n)=1$. Especially, all distinct $(2+u)$-constacyclic codes of length $6\cdot 5^t$ over $\mathbb{F}_{3}+u\mathbb{F}_3$ and their dual codes are listed, where $t$ is a positive integer.
• ### On a class of $(\delta+\alpha u^2)$-constacyclic codes over $\mathbb{F}_{q}[u]/\langle u^4\rangle$(1511.02369)

Nov. 7, 2015 cs.IT, math.IT
Let $\mathbb{F}_{q}$ be a finite field of cardinality $q$, $R=\mathbb{F}_{q}[u]/\langle u^4\rangle=\mathbb{F}_{q}+u\mathbb{F}_{q}+u^2\mathbb{F}_{q}+u^3\mathbb{F}_{q}$ $(u^4=0)$ which is a finite chain ring, and $n$ be a positive integer satisfying ${\rm gcd}(q,n)=1$. For any $\delta,\alpha\in \mathbb{F}_{q}^{\times}$, an explicit representation for all distinct $(\delta+\alpha u^2)$-constacyclic codes over $R$ of length $n$ is given, and the dual code for each of these codes is determined. For the case of $q=2^m$ and $\delta=1$, all self-dual $(1+\alpha u^2)$-constacyclic codes over $R$ of odd length $n$ are provided.
• ### Training Conditional Random Fields with Natural Gradient Descent(1508.02373)

Aug. 10, 2015 cs.LG
We propose a novel parameter estimation procedure that works efficiently for conditional random fields (CRF). This algorithm is an extension to the maximum likelihood estimation (MLE), using loss functions defined by Bregman divergences which measure the proximity between the model expectation and the empirical mean of the feature vectors. This leads to a flexible training framework from which multiple update strategies can be derived using natural gradient descent (NGD). We carefully choose the convex function inducing the Bregman divergence so that the types of updates are reduced, while making the optimization procedure more effective by transforming the gradients of the log-likelihood loss function. The derived algorithms are very simple and can be easily implemented on top of the existing stochastic gradient descent (SGD) optimization procedure, yet it is very effective as illustrated by experimental results.
• ### Local and Global Inference for High Dimensional Nonparanormal Graphical Models(1502.02347)

June 30, 2015 stat.ML
This paper proposes a unified framework to quantify local and global inferential uncertainty for high dimensional nonparanormal graphical models. In particular, we consider the problems of testing the presence of a single edge and constructing a uniform confidence subgraph. Due to the presence of unknown marginal transformations, we propose a pseudo likelihood based inferential approach. In sharp contrast to the existing high dimensional score test method, our method is free of tuning parameters given an initial estimator, and extends the scope of the existing likelihood based inferential framework. Furthermore, we propose a U-statistic multiplier bootstrap method to construct the confidence subgraph. We show that the constructed subgraph is contained in the true graph with probability greater than a given nominal level. Compared with existing methods for constructing confidence subgraphs, our method does not rely on Gaussian or sub-Gaussian assumptions. The theoretical properties of the proposed inferential methods are verified by thorough numerical experiments and real data analysis.