• We present Low*, a language for low-level programming and verification, and its application to high-assurance optimized cryptographic libraries. Low* is a shallow embedding of a small, sequential, well-behaved subset of C in F*, a dependently-typed variant of ML aimed at program verification. Departing from ML, Low* does not involve any garbage collection or implicit heap allocation; instead, it has a structured memory model \`a la CompCert, and it provides the control required for writing efficient low-level security-critical code. By virtue of typing, any Low* program is memory safe. In addition, the programmer can make full use of the verification power of F* to write high-level specifications and verify the functional correctness of Low* code using a combination of SMT automation and sophisticated manual proofs. At extraction time, specifications and proofs are erased, and the remaining code enjoys a predictable translation to C. We prove that this translation preserves semantics and side-channel resistance. We provide a new compiler back-end from Low* to C and, to evaluate our approach, we implement and verify various cryptographic algorithms, constructions, and tools for a total of about 28,000 lines of code, specification and proof. We show that our Low* code delivers performance competitive with existing (unverified) C cryptographic libraries, suggesting our approach may be applicable to larger-scale low-level software.
  • To well understand crowd behavior, microscopic models have been developed in recent decades, in which an individual's behavioral/psychological status can be modeled and simulated. A well-known model is the social-force model innovated by physical scientists (Helbing and Molnar, 1995; Helbing, Farkas and Vicsek, 2000; Helbing et al., 2002). This model has been widely accepted and mainly used in simulation of crowd evacuation in the past decade. A problem, however, is that the testing results of the model were not explained in consistency with the psychological findings, resulting in misunderstanding of the model by psychologists. This paper will bridge the gap between psychological studies and physical explanation about this model. We reinterpret this physics-based model from a psychological perspective, clarifying that the model is consistent with psychological theories on stress, including time-related stress and interpersonal stress. Based on the conception of stress, we renew the model at both micro-and-macro level, referring to multi-agent simulation in a microscopic sense and fluid-based analysis in a macroscopic sense. The cognition and behavior of individual agents are critically modeled as response to environmental stimuli. Existing simulation results such as faster-is-slower effect will be reinterpreted by Yerkes-Dodson law, and herding and grouping effect are further discussed by integrating attraction into the social force. In brief the social-force model exhibits a bridge between the physics laws and psychological principles regarding crowd motion, and this paper will renew and reinterpret the model on the foundation of psychological studies.
  • The volume of time series data has exploded due to the popularity of new applications, such as data center management and IoT. Subsequence matching is a fundamental task in mining time series data. All index-based approaches only consider raw subsequence matching (RSM) and do not support subsequence normalization. UCR Suite can deal with normalized subsequence match problem (NSM), but it needs to scan full time series. In this paper, we propose a novel problem, named constrained normalized subsequence matching problem (cNSM), which adds some constraints to NSM problem. The cNSM problem provides a knob to flexibly control the degree of offset shifting and amplitude scaling, which enables users to build the index to process the query. We propose a new index structure, KV-index, and the matching algorithm, KV-match. With a single index, our approach can support both RSM and cNSM problems under either ED or DTW distance. KV-index is a key-value structure, which can be easily implemented on local files or HBase tables. To support the query of arbitrary lengths, we extend KV-match to KV-match$_{DP}$, which utilizes multiple varied-length indexes to process the query. We conduct extensive experiments on synthetic and real-world datasets. The results verify the effectiveness and efficiency of our approach.
  • Humans are capable of learning a new fine-grained concept with very little supervision, e.g., few exemplary images for a species of bird, yet our best deep learning systems need hundreds or thousands of labeled examples. In this paper, we try to reduce this gap by studying the fine-grained image recognition problem in a challenging few-shot learning setting, termed few-shot fine-grained recognition (FSFG). The task of FSFG requires the learning systems to build classifiers for novel fine-grained categories from few examples (only one or less than five). To solve this problem, we propose an end-to-end trainable deep network which is inspired by the state-of-the-art fine-grained recognition model and is tailored for the FSFG task. Specifically, our network consists of a bilinear feature learning module and a classifier mapping module: while the former encodes the discriminative information of an exemplar image into a feature vector, the latter maps the intermediate feature into the decision boundary of the novel category. The key novelty of our model is a "piecewise mappings" function in the classifier mapping module, which generates the decision boundary via learning a set of more attainable sub-classifiers in a more parameter-economic way. We learn the exemplar-to-classifier mapping based on an auxiliary dataset in a meta-learning fashion, which is expected to be able to generalize to novel categories. By conducting comprehensive experiments on three fine-grained datasets, we demonstrate that the proposed method achieves superior performance over the competing baselines.
  • Streaking of photoelectrons with optical lasers has been widely used for temporal characterization of attosecond extreme ultraviolet pulses. Recently, this technique has been adapted to characterize femtosecond x-ray pulses in free-electron lasers with the streaking imprinted by farinfrared and Terahertz (THz) pulses. Here, we report successful implementation of THz streaking for time-stamping of an ultrashort relativistic electron beam of which the energy is several orders of magnitude higher than photoelectrons. Such ability is especially important for MeV ultrafast electron diffraction (UED) applications where electron beams with a few femtosecond pulse width may be obtained with longitudinal compression while the arrival time may fluctuate at a much larger time scale. Using this laser-driven THz streaking technique, the arrival time of an ultrashort electron beam with 6 fs (rms) pulse width has been determined with 1.5 fs (rms) accuracy. Furthermore, we have proposed and demonstrated a non-invasive method for correction of the timing jitter with femtosecond accuracy through measurement of the compressed beam energy, which may allow one to advance UED towards sub-10 fs frontier far beyond the ~100 fs (rms) jitter.
  • We observe that focusing a femtosecond laser beam simultaneously chirped in time and space domains in glass can efficiently suppress the optical aberration caused by the refractive index mismatch at the interface of air and the glass sample. We then demonstrate three dimensional microprocessing in glass with a nearly invariant spatial resolution for a large range of penetration depth between 0.25 mm and 9 mm without any aberration correction.
  • In this note we consider homogeneous Willmore surfaces in $S^{n+2}$. The main result is that a homogeneous Willmore two-sphere is conformally equivalent to a homogeneous minimal two-sphere in $S^{n+2}$, i.e., either a round two-sphere or one of the Bor\r{u}vka-Veronese 2-spheres in $S^{2m}$. This entails a classification of all Willmore $\mathbb{C} P^1$ in $S^{2m}$. As a second main result we show that there exists no homogeneous Willmore upper-half plane in $S^{n+2}$ and we give, in terms of special constant potentials, a simple loop group characterization of all homogeneous surfaces which have an abelian transitive group.
  • In this paper, we focus on image inpainting task, aiming at recovering the missing area of an incomplete image given the context information. Recent development in deep generative models enables an efficient end-to-end framework for image synthesis and inpainting tasks, but existing methods based on generative models don't exploit the segmentation information to constrain the object shapes, which usually lead to blurry results on the boundary. To tackle this problem, we propose to introduce the semantic segmentation information, which disentangles the inter-class difference and intra-class variation for image inpainting. This leads to much clearer recovered boundary between semantically different regions and better texture within semantically consistent segments. Our model factorizes the image inpainting process into segmentation prediction (SP-Net) and segmentation guidance (SG-Net) as two steps, which predict the segmentation labels in the missing area first, and then generate segmentation guided inpainting results. Experiments on multiple public datasets show that our approach outperforms existing methods in optimizing the image inpainting quality, and the interactive segmentation guidance provides possibilities for multi-modal predictions of image inpainting.
  • The performance of penalized likelihood approaches depends profoundly on the selection of the tuning parameter; however, there is no commonly agreed-upon criterion for choosing the tuning parameter. Moreover, penalized likelihood estimation based on a single value of the tuning parameter suffers from several drawbacks. This article introduces a novel approach for feature selection based on the entire solution paths rather than the choice of a single tuning parameter, which significantly improves the accuracy of the selection. Moreover, the approach allows for feature selection using ridge or other strictly convex penalties. The key idea is to classify variables as relevant or irrelevant at each tuning parameter and then to select all of the variables which have been classified as relevant at least once. We establish the theoretical properties of the method, which requires significantly weaker conditions than existing methods in the literature. We also illustrate the advantages of the proposed approach with simulation studies and a data example.
  • This paper is concerned with the channel estimation problem in millimetre wave (MMW) wireless systems with large antenna arrays. By exploiting the sparse nature of the MMW channel, we present an efficient estimation algorithm based on a novel overlapped beam pattern design. The performance of the algorithm is analyzed and an upper bound on the probability of channel estimation failure is derived. Results show that the algorithm can significantly reduce the number of required measurements in channel estimation (e.g., by 225% when a single overlap is used) when compared to the existing channel estimation algorithm based on non-overlapped beam patterns.
  • Autonomous driving has harsh requirements of small model size and energy efficiency, in order to enable the embedded system to achieve real-time on-board object detection. Recent deep convolutional neural network based object detectors have achieved state-of-the-art accuracy. However, such models are trained with numerous parameters and their high computational costs and large storage prohibit the deployment to memory and computation resource limited systems. Low-precision neural networks are popular techniques for reducing the computation requirements and memory footprint. Among them, binary weight neural network (BWN) is the extreme case which quantizes the float-point into just $1$ bit. BWNs are difficult to train and suffer from accuracy deprecation due to the extreme low-bit representation. To address this problem, we propose a knowledge transfer (KT) method to aid the training of BWN using a full-precision teacher network. We built DarkNet- and MobileNet-based binary weight YOLO-v2 detectors and conduct experiments on KITTI benchmark for car, pedestrian and cyclist detection. The experimental results show that the proposed method maintains high detection accuracy while reducing the model size of DarkNet-YOLO from 257 MB to 8.8 MB and MobileNet-YOLO from 193 MB to 7.9 MB.
  • The alignment between satellites and central galaxies has been studied in detail both in observational and theoretical works. The widely accepted fact is that the satellites preferentially reside along the major axis of their central galaxy. However, the origin and large-scale environment dependence of this alignment are still unknown. In an attempt to figure out those, we use data constructed from SDSS DR7 to investigate the large-scale environmental dependence of this alignment with emphasis on examining the alignments' dependence on the colour of the central galaxy. We find a very strong large-scale environmental dependence of the satellite-central alignment in groups with blue centrals. Satellites of blue centrals in knots are preferentially located perpendicular to the major axis of the centrals, and the alignment angle decreases with environment namely when going from knots to voids. The alignment angle strongly depend on the ${}^{0.1}(g-r)$ colour of centrals. We suggest that the satellite-central alignment is the result of a competition between satellite accretion within large scale-structure and galaxy evolution inside host haloes. For groups containing red central galaxies, the satellite-central alignment is mainly determined by the evolution effect, while for blue central dominated groups, the effect of large-scale structure plays a more important role, especially in knots. Our results provide an explanation for how the satellite-central alignment forms within different large-scale environments. The perpendicular case in groups and knots with blue centrals may also provide insight into understanding similar polar arrangements such the formation of the Milky Way and Centaurus A's satellite system.
  • We study how to synthesize novel views of human body from a single image. Though recent deep learning based methods work well for rigid objects, they often fail on objects with large articulation, like human bodies. The core step of existing methods is to fit a map from the observable views to novel views by CNNs; however, the rich articulation modes of human body make it rather challenging for CNNs to memorize and interpolate the data well. To address the problem, we propose a novel deep learning based pipeline that explicitly estimates and leverages the geometry of the underlying human body. Our new pipeline is a composition of a shape estimation network and an image generation network, and at the interface a perspective transformation is applied to generate a forward flow for pixel value transportation. Our design is able to factor out the space of data variation and makes learning at each step much easier. Empirically, we show that the performance for pose-varying objects can be improved dramatically. Our method can also be applied on real data captured by 3D sensors, and the flow generated by our methods can be used for generating high quality results in higher resolution.
  • It has been recently shown that a convolutional neural network can learn optical flow estimation with unsupervised learning. However, the performance of the unsupervised methods still has a relatively large gap compared to its supervised counterpart. Occlusion and large motion are some of the major factors that limit the current unsupervised learning of optical flow methods. In this work we introduce a new method which models occlusion explicitly and a new warping way that facilitates the learning of large motion. Our method shows promising results on Flying Chairs, MPI-Sintel and KITTI benchmark datasets. Especially on KITTI dataset where abundant unlabeled samples exist, our unsupervised method outperforms its counterpart trained with supervised learning.
  • The mass flow rate of Poiseuille flow of rarefied gas through long ducts of two-dimensional cross-sections with arbitrary shape are critical in the pore-network modeling of gas transport in porous media. In this paper, for the first time, the high-order hybridizable discontinuous Galerkin (HDG) method is used to find the steady-state solution of the linearized Bhatnagar-Gross-Krook equation on two-dimensional triangular meshes. The velocity distribution function and its traces are approximated in the piecewise polynomial space (of degree up to 4) on the triangular meshes and the mesh skeletons, respectively. By employing a numerical flux that is derived from the first-order upwind scheme and imposing its continuity on the mesh skeletons, global systems for unknown traces are obtained with a few coupled degrees of freedom. To achieve fast convergence to the steady-state solution, a diffusion-type equation for flow velocity that is asymptotic-preserving into the fluid dynamic limit is solved by the HDG simultaneously, on the same meshes. The proposed HDG-synthetic iterative scheme is proved to be accurate and efficient. Specifically, for flows in the near-continuum regime, numerical simulations have shown that, to achieve the same level of accuracy, our scheme could be faster than the conventional iterative scheme by two orders of magnitude, while it is faster than the synthetic iterative scheme based on the finite difference discretization in the spatial space by one order of magnitude. The HDG-synthetic iterative scheme is ready to be extended to simulate rarefied gas mixtures and the Boltzmann collision operator.
  • In this paper, we exploit a memory-augmented neural network to predict accurate answers to visual questions, even when those answers occur rarely in the training set. The memory network incorporates both internal and external memory blocks and selectively pays attention to each training exemplar. We show that memory-augmented neural networks are able to maintain a relatively long-term memory of scarce training exemplars, which is important for visual question answering due to the heavy-tailed distribution of answers in a general VQA setting. Experimental results on two large-scale benchmark datasets show the favorable performance of the proposed algorithm with a comparison to state of the art.
  • Learning to estimate 3D geometry in a single image by watching unlabeled videos via deep convolutional network is attracting significant attention. In this paper, we introduce a "3D as-smooth-as-possible (3D-ASAP)" prior inside the pipeline, which enables joint estimation of edges and 3D scene, yielding results with significant improvement in accuracy for fine detailed structures. Specifically, we define the 3D-ASAP prior by requiring that any two points recovered in 3D from an image should lie on an existing planar surface if no other cues provided. We design an unsupervised framework that Learns Edges and Geometry (depth, normal) all at Once (LEGO). The predicted edges are embedded into depth and surface normal smoothness terms, where pixels without edges in-between are constrained to satisfy the prior. In our framework, the predicted depths, normals and edges are forced to be consistent all the time. We conduct experiments on KITTI to evaluate our estimated geometry and CityScapes to perform edge evaluation. We show that in all of the tasks, i.e.depth, normal and edge, our algorithm vastly outperforms other state-of-the-art (SOTA) algorithms, demonstrating the benefits of our approach.
  • Throughput and resolution are both of critical importance for modern manufacturing, however, they are usually contradictory with each other. Here, a high-throughput high-resolution three dimensional (3D) printing is demonstrated by incorporating a simultaneous spatiotemporal focusing (SSTF) scheme in two-photon polymerization (TPP). Remarkably, the SSTF can ensure generation of a spherical focal spot of which the size depends linearly on the laser power. Thus, the resolution can be continuously adjusted from sub-10 {\mu}m to ~40 {\mu}m by only increasing the laser power. A multi-scale 3D structure is fabricated using this technique, for which the regions of coarse and fine feature sizes are produced at high and low resolutions, respectively.
  • Atomically engineered oxide heterostructures provide a fertile ground for creating novel states. For example, a two-dimensional electron gas at the interface between two oxide insulators, giant thermoelectric Seebeck coefficient, emergent ferromagnetism from otherwise nonmagnetic components, and colossal ionic conductivity. Extensive research efforts reveal that oxygen deficiency or lattice strain play an important role in determining these unexpected properties. Herein, by studying the abrupt presence of robust ferromagnetism (up to 1.5 uB/Mn) in LaMnO3-based heterostructures, we find the multivalence states of Mn that play a decisive role in the emergence of ferromagnetism in the otherwise antiferromagnetic LaMnO3 thin films. Combining spatially resolved electron energy-loss spectroscopy, X-ray absorption spectroscopy and X-ray magnetic circular dichroism techniques, we determine unambiguously that the ferromagnetism results from a conventional Mn3+-O-Mn4+ double-exchange mechanism rather than an interfacial effect. In contrast, the magnetic dead layer of 5 unit cell in proximity to the interface is found to be accompanied with the accumulation of Mn2+ induced by electronic reconstruction. These findings provide a hitherto-unexplored multivalence state of Mn on the emergent magnetism in undoped manganite epitaxial thin films, such as LaMnO3 and BiMnO3, and shed new light on all-oxide spintronic devices.
  • Scene parsing aims to assign a class (semantic) label for each pixel in an image. It is a comprehensive analysis of an image. Given the rise of autonomous driving, pixel-accurate environmental perception is expected to be a key enabling technical piece. However, providing a large scale dataset for the design and evaluation of scene parsing algorithms, in particular for outdoor scenes, has been difficult. The per-pixel labelling process is prohibitively expensive, limiting the scale of existing ones. In this paper, we present a large-scale open dataset, ApolloScape, that consists of RGB videos and corresponding dense 3D point clouds. Comparing with existing datasets, our dataset has the following unique properties. The first is its scale, our initial release contains over 140K images - each with its per-pixel semantic mask, up to 1M is scheduled. The second is its complexity. Captured in various traffic conditions, the number of moving objects averages from tens to over one hundred. And the third is the 3D attribute, each image is tagged with high-accuracy pose information at cm accuracy and the static background point cloud has mm relative accuracy. We are able to label these many images by an interactive and efficient labelling pipeline that utilizes the high-quality 3D point cloud. Moreover, our dataset also contains different lane markings based on the lane colors and styles. We expect our new dataset can deeply benefit various autonomous driving related applications that include but not limited to 2D/3D scene understanding, localization, transfer learning, and driving simulation.
  • In this note we prove that any minimal $2$-torus in $S^4$ has Morse index at least $6$, with equality if and only if it is congruent to the Clifford torus in some great $S^3\subset S^4$. For a minimal $2$-torus in $S^n$ with vanishing Hopf differential, we show that its index is at least $n+3$, and that this estimate is sharp: there exists a homogeneous minimal torus in $S^5\subset S^n$ with vanishing Hopf differential whose index in $S^n$ is exactly $n+3$.
  • Layered metal chalcogenide materials provide a versatile platform to investigate emergent phenomena and two-dimensional (2D) superconductivity at/near the atomically thin limit. In particular, gate-induced interfacial superconductivity realized by the use of an electric-double-layer transistor (EDLT) has greatly extended the capability to electrically induce superconductivity in oxides, nitrides and transition metal chalcogenides and enable one to explore new physics, such as the Ising pairing mechanism. Exploiting gate-induced superconductivity in various materials can provide us with additional platforms to understand emergent interfacial superconductivity. Here, we report the discovery of gate-induced 2D superconductivity in layered 1T-SnSe2, a typical member of the main-group metal dichalcogenide (MDC) family, using an EDLT gating geometry. A superconducting transition temperature Tc around 3.9 K was demonstrated at the EDL interface. The 2D nature of the superconductivity therein was further confirmed based on 1) a 2D Tinkham description of the angle-dependent upper critical field, 2) the existence of a quantum creep state as well as a large ratio of the coherence length to the thickness of superconductivity. Interestingly, the in-plane approaching zero temperature was found to be 2-3 times higher than the Pauli limit, which might be related to an electric field-modulated spin-orbit interaction. Such results provide a new perspective to expand the material matrix available for gate-induced 2D superconductivity and the fundamental understanding of interfacial superconductivity.
  • By placing a diffractive element in front of an image sensor, we are able to multiplex the spectral and angular information of a scene onto the image sensor. Reconstruction of the angular-spectral distribution is attained by first calibrating the angular-spectral response of the system and then, applying optimization-based matrix inversion. In our proof-of-concept demonstration, we imaged the 1D angle and the spectrum with resolutions of 0.15o and 6nm, respectively. The information is reconstructed from a single frame, thereby enabling snapshot functionality for video-rate imaging.
  • The intrinsic alignment of galaxies is an important systematic effect in weak-lensing surveys, which can affect the derived cosmological parameters. One direct way to distinguish different alignment models and quantify their effects on the measurement is to produce mocked weak-lensing surveys. In this work, we use full-sky ray-tracing technique to produce mock images of galaxies from the ELUCID $N$-body simulation run with the WMAP9 cosmology. In our model we assume that the shape of central elliptical galaxy follows that of the dark matter halo, and spiral galaxy follows the halo spin. Using the mocked galaxy images, a combination of galaxy intrinsic shape and the gravitational shear, we compare the predicted tomographic shear correlations to the results of KiDS and DLS. It is found that our predictions stay between the KiDS and DLS results. We rule out a model in which the satellite galaxies are radially aligned with the center galaxy, otherwise the shear-correlations on small scales are too high. Most important, we find that although the intrinsic alignment of spiral galaxies is very weak, they induce a positive correlation between the gravitational shear signal and the intrinsic galaxy orientation (GI). This is because the spiral galaxy is tangentially aligned with the nearby large-scale overdensity, contrary to the radial alignment of elliptical galaxy. Our results explain the origin of detected positive GI term from the weak-lensing surveys. We conclude that in future analysis, the GI model must include the dependence on galaxy types in more detail. And the full-sky mock data introduced in this work can be available if you are interesting.
  • Van der Waals heterostructure based on layered two-dimensional (2D) materials offers unprecedented opportunities to create materials with atomic precision by design. By combining superior properties of each component, such heterostructure also provides possible solutions to address various challenges of the electronic devices, especially those with vertical multilayered structures. Here, we report the realization of robust memristors for the first time based on van der Waals heterostructure of fully layered 2D materials (graphene/MoS2-xOx/graphene) and demonstrate a good thermal stability lacking in traditional memristors. Such devices have shown excellent switching performance with endurance up to 107 and a record-high operating temperature up to 340oC. By combining in situ high-resolution TEM and STEM studies, we have shown that the MoS2-xOx switching layer, together with the graphene electrodes and their atomically sharp interfaces, are responsible for the observed thermal stability at elevated temperatures. A well-defined conduction channel and a switching mechanism based on the migration of oxygen ions were also revealed. In addition, the fully layered 2D materials offer a good mechanical flexibility for flexible electronic applications, manifested by our experimental demonstration of a good endurance against over 1000 bending cycles. Our results showcase a general and encouraging pathway toward engineering desired device properties by using 2D van der Waals heterostructures.