• Extraction of local feature descriptors is a vital stage in the solution pipelines for numerous computer vision tasks. Learning-based approaches improve performance in certain tasks, but still cannot replace handcrafted features in general. In this paper, we improve the learning of local feature descriptors by optimizing the performance of descriptor matching, which is a common stage that follows descriptor extraction in local feature based pipelines, and can be formulated as nearest neighbor retrieval. Specifically, we directly optimize a ranking-based retrieval performance metric, Average Precision, using deep neural networks. This general-purpose solution can also be viewed as a listwise learning to rank approach, which is advantageous compared to recent local ranking approaches. On standard benchmarks, descriptors learned with our formulation achieve state-of-the-art results in patch verification, patch retrieval, and image matching.
  • Metallic nanoparticles have been used as catalysts for various reactions, and the huge literature on the subject is hard to overlook. In many applications, the nanoparticles must be affixed to a colloidal carrier for easy handling during catalysis. These "passive carriers" (e.g., dendrimers) serve for a controlled synthesis of the nanoparticles and prevent coagulation during catalysis. Recently, hybrids from nanoparticles and polymers have been developed that allow us to change the catalytic activity of the nanoparticles by external triggers. In particular, single nanoparticles embedded in a thermosensitive network made from poly(N-isopropylacrylamide) (PNIPAM) have become the most-studied examples of such hybrids: Immersed in cold water, the PNIPAM network is hydrophilic and fully swollen. In this state, hydrophilic substrates can diffuse easily through the network, and react at the surface of the nanoparticles. Above the volume transition located at 32{\deg}C, the network becomes hydrophobic and shrinks. Now hydrophobic substrates will preferably diffuse through the network and react with other substrates in the reaction catalyzed by the enclosed nanoparticle. Such "active carriers", may thus be viewed as true nanoreactors that open new ways for the use of nanoparticles in catalysis.
  • In this paper we show that deep convolutional neural networks (CNN) can massively outperform traditional densely connected neural networks (both deep or shallow) in predicting eigenvalue problems in mechanics. In this sense, we strike out in a novel direction in mechanics computations with strongly predictive neural networks whose success depends not only neural architectures being deep but also being fundamentally different from neural architectures which have been used in mechanics till now. To show this, we consider a model problem: predicting the eigenvalues of a 1-D phononic crystal, however, the general observations pertaining to the predictive superiority of CNNs over MLPs should extend to other problems in mechanics as well. In the present problem, the optimal CNN architecture reaches $98\%$ accuracy level on unseen data when trained with just 20,000 training samples. Fully-connected multi-layer perceptrons (MLP) - the network of choice in mechanics research - on the other hand, does not improve beyond $85\%$ accuracy even with $100,000$ training samples. We also show that even with a relatively small amount of training data, CNNs have the capability to generalize well for our problems and that they automatically learn deep symmetry operations such as translational invariance. Most importantly, however, we show how CNNs can naturally represent mechanical material tensors and that the convolution operation of CNNs has the ability to serve as local receptive fields which is a natural representation of mechanical response. Strategies proposed here may be used for other problems of mechanics and may, in the future, be used to completely sidestep certain cumbersome algorithms with a purely data driven approach based upon deep architectures of modern neural networks such as deep CNNs.
  • In this paper we consider the problem of avoided crossings (level repulsion) in phononic crystals and suggest a computationally efficient strategy to distinguish them from normal cross points. This process is essential for the correct sorting of the phononic bands and, subsequently, for the accurate determination of mode continuation, group velocities, and emergent properties which depend on them such as thermal conductivity. Through explicit phononic calculations using generalized Rayleigh quotient, we identify exact locations of exceptional points in the complex wavenumber domain which results in level repulsion in the real domain. We show that in the vicinity of the exceptional point the relevant phononic eigenvalue surfaces resemble the surfaces of a 2 by 2 parameter-dependent matrix. Along a closed loop encircling the exceptional point we show that the phononic eigenvalues are exchanged, just as they are for the 2 by 2 matrix case. However, the behavior of the associated eigenvectors is shown to be more complex in the phononic case. Along a closed loop around an exceptional point, we show that the eigenvectors can flip signs multiple times unlike a 2 by 2 matrix where the flip of sign occurs only once. Finally, we exploit these eigenvector sign flips around exceptional points to propose a simple and efficient method of distinguishing them from normal crosses and of correctly sorting the band-structure. Our proposed method is roughly an order-of magnitude faster than the zoom-in method and correctly identifies > 97% of the cases considered. Both its speed and accuracy can be further improved and we suggest some ways of achieving this. Our method is general and, as such, would be directly applicable to other eigenvalue problems where the eigenspectrum needs to be correctly sorted.
  • In this paper the salient features of the Plane Wave Expansion (PWE) method and the mixed variational technique are combined for the fast eigenvalue computations of arbitrarily complex phononic unit cells. This is done by expanding the material properties in a Fourier expansion, as is the case with PWE. The required matrix elements in the variational scheme are identified as the discrete Fourier transform coefficients of material properties, thus obviating the need for any explicit integration. The process allows us to provide succinct and closed form expressions for all the matrices involved in the mixed variational method. The scheme proposed here preserves both the simplicity of expression which is inherent in the PWE method and the superior convergence properties of the mixed variational scheme. We present numerical results and comment upon the convergence and stability of the current method. We show that the current representation renders the results of the method stable over the entire range of the expansion terms as allowed by the spatial discretization. When compared with a zero order numerical integration scheme, the present method results in greater computational accuracy of all eigenvalues. A higher order numerical integration scheme comes close to the accuracy of the present method but only with significantly more computational expense.
  • In this paper gradient based topology optimization (TO) is used to discover 3-D phononic structures that exhibit ultra-wide normalized all-angle all-mode band gaps. The challenging computational task of repeated 3-D phononic band-structure evaluations is accomplished by a combination of a fast mixed variational eigenvalue solver and distributed Graphic Processing Unit (GPU) parallel computations. The TO algorithm utilizes the material distribution-based approach and a gradient-based optimizer. The design sensitivity for the mixed variational eigenvalue problem is derived using the adjoint method and is implemented through highly efficient vectorization techniques. We present optimized results for two-material simple cubic (SC), body centered cubic (BCC), and face centered cubic (FCC) crystal structures and show that in each of these cases different initial designs converge to single inclusion network topologies within their corresponding primitive cells. The optimized results show that large phononic stop bands for bulk wave propagation can be achieved at lower than close packed spherical configurations leading to lighter unit cells. For tungsten carbide - epoxy crystals we identify all angle all mode normalized stop bands exceeding 100%, which is larger than what is possible with only spherical inclusions.
  • We report a facile and novel method for the fabrication of Cu2O@PNIPAM core-shell nanoreactors using Cu2O nanocubes as the core. The PNIPAM shell not only effectively protects the Cu2O nanocubes from oxidation, but also improves the colloidal stability of the system. The Cu2O@PNIPAM core-shell microgels can work efficiently as photocatalyst for the decomposition of methyl orange under visible light. A significant enhancement in the catalytic activity has been observed for the core-shell microgels compared with the pure Cu2O nanocubes. Most importantly, the photocatalytic activity of the Cu2O nanocubes can be further tuned by the thermosensitive PNIPAM shell, as rationalized by our recent theory.
  • In a hybrid pumping alkali vapor cell that both K and Rb are filled, K atom spins are optically pumped by laser and Rb atom spins are polarized by the K spins through spin exchange. We find that the AC Stark shift of the Rb atoms is composed of not only the AC Stark shift of the Rb atoms caused by the far off resonant pumping laser which is tuned to the K absorption lines, but also the AC Stark shift of the K atom spins. The mixing of the light shifts through fast spin exchange between K and Rb atoms are studied in this paper and we demonstrate a K-Rb-21Ne co-magnetometer in which the AC Stark shift of the Rb atoms are reduced by the collision mixing.
  • Three fundamental variational principles used for solving elastodynamic eigenvalue problems are studied within the context of elastic wave propagation in periodic composites (phononics). We study the convergence of the eigenvalue problems resulting from the displacement Rayleigh quotient, the stress Rayleigh quotient and the mixed quotient. The convergence rates of the three quotients are found to be related to the continuity and differentiability of the density and compliance variation over the unit cell. In general, the mixed quotient converges faster than both the displacement Rayleigh and the stress Rayleigh quotients, however, there exist special cases where either the displacement Rayleigh or the stress Rayleigh quotient shows the exact same convergence as the mixed-method. We show that all methods converge faster for smoother material property variations, but when density variation is rough, the difference between the mixed quotient and stress Rayleigh quotient is higher and similarly, when compliance variation is rough, the difference between the mixed quotient and displacement Rayleigh quotient is higher. Since eigenvalue problems such as those considered in this paper tend to be highly computationally intensive, it is expected that these results will lead to fast and efficient algorithms in the areas of phononics and photonics.
  • Raman spectroscopy is the prime non-destructive characterization tool for graphene and related layered materials. The shear (C) and layer breathing modes (LBMs) are due to relative motions of the planes, either perpendicular or parallel to their normal. This allows one to directly probe the interlayer interactions in multilayer samples. Graphene and other two-dimensional (2d) crystals can be combined to form various hybrids and heterostructures, creating materials on demand with properties determined by the interlayer interaction. This is the case even for a single material, where multilayer stacks with different relative orientation have different optical and electronic properties. In twisted multilayer graphene samples there is a significant enhancement of the C modes due to resonance with new optically allowed electronic transitions, determined by the relative orientation of the layers. Here we show that this applies also to the LBMs, that can be now directly measured at room temperature. We find that twisting does not affect LBMs, quite different from the case of the C modes. This implies that the periodicity mismatch between two twisted layers mostly affects shear interactions. Our work shows that Raman spectroscopy is an ideal tool to uncover the interface coupling of 2d hybrids and heterostructures.
  • We investigate the nonequilibrium behavior of dense, plastic-crystalline suspensions of mildly anisotropic colloidal hard dumbbells under the action of an oscillatory shear field by employing Brownian dynamics computer simulations. In particular, we extend previous investigations, where we uncovered novel nonequilibrium phase transitions, to other aspect ratios and to a larger nonequilibrium parameter space, that is, a wider range of strains and shear frequencies. We compare and discuss selected results in the context of novel scattering and rheological experiments. Both simulations and experiments demonstrate that the previously found transitions from the plastic crystal phase with increasing shear strain also occur at other aspect ratios. We explore the transition behavior in the strain-frequency phase and summarize it in a nonequilibrium phase diagram. Additionally, the experimental rheology results hint at a slowing down of the colloidal dynamics with higher aspect ratio.
  • This paper proposes an efficient content adaptive screen image scaling scheme for the real-time screen applications like remote desktop and screen sharing. In the proposed screen scaling scheme, a screen content classification step is first introduced to classify the screen image into text and pictorial regions. Afterward, we propose an adaptive shift linear interpolation algorithm to predict the new pixel values with the shift offset adapted to the content type of each pixel. The shift offset for each screen content type is offline optimized by minimizing the theoretical interpolation error based on the training samples respectively. The proposed content adaptive screen image scaling scheme can achieve good visual quality and also keep the low complexity for real-time applications.
  • Metallic nanoparticles embedded in stimuli-responsive polymers can be regarded as nanoreactors since their catalytic activity can be changed within wide limits: the physicochemical properties of the polymer network can be tuned and switched by external parameters, e.g. temperature or pH, and thus allows a selective control of reactant mobility and concentration close to the reaction site. Based on a combination of Debye's model of diffusion through an energy landscape and a two-state model for the polymer, here we develop an analytical expression for the observed reaction rate constant $k_{\rm obs}$. Our formula shows an exponential dependence of this rate on the solvation free enthalpy change $\Delta \bar{G}_{\rm sol}$, a quantity which describes the partitioning of the reactant in the network versus bulk. Thus, changes in $\Delta \bar{G}_{\rm sol}$, and not in the diffusion coefficient, will be the decisive factor affecting the reaction rate in most cases. A comparison with recent experimental data on switchable, thermosensitive nanoreactors demonstrates the general validity of the concept.
  • We report on a strong photoluminescence (PL) enhancement of monolayer MoS2 through defect engineering and oxygen bonding. Micro- PL and Raman images clearly reveal that the PL enhancement occurs at cracks/defects formed during high temperature vacuum annealing. The PL enhancement at crack/defect sites could be as high as thousands of times after considering the laser spot size. The main reasons of such huge PL enhancement include: (1) the oxygen chemical adsorption induced heavy p doping and the conversion from trion to exciton; (2) the suppression of non-radiative recombination of excitons at defect sites as verified by low temperature PL measurements. First principle calculations reveal a strong binding energy of ~2.395 eV for oxygen molecule adsorbed on an S vacancy of MoS2. The chemical adsorbed oxygen also provides a much more effective charge transfer (0.997 electrons per O2) compared to physical adsorbed oxygen on ideal MoS2 surface. We also demonstrate that the defect engineering and oxygen bonding could be easily realized by oxygen plasma irradiation. X-ray photoelectron spectroscopy further confirms the formation of Mo-O bonding. Our results provide a new route for modulating the optical properties of two dimensional semiconductors. The strong and stable PL from defects sites of MoS2 may have promising applications in optoelectronic devices.
  • Human activity recognition has wide applications in medical research and human survey system. In this project, we design a robust activity recognition system based on a smartphone. The system uses a 3-dimentional smartphone accelerometer as the only sensor to collect time series signals, from which 31 features are generated in both time and frequency domain. Activities are classified using 4 different passive learning methods, i.e., quadratic classifier, k-nearest neighbor algorithm, support vector machine, and artificial neural networks. Dimensionality reduction is performed through both feature extraction and subset selection. Besides passive learning, we also apply active learning algorithms to reduce data labeling expense. Experiment results show that the classification rate of passive learning reaches 84.4% and it is robust to common positions and poses of cellphone. The results of active learning on real data demonstrate a reduction of labeling labor to achieve comparable performance with passive learning.
  • Many animal species were verified to use geomagnetic field for their navigation, but the biophysical mechanism of magnetoreception has remained enigmatic. This paper presents a special biophysical model that consists of magnetite-based and radical-pair-based mechanisms for avian magnetoreception. The amplitude of the resultant magnetic field around the magnetic particles corresponds to the geomagnetic field direction and affects the yield of singlet/triplet state products in the radical-pair reactions. Therefore, in the proposed model, the singlet/triplet state product yields are related to the geomagnetic field information for orientational detection. The resultant magnetic fields corresponding to two materials with different magnetic properties were analyzed under different geomagnetic field directions. The results showed that ferromagnetic particles in organisms can provide more significant changes in singlet state products than superparamagnetic particles, and the period of variation for the singlet state products with an included angle in the geomagnetic field is approximately 180{\deg} when the magnetic particles are ferromagnetic materials, consistent with the experimental results obtained from avian magnetic compass. Further, the calculated results of the singlet state products in a reception plane showed that the proposed model can explain the avian magnetoreception mechanism with an inclination compass.
  • We fabricated thermoresponsive colloidal molecules of ca. 250 nm size. Electron- and scanning force microscopy reveal the dumbbell-shaped morphology. The temperature dependence of the size and aspect ratio (ca. 1.4 to 1.6) is analyzed by depolarized dynamic light scattering and found to be in good agreement with microscopic evidence.