Interpreting the small-scale clustering of galaxies with halo models can elucidate the connection between galaxies and dark matter halos. Unfortunately, the modelling is typically not sufficiently accurate for ruling out models statistically. It is thus difficult to use the information encoded in small scales to test cosmological models or probe subtle features of the galaxy-halo connection. In this paper, we attempt to push halo modelling into the "accurate" regime with a fully numerical mock-based methodology and careful treatment of statistical and systematic errors. With our forward-modelling approach, we can incorporate clustering statistics beyond the traditional two-point statistics. We use this modelling methodology to test the standard $\Lambda\mathrm{CDM}$ + halo model against the clustering of SDSS DR7 galaxies. Specifically, we use the projected correlation function, group multiplicity function and galaxy number density as constraints. We find that while the model fits each statistic separately, it struggles to fit them simultaneously. Adding group statistics leads to a more stringent test of the model and significantly tighter constraints on model parameters. We explore the impact of varying the adopted halo definition and cosmological model and find that changing the cosmology makes a significant difference. The most successful model we tried (Planck cosmology with Mvir halos) matches the clustering of low luminosity galaxies, but exhibits a 2.3$\sigma$ tension with the clustering of luminous galaxies, thus providing evidence that the "standard" halo model needs to be extended. This work opens the door to adding interesting freedom to the halo model and including additional clustering statistics as constraints.

Standard present day large-scale structure (LSS) analyses make a major assumption in their Bayesian parameter inference --- that the likelihood has a Gaussian form. For summary statistics currently used in LSS, this assumption, even if the underlying density field is Gaussian, cannot be correct in detail. We investigate the impact of this assumption on two recent LSS analyses: the Beutler et al. (2017) power spectrum multipole ($P_\ell$) analysis and the Sinha et al. (2017) group multiplicity function ($\zeta$) analysis. Using non-parametric divergence estimators on mock catalogs originally constructed for covariance matrix estimation, we identify significant non-Gaussianity in both the $P_\ell$ and $\zeta$ likelihoods. We then use Gaussian mixture density estimation and Independent Component Analysis on the same mocks to construct likelihood estimates that approximate the true likelihood better than the Gaussian $pseudo$-likelihood. Using these likelihood estimates, we accurately estimate the true posterior probability distribution of the Beutler et al. (2017) and Sinha et al. (2017) parameters. Likelihood non-Gaussianity shifts the $f\sigma_8$ constraint by $-0.44\sigma$, but otherwise, does not significantly impact the overall parameter constraints of Beutler et al. (2017). For the $\zeta$ analysis, using the pseudo-likelihood significantly underestimates the uncertainties and biases the constraints of Sinha et al. (2017) halo occupation parameters. For $\log M_1$ and $\alpha$, the posteriors are shifted by $+0.43\sigma$ and $-0.51\sigma$ and broadened by $42\%$ and $66\%$, respectively. The divergence and likelihood estimation methods we present provide a straightforward framework for quantifying the impact of likelihood non-Gaussianity and deriving more accurate parameter constraints.

We explore the phenomenon commonly known as halo assembly bias, whereby dark matter halos of the same mass are found to be more or less clustered when a second halo property is considered, for halos in the mass range $3.7 \times 10^{11} \; h^{-1} \mathrm{M_{\odot}} - 5.0 \times 10^{13} \; h^{-1} \mathrm{M_{\odot}}$. Using the Large Suite of Dark Matter Simulations (LasDamas) we consider nine commonly used halo properties and find that a clustering bias exists if halos are binned by mass or by any other halo property. This secondary bias implies that no single halo property encompasses all the spatial clustering information of the halo population. The mean values of some halo properties depend on their halo's distance to a more massive neighbor. Halo samples selected by having high values of one of these properties therefore inherit a neighbor bias such that they are much more likely to be close to a much more massive neighbor. This neighbor bias largely accounts for the secondary bias seen in halos binned by mass and split by concentration or age. However, halos binned by other mass-like properties still show a secondary bias even when the neighbor bias is removed. The secondary bias of halos selected by their spin behaves differently than that for other halo properties, suggesting that the origin of the spin bias is different than of other secondary biases.

We present the public release of the MultiDark-Galaxies: three distinct galaxy catalogues derived from one of the Planck cosmology MultiDark simulations (i.e. MDPL2, with a volume of (1 Gpc/$h$)$^{3}$ and mass resolution of $1.5 \times 10^{9} M_{\odot}/h$) by applying the semi-analytic models GALACTICUS, SAG, and SAGE to it. We compare the three models and their conformity with observational data for a selection of fundamental properties of galaxies like stellar mass function, star formation rate, cold gas fractions, and metallicities - noting that they sometimes perform differently reflecting model designs and calibrations. We have further selected galaxy subsamples of the catalogues by number densities in stellar mass, cold gas mass, and star formation rate in order to study the clustering statistics of galaxies. We show that despite different treatment of orphan galaxies, i.e. galaxies that lost their dark-matter host halo due to the finite mass resolution of the N-body simulation or tidal stripping, the clustering signal is comparable, and reproduces the observations in all three models - in particular when selecting samples based upon stellar mass. Our catalogues provide a powerful tool to study galaxy formation within a volume comparable to those probed by on-going and future photometric and redshift surveys. All model data consisting of a range of galaxy properties - including broad-band SDSS magnitudes - are publicly available.

We present the first stable release of Halotools (v0.2), a community-driven Python package designed to build and test models of the galaxy-halo connection. Halotools provides a modular platform for creating mock universes of galaxies starting from a catalog of dark matter halos obtained from a cosmological simulation. The package supports many of the common forms used to describe galaxy-halo models: the halo occupation distribution (HOD), the conditional luminosity function (CLF), abundance matching, and alternatives to these models that include effects such as environmental quenching or variable galaxy assembly bias. Satellite galaxies can be modeled to live in subhalos, or to follow custom number density profiles within their halos, including spatial and/or velocity bias with respect to the dark matter profile. The package has an optimized toolkit to make mock observations on a synthetic galaxy population, including galaxy clustering, galaxy-galaxy lensing, galaxy group identification, RSD multipoles, void statistics, pairwise velocities and others, allowing direct comparison to observations. Halotools is object-oriented, enabling complex models to be built from a set of simple, interchangeable components, including those of your own creation. Halotools has an automated testing suite and is exhaustively documented on http://halotools.readthedocs.io, which includes quickstart guides, source code notes and a large collection of tutorials. The documentation is effectively an online textbook on how to build and study empirical models of galaxy formation with Python.

The Astropy Project (http://astropy.org) is, in its own words, "a community effort to develop a single core package for Astronomy in Python and foster interoperability between Python astronomy packages." For five years this project has been managed, written, and operated as a grassroots, self-organized, almost entirely volunteer effort while the software is used by the majority of the astronomical community. Despite this, the project has always been and remains to this day effectively unfunded. Further, contributors receive little or no formal recognition for creating and supporting what is now critical software. This paper explores the problem in detail, outlines possible solutions to correct this, and presents a few suggestions on how to address the sustainability of general purpose astronomical software.

Recent observations of AGN activity in massive galaxies (log Mstar / Msun > 10.4) show that: 1) at z < 1, AGN-hosting galaxies do not show enhanced merger signatures compared to normal galaxies, 2) also at z < 1, most AGNs are hosted by quiescent galaxies; and 3) at z > 1, percentage of AGNs in star forming galaxies increases and becomes comparable to AGN percentage in quiescent galaxies at z ~ 2. How can major mergers explain AGN activity in massive quiescent galaxies which have no merger features and no star formation to indicate recent galaxy merger? By matching merger events in a cosmological N-body simulation to the observed AGN incidence probability in the COSMOS survey, we show that major merger triggered AGN activity is consistent with the observations. By distinguishing between "peak" AGNs (recently merger triggered and hosted by star forming galaxies) and "faded" AGNs (merger triggered a long time ago and now residing in quiescent galaxies), we show that the AGN occupation fraction in star forming and quiescent galaxies simply follows the evolution of the galaxy merger rate. Since the galaxy merger rate drops dramatically at z < 1, the only AGNs left to be observed are the ones triggered by old mergers and are now in the declining phase of their nuclear activity, hosted by quiescent galaxies. As we go toward higher redshifts the galaxy merger rate increases and the percentages of "peak" AGNs and "faded" AGNs become comparable.

We use subhalo abundance matching (SHAM) to model the stellar mass function (SMF) and clustering of the Baryon Oscillation Spectroscopic Survey (BOSS) "CMASS" sample at $z\sim0.5$. We introduce a novel method which accounts for the stellar mass incompleteness of CMASS as a function of redshift, and produce CMASS mock catalogs which include selection effects, reproduce the overall SMF, the projected two-point correlation function $w_{\rm p}$, the CMASS $dn/dz$, and are made publicly available. We study the effects of assembly bias above collapse mass in the context of "age matching" and show that these effects are markedly different compared to the ones explored by Hearin et al. (2013) at lower stellar masses. We construct two models, one in which galaxy color is stochastic ("AbM" model) as well as a model which contains assembly bias effects ("AgM" model). By confronting the redshift dependent clustering of CMASS with the predictions from our model, we argue that that galaxy colors are not a stochastic process in high-mass halos. Our results suggest that the colors of galaxies in high-mass halos are determined by other halo properties besides halo peak velocity and that assembly bias effects play an important role in determining the clustering properties of this sample.

In the second paper of this series, we present results from cosmological simulations on the demographics of flyby interactions to gauge their potential impact on galaxy evolution. In a previous paper, we demonstrated that flybys -- an interaction where two independent halos inter-penetrate but detach at a later time and do not merge -- occur much more frequently than previously believed. In particular, we found that the frequency of flybys increases at low redshift and is comparable to or even greater than the frequency of mergers for halos $\gtrsim 10^{11} M_\odot/h$. In this paper, we classify flybys according to their orbits and the level of perturbation exacted on both the halos involved. We find that the majority of flybys penetrate deeper than $\sim R_{half}$ of the primary and have an initial relative speed $\sim 1.6\times V_{vir}$ of the primary. The typical flyby mass-ratio is $\sim 0.1$ at high $z$ for all halos, while at low $z$, massive primary halos undergo flybys with small secondary halos. We estimate the perturbation from the flyby on both the primary and the secondary and find that a typical flyby is mostly non-perturbative for the primary halo. However, since a massive primary experiences so many flybys at any given time, they are nearly continually a victim of a perturbative event. In particular, we find flybys that cause $\sim 1\%$ change in the binding energy of a primary halo occurs $\gtrsim 1 $ Gyr$^{-1}$ for halos $> 10^{10} M_\odot/h$ for $z \lesssim 4$. Secondary halos, on the other hand, are highly perturbed by the typical encounter, experiencing a change in binding energy of nearly order unity. Our results imply that flybys can drive a significant part of galaxy transformation at moderate to lower redshifts ($z \lesssim 4$). We touch on implications for observational surveys, mass-to-light ratios, and galaxy assembly bias.

We present and test TesseRACt, a non-parametric technique for recovering the concentration of simulated dark matter halos using Voronoi tessellation. TesseRACt is tested on idealized N-body halos that are axisymmetric, triaxial, and contain substructure and compared to traditional least-squares fitting as well as two non-parametric techniques that assume spherical symmetry. TesseRACt recovers halo concentrations within 0.3% of the true value regardless of whether the halo is spherical, axisymmetric, or triaxial. Traditional fitting and non-parametric techniques that assume spherical symmetry can return concentrations that are systematically off by as much as 10% from the true value for non-spherical halos. TesseRACt also performs significantly better when there is substructure present outside $0.5R_{200}$. Given that cosmological halos are rarely spherical and often contain substructure, we discuss implications for studies of halo concentration in cosmological N-body simulations including how choice of technique for measuring concentration might bias scaling relations.

We study the structure and evolution of dark matter halos from z = 300 to z = 6 for two cosmological N-body simulation initialization techniques. While the second order Lagrangian perturbation theory (2LPT) and the Zel'dovich approximation (ZA) both produce accurate present day halo mass functions, earlier collapse of dense regions in 2LPT can result in larger mass halos at high redshift. We explore the differences in dark matter halo mass and concentration due to initialization method through three 2LPT and three ZA initialized cosmological simulations. We find that 2LPT induces more rapid halo growth, resulting in more massive halos compared to ZA. This effect is most pronounced for high mass halos and at high redshift. Halo concentration is, on average, largely similar between 2LPT and ZA, but retains differences when viewed as a function of halo mass. For both mass and concentration, the difference between typical individual halos can be very large, highlighting the shortcomings of ZA-initialized simulations for high-z halo population studies.

Recently, both simulations and observations have revealed that flybys - fast, one-time interactions between two galaxy halos - are surprisingly common, nearing/comparable to galaxy mergers. Since these are rapid, transient events with the closest approach well outside the galaxy disk, it is unclear if flybys can transform the galaxy in a lasting way. We conduct collisionless N-body simulations of three co-planer flyby interactions between pure-disk galaxies to take a first look at the effects flybys have on disk structure, with particular focus on stellar bar formation. We find that some flybys are capable of inciting a bar with bars forming in both galaxies during our 1:1 interaction and in the secondary during our 10:1 interaction. The bars formed have ellipticities >0.5, sizes on the order of the host disk's scale length, and persist to the end of our simulations, ~5 Gyr after pericenter. The ability of flybys to incite bar formation implies that many processes associated with secular bar evolution may be more closely tied with interactions than previously though.

Hierarchical structure formation theory is based on the notion that mergers drive galaxy evolution, so a considerable framework of semi-analytic models and N-body simulations has been constructed to calculate how mergers transform a growing galaxy. However, galaxy mergers are only one type of major dynamical interaction between halos -- another class of encounter, a close flyby, has been largely ignored. We analyze a 50 Mpc/h, $1024^3$ collisionless cosmological simulation and find that the number of close flyby interactions is comparable to, or even surpasses, the number of mergers for halo masses $\ga 10^{11}\,{h^{-1} M_\odot}$ at $z \la 2$. Halo flybys occur so frequently to high mass halos that they are continually perturbed, unable to reach a dynamical equilibrium. We also find tentative evidence that at high redshift, $z \ga 14$, flybys are as frequent as mergers. Our results suggest that close halo flybys can play an important role in the evolution of the earliest dark matter halos and their galaxies, and can still influence galaxy evolution at the present epoch.

Observations of the Galactic Center (GC) have accumulated a multitude of "forensic" evidence indicating that several million years ago the center of the Milky Way galaxy was teaming with starforming and accretion-powered activity -- this paints a rather different picture from the GC as we understand it today. We examine a possibility that this epoch of activity could have been triggered by the infall of a satellite galaxy into the Milky Way which began at the redshift of 10 and ended few million years ago with a merger of the Galactic supermassive black hole with an intermediate mass black hole brought in by the inspiralling satellite.

We explore structure formation in the dark ages ($z\sim 30-6$) using two well-known methods for initializing cosmological $N$-body simulations. Overall, both the Zel'dovich approximation (\za) and second order Lagrangian perturbation theory (\lpt) are known to produce accurate present-day dark matter halo mass functions. However, since the \lpt method drives more rapid evolution of dense regions, it increases the occurrence of rare massive objects -- an effect that is most pronounced at high redshift. We find that \lpt produces more halos that could harbor Population III stars and their black hole remnants, and they produce them earlier. Although the differences between the \lpt and \za mass functions are nearly erased by $z=6$, this small boost to the number and mass of black holes more than doubles the reionized volume of the early Universe. We discuss the implications for reionization and massive black hole growth.

We present a comparative study of recent works on merger-timescales with dynamical friction and find a strong contrast between idealized/isolated mergers (Boylan-Kolchin et al. 2008) and mergers from a cosmological volume (Jiang et al. 2008). Our study measures the duration of mergers in a cosmological N-body simulation of dark matter, with emphasis on higher redshifts (z < 10) and a lower mass range. In our analysis we consider and compare two merger definitions; tidal disruption and coalescence. We find that the merger-time formula proposed by Jiang et al. (2008) describes our results well and conclude that cosmologically motivated merger-time formulae provide a more versatile and statistically robust approximation for practical applications such as semi-analytic/hybrid models.

Hierarchical structure formation theory is based on the notion that mergers drive galaxy evolution, so a considerable framework of semi-analytic models and N-body simulations has been constructed to calculate how mergers transform a growing galaxy. However, galaxy mergers are only one type of major dynamical interaction between halos -- another class of encounter, a close flyby, has been largely ignored. We use cosmological N-body simulations to reconstruct the entire dynamical interaction history of dark matter halos. We present a careful method of identifying and tracking a dark matter halo which resolves the typical classes of anomalies that occur in N-body data. This technique allows us to robustly follow halos and several hierarchical levels of subhalos as they grow, dissolve, merge, and flyby one another -- thereby constructing both a census of the dynamical interactions in a volume and an archive of the dynamical evolution of an individual halo. In addition to a census of mergers, our tool characterizes the frequency of close flyby interactions in the Universe. We find that the number of close flyby interactions is comparable to, or even surpasses, the number of mergers for halo masses $\gtrsim 10^{11}\,\Msun$ at $z \lesssim 2$. Halo flybys occur so frequently to high mass halos that they are continually perturbed, unable to reach a dynamical equilibrium. In particular, we find that Milky Way type halos undergo a similar number of flybys as mergers irrespective of mass-ratio for $z\lesssim 2$. We also find tentative evidence that at high redshift, $z \gtrsim 14$, flybys are as frequent as mergers. Our results suggest that close halo flybys can play an important role in the evolution of the earliest dark matter halos and their galaxies, and can still influence galaxy evolution at the present epoch. [Abridged]

Observations indicate that roughly 60% of the baryons may exist in a Warm-Hot Intergalactic Medium (WHIM) at low redshifts. Following up on previous results showing that gas is released through galaxy mergers, we use a semi-analytic technique to estimate the fraction of gas mass lost from haloes solely due to mergers. We find that up to ~25% of the gas in a halo can unbind over the course of galaxy assembly. This process does not act preferentially on smaller mass haloes; bigger haloes \emph{always} release larger amounts of gas in a given volume of the Universe. However, if we include multi-phase gas accretion onto haloes, we find that only a few percent is unbound. We conclude that either non-gravitational processes may be in play to heat up the gas in the galaxies prior to unbinding by mergers or most of the baryons in the WHIM have never fallen into virialised dark matter haloes. We present a budget for stocking the WHIM compiled from recent work.

Galaxy merger simulations have explored the behaviour of gas within the galactic disk, yet the dynamics of hot gas within the galaxy halo has been neglected. We report on the results of high-resolution hydrodynamic simulations of colliding galaxies with hot halo gas. We explore a range of mass ratios, gas fractions and orbital configurations to constrain the shocks and gas dynamics within the progenitor haloes. We find that : (i) A strong shock is produced in the galaxy haloes before the first passage, increasing the temperature of the gas by almost an order of magnitude to $T\sim 10^{6.3}$ K. (ii) The X-ray luminosity of the shock is strongly dependent on the gas fraction; it is $\gtrsim 10^{39}$ erg/s for halo gas fractions larger than 10%. (iii) The hot diffuse gas in the simulation produces X-ray luminosities as large as $10^{42}$ erg/s. This contributes to the total X-ray background in the Universe. (iv) We find an analytic fit to the maximum X-ray luminosity of the shock as a function of merger parameters. This fit can be used in semi-analytic recipes of galaxy formation to estimate the total X-ray emission from shocks in merging galaxies. (v) $\sim$ 10-20% of the initial gas mass is unbound from the galaxies for equal-mass mergers, while $3-5%$ of the gas mass is released for the 3:1 and 10:1 mergers. This unbound gas ends up far from the galaxy and can be a feasible mechanism to enrich the IGM with metals.