We present a weak gravitational lensing analysis of 815 square degree of $i$-band imaging from the Kilo-Degree Survey (KiDS-$i$-800). In contrast to the deep $r$-band observations, which take priority during excellent seeing conditions and form the primary KiDS dataset (KiDS-$r$-450), the complementary yet shallower KiDS-$i$-800 spans a wide range of observing conditions. The overlapping KiDS-$i$-800 and KiDS-$r$-450 imaging therefore provides a unique opportunity to assess the robustness of weak lensing measurements. In our analysis, we introduce two new `null' tests. The `nulled' two-point shear correlation function uses a matched catalogue to show that the calibrated KiDS-$i$-800 and KiDS-$r$-450 shear measurements agree at the level of $1 \pm 4$\%. We use five galaxy lens samples to determine a `nulled' galaxy-galaxy lensing signal from the full KiDS-$i$-800 and KiDS-$r$-450 surveys and find that the measurements agree to $7 \pm 5$\% when the KiDS-$i$-800 source redshift distribution is calibrated using either spectroscopic redshifts, or the 30-band photometric redshifts from the COSMOS survey.

We present a public suite of weak lensing mock data, extending the Scinet Light Cone Simulations (SLICS) to simulate cross-correlation analyses with different cosmological probes. These mocks include KiDS-450- and LSST-like lensing data, cosmic microwave background lensing maps and simulated spectroscopic surveys that emulate the GAMA, BOSS and 2dFLenS galaxy surveys. With 817 independent realisations, our mocks are optimised for combined-probe covariance estimation, which we illustrate for the case of a joint measurement involving cosmic shear, galaxy-galaxy lensing and galaxy clustering from KiDS-450 and BOSS data. With their high spatial resolution, the SLICS are also optimal for predicting the signal for novel lensing estimators, for the validation of analysis pipelines, and for testing a range of systematic effects such as the impact of neighbour-exclusion bias on the measured tomographic cosmic shear signal. For surveys like KiDS and DES, where the rejection of neighbouring galaxies occurs within ~2 arcseconds, we show that the measured cosmic shear signal will be biased low, but by less than a percent on the angular scales that are typically used in cosmic shear analyses. The amplitude of the neighbour-exclusion bias doubles in deeper, LSST-like data. The simulation products described in this paper are made available at http://slics.roe.ac.uk/.

We present a machine-learning photometric redshift analysis of the Kilo-Degree Survey Data Release 3, using two neural-network based techniques: ANNz2 and MLPQNA. Despite limited coverage of spectroscopic training sets, these ML codes provide photo-zs of quality comparable to, if not better than, those from the BPZ code, at least up to zphot<0.9 and r<23.5. At the bright end of r<20, where very complete spectroscopic data overlapping with KiDS are available, the performance of the ML photo-zs clearly surpasses that of BPZ, currently the primary photo-z method for KiDS. Using the Galaxy And Mass Assembly (GAMA) spectroscopic survey as calibration, we furthermore study how photo-zs improve for bright sources when photometric parameters additional to magnitudes are included in the photo-z derivation, as well as when VIKING and WISE infrared bands are added. While the fiducial four-band ugri setup gives a photo-z bias $\delta z=-2e-4$ and scatter $\sigma_z<0.022$ at mean z = 0.23, combining magnitudes, colours, and galaxy sizes reduces the scatter by ~7% and the bias by an order of magnitude. Once the ugri and IR magnitudes are joined into 12-band photometry spanning up to 12 $\mu$, the scatter decreases by more than 10% over the fiducial case. Finally, using the 12 bands together with optical colours and linear sizes gives $\delta z<4e-5$ and $\sigma_z<0.019$. This paper also serves as a reference for two public photo-z catalogues accompanying KiDS DR3, both obtained using the ANNz2 code. The first one, of general purpose, includes all the 39 million KiDS sources with four-band ugri measurements in DR3. The second dataset, optimized for low-redshift studies such as galaxy-galaxy lensing, is limited to r<20, and provides photo-zs of much better quality than in the full-depth case thanks to incorporating optical magnitudes, colours, and sizes in the GAMA-calibrated photo-z derivation.

We describe data release 3 (DR3) of the Galaxy And Mass Assembly (GAMA) survey. The GAMA survey is a spectroscopic redshift and multi-wavelength photometric survey in three equatorial regions each of 60.0 deg^2 (G09, G12, G15), and two southern regions of 55.7 deg^2 (G02) and 50.6 deg^2 (G23). DR3 consists of: the first release of data covering the G02 region and of data on H-ATLAS sources in the equatorial regions; and updates to data on sources released in DR2. DR3 includes 154809 sources with secure redshifts across four regions. A subset of the G02 region is 95.5% redshift complete to r<19.8 over an area of 19.5 deg^2, with 20086 galaxy redshifts, that overlaps substantially with the XXL survey (X-ray) and VIPERS (redshift survey). In the equatorial regions, the main survey has even higher completeness (98.5%), and spectra for about 75% of H-ATLAS filler targets were also obtained. This filler sample extends spectroscopic redshifts, for probable optical counterparts to H-ATLAS sub-mm sources, to 0.8 mag deeper (r<20.6) than the GAMA main survey. There are 25814 galaxy redshifts for H-ATLAS sources from the GAMA main or filler surveys. GAMA DR3 is available at the survey website (www.gama-survey.org/dr3/).

We present measurements of the weak gravitational lensing shear power spectrum based on $450$ sq. deg. of imaging data from the Kilo Degree Survey. We employ a quadratic estimator in two and three redshift bins and extract band powers of redshift auto-correlation and cross-correlation spectra in the multipole range $76 \leq \ell \leq 1310$. The cosmological interpretation of the measured shear power spectra is performed in a Bayesian framework assuming a $\Lambda$CDM model with spatially flat geometry, while accounting for small residual uncertainties in the shear calibration and redshift distributions as well as marginalising over intrinsic alignments, baryon feedback and an excess-noise power model. Moreover, massive neutrinos are included in the modelling. The cosmological main result is expressed in terms of the parameter combination $S_8 \equiv \sigma_8 \sqrt{\Omega_{\rm m}/0.3}$ yielding $S_8 = \ 0.651 \pm 0.058$ (3 z-bins), confirming the recently reported tension in this parameter with constraints from Planck at $3.2\sigma$ (3 z-bins). We cross-check the results of the 3 z-bin analysis with the weaker constraints from the 2 z-bin analysis and find them to be consistent. The high-level data products of this analysis, such as the band power measurements, covariance matrices, redshift distributions, and likelihood evaluation chains are available at http://kids.strw.leidenuniv.nl/

The Kilo-Degree Survey (KiDS) is an ongoing optical wide-field imaging survey with the OmegaCAM camera at the VLT Survey Telescope. It aims to image 1500 square degrees in four filters (ugri). The core science driver is mapping the large-scale matter distribution in the Universe, using weak lensing shear and photometric redshift measurements. Further science cases include galaxy evolution, Milky Way structure, detection of high-redshift clusters, and finding rare sources such as strong lenses and quasars. Here we present the third public data release (DR3) and several associated data products, adding further area, homogenized photometric calibration, photometric redshifts and weak lensing shear measurements to the first two releases. A dedicated pipeline embedded in the Astro-WISE information system is used for the production of the main release. Modifications with respect to earlier releases are described in detail. Photometric redshifts have been derived using both Bayesian template fitting, and machine-learning techniques. For the weak lensing measurements, optimized procedures based on the THELI data reduction and lensfit shear measurement packages are used. In DR3 stacked ugri images, weight maps, masks, and source lists for 292 new survey tiles (~300 sq.deg) are made available. The multi-band catalogue, including homogenized photometry and photometric redshifts, covers the combined DR1, DR2 and DR3 footprint of 440 survey tiles (447 sq.deg). Limiting magnitudes are typically 24.3, 25.1, 24.9, 23.8 (5 sigma in a 2 arcsec aperture) in ugri, respectively, and the typical r-band PSF size is less than 0.7 arcsec. The photometric homogenization scheme ensures accurate colors and an absolute calibration stable to ~2% for gri and ~3% in u. Separately released are a weak lensing shear catalogue and photometric redshifts based on two different machine-learning techniques.

We present cosmological parameter constraints from a tomographic weak gravitational lensing analysis of ~450deg$^2$ of imaging data from the Kilo Degree Survey (KiDS). For a flat $\Lambda$CDM cosmology with a prior on $H_0$ that encompasses the most recent direct measurements, we find $S_8\equiv\sigma_8\sqrt{\Omega_{\rm m}/0.3}=0.745\pm0.039$. This result is in good agreement with other low redshift probes of large scale structure, including recent cosmic shear results, along with pre-Planck cosmic microwave background constraints. A $2.3$-$\sigma$ tension in $S_8$ and `substantial discordance' in the full parameter space is found with respect to the Planck 2015 results. We use shear measurements for nearly 15 million galaxies, determined with a new improved `self-calibrating' version of $lens$fit validated using an extensive suite of image simulations. Four-band $ugri$ photometric redshifts are calibrated directly with deep spectroscopic surveys. The redshift calibration is confirmed using two independent techniques based on angular cross-correlations and the properties of the photometric redshift probability distributions. Our covariance matrix is determined using an analytical approach, verified numerically with large mock galaxy catalogues. We account for uncertainties in the modelling of intrinsic galaxy alignments and the impact of baryon feedback on the shape of the non-linear matter power spectrum, in addition to the small residual uncertainties in the shear and redshift calibration. The cosmology analysis was performed blind. Our high-level data products, including shear correlation functions, covariance matrices, redshift distributions, and Monte Carlo Markov Chains are available at http://kids.strw.leidenuniv.nl.

We present the Red-sequence Cluster Lensing Survey (RCSLenS), an application of the methods developed for the Canada France Hawaii Telescope Lensing Survey (CFHTLenS) to the ~785deg$^2$, multi-band imaging data of the Red-sequence Cluster Survey 2 (RCS2). This project represents the largest public, sub-arcsecond seeing, multi-band survey to date that is suited for weak gravitational lensing measurements. With a careful assessment of systematic errors in shape measurements and photometric redshifts we extend the use of this data set to allow cross-correlation analyses between weak lensing observables and other data sets. We describe the imaging data, the data reduction, masking, multi-colour photometry, photometric redshifts, shape measurements, tests for systematic errors, and a blinding scheme to allow for more objective measurements. In total we analyse 761 pointings with r-band coverage, which constitutes our lensing sample. Residual large-scale B-mode systematics prevent the use of this shear catalogue for cosmic shear science. The effective number density of lensing sources over an unmasked area of 571.7deg$^2$ and down to a magnitude limit of r~24.5 is 8.1 galaxies per arcmin$^2$ (weighted: 5.5 arcmin$^{-2}$) distributed over 14 patches on the sky. Photometric redshifts based on 4-band griz data are available for 513 pointings covering an unmasked area of 383.5 deg$^2$ We present weak lensing mass reconstructions of some example clusters as well as the full survey representing the largest areas that have been mapped in this way. All our data products are publicly available through CADC at http://www.cadc-ccda.hia-iha.nrc-cnrc.gc.ca/en/community/rcslens/query.html in a format very similar to the CFHTLenS data release.

We present measurements of the galaxy bias $b$ and the galaxy-matter cross-correlation coefficient $r$ for the BOSS LOWZ luminous red galaxy sample. Using a new statistical weak lensing analysis of the Red Sequence Cluster Lensing Survey (RCSLenS) we find the bias properties of this sample to be higher than previously reported with $b=2.45^{+0.05}_{-0.05}$ and $r=1.64^{+0.17}_{-0.16}$ on scales between $3'$ and $20'$. We repeat the measurement for angular scales of $20'\leq \vartheta \leq70'$, which yields $b=2.39^{+0.07}_{-0.07}$ and $r=1.24^{+0.26}_{-0.25}$. This is the first application of a data compression analysis using a complete set of discrete estimators for galaxy-galaxy lensing and galaxy clustering. As cosmological data sets grow, our new method of data compression will become increasingly important in order to interpret joint weak lensing and galaxy clustering measurements and to estimate the data covariance. In future studies this formalism can be used as a tool to study the large-scale structure of the Universe to yield a precise determination of cosmological parameters.

In this paper we present results of applying the shear-ratio method to the RCSLenS data. The method takes the ratio of the mean of the weak lensing tangential shear signal about galaxy clusters, averaged over all clusters of the same redshift, in multiple background redshift bins. In taking a ratio the mass-dependency of the shear signal is cancelled-out leaving a statistic that is dependent on the geometric part of the lensing kernel only. We apply this method to 535 clusters and measure a cosmology-independent distance-redshift relation to redshifts z~1. In combination with Planck data the method lifts the degeneracies in the CMB measurements, resulting in cosmological parameter constraints of OmegaM=0.31 +/- 0.10 and w0 = -1.02 +/- 0.37, for a flat wCDM cosmology.

The Kilo-Degree Survey (KiDS) is an optical wide-field survey designed to map the matter distribution in the Universe using weak gravitational lensing. In this paper, we use these data to measure the density profiles and masses of a sample of $\sim \mathrm{1400}$ spectroscopically identified galaxy groups and clusters from the Galaxy And Mass Assembly (GAMA) survey. We detect a highly significant signal (signal-to-noise-ratio $\sim$ 120), allowing us to study the properties of dark matter haloes over one and a half order of magnitude in mass, from $M \sim 10^{13}-10^{14.5} h^{-1}\mathrm{M_{\odot}}$. We interpret the results for various subsamples of groups using a halo model framework which accounts for the mis-centring of the Brightest Cluster Galaxy (used as the tracer of the group centre) with respect to the centre of the group's dark matter halo. We find that the density profiles of the haloes are well described by an NFW profile with concentrations that agree with predictions from numerical simulations. In addition, we constrain scaling relations between the mass and a number of observable group properties. We find that the mass scales with the total r-band luminosity as a power-law with slope $1.16 \pm 0.13$ (1-sigma) and with the group velocity dispersion as a power-law with slope $1.89 \pm 0.27$ (1-sigma). Finally, we demonstrate the potential of weak lensing studies of groups to discriminate between models of baryonic feedback at group scales by comparing our results with the predictions from the Cosmo-OverWhelmingly Large Simulations (Cosmo-OWLS) project, ruling out models without AGN feedback.

Ultra-deep observations of ECDF-S with Chandra and XMM-Newton enable a search for extended X-ray emission down to an unprecedented flux of $2\times10^{-16}$ ergs s$^{-1}$ cm$^{-2}$. We present the search for the extended emission on spatial scales of 32$^{\prime\prime}$ in both Chandra and XMM data, covering 0.3 square degrees and model the extended emission on scales of arcminutes. We present a catalog of 46 spectroscopically identified groups, reaching a redshift of 1.6. We show that the statistical properties of ECDF-S, such as logN-logS and X-ray luminosity function are broadly consistent with LCDM, with the exception that dn/dz/d$\Omega$ test reveals that a redshift range of $0.2<z<0.5$ in ECDF-S is sparsely populated. The lack of nearby structure, however, makes studies of high-redshift groups particularly easier both in X-rays and lensing, due to a lower level of clustered foreground. We present one and two point statistics of the galaxy groups as well as weak-lensing analysis to show that the detected low-luminosity systems are indeed low-mass systems. We verify the applicability of the scaling relations between the X-ray luminosity and the total mass of the group, derived for the COSMOS survey to lower masses and higher redshifts probed by ECDF-S by means of stacked weak lensing and clustering analysis, constraining any possible departures to be within 30% in mass. Abridged.

We present weak lensing and X-ray analysis of 12 low mass clusters from the CFHTLenS and XMM-CFHTLS surveys. We combine these systems with high-mass systems from CCCP and low-mass systems from COSMOS to obtain a sample of 70 systems, spanning over two orders of magnitude in mass. We measure core-excised Lx-Tx, M-Lx and M-Tx scaling relations and include corrections for observational biases. By providing fully bias corrected relations, we give the current limitations for Lx and Tx as cluster mass proxies. We demonstrate that Tx benefits from a significantly lower intrinsic scatter at fixed mass than Lx. By studying the residuals of the bias corrected relations, we show for the first time using weak lensing masses that galaxy groups seem more luminous and warmer for their mass than clusters. This implies a steepening of the M-Lx and M-Tx relations at low masses. We verify the inferred steepening using a different high mass sample from the literature and show that variance between samples is the dominant effect leading to discrepant scaling relations. We divide our sample into subsamples of merging and relaxed systems, and find that mergers may have enhanced scatter in lensing measurements, most likely due to stronger triaxiality and more substructure. For the Lx-Tx relation, which is unaffected by lensing measurements, we find the opposite trend in scatter. We also explore the effects of X-ray cross-calibration and find that Chandra calibration leads to flatter Lx-Tx and M-Tx relations than XMM-Newton.

We study the correlations of the shear signal between triplets of sources in the Canada-France-Hawaii Lensing Survey (CFHTLenS) to probe cosmological parameters via the matter bispectrum. In contrast to previous studies, we adopted a non-Gaussian model of the data likelihood which is supported by our simulations of the survey. We find that for state-of-the-art surveys, similar to CFHTLenS, a Gaussian likelihood analysis is a reasonable approximation, albeit small differences in the parameter constraints are already visible. For future surveys we expect that a Gaussian model becomes inaccurate. Our algorithm for a refined non-Gaussian analysis and data compression is then of great utility especially because it is not much more elaborate if simulated data are available. Applying this algorithm to the third-order correlations of shear alone in a blind analysis, we find a good agreement with the standard cosmological model: $\Sigma_8$=$\sigma_8$ $(\Omega_{\rm m}/0.27)^{0.64}$=$0.79^{+0.08}_{-0.11}$ for a flat $\Lambda\rm CDM$ cosmology with $h=0.7\pm0.04$ ($68\%$ credible interval). Nevertheless our models provide only moderately good fits as indicated by $\chi^2/{\rm dof}=2.9$, including a $20\%$ r.m.s. uncertainty in the predicted signal amplitude. The models cannot explain a signal drop on scales around 15 arcmin, which may be caused by systematics. It is unclear whether the discrepancy can be fully explained by residual PSF systematics of which we find evidence at least on scales of a few arcmin. Therefore we need a better understanding of higher-order correlations of cosmic shear and their systematics to confidently apply them as cosmological probes.

We present new constraints on the relationship between galaxies and their host dark matter halos, measured from the location of the peak of the stellar-to-halo mass ratio (SHMR), up to the most massive galaxy clusters at redshift $z\sim0.8$ and over a volume of nearly 0.1~Gpc$^3$. We use a unique combination of deep observations in the CFHTLenS/VIPERS field from the near-UV to the near-IR, supplemented by $\sim60\,000$ secure spectroscopic redshifts, analysing galaxy clustering, galaxy-galaxy lensing and the stellar mass function. We interpret our measurements within the halo occupation distribution (HOD) framework, separating the contributions from central and satellite galaxies. We find that the SHMR for the central galaxies peaks at $M_{\rm h, peak} = 1.9^{+0.2}_{-0.1}\times10^{12} M_{\odot}$ with an amplitude of $0.025$, which decreases to $\sim0.001$ for massive halos ($M_{\rm h} > 10^{14} M_{\odot}$). Compared to central galaxies only, the total SHMR (including satellites) is boosted by a factor 10 in the high-mass regime (cluster-size halos), a result consistent with cluster analyses from the literature based on fully independent methods. After properly accounting for differences in modelling, we have compared our results with a large number of results from the literature up to $z=1$: we find good general agreement, independently of the method used, within the typical stellar-mass systematic errors at low to intermediate mass (${M}_{\star} < 10^{11} M_{\odot}$) and the statistical errors above. We have also compared our SHMR results to semi-analytic simulations and found that the SHMR is tilted compared to our measurements in such a way that they over- (under-) predict star formation efficiency in central (satellite) galaxies.

This paper presents the first application of 3D cosmic shear to a wide-field weak lensing survey. 3D cosmic shear is a technique that analyses weak lensing in three dimensions using a spherical harmonic approach, and does not bin data in the redshift direction. This is applied to CFHTLenS, a 154 square degree imaging survey with a median redshift of 0.7 and an effective number density of 11 galaxies per square arcminute usable for weak lensing. To account for survey masks we apply a 3D pseudo-Cl approach on weak lensing data, and to avoid uncertainties in the highly non-linear regime, we separately analyse radial wave numbers k<=1.5h/Mpc and k<=5.0h/Mpc, and angular wavenumbers l~400-5000. We show how one can recover 2D and tomographic power spectra from the full 3D cosmic shear power spectra and present a measurement of the 2D cosmic shear power spectrum, and measurements of a set of 2-bin and 6-bin cosmic shear tomographic power spectra; in doing so we find that using the 3D power in the calculation of such 2D and tomographic power spectra from data naturally accounts for a minimum scale in the matter power spectrum. We use 3D cosmic shear to constrain cosmologies with parameters OmegaM, OmegaB, sigma8, h, ns, w0, wa. For a non-evolving dark energy equation of state, and assuming a flat cosmology, lensing combined with WMAP7 results in h=0.78+/-0.12, OmegaM=0.252+/-0.079, sigma8=0.88+/-0.23 and w=-1.16+/-0.38 using only scales k<=1.5h/Mpc. We also present results of lensing combined with first year Planck results, where we find no tension with the results from this analysis, but we also find no significant improvement over the Planck results alone. We find evidence of a suppression of power compared to LCDM on small scales 1.5 < k < 5.0 h/Mpc in the lensing data, which is consistent with predictions of the effect of baryonic feedback on the matter power spectrum.

We investigate the dependence of the galaxy luminosity function on geometric environment within the Galaxy And Mass Assembly (GAMA) survey. The tidal tensor prescription, based on the Hessian of the pseudo-gravitational potential, is used to classify the cosmic web and define the geometric environments: for a given smoothing scale, we classify every position of the surveyed region, $0.04<{z}<0.26$, as either a void, a sheet, a filament or a knot. We consider how to choose appropriate thresholds in the eigenvalues of the Hessian in order to partition the galaxies approximately evenly between environments. We find a significant variation in the luminosity function of galaxies between different geometric environments; the normalisation, characterised by $\phi^{*}$ in a Schechter function fit, increases by an order of magnitude from voids to knots. The turnover magnitude, characterised by $M^*$, brightens by approximately $0.5$ mag from voids to knots. However, we show that the observed modulation can be entirely attributed to the indirect local-density dependence. We therefore find no evidence of a direct influence of the cosmic web on the galaxy luminosity function.

We outline the prospects for performing pioneering radio weak gravitational lensing analyses using observations from a potential forthcoming JVLA Sky Survey program. A large-scale survey with the JVLA can offer interesting and unique opportunities for performing weak lensing studies in the radio band, a field which has until now been the preserve of optical telescopes. In particular, the JVLA has the capacity for large, deep radio surveys with relatively high angular resolution, which are the key characteristics required for a successful weak lensing study. We highlight the potential advantages and unique aspects of performing weak lensing in the radio band. In particular, the inclusion of continuum polarisation information can greatly reduce noise in weak lensing reconstructions and can also remove the effects of intrinsic galaxy alignments, the key astrophysical systematic effect that limits weak lensing at all wavelengths. We identify a VLASS "deep fields" program (total area ~10-20 square degs), to be conducted at L-band and with high-resolution (A-array configuration), as the optimal survey strategy from the point of view of weak lensing science. Such a survey will build on the unique strengths of the JVLA and will remain unsurpassed in terms of its combination of resolution and sensitivity until the advent of the Square Kilometre Array. We identify the best fields on the JVLA-accessible sky from the point of view of overlapping with existing deep optical and near infra-red data which will provide crucial redshift information and facilitate a host of additional compelling multi-wavelength science.

In this paper we present results from the weak lensing shape measurement GRavitational lEnsing Accuracy Testing 2010 (GREAT10) Galaxy Challenge. This marks an order of magnitude step change in the level of scrutiny employed in weak lensing shape measurement analysis. We provide descriptions of each method tested and include 10 evaluation metrics over 24 simulation branches. GREAT10 was the first shape measurement challenge to include variable fields; both the shear field and the Point Spread Function (PSF) vary across the images in a realistic manner. The variable fields enable a variety of metrics that are inaccessible to constant shear simulations including a direct measure of the impact of shape measurement inaccuracies, and the impact of PSF size and ellipticity, on the shear power spectrum. To assess the impact of shape measurement bias for cosmic shear we present a general pseudo-Cl formalism, that propagates spatially varying systematics in cosmic shear through to power spectrum estimates. We also show how one-point estimators of bias can be extracted from variable shear simulations. The GREAT10 Galaxy Challenge received 95 submissions and saw a factor of 3 improvement in the accuracy achieved by shape measurement methods. The best methods achieve sub-percent average biases. We find a strong dependence in accuracy as a function of signal-to-noise, and indications of a weak dependence on galaxy type and size. Some requirements for the most ambitious cosmic shear experiments are met above a signal-to-noise ratio of 20. These results have the caveat that the simulated PSF was a ground-based PSF. Our results are a snapshot of the accuracy of current shape measurement methods and are a benchmark upon which improvement can continue. This provides a foundation for a better understanding of the strengths and limitations of shape measurement methods.

The Galaxy And Mass Assembly (GAMA) survey is a multiwavelength photometric and spectroscopic survey, using the AAOmega spectrograph on the Anglo-Australian Telescope to obtain spectra for up to ~300000 galaxies over 280 square degrees, to a limiting magnitude of r_pet < 19.8 mag. The target galaxies are distributed over 0<z<0.5 with a median redshift of z~0.2, although the redshift distribution includes a small number of systems, primarily quasars, at higher redshifts, up to and beyond z=1. The redshift accuracy ranges from sigma_v~50km/s to sigma_v~100km/s depending on the signal-to-noise of the spectrum. Here we describe the GAMA spectroscopic reduction and analysis pipeline. We present the steps involved in taking the raw two-dimensional spectroscopic images through to flux-calibrated one-dimensional spectra. The resulting GAMA spectra cover an observed wavelength range of 3750<lambda<8850 A at a resolution of R~1300. The final flux calibration is typically accurate to 10-20%, although the reliability is worse at the extreme wavelength ends, and poorer in the blue than the red. We present details of the measurement of emission and absorption features in the GAMA spectra. These measurements are characterised through a variety of quality control analyses detailing the robustness and reliability of the measurements. We illustrate the quality of the measurements with a brief exploration of elementary emission line properties of the galaxies in the GAMA sample. We demonstrate the luminosity dependence of the Balmer decrement, consistent with previously published results, and explore further how Balmer decrement varies with galaxy mass and redshift. We also investigate the mass and redshift dependencies of the [NII]/Halpha vs [OIII]/Hbeta spectral diagnostic diagram, commonly used to discriminate between star forming and nuclear activity in galaxies.

We present the first direct measurement of the galaxy-matter bispectrum as a function of galaxy luminosity, stellar mass, and SED type. Our analysis uses a galaxy-galaxy-galaxy lensing technique (G3L), on angular scales between 9 arcsec to 50 arcmin, to quantify (i) the excess surface mass density around galaxy pairs (excess mass hereafter) and (ii) the excess shear-shear correlations around single galaxies, both of which yield a measure of two types of galaxy-matter bispectra. We apply our method to the state-of-the-art Canada-France-Hawaii Telescope Lensing Survey (CFHTLenS), spanning 154 square degrees. This survey allows us to detect a significant change of the bispectra with lens properties. Measurements for lens populations with distinct redshift distributions become comparable by a newly devised normalisation technique. That will also aid future comparisons to other surveys or simulations. A significant dependence of the normalised G3L statistics on luminosity within -23<M_r<-18 and stellar mass within 5x10^9 M_sol<M_star<2x10^11 M_sol is found (h=0.73). Both bispectra exhibit a stronger signal for more luminous lenses or those with higher stellar mass (up to a factor 2-3). This is accompanied by a steeper equilateral bispectrum for more luminous or higher stellar mass lenses for the excess mass. Importantly, we find the excess mass to be very sensitive to galaxy type as recently predicted with semi-analytic galaxy models: luminous (M_r<-21) late-type galaxies show no detectable signal, while all excess mass detected for luminous galaxies seems to be associated with early-type galaxies. We also present the first observational constraints on third-order stochastic galaxy biasing parameters.

We present data products from the Canada-France-Hawaii Telescope Lensing Survey (CFHTLenS). CFHTLenS is based on the Wide component of the Canada-France-Hawaii Telescope Legacy Survey (CFHTLS). It encompasses 154 deg^2 of deep, optical, high-quality, sub-arcsecond imaging data in the five optical filters u^*g'r'i'z'. The article presents our data processing of the complete CFHTLenS data set. We were able to obtain a data set with very good image quality and high-quality astrometric and photometric calibration. Our external astrometric accuracy is between 60-70 mas with respect to SDSS data and the internal alignment in all filters is around 30 mas. Our average photometric calibration shows a dispersion on the order of 0.01 to 0.03 mag for g'r'i'z' and about 0.04 mag for u^* with respect to SDSS sources down to i <= 21. In the spirit of the CFHTLS all our data products are released to the astronomical community via the Canadian Astronomy Data Centre. We give a description and how-to manuals of the public products which include image pixel data, source catalogues with photometric redshift estimates and all relevant quantities to perform weak lensing studies.

A likelihood-based method for measuring weak gravitational lensing shear in deep galaxy surveys is described and applied to the Canada-France-Hawaii Telescope (CFHT) Lensing Survey (CFHTLenS). CFHTLenS comprises 154 sq deg of multicolour optical data from the CFHT Legacy Survey, with lensing measurements being made in the i' band to a depth i'(AB)<24.7, for galaxies with signal-to-noise ratio greater than about 10. The method is based on the lensfit algorithm described in earlier papers, but here we describe a full analysis pipeline that takes into account the properties of real surveys. The method creates pixel-based models of the varying point spread function (PSF) in individual image exposures. It fits PSF-convolved two-component (disk plus bulge) models, to measure the ellipticity of each galaxy, with bayesian marginalisation over model nuisance parameters of galaxy position, size, brightness and bulge fraction. The method allows optimal joint measurement of multiple, dithered image exposures, taking into account imaging distortion and the alignment of the multiple measurements. We discuss the effects of noise bias on the likelihood distribution of galaxy ellipticity. Two sets of image simulations that mirror the observed properties of CFHTLenS have been created, to establish the method's accuracy and to derive an empirical correction for the effects of noise bias.

We present the results from the first public blind PSF reconstruction challenge, the GRavitational lEnsing Accuracy Testing 2010 (GREAT10) Star Challenge. Reconstruction of a spatially varying PSF, sparsely sampled by stars, at non-star positions is a critical part in the image analysis for weak lensing where inaccuracies in the modelled ellipticity and size-squared can impact the ability to measure the shapes of galaxies. This is of importance because weak lensing is a particularly sensitive probe of dark energy, and can be used to map the mass distribution of large scale structure. Participants in the challenge were presented with 27,500 stars over 1300 images subdivided into 26 sets, where in each set a category change was made in the type or spatial variation of the PSF. Thirty submissions were made by 9 teams. The best methods reconstructed the PSF with an accuracy of ~0.00025 in ellipticity and ~0.00074 in size squared. For a fixed pixel scale narrower PSFs were found to be more difficult to model than larger PSFs, and the PSF reconstruction was severely degraded with the inclusion of an atmospheric turbulence model (although this result is likely to be a strong function of the amplitude of the turbulence power spectrum).

In this paper we present results from the Mapping Dark Matter competition that expressed the weak lensing shape measurement task in its simplest form and as a result attracted over 700 submissions in 2 months and a factor of 3 improvement in shape measurement accuracy on high signal to noise galaxies, over previously published results, and a factor 10 improvement over methods tested on constant shear blind simulations. We also review weak lensing shape measurement challenges, including the Shear TEsting Programmes (STEP1 and STEP2) and the GRavitational lEnsing Accuracy Testing competitions (GREAT08 and GREAT10).