
Maxstable processes are a common choice for modelling spatial extreme data
as they arise naturally as the infinitedimensional generalisation of
multivariate extreme value theory. Statistical inference for such models is
complicated by the intractability of the multivariate density function.
Nonparametric, composite likelihoodbased, and Bayesian approaches have been
proposed to address this difficulty. More recently, a simulationbased approach
using approximate Bayesian computation (ABC) has been employed for estimating
parameters of maxstable models. ABC algorithms rely on the evaluation of
discrepancies between model simulations and the observed data rather than
explicit evaluations of computationally expensive or intractable likelihood
functions. The use of an ABC method to perform model selection for maxstable
models is explored. Three maxstable models are regarded: the extremalt model
with either a WhittleMat\'ern or a powered exponential covariance function,
and the BrownResnick model with power variogram. In addition, the nonextremal
Studentt copula model with a WhittleMat\'ern or a powered exponential
covariance function is also considered. The method is applied to annual maximum
temperature data from 25 weather stations dispersed around South Australia.

We introduce a new class of sequential Monte Carlo methods called Nested
Sampling via Sequential Monte Carlo (NSSMC), which reframes the Nested
Sampling method of Skilling (2006) in terms of sequential Monte Carlo
techniques. This new framework allows one to obtain provably consistent
estimates of marginal likelihood and posterior inferences when Markov chain
Monte Carlo (MCMC) is used to produce new samples. An additional benefit is
that marginal likelihood estimates are also unbiased. In contrast to NS, the
analysis of NSSMC does not require the (unrealistic) assumption that the
simulated samples be independent. As the original NS algorithm is a special
case of NSSMC, this provides insights as to why NS seems to produce accurate
estimates despite a typical violation of its assumptions. For applications of
NSSMC, we give advice on tuning MCMC kernels in an automated manner via a
preliminary pilot run, and present a new method for appropriately choosing the
number of MCMC repeats at each iteration. Finally, a numerical study is
conducted where the performance of NSSMC and temperatureannealed SMC is
compared on several challenging and realistic problems. MATLAB code for our
experiments is made available at https://github.com/LeahPrice/SMCNS.

The understanding of complex physical or biological systems nearly always
requires a characterisation of the variability that underpins these processes.
In addition, the data used to calibrate such models may also often exhibit
considerable variability. A recent approach to deal with these issues has been
to calibrate populations of models (POMs), that is multiple copies of a single
mathematical model but with different parameter values. To date this
calibration has been limited to selecting models that produce outputs that fall
within the ranges of the dataset, ignoring any trends that might be present in
the data. We present here a novel and general methodology for calibrating POMs
to the distributions of a set of measured values in a dataset. We demonstrate
the benefits of our technique using a dataset from a cardiac atrial
electrophysiology study based on the differences in atrial action potential
readings between patients exhibiting sinus rhythm (SR) or chronic atrial
fibrillation (cAF) and the CourtemancheRamirezNattel model for human atrial
action potentials. Our approach accurately captures the variability inherent in
the experimental population, and allows us to identify the differences
underlying stratified data as well as the effects of drug block.

The generation of decisiontheoretic Bayesian optimal designs is complicated
by the significant computational challenge of minimising an analytically
intractable expected loss function over a, potentially, highdimensional design
space. A new general approach for approximately finding Bayesian optimal
designs is proposed which uses computationally efficient normalbased
approximations to posterior summaries to aid in approximating the expected
loss. This new approach is demonstrated on illustrative, yet challenging,
examples including hierarchical models for blocked experiments, and
experimental aims of parameter estimation and model discrimination. Where
possible, the results of the proposed methodology are compared, both in terms
of performance and computing time, to results from using computationally more
expensive, but potentially more accurate, Monte Carlo approximations. Moreover
the methodology is also applied to problems where the use of Monte Carlo
approximations is computationally infeasible.

Synthetic likelihood is an attractive approach to likelihoodfree inference
when an approximately Gaussian summary statistic for the data, informative for
inference about the parameters, is available. The synthetic likelihood method
derives an approximate likelihood function from a plugin normal density
estimate for the summary statistic, with plugin mean and covariance matrix
obtained by Monte Carlo simulation from the model. In this article, we develop
alternatives to Markov chain Monte Carlo implementations of Bayesian synthetic
likelihoods with reduced computational overheads. Our approach uses stochastic
gradient variational inference methods for posterior approximation in the
synthetic likelihood context, employing unbiased estimates of the log
likelihood. We compare the new method with a related likelihood free
variational inference technique in the literature, while at the same time
improving the implementation of that approach in a number of ways. These new
algorithms are feasible to implement in situations which are challenging for
conventional approximate Bayesian computation (ABC) methods, in terms of the
dimensionality of the parameter and summary statistic.

Indirect inference (II) is a methodology for estimating the parameters of an
intractable (generative) model on the basis of an alternative parametric
(auxiliary) model that is both analytically and computationally easier to deal
with. Such an approach has been well explored in the classical literature but
has received substantially less attention in the Bayesian paradigm. The purpose
of this paper is to compare and contrast a collection of what we call
parametric Bayesian indirect inference (pBII) methods. One class of pBII
methods uses approximate Bayesian computation (referred to here as ABC II)
where the summary statistic is formed on the basis of the auxiliary model,
using ideas from II. Another approach proposed in the literature, referred to
here as parametric Bayesian indirect likelihood (pBIL), uses the auxiliary
likelihood as a replacement to the intractable likelihood. We show that pBIL is
a fundamentally different approach to ABC II. We devise new theoretical results
for pBIL to give extra insights into its behaviour and also its differences
with ABC II. Furthermore, we examine in more detail the assumptions required to
use each pBII method. The results, insights and comparisons developed in this
paper are illustrated on simple examples and two other substantive
applications. The first of the substantive examples involves performing
inference for complex quantile distributions based on simulated data while the
second is for estimating the parameters of a trivariate stochastic process
describing the evolution of macroparasites within a host based on real data. We
create a novel framework called Bayesian indirect likelihood (BIL) that
encompasses pBII as well as general ABC methods so that the connections between
the methods can be established.

Most of the existing algorithms for approximate Bayesian computation (ABC)
assume that it is feasible to simulate pseudodata from the model at each
iteration. However, the computational cost of these simulations can be
prohibitive for high dimensional data. An important example is the Potts model,
which is commonly used in image analysis. Images encountered in real world
applications can have millions of pixels, therefore scalability is a major
concern. We apply ABC with a synthetic likelihood to the hidden Potts model
with additive Gaussian noise. Using a preprocessing step, we fit a binding
function to model the relationship between the model parameters and the
synthetic likelihood parameters. Our numerical experiments demonstrate that the
precomputed binding function dramatically improves the scalability of ABC,
reducing the average runtime required for model fitting from 71 hours to only 7
minutes. We also illustrate the method by estimating the smoothing parameter
for remotely sensed satellite imagery. Without precomputation, Bayesian
inference is impractical for datasets of that scale.