
In many settings people must give numerical scores to entities from a small
discrete set. For instance, rating physical attractiveness from 15 on dating
sites, or papers from 110 for conference reviewing. We study the problem of
understanding when using a different number of options is optimal. We consider
the case when scores are uniform random and Gaussian. We study computationally
when using 2, 3, 4, 5, and 10 options out of a total of 100 is optimal in these
models (though our theoretical analysis is for a more general setting with $k$
choices from $n$ total options as well as a continuous underlying space). One
may expect that using more options would always improve performance in this
model, but we show that this is not necessarily the case, and that using fewer
choiceseven just twocan surprisingly be optimal in certain situations.
While in theory for this setting it would be optimal to use all 100 options, in
practice this is prohibitive, and it is preferable to utilize a smaller number
of options due to humans' limited computational resources. Our results could
have many potential applications, as settings requiring entities to be ranked
by humans are ubiquitous. There could also be applications to other fields such
as signal or image processing where input values from a large set must be
mapped to output values in a smaller set.

Two fundamental problems in computational game theory are computing a Nash
equilibrium and learning to exploit opponents given observations of their play
(opponent exploitation). The latter is perhaps even more important than the
former: Nash equilibrium does not have a compelling theoretical justification
in game classes other than twoplayer zerosum, and for all games one can
potentially do better by exploiting perceived weaknesses of the opponent than
by following a static equilibrium strategy throughout the match. The natural
setting for opponent exploitation is the Bayesian setting where we have a prior
model that is integrated with observations to create a posterior opponent model
that we respond to. The most natural, and a wellstudied prior distribution is
the Dirichlet distribution. An exact polynomialtime algorithm is known for
bestresponding to the posterior distribution for an opponent assuming a
Dirichlet prior with multinomial sampling in normalform games; however, for
imperfectinformation games the best known algorithm is based on approximating
an infinite integral without theoretical guarantees. We present the first exact
algorithm for a natural class of imperfectinformation games. We demonstrate
that our algorithm runs quickly in practice and outperforms the best prior
approaches. We also present an algorithm for the uniform prior setting.

Creating strong agents for games with more than two players is a major open
problem in AI. Common approaches are based on approximating gametheoretic
solution concepts such as Nash equilibrium, which have strong theoretical
guarantees in twoplayer zerosum games, but no guarantees in nonzerosum
games or in games with more than two players. We describe an agent that is able
to defeat a variety of realistic opponents using an exact Nash equilibrium
strategy in a 3player imperfectinformation game. This shows that, despite a
lack of theoretical guarantees, agents based on Nash equilibrium strategies can
be successful in multiplayer games after all.

Hurricanes are cyclones circulating about a defined center whose closed wind
speeds exceed 75 mph originating over tropical and subtropical waters. At
landfall, hurricanes can result in severe disasters. The accuracy of predicting
their trajectory paths is critical to reduce economic loss and save human
lives. Given the complexity and nonlinearity of weather data, a recurrent
neural network (RNN) could be beneficial in modeling hurricane behavior. We
propose the application of a fully connected RNN to predict the trajectory of
hurricanes. We employed the RNN over a fine grid to reduce typical truncation
errors. We utilized their latitude, longitude, wind speed, and pressure
publicly provided by the National Hurricane Center (NOAA) to predict the
trajectory of a hurricane at 6hour intervals.

Evolutionarily stable strategy (ESS) is an important solution concept in game
theory which has been applied frequently to biology and even cancer. Finding
such a strategy has been shown to be difficult from a theoretical complexity
perspective. Informally an ESS is a strategy that if followed by the population
cannot be taken over by a mutation strategy. We present an algorithm for the
case where mutations are restricted to pure strategies. This is the first
positive result for computation of ESS, as all prior results are computational
hardness and no prior algorithms have been presented.

A problem faced by many instructors is that of designing exams that
accurately assess the abilities of the students. Typically these exams are
prepared several days in advance, and generic question scores are used based on
rough approximation of the question difficulty and length. For example, for a
recent class taught by the author, there were 30 multiple choice questions
worth 3 points, 15 true/false with explanation questions worth 4 points, and 5
analytical exercises worth 10 points. We describe a novel framework where
algorithms from machine learning are used to modify the exam question weights
in order to optimize the exam scores, using the overall class grade as a proxy
for a student's true ability. We show that significant error reduction can be
obtained by our approach over standard weighting schemes, and we make several
new observations regarding the properties of the "good" and "bad" exam
questions that can have impact on the design of improved future evaluation
methods.

Algorithms for equilibrium computation generally make no attempt to ensure
that the computed strategies are understandable by humans. For instance the
strategies for the strongest poker agents are represented as massive binary
files. In many situations, we would like to compute strategies that can
actually be implemented by humans, who may have computational limitations and
may only be able to remember a small number of features or components of the
strategies that have been computed. We study poker games where private
information distributions can be arbitrary. We create a large training set of
game instances and solutions, by randomly selecting the information
probabilities, and present algorithms that learn from the training instances in
order to perform well in games with unseen information distributions. We are
able to conclude several new fundamental rules about poker strategy that can be
easily implemented by humans.

We develop a new approach that computes approximate equilibrium strategies in
Jotto, a popular word game. Jotto is an extremely large twoplayer game of
imperfect information; its game tree has many orders of magnitude more states
than games previously studied, including nolimit Texas hold 'em. To address
the fact that the game is so large, we propose a novel strategy representation
called oracular form, in which we do not explicitly represent a strategy, but
rather appeal to an oracle that quickly outputs a sample move from the
strategy's distribution. Our overall approach is based on an extension of the
fictitious play algorithm to this oracular setting. We demonstrate the
superiority of our computed strategies over the strategies computed by a
benchmark algorithm, both in terms of headtohead and worstcase performance.

The first ever human vs. computer nolimit Texas hold 'em competition took
place from April 24May 8, 2015 at River's Casino in Pittsburgh, PA. In this
article I present my thoughts on the competition design, agent architecture,
and lessons learned.