In plain words: A tool breeds a wide mix of Hanabi partners by rewarding agents for playing well while acting differently from each other, so new agents can be tested with unknown teammates. The first working version shows it generates varied partners and suggests how to judge them.
Abstract
In complex scenarios where a model of other actors is necessary to predict and interpret their actions, it is often desirable that the model works well with a wide variety of previously unknown actors. Hanabi is a card game that brings the problem of modeling other players to the forefront, but there is no agreement on how to best generate a pool of agents to use as partners in ad-hoc cooperation evaluation. This paper proposes Quality Diversity algorithms as a promising class of algorithms to generate populations for this purpose and shows an initial implementation of an agent generator based on this idea. We also discuss what metrics can be used to compare such generators, and how the proposed generator could be leveraged to help build adaptive agents for the game.
Rodrigo Canaan, Julian Togelius, Andy Nealen, Stefan Menzel
arXiv:1907.03840 · cs.AI, cs.NE · submitted Jul 8, 2019
abstract · pdf · html · 8 pages, 4 figures. Accepted at the 2019 IEEE Conference on Games (CoG)