about
Giraffe: Using Deep Reinforcement Learning to Play Chess (arxiv.org)
17 points by Schiphol on Sep 15, 2015 | hide | past | pdf | 2 comments on HN

In plain words: Giraffe learns how to judge chess positions by playing against itself, working out on its own which patterns matter instead of using rules written by people. Its judgments match those of top engines built from thousands of carefully tuned lines of expert rules.

Abstract

This report presents Giraffe, a chess engine that uses self-play to discover all its domain-specific knowledge, with minimal hand-crafted knowledge given by the programmer. Unlike previous attempts using machine learning only to perform parameter-tuning on hand-crafted evaluation functions, Giraffe's learning system also performs automatic feature extraction and pattern recognition. The trained evaluation function performs comparably to the evaluation functions of state-of-the-art chess engines - all of which containing thousands of lines of carefully hand-crafted pattern recognizers, tuned over many years by both computer chess experts and human chess masters. Giraffe is the most successful attempt thus far at using end-to-end machine learning to play chess.

Matthew Lai
arXiv:1509.01549 · cs.AI, cs.LG, cs.NE · submitted Sep 4, 2015 · updated Sep 14, 2015
abstract · pdf · html · MSc Dissertation

add comment on HN
Also discussed: Sep 2015 (6 points, 1 comment) · Sep 2015 (3 points, 0 comments)

I heard of this on the news and was looking for documentation. There is a 39 page PDF report on this project.

In the 1980s and early 1990s I was heavily into neural networks but I am a little rusty now except for taking Hinton's and Ng's classes and doing some small projects. If I can find the time I would love to re-implement what Matthew Lai has done. Very cool stuff.