In plain words: Vision transformers judge a whole Go board at once instead of scanning it with small sliding windows like the deep residual networks usually used for Go. Across accuracy, win rate, memory, speed, and size, they proved a strong alternative to those networks.
Abstract
Motivated by the success of transformers in various fields, such as language understanding and image analysis, this investigation explores their application in the context of the game of Go. In particular, our study focuses on the analysis of the Transformer in Vision. Through a detailed analysis of numerous points such as prediction accuracy, win rates, memory, speed, size, or even learning rate, we have been able to highlight the substantial role that transformers can play in the game of Go. This study was carried out by comparing them to the usual Residual Networks.
Amani Sagri, Tristan Cazenave, Jérôme Arjonilla, Abdallah Saffidine
arXiv:2309.12675 · cs.AI, cs.CV · submitted Sep 22, 2023
abstract · pdf · html