In plain words: A tool reads the attention weights, which words the translation system focused on, to estimate how confident each output is so developers can spot bad translations without a correct reference version. It can also show two systems' translations side by side.
Abstract
In this paper, we describe a tool for debugging the output and attention weights of neural machine translation (NMT) systems and for improved estimations of confidence about the output based on the attention. The purpose of the tool is to help researchers and developers find weak and faulty example translations that their NMT systems produce without the need for reference translations. Our tool also includes an option to directly compare translation outputs from two different NMT engines or experiments. In addition, we present a demo website of our tool with examples of good and bad translations: http://attention.lielakeda.lv
Matīss Rikters
arXiv:1808.02733 · cs.CL · submitted Aug 8, 2018
abstract · pdf · html