about
Generative Adversarial Networks for Translation (arxiv.org)
1 point by nafizh on Apr 28, 2017 | hide | past | pdf | discuss on HN

In plain words: A translator is trained not to copy human sentences word for word, but to fool a second network that tries to spot machine-made translations. On English-to-French and German-to-English, this trick produced better translations than several strong standard systems.

Abstract · Adversarial Neural Machine Translation

In this paper, we study a new learning paradigm for Neural Machine Translation (NMT). Instead of maximizing the likelihood of the human translation as in previous works, we minimize the distinction between human translation and the translation given by an NMT model. To achieve this goal, inspired by the recent success of generative adversarial networks (GANs), we employ an adversarial training architecture and name it as Adversarial-NMT. In Adversarial-NMT, the training of the NMT model is assisted by an adversary, which is an elaborately designed Convolutional Neural Network (CNN). The goal of the adversary is to differentiate the translation result generated by the NMT model from that by human. The goal of the NMT model is to produce high quality translations so as to cheat the adversary. A policy gradient method is leveraged to co-train the NMT model and the adversary. Experimental results on English$\rightarrow$French and German$\rightarrow$English translation tasks show that Adversarial-NMT can achieve significantly better translation quality than several strong baselines.

Lijun Wu, Yingce Xia, Li Zhao, Fei Tian, Tao Qin, Jianhuang Lai, Tie-Yan Liu
arXiv:1704.06933 · cs.CL, cs.LG, stat.ML · submitted Apr 20, 2017 · updated Sep 30, 2018
abstract · pdf · html · ACML 2018

add comment on HN