In plain words: A question-answering system that reads a passage and finds the answer was slimmed down by cutting slow extra layers and swapping the rest for lighter, faster ones. It topped the speed-and-accuracy leaderboard while training and answering faster than any earlier system.
Abstract
In this technical report, we introduce FastFusionNet, an efficient variant of FusionNet [12]. FusionNet is a high performing reading comprehension architecture, which was designed primarily for maximum retrieval accuracy with less regard towards computational requirements. For FastFusionNets we remove the expensive CoVe layers [21] and substitute the BiLSTMs with far more efficient SRU layers [19]. The resulting architecture obtains state-of-the-art results on DAWNBench [5] while achieving the lowest training and inference time on SQuAD [25] to-date. The code is available at https://github.com/felixgwu/FastFusionNet.
Felix Wu, Boyi Li, Lequn Wang, Ni Lao, John Blitzer, Kilian Q. Weinberger
arXiv:1902.11291 · cs.CL · submitted Feb 28, 2019 · updated Mar 2, 2019
abstract · pdf · html · A Technical Report