about
Tacotron: A Fully End-To-End Text-To-Speech Synthesis Model (arxiv.org)
2 points by aaronyy on Mar 30, 2017 | hide | past | pdf | discuss on HN

In plain words: One model turns typed characters straight into speech, learning from scratch on text-and-recording pairs instead of the usual separate text, voice, and audio stages. Listeners rated its US English 3.82 out of 5 for naturalness, beating a standard production system.

Abstract · Tacotron: Towards End-to-End Speech Synthesis

A text-to-speech synthesis system typically consists of multiple stages, such as a text analysis frontend, an acoustic model and an audio synthesis module. Building these components often requires extensive domain expertise and may contain brittle design choices. In this paper, we present Tacotron, an end-to-end generative text-to-speech model that synthesizes speech directly from characters. Given <text, audio> pairs, the model can be trained completely from scratch with random initialization. We present several key techniques to make the sequence-to-sequence framework perform well for this challenging task. Tacotron achieves a 3.82 subjective 5-scale mean opinion score on US English, outperforming a production parametric system in terms of naturalness. In addition, since Tacotron generates speech at the frame level, it's substantially faster than sample-level autoregressive methods.

Yuxuan Wang, RJ Skerry-Ryan, Daisy Stanton, Yonghui Wu, Ron J. Weiss, Navdeep Jaitly, Zongheng Yang, Ying Xiao, Zhifeng Chen, Samy Bengio, Quoc Le, Yannis Agiomyrgiannakis, et al.
arXiv:1703.10135 · cs.CL, cs.LG, cs.SD · submitted Mar 29, 2017 · updated Apr 6, 2017
abstract · pdf · html · Submitted to Interspeech 2017. v2 changed paper title to be consistent with our conference submission (no content change other than typo fixes)

add comment on HN