about
Text understanding from scratch (arxiv.org)
2 points by dorsatum on Jun 2, 2016 | hide | past | pdf | discuss on HN

In plain words: A network that scans raw characters with sliding filters learns to classify text without ever being told about words, phrases, or grammar. It reached strong results on large labeling tasks and worked for both English and Chinese.

Abstract · Text Understanding from Scratch

This article demontrates that we can apply deep learning to text understanding from character-level inputs all the way up to abstract text concepts, using temporal convolutional networks (ConvNets). We apply ConvNets to various large-scale datasets, including ontology classification, sentiment analysis, and text categorization. We show that temporal ConvNets can achieve astonishing performance without the knowledge of words, phrases, sentences and any other syntactic or semantic structures with regards to a human language. Evidence shows that our models can work for both English and Chinese.

Xiang Zhang, Yann LeCun
arXiv:1502.01710 · cs.LG, cs.CL · submitted Feb 5, 2015 · updated Apr 4, 2016
abstract · pdf · html · This technical report is superseded by a paper entitled "Character-level Convolutional Networks for Text Classification", arXiv:1509.01626. It has considerably more experimental results and a rewritten introduction

add comment on HN
Also discussed: Feb 2017 (10 points, 0 comments) · Mar 2015 (53 points, 5 comments) · Feb 2015 (61 points, 9 comments)