about
Natural Language Processing Almost from Scratch (arxiv.org)
2 points by Anon84 52 days ago | hide | past | pdf | discuss on HN

In plain words: A single neural network learns its own word representations from huge amounts of mostly unlabeled text, instead of relying on hand-made features tuned for each job. It handles several language tasks well while needing little computing power.

Abstract · Natural Language Processing (almost) from Scratch

We propose a unified neural network architecture and learning algorithm that can be applied to various natural language processing tasks including: part-of-speech tagging, chunking, named entity recognition, and semantic role labeling. This versatility is achieved by trying to avoid task-specific engineering and therefore disregarding a lot of prior knowledge. Instead of exploiting man-made input features carefully optimized for each task, our system learns internal representations on the basis of vast amounts of mostly unlabeled training data. This work is then used as a basis for building a freely available tagging system with good performance and minimal computational requirements.

Ronan Collobert, Jason Weston, Leon Bottou, Michael Karlen, Koray Kavukcuoglu, Pavel Kuksa
arXiv:1103.0398 · cs.LG, cs.CL · submitted Mar 2, 2011
abstract · pdf · html

add comment on HN
Also discussed: Aug 2017 (3 points, 0 comments) · Oct 2015 (1 point, 0 comments)