In plain words: A deep-learning system breaks long documents into sections and labels what each is for, so people and software can jump straight to the needed information. Tested on over a million arXiv papers and government proposal requests, it reliably mapped both kinds of documents.
Abstract · Unfolding the Structure of a Document using Deep Learning
Understanding and extracting of information from large documents, such as business opportunities, academic articles, medical documents and technical reports, poses challenges not present in short documents. Such large documents may be multi-themed, complex, noisy and cover diverse topics. We describe a framework that can analyze large documents and help people and computer systems locate desired information in them. We aim to automatically identify and classify different sections of documents and understand their purpose within the document. A key contribution of our research is modeling and extracting the logical and semantic structure of electronic documents using deep learning techniques. We evaluate the effectiveness and robustness of our framework through extensive experiments on two collections: more than one million scholarly articles from arXiv and a collection of requests for proposal documents from government sources.
Muhammad Mahbubur Rahman, Tim Finin
arXiv:1910.03678 · cs.CL, cs.LG, stat.ML · submitted Sep 29, 2019
abstract · pdf · html · 16 pages, 16 figures and 10 tables. arXiv admin note: text overlap with arXiv:1709.00770