about
S2ORC: The Semantic Scholar Open Research Corpus (arxiv.org)
2 points by Anon84 on Oct 11, 2023 | hide | past | pdf | discuss on HN

In plain words: A free collection gathers 81.1 million English academic papers from hundreds of publishers and archives into a machine-readable place, with full text for 8.1 million open-access papers and citations, figures, and tables marked and linked. It is the largest public set of machine-readable academic text.

Abstract

We introduce S2ORC, a large corpus of 81.1M English-language academic papers spanning many academic disciplines. The corpus consists of rich metadata, paper abstracts, resolved bibliographic references, as well as structured full text for 8.1M open access papers. Full text is annotated with automatically-detected inline mentions of citations, figures, and tables, each linked to their corresponding paper objects. In S2ORC, we aggregate papers from hundreds of academic publishers and digital archives into a unified source, and create the largest publicly-available collection of machine-readable academic text to date. We hope this resource will facilitate research and development of tools and tasks for text mining over academic text.

Kyle Lo, Lucy Lu Wang, Mark Neumann, Rodney Kinney, Dan S. Weld
arXiv:1911.02782 · cs.CL, cs.DL · submitted Nov 7, 2019 · updated Jul 7, 2020
abstract · pdf · html · ACL 2020

add comment on HN