about
Datasheets for Datasets (arxiv.org)
2 points by blopeur on Oct 15, 2019 | hide | past | pdf | discuss on HN

In plain words: Like electronics parts that ship with a datasheet, every dataset should come with a form covering its purpose, contents, and how it was collected. Datasets are usually shared with little explanation, so this would help users choose the right data and hold creators accountable.

Abstract

The machine learning community currently has no standardized process for documenting datasets, which can lead to severe consequences in high-stakes domains. To address this gap, we propose datasheets for datasets. In the electronics industry, every component, no matter how simple or complex, is accompanied with a datasheet that describes its operating characteristics, test results, recommended uses, and other information. By analogy, we propose that every dataset be accompanied with a datasheet that documents its motivation, composition, collection process, recommended uses, and so on. Datasheets for datasets will facilitate better communication between dataset creators and dataset consumers, and encourage the machine learning community to prioritize transparency and accountability.

Timnit Gebru, Jamie Morgenstern, Briana Vecchione, Jennifer Wortman Vaughan, Hanna Wallach, Hal Daumé, Kate Crawford
arXiv:1803.09010 · cs.DB, cs.AI, cs.LG · submitted Mar 23, 2018 · updated Dec 1, 2021
abstract · pdf · html · Published in CACM in December, 2021

add comment on HN
Also discussed: Aug 2020 (1 point, 0 comments) · May 2018 (1 point, 0 comments)