about
A Framework for Understanding Unintended Consequences of Machine Learning (arxiv.org)
2 points by tosh on Aug 9, 2020 | hide | past | pdf | discuss on HN

In plain words: A map of where things go wrong when AI is built and used, sorting harms into seven sources across gathering data, building the system, and releasing it. It helps people name the exact problem and fix it directly instead of arguing vaguely.

Abstract · A Framework for Understanding Sources of Harm throughout the Machine Learning Life Cycle

As machine learning (ML) increasingly affects people and society, awareness of its potential unwanted consequences has also grown. To anticipate, prevent, and mitigate undesirable downstream consequences, it is critical that we understand when and how harm might be introduced throughout the ML life cycle. In this paper, we provide a framework that identifies seven distinct potential sources of downstream harm in machine learning, spanning data collection, development, and deployment. In doing so, we aim to facilitate more productive and precise communication around these issues, as well as more direct, application-grounded ways to mitigate them.

Harini Suresh, John V. Guttag
arXiv:1901.10002 · cs.LG, stat.ML · submitted Jan 28, 2019 · updated Dec 1, 2021
abstract · pdf · html

add comment on HN