about
How to avoid machine learning pitfalls (arxiv.org)
7 points by golergka on Apr 20, 2024 | hide | past | pdf | discuss on HN

In plain words: A guide collects the most common machine learning mistakes and shows how to avoid them, from planning and building models to testing, comparing, and reporting. It focuses on academic research, where sloppy comparisons can make results untrustworthy.

Abstract · How to avoid machine learning pitfalls: a guide for academic researchers

Mistakes in machine learning practice are commonplace, and can result in a loss of confidence in the findings and products of machine learning. This guide outlines common mistakes that occur when using machine learning, and what can be done to avoid them. Whilst it should be accessible to anyone with a basic understanding of machine learning techniques, it focuses on issues that are of particular concern within academic research, such as the need to do rigorous comparisons and reach valid conclusions. It covers five stages of the machine learning process: what to do before model building, how to reliably build models, how to robustly evaluate models, how to compare models fairly, and how to report results.

Michael A. Lones
arXiv:2108.02497 · cs.LG · submitted Aug 5, 2021 · updated Aug 29, 2024
abstract · pdf · html

add comment on HN
Also discussed: Mar 2023 (2 points, 0 comments) · Aug 2021 (1 point, 0 comments) · Aug 2021 (3 points, 0 comments) · Aug 2021 (5 points, 1 comment)