about
94% on Cifar-10 in 3.29 Seconds on a Single GPU (arxiv.org)
2 points by alexahn on Apr 11, 2024 | hide | past | pdf | discuss on HN

In plain words: Training recipes reach 94% accuracy on the CIFAR-10 image set in 3.29 seconds on one graphics card, helped by a fixed version of the usual left-right picture flip. That flip beats the standard random one whenever flipping helps at all.

Abstract · 94% on CIFAR-10 in 3.29 Seconds on a Single GPU

CIFAR-10 is among the most widely used datasets in machine learning, facilitating thousands of research projects per year. To accelerate research and reduce the cost of experiments, we introduce training methods for CIFAR-10 which reach 94% accuracy in 3.29 seconds, 95% in 10.4 seconds, and 96% in 46.3 seconds, when run on a single NVIDIA A100 GPU. As one factor contributing to these training speeds, we propose a derandomized variant of horizontal flipping augmentation, which we show improves over the standard method in every case where flipping is beneficial over no flipping at all. Our code is released at https://github.com/KellerJordan/cifar10-airbench.

Keller Jordan
arXiv:2404.00498 · cs.LG, cs.CV · submitted Mar 30, 2024 · updated Apr 5, 2024
abstract · pdf · html

add comment on HN