In plain words: Training recipes reach 94% accuracy on the CIFAR-10 image set in 3.29 seconds on one graphics card, helped by a fixed version of the usual left-right picture flip. That flip beats the standard random one whenever flipping helps at all.
Abstract · 94% on CIFAR-10 in 3.29 Seconds on a Single GPU
CIFAR-10 is among the most widely used datasets in machine learning, facilitating thousands of research projects per year. To accelerate research and reduce the cost of experiments, we introduce training methods for CIFAR-10 which reach 94% accuracy in 3.29 seconds, 95% in 10.4 seconds, and 96% in 46.3 seconds, when run on a single NVIDIA A100 GPU. As one factor contributing to these training speeds, we propose a derandomized variant of horizontal flipping augmentation, which we show improves over the standard method in every case where flipping is beneficial over no flipping at all. Our code is released at https://github.com/KellerJordan/cifar10-airbench.
Keller Jordan
arXiv:2404.00498 · cs.LG, cs.CV · submitted Mar 30, 2024 · updated Apr 5, 2024
abstract · pdf · html