In plain words: Katib automatically tests different training settings—like learning rate—to find the best ones, and works with any machine-learning library. Unlike tools built for one user on one machine, it serves many people, keeps running when jobs fail, and runs in the cloud.
Abstract
In this paper, we introduce Katib: a scalable, cloud-native, and production-ready hyperparameter tuning system that is agnostic of the underlying machine learning framework. Though there are multiple hyperparameter tuning systems available, this is the first one that caters to the needs of both users and administrators of the system. We present the motivation and design of the system and contrast it with existing hyperparameter tuning systems, especially in terms of multi-tenancy, scalability, fault-tolerance, and extensibility. It can be deployed on local machines, or hosted as a service in on-premise data centers, or in private/public clouds. We demonstrate the advantage of our system using experimental results as well as real-world, production use cases. Katib has active contributors from multiple companies and is open-sourced at \emph{https://github.com/kubeflow/katib} under the Apache 2.0 license.
Johnu George, Ce Gao, Richard Liu, Hou Gang Liu, Yuan Tang, Ramdoot Pydipaty, Amit Kumar Saha
arXiv:2006.02085 · cs.DC, cs.LG · submitted Jun 3, 2020 · updated Jun 8, 2020
abstract · pdf · html · Fixed some typos, no content change at all from previous version