about
Fixing MLOps with reusable best practices? (arxiv.org)
3 points by mpla67 on Jun 16, 2020 | hide | past | pdf | discuss on HN

In plain words: It breaks big machine-learning projects into reusable pieces with one shared interface, so you can swap models, data, and tools and run the same steps anywhere. Industrial partners used it to tune object detection for speed, accuracy, energy, and size while keeping results reproducible.

Abstract · The Collective Knowledge project: making ML models more portable and reproducible with open APIs, reusable best practices and MLOps

This article provides an overview of the Collective Knowledge technology (CK or cKnowledge). CK attempts to make it easier to reproduce ML&systems research, deploy ML models in production, and adapt them to continuously changing data sets, models, research techniques, software, and hardware. The CK concept is to decompose complex systems and ad-hoc research projects into reusable sub-components with unified APIs, CLI, and JSON meta description. Such components can be connected into portable workflows using DevOps principles combined with reusable automation actions, software detection plugins, meta packages, and exposed optimization parameters. CK workflows can automatically plug in different models, data and tools from different vendors while building, running and benchmarking research code in a unified way across diverse platforms and environments. Such workflows also help to perform whole system optimization, reproduce results, and compare them using public or private scoreboards on the CK platform (https://cKnowledge.io). For example, the modular CK approach was successfully validated with industrial partners to automatically co-design and optimize software, hardware, and machine learning models for reproducible and efficient object detection in terms of speed, accuracy, energy, size, and other characteristics. The long-term goal is to simplify and accelerate the development and deployment of ML models and systems by helping researchers and practitioners to share and reuse their knowledge, experience, best practices, artifacts, and techniques using open CK APIs.

Grigori Fursin
arXiv:2006.07161 · cs.LG, cs.SE, stat.ML · submitted Jun 12, 2020 · updated Jun 18, 2020
abstract · pdf · html · arXiv admin note: text overlap with arXiv:2001.07935

add comment on HN