about
FedJAX: Federated Learning Simulation with Jax (arxiv.org)
1 point by lnyan on Aug 5, 2021 | hide | past | pdf | discuss on HN

In plain words: FedJAX is a toolkit for simulating federated learning, where a model trains across data on devices, with ready-made parts and fast speed. It trains a standard averaging approach on EMNIST in a few minutes and Stack Overflow in about an hour on Google's chips.

Abstract · FedJAX: Federated learning simulation with JAX

Federated learning is a machine learning technique that enables training across decentralized data. Recently, federated learning has become an active area of research due to an increased focus on privacy and security. In light of this, a variety of open source federated learning libraries have been developed and released. We introduce FedJAX, a JAX-based open source library for federated learning simulations that emphasizes ease-of-use in research. With its simple primitives for implementing federated learning algorithms, prepackaged datasets, models and algorithms, and fast simulation speed, FedJAX aims to make developing and evaluating federated algorithms faster and easier for researchers. Our benchmark results show that FedJAX can be used to train models with federated averaging on the EMNIST dataset in a few minutes and the Stack Overflow dataset in roughly an hour with standard hyperparameters using TPUs.

Jae Hun Ro, Ananda Theertha Suresh, Ke Wu
arXiv:2108.02117 · cs.LG · submitted Aug 4, 2021 · updated Nov 6, 2021
abstract · pdf · html

add comment on HN