about
Towards Hardware Implementation of Neural Network-Based Communication Algorithms (arxiv.org)
1 point by godelmachine on Feb 20, 2019 | hide | past | pdf | discuss on HN

In plain words: They showed neural-network communication algorithms can run on real chips using rounded weights and fixed decimal-place math instead of the usual high-precision numbers. Accuracy barely dropped, and the circuit stayed small enough for practical chips.

Abstract · Towards Hardware Implementation of Neural Network-based Communication Algorithms

There is a recent interest in neural network (NN)-based communication algorithms which have shown to achieve (beyond) state-of-the-art performance for a variety of problems or lead to reduced implementation complexity. However, most work on this topic is simulation based and implementation on specialized hardware for fast inference, such as field-programmable gate arrays (FPGAs), is widely ignored. In particular for practical uses, NN weights should be quantized and inference carried out by a fixed-point instead of floating-point system, widely used in consumer class computers and graphics processing units (GPUs). Moving to such representations enables higher inference rates and complexity reductions, at the cost of precision loss. We demonstrate that it is possible to implement NN-based algorithms in fixed-point arithmetic with quantized weights at negligible performance loss and with hardware complexity compatible with practical systems, such as FPGAs and application-specific integrated circuits (ASICs).

Fayçal Ait Aoudia, Jakob Hoydis
arXiv:1902.06939 · cs.IT, stat.ML · submitted Feb 19, 2019
abstract · pdf · html

add comment on HN