about
A Scalable RISC-V Vector Processor Enabling Efficient Multi-Precision Inference (arxiv.org)
3 points by PaulHoule on Feb 4, 2024 | hide | past | pdf | discuss on HN

In plain words: A processor that runs AI networks with 4- to 16-bit numbers, using new RISC-V instructions to pick precision and a multiply grid that reuses data across layer shapes. Compared with open-source Ara, it packs 2.04 times more work per chip area at 16-bit numbers.

Abstract · A Scalable RISC-V Vector Processor Enabling Efficient Multi-Precision DNN Inference

RISC-V processors encounter substantial challenges in deploying multi-precision deep neural networks (DNNs) due to their restricted precision support, constrained throughput, and suboptimal dataflow design. To tackle these challenges, a scalable RISC-V vector (RVV) processor, namely SPEED, is proposed to enable efficient multi-precision DNN inference by innovations from customized instructions, hardware architecture, and dataflow mapping. Firstly, dedicated customized RISC-V instructions are proposed based on RVV extensions, providing SPEED with fine-grained control over processing precision ranging from 4 to 16 bits. Secondly, a parameterized multi-precision systolic array unit is incorporated within the scalable module to enhance parallel processing capability and data reuse opportunities. Finally, a mixed multi-precision dataflow strategy, compatible with different convolution kernels and data precision, is proposed to effectively improve data utilization and computational efficiency. We perform synthesis of SPEED in TSMC 28nm technology. The experimental results demonstrate that SPEED achieves a peak throughput of 287.41 GOPS and an energy efficiency of 1335.79 GOPS/W at 4-bit precision condition, respectively. Moreover, when compared to the pioneer open-source vector processor Ara, SPEED provides an area efficiency improvement of 2.04$\times$ and 1.63$\times$ under 16-bit and 8-bit precision conditions, respectively, which shows SPEED's significant potential for efficient multi-precision DNN inference.

Chuanning Wang, Chao Fang, Xiao Wu, Zhongfeng Wang, Jun Lin
arXiv:2401.16872 · cs.AR · submitted Jan 30, 2024 · updated Jan 31, 2024
abstract · pdf · html · The work is accepted by 2024 IEEE International Symposium on Circuits and Systems (ISCAS 2024)

add comment on HN