about
tritonBLAS: Triton-based Analytical Approach for GEMM Kernel Parameter Selection (arxiv.org)
1 point by matt_d 300 days ago | hide | past | pdf | discuss on HN

In plain words: A formula-based tool uses a GPU's cache layout and where code and data sit to pick good settings for matrix-multiply kernels, instead of testing many settings by trial. It reaches over 95% of the speed of trial-tuned settings while needing zero tuning time.

Abstract

We present tritonBLAS, a fast and deterministic analytical model that uses architectural parameters like the cache hierarchy, and relative code and data placement to generate performant GPU GEMM kernels. tritonBLAS explicitly models the relationship between architectural topology, matrix shapes, and algorithmic blocking behavior to predict near-optimal configurations without runtime autotuning. Based on this model, we developed and implemented a lightweight GEMM framework entirely within Triton. We evaluate the performance of tritonBLAS across a diverse set of GEMM problem sizes on modern GPUs. tritonBLAS achieves over 95% of the performance of autotuning solutions, while reducing autotuning time to zero. This makes tritonBLAS a practical drop-in replacement for empirical tuning in production HPC and ML workloads.

Ryan Swann, Muhammad Osama, Xiaohu Guo, Bryant Nelson, Lixun Zhang, Alex Brown, Yen Ong, Ali Yazdani, Sean Siddens, Ganesh Dasika, Alex Underwood
arXiv:2512.04226 · cs.DC · submitted Dec 3, 2025
abstract · pdf · html

add comment on HN