about
Slicing Is All You Need: Towards a Universal One-Sided Distributed MatMul (arxiv.org)
99 points by matt_d 318 days ago | hide | past | pdf | 8 comments on HN

In plain words: A single algorithm splits matrices across machines in any layout, using index arithmetic to find which pieces overlap and must be multiplied together. It matches the speed of a highly optimized AI library across many layouts, avoiding costly reshuffling of data.

Abstract · Slicing Is All You Need: Towards A Universal One-Sided Algorithm for Distributed Matrix Multiplication

Many important applications across science, data analytics, and AI workloads depend on distributed matrix multiplication. Prior work has developed a large array of algorithms suitable for different problem sizes and partitionings including 1D, 2D, 1.5D, and 2.5D algorithms. A limitation of current work is that existing algorithms are limited to a subset of partitionings. Multiple algorithm implementations are required to support the full space of possible partitionings. If no algorithm implementation is available for a particular set of partitionings, one or more operands must be redistributed, increasing communication costs. This paper presents a universal one-sided algorithm for distributed matrix multiplication that supports all combinations of partitionings and replication factors. Our algorithm uses slicing (index arithmetic) to compute the sets of overlapping tiles that must be multiplied together. This list of local matrix multiplies can then either be executed directly, or reordered and lowered to an optimized IR to maximize overlap. We implement our algorithm using a high-level C++-based PGAS programming framework that performs direct GPU-to-GPU communication using intra-node interconnects. We evaluate performance for a wide variety of partitionings and replication factors, finding that our work is competitive with PyTorch DTensor, a highly optimized distributed tensor library targeting AI models.

Benjamin Brock, Renato Golin
arXiv:2510.08874 · cs.DC, cs.AI · submitted Oct 10, 2025
abstract · pdf · html

add comment on HN

Not using "all you need" in your paper titles is all you need.
"All You Need" Considered Harmful

https://news.ycombinator.com/item?id=9744916

goto is all you need.
"Harm is all you need" works with the Beatles song.
I think anyone who still likes the phrase has a right to use it in public. Once.
That could be part of HN titles automatic words deletion
As a small consolation, consider that these title fads might become light-hearted footnotes in internet history books.

"¹ During AI's reign over popular science, people emulated that royal family to invoke erudition-by-association."

Arxiv should just retire "is all you need" in the title. Block the post and make them come up with something new. Anything.

Same for YOLO "versioned" models. People just claim they come up with "YOLO-v15" as if it was their trademark to version.

Luckily "web3" burned the idea of branding some technology as a version of the entire internet...