about
Who Needs DRAM? We Have Fiber (arxiv.org)
12 points by alechammond 82 days ago | hide | past | pdf | 2 comments on HN

In plain words: Instead of storing unchanging AI model weights in every chip's memory, this design loops them through optical fiber and broadcasts them to computers that need them. It removed duplicate copies across 10,000 AI accelerators and cut weight-delivery energy by over 70% versus high-bandwidth memory.

Abstract

The rising pressure on DRAM availability and contract pricing reflects generative AI's massive high-performance memory requirements. This pressure is heavily compounded by hyperscale data center expansion, which now consumes a significant portion of global DRAM output. In this work, we propose a new architecture: Fiber Memory, which reimagines the role of optical fiber in a hyperscale data center, deploying it as an active, recirculating delay-line memory for immutable data, such as large language model weights. We present a data-parallel optical broadcast delay-line memory architecture that accounts for fiber's physical realities. By incorporating space-division multiplexed multi-core fibers, passive optical tap-and-amplify interfaces, co-packaged optics, and regional all-optical regeneration, our case study evaluation suggests that Fiber Memory can eliminate redundant weight storage across 10,000 AI accelerators and reduce weight-delivery energy by over 70% compared to traditional HBM3e configurations.

Hannah Atmer, Yuan Yao, Thiemo Voigt, Stefanos Kaxiras
arXiv:2607.08407 · cs.AR, cs.DC, cs.ET, cs.NI · submitted Jul 9, 2026 · updated Jul 16, 2026
abstract · pdf · html

add comment on HN

Reminds me of the time I was sitting on a regional jet on the airport in Philly where planes were stacked up because a runway was under construction. Near sunset we'd finally reached the head of the line of many planes of all different sizes and I thought it looked like a scene out of a retro science-fiction movie say Flash Gordon or Buck Rogers and what a miracle it is to be alive in the 21st century -- then this redneck in the seat behind me says "I can't believe I paid $1000 for this!"

Turned out he was flying home to the finger lakes after doing a job pulling a literally astronomical length of fiber through a data center in the land of us-east-1 a little south of Washington, DC. Like all that optic fiber that they didn't lay to your house [1] is a data center and no doubt there is enough to use as a delay line memory.

[1] empowering Elon Musk to blot out the stars

Reminiscent of acoustic memory on early calculators