In plain words: Instead of storing unchanging AI model weights in every chip's memory, this design loops them through optical fiber and broadcasts them to computers that need them. It removed duplicate copies across 10,000 AI accelerators and cut weight-delivery energy by over 70% versus high-bandwidth memory.
Abstract
The rising pressure on DRAM availability and contract pricing reflects generative AI's massive high-performance memory requirements. This pressure is heavily compounded by hyperscale data center expansion, which now consumes a significant portion of global DRAM output. In this work, we propose a new architecture: Fiber Memory, which reimagines the role of optical fiber in a hyperscale data center, deploying it as an active, recirculating delay-line memory for immutable data, such as large language model weights. We present a data-parallel optical broadcast delay-line memory architecture that accounts for fiber's physical realities. By incorporating space-division multiplexed multi-core fibers, passive optical tap-and-amplify interfaces, co-packaged optics, and regional all-optical regeneration, our case study evaluation suggests that Fiber Memory can eliminate redundant weight storage across 10,000 AI accelerators and reduce weight-delivery energy by over 70% compared to traditional HBM3e configurations.
Hannah Atmer, Yuan Yao, Thiemo Voigt, Stefanos Kaxiras
arXiv:2607.08407 · cs.AR, cs.DC, cs.ET, cs.NI · submitted Jul 9, 2026 · updated Jul 16, 2026
abstract · pdf · html
Turned out he was flying home to the finger lakes after doing a job pulling a literally astronomical length of fiber through a data center in the land of us-east-1 a little south of Washington, DC. Like all that optic fiber that they didn't lay to your house [1] is a data center and no doubt there is enough to use as a delay line memory.
[1] empowering Elon Musk to blot out the stars