about
The Principles of Diffusion Models (arxiv.org)
239 points by Anon84 328 days ago | hide | past | pdf | 31 comments on HN

In plain words: Diffusion models work by slowly turning data into noise, then learning to run that process backward to create new samples. This book shows how three popular formulations all reduce to one idea: a velocity field that guides noise along a smooth path into data.

Abstract

This book presents the core principles that have guided the development of diffusion models, tracing their origins and showing how diverse formulations arise from shared mathematical ideas. Diffusion modeling starts by defining a forward process that gradually corrupts data into noise, linking the data distribution to a simple prior through a continuum of intermediate distributions. The goal is to learn a reverse process that transforms noise back into data while recovering the same intermediates. We describe three complementary views. The variational view, inspired by variational autoencoders, sees diffusion as learning to remove noise step by step. The score-based view, rooted in energy-based modeling, learns the gradient of the evolving data distribution, indicating how to nudge samples toward more likely regions. The flow-based view, related to normalizing flows, treats generation as following a smooth path that moves samples from noise to data under a learned velocity field. These perspectives share a common backbone: a time-dependent velocity field whose flow transports a simple prior to the data. Sampling then amounts to solving a differential equation that evolves noise into data along a continuous trajectory. On this foundation, the book discusses guidance for controllable generation, efficient numerical solvers, and diffusion-motivated flow-map models that learn direct mappings between arbitrary times. It provides a conceptual and mathematically grounded understanding of diffusion models for readers with basic deep-learning knowledge. Supplementary materials for the book are available at the book website: https://the-principles-of-diffusion-models.github.io/

Chieh-Hsin Lai, Yang Song, Dongjun Kim, Yuki Mitsufuji, Stefano Ermon
arXiv:2510.21890 · cs.LG, cs.AI, cs.GR · submitted Oct 24, 2025 · updated Aug 27, 2026
abstract · pdf · Supplementary materials for the book are available at the book website: https://the-principles-of-diffusion-models.github.io/

add comment on HN
Also discussed: Oct 2025 (10 points, 1 comment)

If you're more into videos, be sure to check out Stefano Ermon's CS236 Deep Generative Models [1]. All lectures are available on YouTube [2].

[1] https://deepgenerativemodels.github.io/

[2] https://m.youtube.com/playlist?list=PLoROMvodv4rPOWA-omMM6ST...

I wish Stanford kept offering CS236 but they haven't run it for two years already :(
hn question: how is this not a dupe of my days old submission (https://news.ycombinator.com/item?id=45743810) ?
It is, but dupes are allowed in some cases:

“Are reposts ok?

If a story has not had significant attention in the last year or so, a small number of reposts is ok. Otherwise we bury reposts as duplicates.”

https://news.ycombinator.com/newsfaq.html

Also, from the guidelines: “Please don't post on HN to ask or tell us something. Send it to [email protected].”

I presume that email address is for when you want to ask something of Hacker New, not to ask something about Hacker News.

For example they probably didn't want posts like "Hey Hacker News, why don't you call for the revival of emacs and the elimination of all vi users?" and would rather you email them so they can ignore it, but they also don't want email messages asking "How do I italicize text in a Hacker News comments, seriously I can't remember and I would have done so earlier in this comment if I could?" and would rather you ask the community who could answer it without bothering anyone working at Y Combinator.

Are you saying this based on experience or are you projecting? In my experience (tho not asking how to italicize text using * characters) Dang and tomhow are happy to answer all sorts of questions. Sometimes they do get bogged down by the reality of running a site of this site manually, as it were, but I can't remember a question that didn't eventually get answered. I'll even tell them I vouched for this bunch of dead comments, was that the right thing to do? And one of them will write back saying mostly, but just fyi comment xyz was more flamebaity than idea, but thank you for asking and working on calibrating your vouch-o-meter.
in other words - "it is lol, also go pound sand"
What's the problem? Someone submitted it for people to read but it didn't catch on, now it's resubmitted and people can read it after all. Everyone happy. Don't be so attached to imaginary internet points.
That's not what I said, but okay.
CTRL-F: "Fokker-Planck"

> 97 matches

Ok I'll read it :)

why am I only getting 26 matches? where's the threshold then? :D
It's all about the en dashes and Fokker-Planck vs Fokker–Planck.
PDF files often break up sentences in ways that the find utility can't follow, so even if they ask have the same dash, it might not find them all. At least those names are uncommon enough you could search for just one.
AI is definitely related to dashes!!
Cool (but long) text. I wanted an overview so I used claude to make a chapter-by-chapter summary, sharing in case anyone else finds it useful

https://github.com/gmaher/diffusion_principles_summary

Is there something equivalent in scope and comprehensiveness for transformers?
i m scared by the maths
Are you sure you're not scated?
470 pages?!?!?!? FML! :-D
Reading this reinforces that a lot of what makes up current "AI" is brute forcing and not actually intelligent or thoughtful. Although I suppose our meat-minds could also be brute-forcing everything throughout our entire lives, and consciousness is like a chat prompt sitting on top of the machinery of the mind. But artificial intelligence will always be just as soulless and unfulfilling as artificial flavors.
Guessing you’re a physicist based on the name. You don’t think automatically doing RG flow in reverse has beauty to it?

There’s a lot of “force” in statistics, but that force relies on pretty deep structures and choices.

Are you familiar with the "Bitter Lesson" by recent Turing Award winner Rich Sutton? http://www.incompleteideas.net/IncIdeas/BitterLesson.html
Always is a long time. It may get better.
Intelligence is the manifold that these brute-force algorithms learn.

Of course we don’t brute-force this in our lifetime. Evolution encoded the coarse structure of the manifold over billions of years. And then encoded a hyper-compressed meta-learning algorithm into primates across millions of years.

Learning a manifold is not intelligence as it lacks the reasoning part.
Leaning the manifold is understanding. Reasoning, which takes place on the manifold, is applying that understanding.
I am not sure what you definition of "understanding" is that you apply here.
I mean understanding physics and the universe of natural possibilities; what can happen. Then comes why.
Fitting a manifold to a bunch of samples does not allow you to understand what can happen in the universe. For example, if you train a regular diffusion model on correct sudokus, it will produce sudokus with errors because it does not understand the rules.
You raise a good point for the diffusion case, which trains only on positive examples, but generally speaking negative examples will warp the manifold appropriately.
Sure, but you show a few correct examples to a human it will quickly pick up the correct rules. And this is understanding.