about
Diffusion Models for Generative AI: An Introduction for Applied Mathematicians (arxiv.org)
1 point by Bostonian on Dec 27, 2023 | hide | past | pdf | discuss on HN

In plain words: Diffusion models make new images by first destroying training data with random noise, then learning to undo that noise so fresh noise can be cleaned into realistic output. This tutorial derives the math behind the trick, links it to heat-flow equations, and shares code.

Abstract · Diffusion Models for Generative Artificial Intelligence: An Introduction for Applied Mathematicians

Generative artificial intelligence (AI) refers to algorithms that create synthetic but realistic output. Diffusion models currently offer state of the art performance in generative AI for images. They also form a key component in more general tools, including text-to-image generators and large language models. Diffusion models work by adding noise to the available training data and then learning how to reverse the process. The reverse operation may then be applied to new random data in order to produce new outputs. We provide a brief introduction to diffusion models for applied mathematicians and statisticians. Our key aims are (a) to present illustrative computational examples, (b) to give a careful derivation of the underlying mathematical formulas involved, and (c) to draw a connection with partial differential equation (PDE) diffusion models. We provide code for the computational experiments. We hope that this topic will be of interest to advanced undergraduate students and postgraduate students. Portions of the material may also provide useful motivational examples for those who teach courses in stochastic processes, inference, machine learning, PDEs or scientific computing.

Catherine F. Higham, Desmond J. Higham, Peter Grindrod
arXiv:2312.14977 · cs.LG, cs.AI · submitted Dec 21, 2023
abstract · pdf · html

add comment on HN