Mathematical foundations of diffusion models
Sign up by Friday, Oct 30
First meeting will be the week of Nov 2 in Gateway (room/day/time TBD)
Curtis McDonald
Simons Institute · UC Berkeley
Dhruv Rohatgi
Statistics / Miller Institute · UC Berkeley
In this ``reading group'', we (the organizers) will give a self-contained introduction to the theory behind diffusion models, loosely following the text A Mathematical Introduction to Diffusion Models. We will introduce the necessary mathematical background as we go (e.g. stochastic processes and PDEs), but will emphasize intuition and algorithmic concepts over full rigor. Later sessions will cover (a selection of) recent developments, including discrete diffusion models and inference-time steering.
The meeting time will be set by a poll sent to everyone who signs up.
Part I · Foundations
Nov – Dec-
1
Week of Nov 2Langevin dynamics, continuous processes, MCMC, mixing
-
2
Week of Nov 9Forward and reverse SDEs, Fokker–Planck, Anderson’s equation
-
3
Week of Nov 16Discretization and error control: step size, Girsanov, time schedules
-
4
Week of Dec 1Score matching and other objectives, Tweedie’s formula, score estimators
— winter break —
Part II · Assorted topics
Jan – Feb-
5
Week of Jan 25Discrete diffusion models
-
6
Week of Feb 1Inference time I: oracle guidance methods and empirical approximations
-
7
Week of Feb 8Inference time II: SMC, closed-form guidance, provable guarantees
-
8
Week of Feb 15Applications: text, images, molecules