Home / AI Research / Posterior Matching Distillation
POAI Research
Posterior Matching Distillation
by nvidia · Hidir Yesiltepe, Julius Berner, Arash Vahdat, Pinar Yanardag
Diffusion distillation accelerates image and video generation by compressing a pretrained teacher's iterative sampling process into a few network evaluations. Distribution-based methods achieve this by matching the student's output distribution to the teacher's. This matching is often driven by reverse-KL objectives, whose mode-seeking bias favors dominant teacher modes at the expense of diversity across samples. We introduce Posterior Matching Distillation (PMD), a new member of the distribution-based distillation family that combines mode-covering posterior sampling with any-step generation. At zero population loss, PMD recovers the teacher's full posterior of clean images at each…
Upvotes37
Comments4
Published18 Nov 2026