# Diffusion Probabilistic Modeling for Video Generation

Article · Ruihan Yang, Prakhar Kumar Srivastava, Stephan Mandt

- Archive id: arxiv:2203.09481
- Published: 2023-10-20
- Venue: Entropy
- DOI: https://doi.org/10.3390/e25101469
- arXiv: https://arxiv.org/abs/2203.09481
- PMID: 37895590
- Citations: 166
- Source URL: https://doi.org/10.3390/e25101469
- PDF: https://www.mdpi.com/1099-4300/25/10/1469/pdf?version=1697803890
- Provenance: openalex+arxiv

## Abstract

Denoising diffusion probabilistic models are a promising new class of generative models that mark a milestone in high-quality image generation. This paper showcases their ability to sequentially generate video, surpassing prior methods in perceptual and probabilistic forecasting metrics. We propose an autoregressive, end-to-end optimized video diffusion model inspired by recent advances in neural video compression. The model successively generates future frames by correcting a deterministic next-frame prediction using a stochastic residual generated by an inverse diffusion process. We compare this approach against five baselines on four datasets involving natural and simulation-based videos. We find significant improvements in terms of perceptual quality for all datasets. Furthermore, by introducing a scalable version of the Continuous Ranked Probability Score (CRPS) applicable to video, we show that our model also outperforms existing approaches in their probabilistic frame forecasting ability.

_Abstract reproduced under CC0-1.0 (arXiv descriptive metadata)._

Topics: [Generative & Multimodal Models](https://space-kitty.com/topics/generative-multimodal)

---
Space Kitty Archive · https://space-kitty.com · API: https://space-kitty.com/api/v1 · MCP: https://space-kitty.com/mcp · Premium: $0.20/request via x402 (Base Sepolia (testnet)). Metadata: arXiv (CC0), OpenAlex (CC0), Europe PMC (CC BY/CC0 works), ClinicalTrials.gov.