# Autoregressive Denoising Diffusion Models for Multivariate Probabilistic Time Series Forecasting

Preprint · Kashif Rasul, Calvin Seward, Ingmar Schuster, Roland Vollgraf

- Archive id: arxiv:2101.12072
- Published: 2021-01-28
- Venue: Proceedings of the 38th International Conference on Machine Learning, PMLR 139:8857-8868, 2021
- arXiv: https://arxiv.org/abs/2101.12072
- Citations: 163
- Source URL: http://arxiv.org/abs/2101.12072
- PDF: https://arxiv.org/pdf/2101.12072
- Provenance: openalex+arxiv

## Abstract

In this work, we propose \\texttt{TimeGrad}, an autoregressive model for multivariate probabilistic time series forecasting which samples from the data distribution at each time step by estimating its gradient. To this end, we use diffusion probabilistic models, a class of latent variable models closely connected to score matching and energy-based methods. Our model learns gradients by optimizing a variational bound on the data likelihood and at inference time converts white noise into a sample of the distribution of interest through a Markov chain using Langevin sampling. We demonstrate experimentally that the proposed autoregressive denoising diffusion model is the new state-of-the-art multivariate probabilistic forecasting method on real-world data sets with thousands of correlated dimensions. We hope that this method is a useful tool for practitioners and lays the foundation for future research in this area.

_Abstract reproduced under CC0-1.0 (arXiv descriptive metadata)._

Topics: [Generative & Multimodal Models](https://space-kitty.com/topics/generative-multimodal)

Cited in dossiers:
- [Generative & Multimodal Models: State of the Field (October 2026)](https://space-kitty.com/dossiers/generative-multimodal)

---
Space Kitty Archive · https://space-kitty.com · API: https://space-kitty.com/api/v1 · MCP: https://space-kitty.com/mcp · Premium: $0.20/request via x402 (Base Sepolia (testnet)). Metadata: arXiv (CC0), OpenAlex (CC0), Europe PMC (CC BY/CC0 works), ClinicalTrials.gov.