# Mean field analysis of neural networks: A central limit theorem

Article · Justin A. Sirignano, Konstantinos Spiliopoulos

- Archive id: arxiv:1808.09372
- Published: 2019-06-12
- Venue: Stochastic Processes and their Applications
- DOI: https://doi.org/10.1016/j.spa.2019.06.003
- arXiv: https://arxiv.org/abs/1808.09372
- Citations: 115
- Source URL: https://doi.org/10.1016/j.spa.2019.06.003
- PDF: https://arxiv.org/pdf/1808.09372
- Provenance: openalex+arxiv

## Abstract

We rigorously prove a central limit theorem for neural network models with a single hidden layer. The central limit theorem is proven in the asymptotic regime of simultaneously (A) large numbers of hidden units and (B) large numbers of stochastic gradient descent training iterations. Our result describes the neural network's fluctuations around its mean-field limit. The fluctuations have a Gaussian distribution and satisfy a stochastic partial differential equation. The proof relies upon weak convergence methods from stochastic analysis. In particular, we prove relative compactness for the sequence of processes and uniqueness of the limiting process in a suitable Sobolev space.

_Abstract reproduced under CC0-1.0 (arXiv descriptive metadata)._

Topics: [AI for Mathematics & Formal Proof](https://space-kitty.com/topics/ai-mathematics)

---
Space Kitty Archive · https://space-kitty.com · API: https://space-kitty.com/api/v1 · MCP: https://space-kitty.com/mcp · Premium: $0.20/request via x402 (Base Sepolia (testnet)). Metadata: arXiv (CC0), OpenAlex (CC0), Europe PMC (CC BY/CC0 works), ClinicalTrials.gov.