# PreCNet: Next-Frame Video Prediction Based on Predictive Coding

Article · Zdenek Straka, Tomas Svoboda, Matej Hoffmann

- Archive id: arxiv:2004.14878
- Published: 2020-04-30
- Venue: IEEE Transactions on Neural Networks and Learning Systems
- DOI: https://doi.org/10.1109/tnnls.2023.3240857
- arXiv: https://arxiv.org/abs/2004.14878
- Citations: 30
- Source URL: https://arxiv.org/abs/2004.14878
- PDF: https://arxiv.org/pdf/2004.14878
- Provenance: arxiv

## Abstract

Predictive coding, currently a highly influential theory in neuroscience, has not been widely adopted in machine learning yet. In this work, we transform the seminal model of Rao and Ballard (1999) into a modern deep learning framework while remaining maximally faithful to the original schema. The resulting network we propose (PreCNet) is tested on a widely used next frame video prediction benchmark, which consists of images from an urban environment recorded from a car-mounted camera, and achieves state-of-the-art performance. Performance on all measures (MSE, PSNR, SSIM) was further improved when a larger training set (2M images from BDD100k), pointing to the limitations of the KITTI training set. This work demonstrates that an architecture carefully based in a neuroscience model, without being explicitly tailored to the task at hand, can exhibit exceptional performance.

_Abstract reproduced under CC0-1.0 (arXiv descriptive metadata)._

Topics: [NeuroAI & Computational Neuroscience](https://space-kitty.com/topics/neuroai)

---
Space Kitty Archive · https://space-kitty.com · API: https://space-kitty.com/api/v1 · MCP: https://space-kitty.com/mcp · Premium: $0.20/request via x402 (Base Sepolia (testnet)). Metadata: arXiv (CC0), OpenAlex (CC0), Europe PMC (CC BY/CC0 works), ClinicalTrials.gov.