{"id":"arxiv:1412.6604","kind":"preprint","title":"Video (language) modeling: a baseline for generative models of natural videos","authors":["Marc’Aurelio Ranzato","Arthur D. Szlam","Joan Bruna","Michaël Mathieu","Ronan Collobert","Sumit Chopra"],"author_count":6,"year":2014,"published":"2014-12-20","venue":null,"cited_by":325,"doi":null,"arxiv_id":"1412.6604","nct_id":null,"source_url":"http://arxiv.org/abs/1412.6604","archive_url":"https://space-kitty.com/papers/arxiv:1412.6604","updated":"2016-05-04","pmid":null,"pmcid":null,"openalex_id":"W1568514080","pdf_url":"https://arxiv.org/pdf/1412.6604","abstract":"We propose a strong baseline model for unsupervised feature learning using video data. By learning to predict missing frames or extrapolate future frames from an input video sequence, the model discovers both spatial and temporal correlations which are useful to represent complex deformations and motion patterns. The models we propose are largely borrowed from the language modeling literature, and adapted to the vision domain by quantizing the space of image patches into a large dictionary. We demonstrate the approach on both a filling and a generation task. For the first time, we show that, after training on natural videos, such a model can predict non-trivial motions over short video sequences.","abstract_license":"CC0-1.0 (arXiv descriptive metadata)","license":null,"is_open_access":true,"retracted":false,"peer_reviewed":false,"categories":["Generative Adversarial Networks and Image Synthesis"],"details":null,"provenance":"openalex+arxiv","attribution":"Abstract: arXiv descriptive metadata (CC0). Thank you to arXiv for use of its open access interoperability. This service was not reviewed or approved by, nor does it necessarily express or reflect the policies or opinions of, arXiv.","topics":[{"slug":"efficient-ai","name":"Efficient Training & Inference","domain_slug":"ai"}],"cited_in_dossiers":[]}