{"id":"arxiv:2403.05131","kind":"preprint","title":"Sora as a World Model? A Complete Survey on Text-to-Video Generation","authors":["Fachrina Dewi Puspitasari","Chaoning Zhang","Joseph Cho","Adnan Haider","Noor Ul Eman","Omer Amin","Alexis Mankowski","Muhammad Umair","Jingyao Zheng","Sheng Zheng","Lik-Hang Lee","Caiyan Qin","Tae-Ho Kim","Choong Seon Hong","Yang Yang","Heng Tao Shen"],"author_count":16,"year":2024,"published":"2024-03-08","venue":null,"cited_by":10,"doi":null,"arxiv_id":"2403.05131","nct_id":null,"source_url":"https://arxiv.org/abs/2403.05131","archive_url":"https://space-kitty.com/papers/arxiv:2403.05131","updated":"2026-01-21","pmid":null,"pmcid":null,"openalex_id":"W4392678331","pdf_url":"https://arxiv.org/pdf/2403.05131","abstract":"The evolution of video generation from text, from animating MNIST to simulating the world with Sora, has progressed at a breakneck speed. Here, we systematically discuss how far text-to-video generation technology supports essential requirements in world modeling. We curate 250+ studies on text-based video synthesis and world modeling. We then observe that recent models increasingly support spatial, action, and strategic intelligences in world modeling through adherence to completeness, consistency, invention, as well as human interaction and control. We conclude that text-to-video generation is adept at world modeling, although homework in several aspects, such as the diversity-consistency trade-offs, remains to be addressed.","abstract_license":"CC0-1.0 (arXiv descriptive metadata)","license":null,"is_open_access":false,"retracted":false,"peer_reviewed":false,"categories":["cs.AI","cs.CV"],"details":null,"provenance":"arxiv","attribution":"Abstract: arXiv descriptive metadata (CC0). Thank you to arXiv for use of its open access interoperability. This service was not reviewed or approved by, nor does it necessarily express or reflect the policies or opinions of, arXiv.","topics":[{"slug":"generative-multimodal","name":"Generative & Multimodal Models","domain_slug":"ai"}],"cited_in_dossiers":[{"slug":"generative-multimodal","title":"Generative & Multimodal Models: State of the Field (October 2026)","url":"https://space-kitty.com/dossiers/generative-multimodal"}]}