# TIP-I2V: A Million-Scale Real Text and Image Prompt Dataset for Image-to-Video Generation

Article · Wenhao Wang, Yi Yang

- Archive id: arxiv:2411.04709
- Published: 2024-11-05
- Venue: IEEE/CVF International Conference on Computer Vision (ICCV)
- DOI: https://doi.org/10.1109/iccv51701.2025.01382
- arXiv: https://arxiv.org/abs/2411.04709
- Citations: 2
- Source URL: https://arxiv.org/abs/2411.04709
- PDF: https://arxiv.org/pdf/2411.04709
- Provenance: arxiv

## Abstract

Video generation models are revolutionizing content creation, with image-to-video models drawing increasing attention due to their enhanced controllability, visual consistency, and practical applications. However, despite their popularity, these models rely on user-provided text and image prompts, and there is currently no dedicated dataset for studying these prompts. In this paper, we introduce TIP-I2V, the first large-scale dataset of over 1.70 million unique user-provided Text and Image Prompts specifically for Image-to-Video generation. Additionally, we provide the corresponding generated videos from five state-of-the-art image-to-video models. We begin by outlining the time-consuming and costly process of curating this large-scale dataset. Next, we compare TIP-I2V to two popular prompt datasets, VidProM (text-to-video) and DiffusionDB (text-to-image), highlighting differences in both basic and semantic information. This dataset enables advancements in image-to-video research. For instance, to develop better models, researchers can use the prompts in TIP-I2V to analyze user preferences and evaluate the multi-dimensional performance of their trained models; and to enhance model safety, they may focus on addressing the misinformation issue caused by image-to-video models. The new research inspired by TIP-I2V and the differences with existing datasets emphasize the importance of a specialized image-to-video prompt dataset. The project is available at https://tip-i2v.github.io.

_Abstract reproduced under CC0-1.0 (arXiv descriptive metadata)._

Topics: [Generative & Multimodal Models](https://space-kitty.com/topics/generative-multimodal)

---
Space Kitty Archive · https://space-kitty.com · API: https://space-kitty.com/api/v1 · MCP: https://space-kitty.com/mcp · Premium: $0.20/request via x402 (Base Sepolia (testnet)). Metadata: arXiv (CC0), OpenAlex (CC0), Europe PMC (CC BY/CC0 works), ClinicalTrials.gov.