# Scaling Law Hypothesis for Multimodal Model

Preprint · Qingyun Sun, Zhen Guo, PIN AI Team

- Archive id: arxiv:2409.06754
- Published: 2024-09-10
- arXiv: https://arxiv.org/abs/2409.06754
- Citations: 0
- Source URL: https://arxiv.org/abs/2409.06754
- PDF: https://arxiv.org/pdf/2409.06754
- Provenance: arxiv

## Abstract

We propose a scaling law hypothesis for multimodal models processing text, audio, images, and video within a shared token and embedding space. Our framework predicts model performance based on modality-specific compression and tokenization efficiency, extending established scaling laws from text-based decoder models to mixed-modality systems. We explore whether leveraging more training data in multiple modalities can reduce the size of the multimodal model, enabling efficient deployment on resource-constrained devices.

_Abstract reproduced under CC0-1.0 (arXiv descriptive metadata)._

Topics: [Scaling Laws & Compute-Optimal Training](https://space-kitty.com/topics/scaling-laws)

---
Space Kitty Archive · https://space-kitty.com · API: https://space-kitty.com/api/v1 · MCP: https://space-kitty.com/mcp · Premium: $0.20/request via x402 (Base Sepolia (testnet)). Metadata: arXiv (CC0), OpenAlex (CC0), Europe PMC (CC BY/CC0 works), ClinicalTrials.gov.