# Sonny: Breaking the Compute Wall in Medium-Range Weather Forecasting

Preprint · Minjong Cheon

- Archive id: arxiv:2603.21284
- Published: 2026-03-22
- arXiv: https://arxiv.org/abs/2603.21284
- Citations: 0
- Source URL: https://arxiv.org/abs/2603.21284
- PDF: https://arxiv.org/pdf/2603.21284
- Provenance: arxiv

## Abstract

Weather forecasting is a fundamental problem for protecting lives and infrastructure from high-impact atmospheric events. Recently, data-driven weather forecasting methods based on deep learning have demonstrated strong performance, often reaching accuracy levels competitive with operational numerical systems. However, many existing models rely on large-scale training regimes and compute-intensive architectures, which raises the practical barrier for academic groups with limited compute resources. Here we introduce Sonny, an efficient hierarchical transformer that achieves competitive medium-range forecasting performance while remaining feasible within reasonable compute budgets. At the core of Sonny is a two-stage StepsNet design: a narrow slow path first models large-scale atmospheric dynamics, and a subsequent full-width fast path integrates thermodynamic interactions. To stabilize medium-range rollout without an additional fine-tuning stage, we apply exponential moving average (EMA) during training. On WeatherBench2, Sonny yields robust medium-range forecast skill, remains competitive with operational baselines, and demonstrates clear advantages over FastNet, particularly at extended tropical lead times. In practice, Sonny can be trained to convergence on a single NVIDIA A40 GPU in approximately 5.5 days.

_Abstract reproduced under CC0-1.0 (arXiv descriptive metadata)._

Topics: [AI Weather & Climate Modeling](https://space-kitty.com/topics/ai-weather-climate)

---
Space Kitty Archive · https://space-kitty.com · API: https://space-kitty.com/api/v1 · MCP: https://space-kitty.com/mcp · Premium: $0.20/request via x402 (Base Sepolia (testnet)). Metadata: arXiv (CC0), OpenAlex (CC0), Europe PMC (CC BY/CC0 works), ClinicalTrials.gov.