{"id":"arxiv:2308.15560","kind":"preprint","title":"WeatherBench 2: A benchmark for the next generation of data-driven global weather models","authors":["Stephan Rasp","Stephan Hoyer","Alexander Merose","Ian Langmore","Peter Battaglia","Tyler Russel","Alvaro Sanchez-Gonzalez","Vivian Yang","Rob Carver","Shreya Agrawal","Matthew Chantry","Zied Ben Bouallegue","Peter Dueben","Carla Bromberg","Jared Sisk","Luke Barrington","Aaron Bell","Fei Sha"],"author_count":18,"year":2023,"published":"2023-08-29","venue":null,"cited_by":null,"doi":null,"arxiv_id":"2308.15560","nct_id":null,"source_url":"https://arxiv.org/abs/2308.15560","archive_url":"https://space-kitty.com/papers/arxiv:2308.15560","updated":"2024-01-26","pmid":null,"pmcid":null,"openalex_id":null,"pdf_url":"https://arxiv.org/pdf/2308.15560","abstract":"WeatherBench 2 is an update to the global, medium-range (1-14 day) weather forecasting benchmark proposed by Rasp et al. (2020), designed with the aim to accelerate progress in data-driven weather modeling. WeatherBench 2 consists of an open-source evaluation framework, publicly available training, ground truth and baseline data as well as a continuously updated website with the latest metrics and state-of-the-art models: https://sites.research.google/weatherbench. This paper describes the design principles of the evaluation framework and presents results for current state-of-the-art physical and data-driven weather models. The metrics are based on established practices for evaluating weather forecasts at leading operational weather centers. We define a set of headline scores to provide an overview of model performance. In addition, we also discuss caveats in the current evaluation setup and challenges for the future of data-driven weather forecasting.","abstract_license":"CC0-1.0 (arXiv descriptive metadata)","license":null,"is_open_access":false,"retracted":false,"peer_reviewed":false,"categories":["physics.ao-ph","cs.AI"],"details":null,"provenance":"arxiv","attribution":"Abstract: arXiv descriptive metadata (CC0). Thank you to arXiv for use of its open access interoperability. This service was not reviewed or approved by, nor does it necessarily express or reflect the policies or opinions of, arXiv.","topics":[],"cited_in_dossiers":[]}