{"id":"arxiv:2610.34514","kind":"preprint","title":"Ambiguous Fits: The Rashomon Effect and Challenges in Scaling Law Estimation","authors":["Bruno Mlodozeniec","Spencer Frei"],"author_count":2,"year":2026,"published":"2026-10-25","venue":null,"cited_by":0,"doi":null,"arxiv_id":"2610.34514","nct_id":null,"source_url":"https://arxiv.org/abs/2610.34514","archive_url":"https://space-kitty.com/papers/arxiv:2610.34514","updated":"2026-10-25","pmid":null,"pmcid":null,"openalex_id":"W7223984944","pdf_url":"https://arxiv.org/pdf/2610.34514","abstract":"Estimating neural scaling laws involves an end-to-end pipeline: designing a scaling recipe, training models across scales, evaluating models on a target metric, and deploying an algorithm to fit a scaling law to the resulting data. This final fitting stage is often treated as routine: standard procedures minimize a non-convex fitting loss using local optimization from a grid of initializations, and return the best solution found. Yet such heuristic searches can fail in two distinct ways: they offer no guarantee of returning a nearly optimal solution, and they obscure whether fundamentally different parameter choices fit the data nearly as well. Indeed, we show that standard scaling law fitting is subject to a Rashomon effect (Breiman, 2001): the sublevel sets of near-minimizers correspond to broad parameter regions whose extrapolations diverge substantially at scale. We resolve these issues with a deterministic branch-and-bound algorithm that guarantees nearly optimal fitting loss and exhaustively maps the near-minimizers to the implied range of scaling curves.","abstract_license":"CC0-1.0 (arXiv descriptive metadata)","license":null,"is_open_access":false,"retracted":false,"peer_reviewed":false,"categories":["cs.LG","stat.ML"],"details":null,"provenance":"arxiv","attribution":"Abstract: arXiv descriptive metadata (CC0). Thank you to arXiv for use of its open access interoperability. This service was not reviewed or approved by, nor does it necessarily express or reflect the policies or opinions of, arXiv.","topics":[{"slug":"scaling-laws","name":"Scaling Laws & Compute-Optimal Training","domain_slug":"ai"}],"cited_in_dossiers":[]}