# scBench-Long: Verifiable Benchmarking of Long-Horizon Single-Cell Biology

Preprint · Ian Diks, Zhen Yang, Arjun Banerjee, Tim Proctor, Kenny Workman

- Archive id: arxiv:2606.26563
- Published: 2026-06-25
- arXiv: https://arxiv.org/abs/2606.26563
- Citations: 0
- Source URL: https://arxiv.org/abs/2606.26563
- PDF: https://arxiv.org/pdf/2606.26563
- Provenance: arxiv

## Abstract

Single-cell studies require analysts to convert raw measurements into specific biological claims through multi-step workflows and integration of metadata, assay context, and auxiliary evidence. Existing AI-biology benchmarks largely measure broad knowledge, executable workflows, or local analysis steps. We introduce scBench-Long, a benchmark for long-horizon single-cell biology in which agents must recover scientific conclusions from raw or near-raw data without prescribed methods. The benchmark contains 21 evaluations spanning melanoma CD8 T-cell reactivity, CD8 RNA+ATAC regulatory inference, human--monkey chimera development, KRAS-driven lung tumor aging, and lethal COVID-19 lung pathology. Tasks cover paired scRNA/TCR sequencing, RNA and chromatin profiling, cross-species transcriptomics, combinatorial scRNA-seq, single-nucleus RNA-seq, immune repertoires, ortholog maps, ligand--receptor resources, and validation evidence. Candidate claims are reproduced, reviewed, and converted into controlled answer vocabularies with deterministic grading and trajectory rubrics. Across 1,068 completed trajectories, the strongest model--harness pair passes 16/63 runs (25.4\\%). scBench-Long evaluates whether agents can move beyond local analysis steps and make complex scientific claims that are supported by single-cell data.

_Abstract reproduced under CC0-1.0 (arXiv descriptive metadata)._

Topics: [Biology of Aging & Longevity](https://space-kitty.com/topics/aging-longevity)

---
Space Kitty Archive · https://space-kitty.com · API: https://space-kitty.com/api/v1 · MCP: https://space-kitty.com/mcp · Premium: $0.20/request via x402 (Base Sepolia (testnet)). Metadata: arXiv (CC0), OpenAlex (CC0), Europe PMC (CC BY/CC0 works), ClinicalTrials.gov.