# Harmonised benchmarking of foundation models for single-cell and spatial transcriptomics reveals context-dependent generalisation

Preprint · Sally Chen, Roxana Zahedi, Lucy Chhuo, Ricky Nguyen, Marjan BaghGolshani, Amin Beheshti, Mark Grosser, Min Yang, Nona Farbehi, Nigel Lovell, Ahmadreza Argha, Thantrira Porntaveetusm, Fatemeh Vafaee, Youqiong Ye, Hamid Alinejad-Rokny

- Archive id: arxiv:2607.17227
- Published: 2026-07-19
- arXiv: https://arxiv.org/abs/2607.17227
- Citations: 1
- Source URL: https://arxiv.org/abs/2607.17227
- PDF: https://arxiv.org/pdf/2607.17227
- Provenance: arxiv

## Abstract

Single-cell and spatial foundation models promise transferable biological representations, yet their generality remains largely untested across modalities, biological domains and analytical tasks. We benchmarked six representative models, Nicheformer, CellPLM, scGPT-spatial, GenePT, scELMo and Novae, using a harmonised framework spanning scRNA-seq, spatial transcriptomics and Perturb-seq. We evaluated zero-shot and continually pretrained clustering, supervised annotation, marker-gene concordance and perturbation prediction. Model performance was strongly conditional: expression-trained cell-level transformers best resolved many cell-identity tasks, spatial and graph-aware models better preserved tissue architecture, and language-derived gene embeddings were competitive for selected perturbation-response metrics. No model dominated across tasks, and rankings shifted with modality, preprocessing, tokenisation, biological prior, domain shift and metric choice. This benchmark provides practical guidance for model selection and argues that future models should be judged by biological generalisation, interpretability and perturbation-grounded validity, not by scale or leaderboard performance alone.

_Abstract reproduced under CC0-1.0 (arXiv descriptive metadata)._

Topics: [Single-Cell & Spatial Omics](https://space-kitty.com/topics/single-cell-spatial)

---
Space Kitty Archive · https://space-kitty.com · API: https://space-kitty.com/api/v1 · MCP: https://space-kitty.com/mcp · Premium: $0.20/request via x402 (Base Sepolia (testnet)). Metadata: arXiv (CC0), OpenAlex (CC0), Europe PMC (CC BY/CC0 works), ClinicalTrials.gov.