# Transcoder-based Circuit Analysis for Interpretable Single-Cell Foundation Models

Preprint · Sosuke Hosokawa, Toshiharu Kawakami, Satoshi Kodera, Masamichi Ito, Norihiko Takeda

- Archive id: arxiv:2509.14723
- Published: 2025-09-18
- arXiv: https://arxiv.org/abs/2509.14723
- Citations: 0
- Source URL: https://arxiv.org/abs/2509.14723
- PDF: https://arxiv.org/pdf/2509.14723
- Provenance: arxiv

## Abstract

Single-cell foundation models (scFMs) have demonstrated state-of-the-art performance on various tasks, such as cell-type annotation and perturbation response prediction, by learning gene regulatory networks from large-scale transcriptome data. However, a significant challenge remains: the decision-making processes of these models are less interpretable compared to traditional methods like differential gene expression analysis. Recently, transcoders have emerged as a promising approach for extracting interpretable decision circuits from large language models (LLMs). In this work, we train a transcoder on the cell2sentence (C2S) model, a state-of-the-art scFM. By leveraging the trained transcoder, we extract internal decision-making circuits from the C2S model. We demonstrate that the discovered circuits correspond to real-world biological mechanisms, confirming the potential of transcoders to uncover biologically plausible pathways within complex single-cell models.

_Abstract reproduced under CC0-1.0 (arXiv descriptive metadata)._

Topics: [Single-Cell & Spatial Omics](https://space-kitty.com/topics/single-cell-spatial)

---
Space Kitty Archive · https://space-kitty.com · API: https://space-kitty.com/api/v1 · MCP: https://space-kitty.com/mcp · Premium: $0.20/request via x402 (Base Sepolia (testnet)). Metadata: arXiv (CC0), OpenAlex (CC0), Europe PMC (CC BY/CC0 works), ClinicalTrials.gov.