# Seeing Is Believing: Brain-Inspired Modular Training for Mechanistic Interpretability

Article · Ziming Liu, Eric Gan, Max Tegmark

- Archive id: arxiv:2305.08746
- Published: 2023-12-30
- Venue: Entropy
- DOI: https://doi.org/10.3390/e26010041
- arXiv: https://arxiv.org/abs/2305.08746
- PMID: 38248167
- Citations: 28
- Source URL: https://doi.org/10.3390/e26010041
- PDF: https://www.mdpi.com/1099-4300/26/1/41/pdf?version=1703927844
- Provenance: openalex+arxiv

## Abstract

We introduce Brain-Inspired Modular Training (BIMT), a method for making neural networks more modular and interpretable. Inspired by brains, BIMT embeds neurons in a geometric space and augments the loss function with a cost proportional to the length of each neuron connection. We demonstrate that BIMT discovers useful modular neural networks for many simple tasks, revealing compositional structures in symbolic formulas, interpretable decision boundaries and features for classification, and mathematical structure in algorithmic datasets. The ability to directly see modules with the naked eye can complement current mechanistic interpretability strategies such as probes, interventions or staring at all weights.

_Abstract reproduced under CC0-1.0 (arXiv descriptive metadata)._

Topics: [Mechanistic Interpretability](https://space-kitty.com/topics/interpretability)

Cited in dossiers:
- [Mechanistic Interpretability: State of the Field (October 2026)](https://space-kitty.com/dossiers/interpretability)

---
Space Kitty Archive · https://space-kitty.com · API: https://space-kitty.com/api/v1 · MCP: https://space-kitty.com/mcp · Premium: $0.20/request via x402 (Base Sepolia (testnet)). Metadata: arXiv (CC0), OpenAlex (CC0), Europe PMC (CC BY/CC0 works), ClinicalTrials.gov.