# Disentangling Polysemantic Channels in Convolutional Neural Networks

Preprint · Robin Hesse, Jonas Fischer, Simone Schaub-Meyer, Stefan Roth

- Archive id: arxiv:2504.12939
- Published: 2025-04-17
- arXiv: https://arxiv.org/abs/2504.12939
- Source URL: https://arxiv.org/abs/2504.12939
- PDF: https://arxiv.org/pdf/2504.12939
- Provenance: arxiv

## Abstract

Mechanistic interpretability is concerned with analyzing individual components in a (convolutional) neural network (CNN) and how they form larger circuits representing decision mechanisms. These investigations are challenging since CNNs frequently learn polysemantic channels that encode distinct concepts, making them hard to interpret. To address this, we propose an algorithm to disentangle a specific kind of polysemantic channel into multiple channels, each responding to a single concept. Our approach restructures weights in a CNN, utilizing that different concepts within the same channel exhibit distinct activation patterns in the previous layer. By disentangling these polysemantic features, we enhance the interpretability of CNNs, ultimately improving explanatory techniques such as feature visualizations.

_Abstract reproduced under CC0-1.0 (arXiv descriptive metadata)._

---
Space Kitty Archive · https://space-kitty.com · API: https://space-kitty.com/api/v1 · MCP: https://space-kitty.com/mcp · Premium: $0.20/request via x402 (Base Sepolia (testnet)). Metadata: arXiv (CC0), OpenAlex (CC0), Europe PMC (CC BY/CC0 works), ClinicalTrials.gov.