# Measuring Uncertainty in Transformer Circuits with Effective Information Consistency

Preprint · Anatoly A. Krasnovsky

- Archive id: arxiv:2509.07149
- Published: 2025-09-08
- Venue: Automatic Documentation and Mathematical Linguistics 59 (Suppl 5), S423-S429 (2025)
- DOI: https://doi.org/10.3103/s0005105525701365
- arXiv: https://arxiv.org/abs/2509.07149
- Source URL: https://arxiv.org/abs/2509.07149
- PDF: https://arxiv.org/pdf/2509.07149
- Provenance: arxiv

## Abstract

Mechanistic interpretability has identified functional subgraphs within large language models (LLMs), known as Transformer Circuits (TCs), that appear to implement specific algorithms. Yet we lack a formal, single-pass way to quantify when an active circuit is behaving coherently and thus likely trustworthy. Building on prior systems-theoretic proposals, we specialize a sheaf/cohomology and causal emergence perspective to TCs and introduce the Effective-Information Consistency Score (EICS). EICS combines (i) a normalized sheaf inconsistency computed from local Jacobians and activations, with (ii) a Gaussian EI proxy for circuit-level causal emergence derived from the same forward state. The construction is white-box, single-pass, and makes units explicit so that the score is dimensionless. We further provide practical guidance on score interpretation, computational overhead (with fast and exact modes), and a toy sanity-check analysis. Empirical validation on LLM tasks is deferred.

_Abstract reproduced under CC0-1.0 (arXiv descriptive metadata)._

---
Space Kitty Archive · https://space-kitty.com · API: https://space-kitty.com/api/v1 · MCP: https://space-kitty.com/mcp · Premium: $0.20/request via x402 (Base Sepolia (testnet)). Metadata: arXiv (CC0), OpenAlex (CC0), Europe PMC (CC BY/CC0 works), ClinicalTrials.gov.