# MechELK: A Mechanistic Interpretability Framework for Eliciting Latent Knowledge in Large Language Models

Preprint · Ji-jun Park, Soo-joon Choi, Jiwon Jeong, Taeyang Yoon, Ju-Wan Lee

- Archive id: arxiv:2605.28825
- Published: 2026-04-07
- arXiv: https://arxiv.org/abs/2605.28825
- Citations: 0
- Source URL: https://arxiv.org/abs/2605.28825
- PDF: https://arxiv.org/pdf/2605.28825
- Provenance: arxiv

## Abstract

Large language models (LLMs) frequently encode factual and reasoning knowledge in their internal representations that is not faithfully reflected in their surface-level outputs -- a phenomenon known as \\emph{latent knowledge}. Existing approaches to eliciting latent knowledge, such as Contrastive Consistency Search (CCS), rely on contrastive activation patterns and struggle with complex multi-step reasoning tasks, while mechanistic interpretability tools have primarily been used to \\emph{understand} model behavior rather than to \\emph{extract} hidden knowledge. We present \\textbf{MechELK}, a unified three-stage framework that bridges mechanistic interpretability and latent knowledge elicitation. MechELK operates through: (1) \\textbf{Locate} -- using Sparse Autoencoder (SAE) feature analysis and activation patching to identify knowledge-bearing representations; (2) \\textbf{Verify} -- employing causal probing to distinguish genuine latent knowledge from spurious correlations; and (3) \\textbf{Elicit} -- applying representation engineering to surface hidden knowledge without modifying model weights. Evaluated on TruthfulQA, a curated Deceptive Alignment benchmark, and the Quirky LM dataset, MechELK achieves an average elicitation accuracy of 84.7\\%, outperforming CCS by 6.2\\% and direct linear probing by 9.1\\%. Crucially, MechELK successfully identifies latent knowledge in 78.3\\% of cases where the model's surface output is incorrect or evasive, demonstrating its utility for AI safety applications including deceptive alignment detection.

_Abstract reproduced under CC0-1.0 (arXiv descriptive metadata)._

Topics: [Mechanistic Interpretability](https://space-kitty.com/topics/interpretability)

---
Space Kitty Archive · https://space-kitty.com · API: https://space-kitty.com/api/v1 · MCP: https://space-kitty.com/mcp · Premium: $0.20/request via x402 (Base Sepolia (testnet)). Metadata: arXiv (CC0), OpenAlex (CC0), Europe PMC (CC BY/CC0 works), ClinicalTrials.gov.