{"id":"arxiv:2502.19964","kind":"preprint","title":"Do Sparse Autoencoders Generalize? A Case Study of Answerability","authors":["Lovis Heindrich","Philip Torr","Fazl Barez","Veronika Thost"],"author_count":4,"year":2025,"published":"2025-02-27","venue":null,"cited_by":null,"doi":null,"arxiv_id":"2502.19964","nct_id":null,"source_url":"https://arxiv.org/abs/2502.19964","archive_url":"https://space-kitty.com/papers/arxiv:2502.19964","updated":"2025-09-05","pmid":null,"pmcid":null,"openalex_id":null,"pdf_url":"https://arxiv.org/pdf/2502.19964","abstract":"Sparse autoencoders (SAEs) have emerged as a promising approach in language model interpretability, offering unsupervised extraction of sparse features. For interpretability methods to succeed, they must identify abstract features across domains, and these features can often manifest differently in each context. We examine this through \"answerability\" - a model's ability to recognize answerable questions. We extensively evaluate SAE feature generalization across diverse, partly self-constructed answerability datasets for Gemma 2 SAEs. Our analysis reveals that residual stream probes outperform SAE features within domains, but generalization performance differs sharply. SAE features show inconsistent out-of-domain transfer, with performance varying from almost random to outperforming residual stream probes. Overall, this demonstrates the need for robust evaluation methods and quantitative approaches to predict feature generalization in SAE-based interpretability.","abstract_license":"CC0-1.0 (arXiv descriptive metadata)","license":null,"is_open_access":false,"retracted":false,"peer_reviewed":false,"categories":["cs.LG"],"details":null,"provenance":"arxiv","attribution":"Abstract: arXiv descriptive metadata (CC0). Thank you to arXiv for use of its open access interoperability. This service was not reviewed or approved by, nor does it necessarily express or reflect the policies or opinions of, arXiv.","topics":[],"cited_in_dossiers":[]}