{"id":"arxiv:2408.05451","kind":"preprint","title":"Mathematical Models of Computation in Superposition","authors":["Kaarel Hänni","Jake Mendel","Dmitry Vaintrob","Lawrence Chan"],"author_count":4,"year":2024,"published":"2024-08-10","venue":null,"cited_by":1,"doi":null,"arxiv_id":"2408.05451","nct_id":null,"source_url":"https://arxiv.org/abs/2408.05451","archive_url":"https://space-kitty.com/papers/arxiv:2408.05451","updated":"2024-08-10","pmid":null,"pmcid":null,"openalex_id":"W4402724519","pdf_url":"https://arxiv.org/pdf/2408.05451","abstract":"Superposition -- when a neural network represents more ``features'' than it has dimensions -- seems to pose a serious challenge to mechanistically interpreting current AI systems. Existing theory work studies \\emph{representational} superposition, where superposition is only used when passing information through bottlenecks. In this work, we present mathematical models of \\emph{computation} in superposition, where superposition is actively helpful for efficiently accomplishing the task. We first construct a task of efficiently emulating a circuit that takes the AND of the $\\binom{m}{2}$ pairs of each of $m$ features. We construct a 1-layer MLP that uses superposition to perform this task up to $\\varepsilon$-error, where the network only requires $\\tilde{O}(m^{\\frac{2}{3}})$ neurons, even when the input features are \\emph{themselves in superposition}. We generalize this construction to arbitrary sparse boolean circuits of low depth, and then construct ``error correction'' layers that allow deep fully-connected networks of width $d$ to emulate circuits of width $\\tilde{O}(d^{1.5})$ and \\emph{any} polynomial depth. We conclude by providing some potential applications of our work for interpreting neural networks that implement computation in superposition.","abstract_license":"CC0-1.0 (arXiv descriptive metadata)","license":null,"is_open_access":false,"retracted":false,"peer_reviewed":false,"categories":["cs.LG","cs.AI"],"details":null,"provenance":"arxiv","attribution":"Abstract: arXiv descriptive metadata (CC0). Thank you to arXiv for use of its open access interoperability. This service was not reviewed or approved by, nor does it necessarily express or reflect the policies or opinions of, arXiv.","topics":[{"slug":"interpretability","name":"Mechanistic Interpretability","domain_slug":"ai"}],"cited_in_dossiers":[]}