# A Penny for Your Thoughts: Decoding Speech from Inexpensive Brain Signals

Preprint · Quentin Auster, Kateryna Shapovalenko, Chuang Ma, Demaio Sun

- Archive id: arxiv:2511.04691
- Published: 2025-10-28
- arXiv: https://arxiv.org/abs/2511.04691
- Source URL: https://arxiv.org/abs/2511.04691
- PDF: https://arxiv.org/pdf/2511.04691
- Provenance: arxiv

## Abstract

We explore whether neural networks can decode brain activity into speech by mapping EEG recordings to audio representations. Using EEG data recorded as subjects listened to natural speech, we train a model with a contrastive CLIP loss to align EEG-derived embeddings with embeddings from a pre-trained transformer-based speech model. Building on the state-of-the-art EEG decoder from Meta, we introduce three architectural modifications: (i) subject-specific attention layers (+0.15% WER improvement), (ii) personalized spatial attention (+0.45%), and (iii) a dual-path RNN with attention (-1.87%). Two of the three modifications improved performance, highlighting the promise of personalized architectures for brain-to-speech decoding and applications in brain-computer interfaces.

_Abstract reproduced under CC0-1.0 (arXiv descriptive metadata)._

---
Space Kitty Archive · https://space-kitty.com · API: https://space-kitty.com/api/v1 · MCP: https://space-kitty.com/mcp · Premium: $0.20/request via x402 (Base Sepolia (testnet)). Metadata: arXiv (CC0), OpenAlex (CC0), Europe PMC (CC BY/CC0 works), ClinicalTrials.gov.