# Contrastive Learning with Variational Regularization for Multi-Session EEG-to-Speech Decoding

Preprint · Tomoaki Mizuno, Toru Nakashika

- Archive id: arxiv:2608.16360
- Published: 2026-08-17
- arXiv: https://arxiv.org/abs/2608.16360
- Source URL: https://arxiv.org/abs/2608.16360
- PDF: https://arxiv.org/pdf/2608.16360
- Provenance: arxiv

## Abstract

Reconstructing heard speech from non-invasive electroencephalography (EEG) is challenging due to a low signal-to-noise ratio (SNR) and inter-session variability. While trial averaging improves the SNR, it is difficult to apply to continuous speech. We instead use repeated EEG responses to the same stimulus across different sessions as positive pairs for contrastive learning, and introduce variational regularization that, combined with this contrastive objective, keeps the encoder representation space broad. Experiments on a Japanese EEG dataset show that combining the session-invariant strategy with variational regularization improves the character error rate (CER) while maintaining mel-spectrogram reconstruction fidelity. Session probing confirms that the encoder representations achieve session-invariance.

_Abstract reproduced under CC0-1.0 (arXiv descriptive metadata)._

---
Space Kitty Archive · https://space-kitty.com · API: https://space-kitty.com/api/v1 · MCP: https://space-kitty.com/mcp · Premium: $0.20/request via x402 (Base Sepolia (testnet)). Metadata: arXiv (CC0), OpenAlex (CC0), Europe PMC (CC BY/CC0 works), ClinicalTrials.gov.