# EEG-Driven Decoding Framework for Passenger Hazard Perception in Highly Automated Vehicles

Preprint · Yingkai Yang, Ashton Yu Xuan Tan, Bowen Li, Xiaorong Gao, Sifa Zheng, Jianqiang Wang, Xinyu Gu, Yang Zhao, Yuxin Zhang, Sharon X. Huang, Tania Stathaki, Jun Li, Hong Wang

- Archive id: arxiv:2609.07128
- Published: 2026-09-07
- arXiv: https://arxiv.org/abs/2609.07128
- Citations: 0
- Source URL: https://arxiv.org/abs/2609.07128
- PDF: https://arxiv.org/pdf/2609.07128
- Provenance: arxiv

## Abstract

Reliable risk assessment remains a central challenge for Autonomous Vehicles (AVs). Despite advances in automation, passenger cognition provides a non-intrusive auxiliary signal that improves both objective and perceived safety without requiring active human intervention. We introduce an Electroencephalogram (EEG)-based Brain-Computer Interface (BCI) that decodes passenger neural responses for both Risk Prediction (RP) and Danger Identification (DI), explicitly modeling humans as passengers to match real-world AV use. To achieve this, we propose the Passenger Cognitive Model (PCM), Risk-aware Sequential Labeling (RSL), and the Passenger EEG Decoding Strategy (PEDS), which integrates a 3D Convolutional Recurrent Neural Network (3D-CRNN) model for joint EEG decoding. Experimental results show that 3D-CRNN achieves a Balanced Accuracy (BA) of $95.3\\% \\pm 2.7\\%$ in RP and improves single-subject DI from $80.9\\% \\pm 3.9\\%$ to $85.0\\% \\pm 3.2\\%$ with RSL. Event-wise analyses further show that 3D-CRNN consistently outperforms other models across different event types in RP and DI. In generalization experiments, 3D-CRNN achieves $77.0\\% \\pm 5.3\\%$ BA in cross-session DI and $77.4\\% \\pm 1.1\\%$ BA on seen subjects in cross-subject evaluation, while maintaining a $64.9\\% \\pm 8.5\\%$ BA on unseen subjects, demonstrating promising generalizability and transferability across both intra-subject and inter-subject variability. These findings establish an Electroencephalogram (EEG) decoding framework for AV passenger hazard perception and suggest that passenger cognitive signals can provide auxiliary supervision for future AV decision-making and Safety of the Intended Functionality (SOTIF) support.

_Abstract reproduced under CC0-1.0 (arXiv descriptive metadata)._

Topics: [Brain-Computer Interfaces](https://space-kitty.com/topics/brain-computer-interfaces)

---
Space Kitty Archive · https://space-kitty.com · API: https://space-kitty.com/api/v1 · MCP: https://space-kitty.com/mcp · Premium: $0.20/request via x402 (Base Sepolia (testnet)). Metadata: arXiv (CC0), OpenAlex (CC0), Europe PMC (CC BY/CC0 works), ClinicalTrials.gov.