# Enhancing RLHF with Human Gaze Modeling

Preprint · Karim Galliamov, Ivan Titov, Ilya Pershin

- Archive id: arxiv:2507.09016
- Published: 2025-07-11
- arXiv: https://arxiv.org/abs/2507.09016
- Source URL: https://arxiv.org/abs/2507.09016
- PDF: https://arxiv.org/pdf/2507.09016
- Provenance: arxiv

## Abstract

Reinforcement Learning from Human Feedback (RLHF) aligns language models with human preferences but is computationally expensive. We explore two approaches that leverage human gaze modeling to enhance RLHF: (1) gaze-aware reward models and (2) gaze-based distribution of sparse rewards at token level. Our experiments demonstate that gaze-informed RLHF achieves faster convergence while maintaining or slightly improving performance, thus, reducing computational costs during policy optimization. These results show that human gaze provides a valuable and underused signal for policy optimization, pointing to a promising direction for improving RLHF efficiency.

_Abstract reproduced under CC0-1.0 (arXiv descriptive metadata)._

---
Space Kitty Archive · https://space-kitty.com · API: https://space-kitty.com/api/v1 · MCP: https://space-kitty.com/mcp · Premium: $0.20/request via x402 (Base Sepolia (testnet)). Metadata: arXiv (CC0), OpenAlex (CC0), Europe PMC (CC BY/CC0 works), ClinicalTrials.gov.