# GFlowNets with Human Feedback

Preprint · Yinchuan Li, Shuang Luo, Yunfeng Shao, Jianye Hao

- Archive id: arxiv:2305.07036
- Published: 2023-05-11
- arXiv: https://arxiv.org/abs/2305.07036
- Source URL: https://arxiv.org/abs/2305.07036
- PDF: https://arxiv.org/pdf/2305.07036
- Provenance: arxiv

## Abstract

We propose the GFlowNets with Human Feedback (GFlowHF) framework to improve the exploration ability when training AI models. For tasks where the reward is unknown, we fit the reward function through human evaluations on different trajectories. The goal of GFlowHF is to learn a policy that is strictly proportional to human ratings, instead of only focusing on human favorite ratings like RLHF. Experiments show that GFlowHF can achieve better exploration ability than RLHF.

_Abstract reproduced under CC0-1.0 (arXiv descriptive metadata)._

---
Space Kitty Archive · https://space-kitty.com · API: https://space-kitty.com/api/v1 · MCP: https://space-kitty.com/mcp · Premium: $0.20/request via x402 (Base Sepolia (testnet)). Metadata: arXiv (CC0), OpenAlex (CC0), Europe PMC (CC BY/CC0 works), ClinicalTrials.gov.