{"id":"arxiv:2610.23245","kind":"preprint","title":"MGE-PO: Entropy-Aware Credit Assignment for Mathematical Reasoning","authors":["Jihao Huang","Guangjia Chai","Zhirui Chen","Lei Wang","Yao Liu","Liu Qi","Pengjie Ding","Xinyang Liu","Chengxun Jia","Ling Shao","Hongyu Chen","Junchen Wan"],"author_count":12,"year":2026,"published":"2026-10-16","venue":null,"cited_by":null,"doi":null,"arxiv_id":"2610.23245","nct_id":null,"source_url":"https://arxiv.org/abs/2610.23245","archive_url":"https://space-kitty.com/papers/arxiv:2610.23245","updated":"2026-10-16","pmid":null,"pmcid":null,"openalex_id":null,"pdf_url":"https://arxiv.org/pdf/2610.23245","abstract":"GRPO assigns the same group-relative advantage to equally rewarded responses within a question, leaving their generation uncertainty unused. We introduce MGE-PO, centered on four-quadrant (4Q) advantage shaping that combines verified correctness with rollout generation entropy. Correctness determines the sign of an additional correction, while entropy controls its magnitude: lower-entropy successes receive larger bonuses and higher-entropy failures receive larger penalties. An online entropy-based question curriculum supports this credit rule using cached rollout measurements. At the final checkpoint after eight training epochs on Qwen3-8B-Base, adding 4Q across three policy optimization settings yields absolute gains of 3.23-3.69% in six-benchmark macro avg@32 and 4.24-11.06% in macro pass@32. On Qwen2.5-7B-Base, the complete configuration raises four-benchmark macro avg@32 from 41.5% to 45.4%.","abstract_license":"CC0-1.0 (arXiv descriptive metadata)","license":null,"is_open_access":false,"retracted":false,"peer_reviewed":false,"categories":["cs.CL","cs.AI"],"details":null,"provenance":"arxiv","attribution":"Abstract: arXiv descriptive metadata (CC0). Thank you to arXiv for use of its open access interoperability. This service was not reviewed or approved by, nor does it necessarily express or reflect the policies or opinions of, arXiv.","topics":[],"cited_in_dossiers":[]}