{"id":"arxiv:2309.04295","kind":"preprint","title":"FIMO: A Challenge Formal Dataset for Automated Theorem Proving","authors":["Chengwu Liu","Jianhao Shen","Huajian Xin","Zhengying Liu","Ye Yuan","Haiming Wang","Wei Ju","Chuanyang Zheng","Yichun Yin","Lin Li","Ming Zhang","Qun Liu"],"author_count":12,"year":2023,"published":"2023-09-08","venue":null,"cited_by":9,"doi":null,"arxiv_id":"2309.04295","nct_id":null,"source_url":"https://arxiv.org/abs/2309.04295","archive_url":"https://space-kitty.com/papers/arxiv:2309.04295","updated":"2023-12-05","pmid":null,"pmcid":null,"openalex_id":"W4386620158","pdf_url":"https://arxiv.org/pdf/2309.04295","abstract":"We present FIMO, an innovative dataset comprising formal mathematical problem statements sourced from the International Mathematical Olympiad (IMO) Shortlisted Problems. Designed to facilitate advanced automated theorem proving at the IMO level, FIMO is currently tailored for the Lean formal language. It comprises 149 formal problem statements, accompanied by both informal problem descriptions and their corresponding LaTeX-based informal proofs. Through initial experiments involving GPT-4, our findings underscore the existing limitations in current methodologies, indicating a substantial journey ahead before achieving satisfactory IMO-level automated theorem proving outcomes.","abstract_license":"CC0-1.0 (arXiv descriptive metadata)","license":null,"is_open_access":false,"retracted":false,"peer_reviewed":false,"categories":["cs.AI"],"details":null,"provenance":"arxiv","attribution":"Abstract: arXiv descriptive metadata (CC0). Thank you to arXiv for use of its open access interoperability. This service was not reviewed or approved by, nor does it necessarily express or reflect the policies or opinions of, arXiv.","topics":[{"slug":"ai-mathematics","name":"AI for Mathematics & Formal Proof","domain_slug":"math-cs"}],"cited_in_dossiers":[]}