研究看点:先明晰,再推理:结构化语义上下文让Coq定理证明成功率从21.8%升至45.8%,并超越Graph2Tac
In this work, we investigate whether improving task clarity can enhance reasoning ability of large language models, focusing on theorem proving in Coq. We introduce a concept-level metric to evaluate task clarity and show that adding structured semantic context to the standard input used by modern LLMs, leads to a 1.85 improvement in clarity score (44.5%~~82.3%). Using the general-purpose model , our approach leads to a 2.1 improvement in proof success (21.8%~~45.8%) and outperforms the previous state-of-the-art (33.2%). We evaluate this on 1,386 theorems randomly sampled from 15 standard Coq packages, following the same evaluation protocol as . Furthermore, fine-tuning smaller models on our structured data can achieve even higher performance (48.6%). Our method uses selective concept unfolding to enrich task descriptions, and employs a Planner–Executor architecture. These findings highlight the value of structured task representations in bridging the gap between understanding and reasoning.

生成讲解博客的中文版本

生成AI智能校验的中文版本