Kyungjae Lee, Yein Park, Chanwoong Yoon, Jaewoo Kang, Hyeon Hwang, Yewon Cho, Minju Song, Gangwoo Kim
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Step-by-step reasoning has become a standard approach for large language models (LLMs) to tackle complex tasks. While this paradigm has proven effective, it raises a fundamental question: How can we verify that an LLM's reasoning is accurately grounded in knowledge? To address this question, we introduce a novel evaluation suite that systematically assesses the knowledge grounding of intermediate reasoning. Our framework comprises three key components. (1) Principal Knowledge Collection, a large-scale repository of atomic knowledge essential for reasoning. Based on the collection, we propose (2) knowledge-grounded evaluation metrics designed to measure how well models recall and apply prerequisite knowledge in reasoning. These metrics are computed by our (3) evaluator LLM, a lightweight model optimized for cost-effective and reliable metric computation. Our evaluation suite demonstrates remarkable effectiveness in identifying missing or misapplied knowledge elements, providing crucial insights for uncovering fundamental reasoning deficiencies in LLMs. Beyond evaluation, we demonstrate how these metrics can be integrated into preference optimization, showcasing further applications of knowledge-grounded evaluation.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2511.00879")
get_code_for_paper("2511.00879")
have("2511.00879")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2511.00879.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2511.00879)
Connect an agent — have() is free.