SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2412.09078 · 2024

Forest-of-Thought: Scaling Test-Time Compute for Enhancing LLM Reasoning

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 11 functions out of this paper's own repositories and ran 4 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
iamhankai/Forest-of-Thought canonical 4 of 11
FunctionStatusWhere it lives
check_expression Ran iamhankai/Forest-of-Thought/methods/bfs.py
pointer only (licence: NONE) · get_code("c87a34d192dc0ead")
check_numbers Ran iamhankai/Forest-of-Thought/methods/bfs.py
pointer only (licence: NONE) · get_code("758ece9e82cfbb05")
get_next_steps_roll Ran iamhankai/Forest-of-Thought/methods/mcts/mcts.py
pointer only (licence: NONE) · get_code("91b601baaf0d2b44")
gpt_usage Ran iamhankai/Forest-of-Thought/models/models.py
pointer only (licence: NONE) · get_code("1506be9f936c7be7")
cal_reward Not yet run iamhankai/Forest-of-Thought/run_with_mcf.py
pointer only (licence: NONE) · get_code("fe0d152ca98c644f")
cal_reward Not yet run iamhankai/Forest-of-Thought/run_with_mcf_stop_noearly.py
pointer only (licence: NONE) · get_code("6d2baf046961cbd6")
generate Not yet run iamhankai/Forest-of-Thought/run_with_mcf.py
pointer only (licence: NONE) · get_code("8c8ee47126d561c8")
generate Not yet run iamhankai/Forest-of-Thought/run_with_mcf_stop_noearly.py
pointer only (licence: NONE) · get_code("67301e6cd34829e9")
get_value Not yet run iamhankai/Forest-of-Thought/methods/bfs.py
pointer only (licence: NONE) · get_code("d58f5d5cbf3c2248")
get_weak_answer Not yet run iamhankai/Forest-of-Thought/run_with_mcf.py
pointer only (licence: NONE) · get_code("a43cae5c00c2780c")
get_weak_answer Not yet run iamhankai/Forest-of-Thought/run_with_mcf_stop_noearly.py
pointer only (licence: NONE) · get_code("f65278bac828725b")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Large Language Models (LLMs) have demonstrated remarkable abilities across various language tasks, but solving complex reasoning problems remains a significant challenge. While existing methods, such as Chain-of-Thought (CoT) and Tree-of-Thought (ToT), enhance reasoning by decomposing problems or structuring prompts, they typically perform a single pass of reasoning and may fail to revisit flawed paths, compromising accuracy. To address this limitation, we propose a novel reasoning framework called Forest-of-Thought (FoT), which integrates multiple reasoning trees to leverage collective decision-making for solving complex logical problems. FoT employs sparse activation strategies to select the most relevant reasoning paths, improving both efficiency and accuracy. Additionally, we introduce a dynamic self-correction strategy that enables real-time error correction, along with consensus-guided decision-making strategies to optimize both correctness and computational resources. Experimental results demonstrate that the FoT framework, combined with these strategies, significantly enhances the reasoning capabilities of LLMs, enabling them to solve complex tasks with greater precision and efficiency. Code will be available at https://github.com/iamhankai/Forest-of-Thought.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2412.09078")
get_code_for_paper("2412.09078")
have("2412.09078")

Connect an agent — have() is free.