We lifted 2 functions out of this paper's own repositories and ran 1 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.
| Repository | Role | Ran |
|---|---|---|
| zhentingqi/rstar | canonical | 1 of 2 |
| Function | Status | Where it lives |
|---|---|---|
| extract_completions | Ran | zhentingqi/rstar/eval_src/do_eval.py code served (permissive licence) · get_code("d1254e518e18e4ee") |
| extract_trace | Not yet run | zhentingqi/rstar/eval_src/do_eval.py code served (permissive licence) · get_code("42015d438bc58d69") |
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
This paper introduces rStar, a self-play mutual reasoning approach that significantly improves reasoning capabilities of small language models (SLMs) without fine-tuning or superior models. rStar decouples reasoning into a self-play mutual generation-discrimination process. First, a target SLM augments the Monte Carlo Tree Search (MCTS) with a rich set of human-like reasoning actions to construct higher quality reasoning trajectories. Next, another SLM, with capabilities similar to the target SLM, acts as a discriminator to verify each trajectory generated by the target SLM. The mutually agreed reasoning trajectories are considered mutual consistent, thus are more likely to be correct. Extensive experiments across five SLMs demonstrate rStar can effectively solve diverse reasoning problems, including GSM8K, GSM-Hard, MATH, SVAMP, and StrategyQA. Remarkably, rStar boosts GSM8K accuracy from 12.51% to 63.91% for LLaMA2-7B, from 36.46% to 81.88% for Mistral-7B, from 74.53% to 91.13% for LLaMA3-8B-Instruct. Code will be available at https://github.com/zhentingqi/rStar.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2408.06195")
get_code_for_paper("2408.06195")
have("2408.06195")
Connect an agent — have() is free.