Derek Wong, Nlp, Min Yang, Minghuan Tan, Renhao Li
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
In recent years, instruction fine-tuning (IFT) on large language models (LLMs) has garnered considerable attention to enhance model performance on unseen tasks. Attempts have been made on automatic construction and effective selection for IFT data. However, we posit that previous methods have not fully harnessed the potential of LLMs for enhancing data quality. The responses within IFT data could be further enhanced by leveraging the capabilities of LLMs themselves. In this paper, we propose COEVOL, an LLM-based multiagent cooperation framework for the improvement of responses for instructions. To effectively refine the responses, we develop an iterative framework following a debate-adviseedit-judge paradigm. A two-stage multi-agent debate strategy is further devised to ensure the diversity and reliability of editing suggestions within the framework. Empirically, models equipped with COEVOL outperform competitive baselines evaluated by MT-Bench and Al-pacaEval, demonstrating its effectiveness in enhancing instruction-following capabilities for LLMs. 1 * Equal contribution. † Under the Joint Ph.D. Program between UM and SIAT.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2406.07054")
get_code_for_paper("2406.07054")
have("2406.07054")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2406.07054.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2406.07054)
Connect an agent — have() is free.