We lifted 3 functions out of this paper's own repositories and ran 3 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.
| Repository | Role | Ran |
|---|---|---|
| tianyi-lab/reflection_tuning | extension | 3 of 3 |
| Function | Status | Where it lives |
|---|---|---|
| gen_prompt_no_input | Ran | tianyi-lab/reflection_tuning/reflection_code/reflect_instruction.py pointer only (licence: NONE) · get_code("0acb012db8f3b45d") |
| get_perplexity_and_embedding_part_text | Ran | tianyi-lab/reflection_tuning/selection_code/data_analysis.py pointer only (licence: NONE) · get_code("906dab8ee3c01e55") |
| get_perplexity_and_embedding_whole_text | Ran | tianyi-lab/reflection_tuning/selection_code/data_analysis.py pointer only (licence: NONE) · get_code("3c94e259a4b7a436") |
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Recent advancements in Large Language Models (LLMs) have expanded the horizons of natural language understanding and generation. Notably, the output control and alignment with the input of LLMs can be refined through instruction tuning. However, as highlighted in several studies, low-quality data in the training set are usually detrimental to instruction tuning, resulting in inconsistent or even misleading LLM outputs. We propose a novel method, termed "reflection-tuning," which addresses the problem by self-improvement and judging capabilities of LLMs. This approach utilizes an oracle LLM to recycle the original training data by introspecting and enhancing the quality of instructions and responses in the data. Extensive experiments on widely used evaluation benchmarks show that LLMs trained with our recycled data outperform those trained with existing datasets in various benchmarks.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2310.11716")
get_code_for_paper("2310.11716")
have("2310.11716")
Connect an agent — have() is free.