Chongyang Tao, Can Xu, Hong Kong, Zhen Li, Ucla, Tao Shen, Jia-Chen Gu, Xiaohan Xu, Yuxuan Lai, Shuai Ma
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
In the rapidly evolving domain of Natural Language Generation (NLG) evaluation, introducing Large Language Models (LLMs) has opened new avenues for assessing generated content quality, e.g., coherence, creativity, and context relevance. This paper aims to provide a thorough overview of leveraging LLMs for NLG evaluation, a burgeoning area that lacks a systematic analysis. We propose a coherent taxonomy for organizing existing LLM-based evaluation metrics, offering a structured framework to understand and compare these methods. Our detailed exploration includes critically assessing various LLM-based methodologies, as well as comparing their strengths and limitations in evaluating NLG outputs. By discussing unresolved challenges, including bias, robustness, domain-specificity, and unified evaluation, this paper seeks to offer insights to researchers and advocate for fairer and more advanced NLG evaluation techniques.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2401.07103")
get_code_for_paper("2401.07103")
have("2401.07103")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2401.07103.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2401.07103)
Connect an agent — have() is free.