Yixuan Su, Nigel Collier, Yinhong Liu, ♠ Ehsan
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Recent large language models (LLMs) have shown remarkable performance in aligning generated text with user intentions across various tasks. When it comes to long-form text generation, there has been a growing interest in generation from a discourse coherence perspective. However, existing lexical or semantic metrics such as BLEU, ROUGE, BertScore cannot effectively capture the discourse coherence. The development of discourse-specific automatic evaluation methods for assessing the output of LLMs warrants greater focus and exploration. In this paper, we present a novel automatic metric designed to quantify the discourse divergence between two long-form articles. Extensive experiments on three datasets from representative domains demonstrate that our metric aligns more closely with human preferences and GPT-4 coherence evaluation, outperforming existing evaluation methods. 1
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2402.10175")
get_code_for_paper("2402.10175")
have("2402.10175")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2402.10175.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2402.10175)
Connect an agent — have() is free.