Suma Bhat, Wanzheng Zhu
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Automatic evaluation metrics are indispensable for evaluating generated text. To date, these metrics have focused almost exclusively on the content selection aspect of the system output, ignoring the linguistic quality aspect altogether. We bridge this gap by proposing GRUEN for evaluating Grammaticality, non-Redundancy, focUs, structure and coherENce of generated text. 1 GRUEN utilizes a BERTbased model and a class of syntactic, semantic, and contextual features to examine the system output. Unlike most existing evaluation metrics which require human references as an input, GRUEN is reference-less and requires only the system output. Besides, it has the advantage of being unsupervised, deterministic, and adaptable to various tasks. Experiments on seven datasets over four language generation tasks show that the proposed metric correlates highly with human judgments. 2
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2010.02498")
get_code_for_paper("2010.02498")
have("2010.02498")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2010.02498.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2010.02498)
Connect an agent — have() is free.