Yang Gao, Wei Zhao, Steffen Eger
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
We study unsupervised multi-document summarization evaluation metrics, which require neither human-written reference summaries nor human annotations (e.g. preferences, ratings, etc.). We propose SUPERT, which rates the quality of a summary by measuring its semantic similarity with a pseudo reference summary, i.e. selected salient sentences from the source documents, using contextualized embeddings and soft token alignment techniques. Compared to the state-of-theart unsupervised evaluation metrics, SUPERT correlates better with human ratings by 18-39%. Furthermore, we use SUPERT as rewards to guide a neural-based reinforcement learning summarizer, yielding favorable performance compared to the state-of-the-art unsupervised summarizers. All source code is available at https://github.com/yg211/ acl20-ref-free-eval.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2005.03724")
get_code_for_paper("2005.03724")
have("2005.03724")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2005.03724.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2005.03724)
Connect an agent — have() is free.