Azadeh Shakery, Alireza Salemi, Emad Kebriaei, Ghazal Minaei
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Abstractive text summarization is one of the areas influenced by the emergence of pre-trained language models. Current pre-training works in abstractive summarization give more points to the summaries with more words in common with the main text and pay less attention to the semantic similarity between generated sentences and the original document. We propose ARMAN, a Transformer-based encoderdecoder model pre-trained with three novel objectives to address this issue. In ARMAN, salient sentences from a document are selected according to a modified semantic score to be masked and form a pseudo summary. To summarize more accurately and similar to human writing patterns, we applied modified sentence reordering. We evaluated our proposed models on six downstream Persian summarization tasks. Experimental results show that our proposed model achieves state-of-the-art performance on all six summarization tasks measured by ROUGE and BERTScore. Our models also outperform prior works in textual entailment, question paraphrasing, and multiple choice question answering. Finally, we established a human evaluation and show that using the semantic score significantly improves summarization results.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2109.04098")
get_code_for_paper("2109.04098")
have("2109.04098")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2109.04098.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2109.04098)
Connect an agent — have() is free.