Furu Wei, Li Dong, Zewen Chi, Shaohan Huang, Shuming Ma, Xian-Ling Mao, Heyan Huang
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Multilingual T5 (MT5; Xue et al. 2020) pretrains a sequence-to-sequence model on massive monolingual texts, which has shown promising results on many cross-lingual tasks. In this paper, we improve multilingual textto-text transfer Transformer with translation pairs (MT6). Specifically, we explore three cross-lingual text-to-text pre-training tasks, namely, machine translation, translation pair span corruption, and translation span corruption. In addition, we propose a partially nonautoregressive objective for text-to-text pretraining. We evaluate the methods on eight multilingual benchmark datasets, including sentence classification, named entity recognition, question answering, and abstractive summarization. Experimental results show that the proposed MT6 improves cross-lingual transferability over MT5.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2104.08692")
get_code_for_paper("2104.08692")
have("2104.08692")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2104.08692.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2104.08692)
Connect an agent — have() is free.