SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2004.01401 · EMNLP · 2020

XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and Generation

Ming Zhou, Fan Yang, Weizhen Qi, Yeyun Gong, Ruofei Zhang, Nan Duan, Daniel Campos, Daxin Jiang, Yaobo Liang, Ming Gong, Linjun Shou, Guihong Cao, and 12 more

arXiv · PDF · Open in the Atlas

Code that ran

We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

In this paper, we introduce XGLUE, a new benchmark dataset that can be used to train large-scale cross-lingual pre-trained models using multilingual and bilingual corpora and evaluate their performance across a diverse set of cross-lingual tasks. Comparing to GLUE (Wang et al., 2019), which is labeled in English for natural language understanding tasks only, XGLUE has two main advantages: (1) it provides 11 diversified tasks that cover both natural language understanding and generation scenarios; (2) for each task, it provides labeled data in multiple languages. We extend a recent cross-lingual pre-trained model Unicoder (Huang et al., 2019) to cover both understanding and generation tasks, which is evaluated on XGLUE as a strong baseline. We also evaluate the base versions (12-layer) of Multilingual BERT, XLM and XLM-R for comparison. 1

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2004.01401")
get_code_for_paper("2004.01401")
have("2004.01401")

The run record, dated, one paper per request, free:

curl https://syntology.ai/api/ran/2004.01401.json

A badge for a README (the split and the date, never a ratio):

[![Syntology run record](https://syntology.ai/api/ran/2004.01401.svg)](https://syntology.ai/paper/2004.01401)

Connect an agent — have() is free.