We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Obtaining high-quality parallel corpora is of paramount importance for training NMT systems. However, as many language pairs lack adequate gold-standard training data, a popular approach has been to mine so-called "pseudo-parallel" sentences from paired documents in two languages. In this paper, we outline some problems with current methods, propose computationally economical solutions to those problems, and demonstrate success with novel methods on the Tatoeba similarity search benchmark and on a downstream task, namely NMT. We uncover the effect of resource-related factors (i.e. how much monolingual/bilingual data is available for a given language) on the optimal choice of bitext mining approach, and echo problems with the oft-used BUCC dataset that have been observed by others. We make the code and data used for our experiments publicly available.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2103.06369")
get_code_for_paper("2103.06369")
have("2103.06369")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2103.06369.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2103.06369)
Connect an agent — have() is free.