SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2203.08307 · ACL · 2022

Improving Word Translation via Two-Stage Contrastive Learning

Ivan Vulić, Fangyu Liu, Nigel Collier, Anna Korhonen, Yaoyiran Li

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 6 functions out of this paper's own repositories and ran 5 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
vinsachi/FIPPCLE — 3 of 4
cambridgeltl/ContrastiveBLI — 2 of 2
FunctionStatusWhere it lives
Beholder Ran cambridgeltl/ContrastiveBLI/C1/src/models.py
code served (permissive licence) · get_code("a3a7abba781e200d")
C1_Model Ran cambridgeltl/ContrastiveBLI/C1/src/models.py
code served (permissive licence) · get_code("1f690157c87b631e")
build_matrices Ran vinsachi/FIPPCLE/xling-bli/code/projection.py
pointer only (licence: NONE) · get_code("44f62679b81ab137")
get_seeds Ran vinsachi/FIPPCLE/xling-bli/code/projection.py
pointer only (licence: NONE) · get_code("731634f448ca1287")
isotrop_preproc Ran vinsachi/FIPPCLE/xling-bli/code/projection.py
pointer only (licence: NONE) · get_code("9a3c12dfc8a9399f")
project_fipp Not yet run vinsachi/FIPPCLE/xling-bli/code/projection.py
pointer only (licence: NONE) · get_code("3472926e2229b9b0")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Word translation or bilingual lexicon induction (BLI) is a key cross-lingual task, aiming to bridge the lexical gap between different languages. In this work, we propose a robust and effective two-stage contrastive learning framework for the BLI task. At Stage C1, we propose to refine standard cross-lingual linear maps between static word embeddings (WEs) via a contrastive learning objective; we also show how to integrate it into the self-learning procedure for even more refined cross-lingual maps. In Stage C2, we conduct BLI-oriented contrastive fine-tuning of mBERT, unlocking its word translation capability. We also show that static WEs induced from the 'C2-tuned' mBERT complement static WEs from Stage C1. Comprehensive experiments on standard BLI datasets for diverse languages and different experimental setups demonstrate substantial gains achieved by our framework. While the BLI method from Stage C1 already yields substantial gains over all state-of-the-art BLI methods in our comparison, even stronger improvements are met with the full two-stage framework: e.g., we report gains for 112/112 BLI setups, spanning 28 language pairs.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2203.08307")
get_code_for_paper("2203.08307")
have("2203.08307")

Connect an agent — have() is free.