SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2004.01079 · 2020

Understanding Linearity of Cross-Lingual Word Embedding Mappings

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 4 functions out of this paper's own repositories and ran 4 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
pzoom522/xanlg canonical 4 of 4
FunctionStatusWhere it lives
filter_x_embs Ran pzoom522/xanlg/get_emb.py
pointer only (licence: AGPL-3.0) · get_code("65019dd978d5fe27")
read_emb Ran pzoom522/xanlg/get_emb.py
pointer only (licence: AGPL-3.0) · get_code("e58e520e94aded67")
read_m_analogy_set Ran pzoom522/xanlg/get_emb.py
pointer only (licence: AGPL-3.0) · get_code("746d551c2ad601a4")
transport Ran pzoom522/xanlg/validate_analogy.py
pointer only (licence: AGPL-3.0) · get_code("b0aa0ea12e60060e")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

The technique of Cross-Lingual Word Embedding (CLWE) plays a fundamental role in tackling Natural Language Processing challenges for low-resource languages. Its dominant approaches assumed that the relationship between embeddings could be represented by a linear mapping, but there has been no exploration of the conditions under which this assumption holds. Such a research gap becomes very critical recently, as it has been evidenced that relaxing mappings to be non-linear can lead to better performance in some cases. We, for the first time, present a theoretical analysis that identifies the preservation of analogies encoded in monolingual word embeddings as a necessary and sufficient condition for the ground-truth CLWE mapping between those embeddings to be linear. On a novel cross-lingual analogy dataset that covers five representative analogy categories for twelve distinct languages, we carry out experiments which provide direct empirical support for our theoretical claim. These results offer additional insight into the observations of other researchers and contribute inspiration for the development of more effective cross-lingual representation learning strategies.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2004.01079")
get_code_for_paper("2004.01079")
have("2004.01079")

Connect an agent — have() is free.