SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2302.01849 · AAAI · 2023

Entity-Agnostic Representation Learning for Parameter-Efficient Knowledge Graph Embedding

Yang Gao, Wen Zhang, Huajun Chen, Mingyang Chen, Jeff Pan, Zhen Yao, Yushan Zhu

arXiv · PDF · Open in the Atlas

Code that ran

We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

We propose an entity-agnostic representation learning method for handling the problem of inefficient parameter storage costs brought by embedding knowledge graphs. Conventional knowledge graph embedding methods map elements in a knowledge graph, including entities and relations, into continuous vector spaces by assigning them one or multiple specific embeddings (i.e., vector representations). Thus the number of embedding parameters increases linearly as the growth of knowledge graphs. In our proposed model, Entity-Agnostic Representation Learning (EARL), we only learn the embeddings for a small set of entities and refer to them as reserved entities. To obtain the embeddings for the full set of entities, we encode their distinguishable information from their connected relations, k-nearest reserved entities, and multi-hop neighbors. We learn universal and entityagnostic encoders for transforming distinguishable information into entity embeddings. This approach allows our proposed EARL to have a static, efficient, and lower parameter count than conventional knowledge graph embedding methods. Experimental results show that EARL uses fewer parameters and performs better on link prediction tasks than baselines, reflecting its parameter efficiency. Recently, many knowledge graphs (KGs) (Pan et al. 2017), including Freebase (Bollacker et al. 2008), NELL (Carlson et al. 2010), Wikidata (Vrandečić and Krötzsch 2014), and YAGO (Tanon, Weikum, and Suchanek 2020) have been used as the knowledge resource for a myriad of applications in the field of natural language processing (Xiong et al. 2020; Yu et al. 2022), as well as in the study of computer vision (Huang et al. 2020; Chen et al. 2021b). Typically, knowledge graphs contain a large number of factual triples in the form of (head entity, relation, tail entity), or (h, r, t) for short. A triple reflects a specific con-* These authors contributed equally.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2302.01849")
get_code_for_paper("2302.01849")
have("2302.01849")

The run record, dated, one paper per request, free:

curl https://syntology.ai/api/ran/2302.01849.json

A badge for a README (the split and the date, never a ratio):

[![Syntology run record](https://syntology.ai/api/ran/2302.01849.svg)](https://syntology.ai/paper/2302.01849)

Connect an agent — have() is free.