SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2205.01841 · 2022

Great Truths are Always Simple: A Rather Simple Knowledge Encoder for Enhancing the Commonsense Reasoning Capacity of Pre-Trained Models

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 4 functions out of this paper's own repositories and ran 0 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
rucaibox/safe canonical 0 of 4
FunctionStatusWhere it lives
calculate_loss Not yet run rucaibox/safe/qagnn.py
code served (permissive licence) · get_code("8d4cd6c11b3d961f")
evaluate_accuracy Not yet run rucaibox/safe/qagnn.py
code served (permissive licence) · get_code("2839d26e6f9412c8")
generate_meta_path_from_adj_data Not yet run rucaibox/safe/utils/extract_meta_path_feature.py
code served (permissive licence) · get_code("238fcc4489158070")
get_meta_path_for_sample Not yet run rucaibox/safe/utils/extract_meta_path_feature.py
code served (permissive licence) · get_code("20290ba8c232b036")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Commonsense reasoning in natural language is a desired ability of artificial intelligent systems. For solving complex commonsense reasoning tasks, a typical solution is to enhance pre-trained language models~(PTMs) with a knowledge-aware graph neural network~(GNN) encoder that models a commonsense knowledge graph~(CSKG). Despite the effectiveness, these approaches are built on heavy architectures, and can't clearly explain how external knowledge resources improve the reasoning capacity of PTMs. Considering this issue, we conduct a deep empirical analysis, and find that it is indeed relation features from CSKGs (but not node features) that mainly contribute to the performance improvement of PTMs. Based on this finding, we design a simple MLP-based knowledge encoder that utilizes statistical relation paths as features. Extensive experiments conducted on five benchmarks demonstrate the effectiveness of our approach, which also largely reduces the parameters for encoding CSKGs. Our codes and data are publicly available at https://github.com/RUCAIBox/SAFE.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2205.01841")
get_code_for_paper("2205.01841")
have("2205.01841")

Connect an agent — have() is free.