Yangqiu Song, Hongming Zhang, Shibo Hao, Tianqing Fang, Weiqi Wang, Bin He, Sehyun Choi
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Reasoning over commonsense knowledge bases (CSKBs) whose elements are in the form of free-text is an important yet hard task in NLP. While CSKB completion only fills the missing links within the domain of the CSKB, CSKB population is alternatively proposed with the goal of reasoning unseen assertions from external resources. In this task, CSKBs are grounded to a large-scale eventuality (activity, state, and event) graph to discriminate whether novel triples from the eventuality graph are plausible or not. However, existing evaluations on the population task are either not accurate (automatic evaluation with randomly sampled negative examples) or of small scale (human annotation). In this paper, we benchmark the CSKB population task with a new large-scale dataset by first aligning four popular CSKBs, and then presenting a highquality human-annotated evaluation set to probe neural models' commonsense reasoning ability. We also propose a novel inductive commonsense reasoning model that reasons over graphs. Experimental results show that generalizing commonsense reasoning on unseen assertions is inherently a hard task. Models achieving high accuracy during training perform poorly on the evaluation set, with a large gap between human performance. Codes and data are available at https://github.com/ HKUST-KnowComp/CSKB-Population.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2109.07679")
get_code_for_paper("2109.07679")
have("2109.07679")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2109.07679.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2109.07679)
Connect an agent — have() is free.