We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Cognitive research indicates that abstraction ability is essential in human intelligence, which remains under-explored in language models. In this paper, we present AbsPyramid, a unified entailment graph of 221K textual descriptions of abstraction knowledge. While existing resources only touch nouns or verbs within simplified events or specific domains, AbsPyramid collects abstract knowledge for three components of diverse events to comprehensively evaluate the abstraction ability of language models in the open domain. Experimental results demonstrate that current LLMs face challenges comprehending abstraction knowledge in zero-shot and few-shot settings. By training on our rich abstraction knowledge, we find LLMs can acquire basic abstraction abilities and generalize to unseen events. In the meantime, we empirically show that our benchmark is comprehensive to enhance LLMs across two previous abstraction tasks.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2311.09174")
get_code_for_paper("2311.09174")
have("2311.09174")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2311.09174.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2311.09174)
Connect an agent — have() is free.