Nanyun Peng, Dan Roth, I-Hung Hsu, Rujun Han, Qiang Ning, Jiao Sun, Julia Baylon
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Understanding how events are semantically related to each other is the essence of reading comprehension. Recent event-centric reading comprehension datasets focus mostly on event arguments or temporal relations. While these tasks partially evaluate machines' ability of narrative understanding, human-like reading comprehension requires the capability to process event-based information beyond arguments and temporal reasoning. For example, to understand causality between events, we need to infer motivation or purpose; to establish event hierarchy, we need to understand the composition of events. To facilitate these tasks, we introduce ESTER, a comprehensive machine reading comprehension (MRC) dataset for Event Semantic Relation Reasoning. The dataset leverages natural language queries to reason about the five most common event semantic relations, provides more than 6K questions, and captures 10.1K event relation pairs. Experimental results show that the current SOTA systems achieve 22.1%, 63.3% and 83.5% for token-based exact-match (EM), F 1 and event-based HIT@1 scores, which are all significantly below human performances (36.0%, 79.6%, 100% respectively), highlighting our dataset as a challenging benchmark. 1
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2104.08350")
get_code_for_paper("2104.08350")
have("2104.08350")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2104.08350.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2104.08350)
Connect an agent — have() is free.