Kentaro Inui, Hitomi Yanaka, Koji Mineshima
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Recently, deep neural networks (DNNs) have achieved great success in semantically challenging NLP tasks, yet it remains unclear whether DNN models can capture compositional meanings, those aspects of meaning that have been long studied in formal semantics. To investigate this issue, we propose a Systematic Generalization testbed based on Natural language Semantics (SyGNS), whose challenge is to map natural language sentences to multiple forms of scoped meaning representations, designed to account for various semantic phenomena. Using SyGNS, we test whether neural networks can systematically parse sentences involving novel combinations of logical expressions such as quantifiers and negation. Experiments show that Transformer and GRU models can generalize to unseen combinations of quantifiers, negations, and modifiers that are similar to given training instances in form, but not to the others. We also find that the generalization performance to unseen combinations is better when the form of meaning representations is simpler. The data and code for SyGNS are publicly available at https: //github.com/verypluming/SyGNS.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2106.01077")
get_code_for_paper("2106.01077")
have("2106.01077")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2106.01077.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2106.01077)
Connect an agent — have() is free.