Konstantinos Kogkalidis, Gijs Wijnholds
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
In this paper, we set out to quantify the syntactic capacity of BERT in the evaluation regime of non-context free patterns, as occurring in Dutch. We devise a test suite based on a mildly context-sensitive formalism, from which we derive grammars that capture the linguistic phenomena of control verb nesting and verb raising. The grammars, paired with a small lexicon, provide us with a large collection of naturalistic utterances, annotated with verb-subject pairings, that serve as the evaluation test bed for an attention-based span selection probe. Our results, backed by extensive analysis, suggest that the models investigated fail in the implicit acquisition of the dependencies examined.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2203.01063")
get_code_for_paper("2203.01063")
have("2203.01063")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2203.01063.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2203.01063)
Connect an agent — have() is free.