Alexander Koller, Yuekun Yao
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Sequence-to-sequence (seq2seq) models have been successful across many NLP tasks, including ones that require predicting linguistic structure. However, recent work on compositional generalization has shown that seq2seq models achieve very low accuracy in generalizing to linguistic structures that were not seen in training. We present new evidence that this is a general limitation of seq2seq models that is present not just in semantic parsing, but also in syntactic parsing and in text-to-text tasks, and that this limitation can often be overcome by neurosymbolic models that have linguistic knowledge built in. We further report on some experiments that give initial answers on the reasons for these limitations. Training Generalization (a) LEX subj_to_obj (common noun) A hedgehog ate the cake. * cake(x4); hedgehog(x1) ∧ eat.agent(x2, x1) ∧eat.theme(x2, x4) The baby liked the hedgehog. * baby(x1); * hedgehog(x4); like.agent(x2, x1) ∧ like.theme(x2, x4) (b) STRUCT PP recursion Ava saw a ball in a bowl on the table. * table(x9); see.agent(x1, Ava) ∧ see.theme(x1, x3) ∧ ball(x3) ∧ ball.nmod.in(x3, x6) ∧ bowl(x6) ∧ bowl.nmod.on(x6, x9) Ava saw a ball in a bowl on the table on the floor. * table(x9); * floor(x12); see.agent(x1, Ava) ∧ see.theme(x1, x3) ∧ ball(x3) ∧ ball.nmod.in(x3, x6) ∧ bowl(x6) ∧ bowl.nmod.on(x6, x9) ∧ table.nmod.on(x9, x12) (c) STRUCT obj_to_subj PP Noah ate the cake on the plate. * cake(x3); * plate(x6); eat.agent(x1, Noah) ∧ eat.theme(x1, x3) ∧ cake.nmod.on(x3, x6) The cake on the table burned. * cake(x1); * table(x4); cake.nmod.on(x1, x4) ∧ burn.theme(x3, x1)
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2210.13050")
get_code_for_paper("2210.13050")
have("2210.13050")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2210.13050.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2210.13050)
Connect an agent — have() is free.