We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
One of the key factors in language productivity and human cognition is the ability of systematic compositionality, which refers to understanding composed unseen examples of seen primitives. However, recent evidence reveals that the Transformers have difficulty generalizing the composed context based on the seen primitives. To this end, we take the first step to propose a compositionality-aware Transformer called CAT and two novel pre-training tasks to facilitate systematic compositionality. We tentatively provide a successful implementation of a multi-layer CAT on the basis of the especially popular BERT. The experimental results demonstrate that CAT outperforms baselines on compositionality-aware tasks with minimal impact on the effectiveness on standardized language understanding tasks.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2312.07280")
get_code_for_paper("2312.07280")
have("2312.07280")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2312.07280.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2312.07280)
Connect an agent — have() is free.