Rachel Rudinger, Neha Srikanth
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
When strong partial-input baselines reveal artifacts in crowdsourced NLI datasets, the performance of full-input models trained on such datasets is often dismissed as reliance on spurious correlations. We investigate whether stateof-the-art NLI models are capable of overriding default inferences made by a partial-input baseline. We introduce an evaluation set of 600 examples consisting of perturbed premises to examine a RoBERTa model's sensitivity to edited contexts. Our results indicate that NLI models are still capable of learning to condition on context-a necessary component of inferential reasoning-despite being trained on artifact-ridden datasets.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2205.12181")
get_code_for_paper("2205.12181")
have("2205.12181")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2205.12181.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2205.12181)
Connect an agent — have() is free.