Chitta Baral, Yezhou Yang, Tejas Gokhale, Pratyay Banerjee
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
While progress has been made on the visual question answering leaderboards, models often utilize spurious correlations and priors in datasets under the i.i.d. setting. As such, evaluation on out-of-distribution (OOD) test samples has emerged as a proxy for generalization. In this paper, we present MUTANT, a training paradigm that exposes the model to perceptually similar, yet semantically distinct mutations of the input, to improve OOD generalization, such as the VQA-CP challenge. Under this paradigm, models utilize a consistency-constrained training objective to understand the effect of semantic changes in input (question-image pair) on the output (answer). Unlike existing methods on VQA-CP, MUTANT does not rely on the knowledge about the nature of train and test answer distributions. MUTANT establishes a new state-ofthe-art accuracy on VQA-CP with a 10.57% improvement. Our work opens up avenues for the use of semantic input mutations for OOD generalization in question answering.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2009.08566")
get_code_for_paper("2009.08566")
have("2009.08566")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2009.08566.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2009.08566)
Connect an agent — have() is free.