We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Many visual recognition models are evaluated only on their classification accuracy, a metric for which they obtain strong performance. In this paper, we investigate whether computer vision models can also provide correct rationales for their predictions. We propose a ``doubly right'' object recognition benchmark, where the metric requires the model to simultaneously produce both the right labels as well as the right rationales. We find that state-of-the-art visual models, such as CLIP, often provide incorrect rationales for their categorical predictions. However, by transferring the rationales from language models into visual representations through a tailored dataset, we show that we can learn a ``why prompt,'' which adapts large visual representations to produce correct rationales. Visualizations and empirical experiments show that our prompts significantly improve performance on doubly right object recognition, in addition to zero-shot transfer to unseen tasks and datasets.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2212.06202")
get_code_for_paper("2212.06202")
have("2212.06202")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2212.06202.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2212.06202)
Connect an agent — have() is free.