Vu Nguyen, Chunhua Shen, Thalaiyasingam Ajanthan, Wei Yin, Anton Van Den Hengel, Pulak Purkait, Alexander Long, Alan Blair, Ravi Garg
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. We have no repository linked to it either. That is a statement about our graph, not about the paper.
We introduce Retrieval Augmented Classification (RAC), a generic approach to augmenting standard image classification pipelines with an explicit retrieval module. RAC consists of a standard base image encoder fused with a parallel retrieval branch that queries a non-parametric external memory of pre-encoded images and associated text snippets. We apply RAC to the problem of long-tail classification and demonstrate a significant improvement over previous state-of-the-art on Places365-LT and iNaturalist-2018 (14.5% and 6.7% respectively), despite using only the training datasets themselves as the external information source. We demonstrate that RAC's retrieval module, without prompting, learns a high level of accuracy on tail classes.This, in turn, frees the base encoder to focus on common classes, and improve its performance thereon. RAC represents an alternative approach to utilizing large, pretrained models without requiring fine-tuning, as well as a first step towards more effectively making use of external memory within common computer vision architectures.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2202.11233")
get_code_for_paper("2202.11233")
have("2202.11233")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2202.11233.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2202.11233)
Connect an agent — have() is free.