SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2303.17595 · ICCV · 2023

Neglected Free Lunch -Learning Image Classifiers Using Annotation Byproducts

Sangdoo Yun, Dongyoon Han, Junsuk Choe, Jean Song, Minsuk Chang, John Joon, Young Chung, Seonghyeok Chun, Dante Company

arXiv · PDF · Open in the Atlas

Code that ran

We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Supervised learning of image classifiers distills human knowledge into a parametric model f θ through pairs of images and corresponding labels {(X i , Y i )} N i=1 . We argue that this simple and widely used representation of human knowledge neglects rich auxiliary information from the annotation procedure, such as the time-series of mouse traces and clicks left after image selection. Our insight is that such annotation byproducts Z provide approximate human attention that weakly guides the model to focus on the foreground cues, reducing spurious correlations and discouraging shortcut learning. To verify this, we create ImageNet-AB and COCO-AB. They are ImageNet and COCO training sets enriched with sample-wise annotation byproducts, collected by replicating the respective original annotation tasks. We refer to the new paradigm of training models with annotation byproducts as learning using annotation byproducts (LUAB). We show that a simple multitask loss for regressing Z together with Y already improves the generalisability and robustness of the learned models. Compared to the original supervised learning, LUAB does not require extra annotation costs. ImageNet-AB and COCO-AB are at github.com/naverai/NeglectedFreeLunch.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2303.17595")
get_code_for_paper("2303.17595")
have("2303.17595")

The run record, dated, one paper per request, free:

curl https://syntology.ai/api/ran/2303.17595.json

A badge for a README (the split and the date, never a ratio):

[![Syntology run record](https://syntology.ai/api/ran/2303.17595.svg)](https://syntology.ai/paper/2303.17595)

Connect an agent — have() is free.