Matthew Groh, Fabian Gröger, Simone Lionetti, Philippe Gottfrois, Marc Pouly, Á. González-Jiménez, L. Amruthalingam, A. Navarini
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Benchmark datasets in computer vision often contain off-topic images, near duplicates, and label errors, leading to inaccurate estimates of model performance. In this paper, we revisit the task of data cleaning and formalize it as either a ranking problem, which significantly reduces human inspection effort, or a scoring problem, which allows for automated decisions based on score distributions. We find that a specific combination of context-aware self-supervised representation learning and distance-based indicators is effective in finding issues without annotation biases. This methodology, which we call SELFCLEAN, surpasses state-of-the-art performance in detecting off-topic images, near duplicates, and label errors within widely-used image datasets, such as ImageNet-1k, Food-101N, and STL-10, both for synthetic issues and real contamination. We apply the detailed method to multiple image benchmarks, identify up to 16% of issues, and confirm an improvement in evaluation reliability upon cleaning. The official implementation can be found at: https://github.com/Digital-Dermatology/SelfClean.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2305.17048")
get_code_for_paper("2305.17048")
have("2305.17048")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2305.17048.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2305.17048)
Connect an agent — have() is free.