Kakao Brain, Ildoo Kim, Sungwoong Kim, Byungseok Roh, Wuhyun Shin
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Self-supervised learning has been widely used to obtain transferrable representations from unlabeled images. Especially, recent contrastive learning methods have shown impressive performances on downstream image classification tasks. While these contrastive methods mainly focus on generating invariant global representations at the image-level under semantic-preserving transformations, they are prone to overlook spatial consistency of local representations and therefore have a limitation in pretraining for localization tasks such as object detection and instance segmentation. Moreover, aggressively cropped views used in existing contrastive methods can minimize representation distances between the semantically different regions of a single image. In this paper, we propose a spatially consistent representation learning algorithm (SCRL) for multi-object and location-specific tasks. In particular, we devise a novel self-supervised objective that tries to produce coherent spatial representations of a randomly cropped local region according to geometric translations and zooming operations. On various downstream localization tasks with benchmark datasets, the proposed SCRL shows significant performance improvements over the image-level supervised pretraining as well as the state-of-the-art self-supervised learning methods. Code is available at https://github.com/ kakaobrain/scrl.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2103.06122")
get_code_for_paper("2103.06122")
have("2103.06122")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2103.06122.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2103.06122)
Connect an agent — have() is free.