We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
In this paper, we present a novel approach, Momentum$^2$ Teacher, for student-teacher based self-supervised learning. The approach performs momentum update on both network weights and batch normalization (BN) statistics. The teacher's weight is a momentum update of the student, and the teacher's BN statistics is a momentum update of those in history. The Momentum$^2$ Teacher is simple and efficient. It can achieve the state of the art results (74.5\%) under ImageNet linear evaluation protocol using small-batch size(\eg, 128), without requiring large-batch training on special hardware like TPU or inefficient across GPU operation (\eg, shuffling BN, synced BN). Our implementation and pre-trained models will be given on GitHub\footnote{https://github.com/zengarden/momentum2-teacher}.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2101.07525")
get_code_for_paper("2101.07525")
have("2101.07525")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2101.07525.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2101.07525)
Connect an agent — have() is free.