SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2110.09506 · NeurIPS · 2022

MEMO: Test Time Robustness via Adaptation and Augmentation

U Berkeley, Sergey Levine, Chelsea Finn, Marvin Zhang

arXiv · PDF · Open in the Atlas

Code that ran

14 of 18 samples (functions and classes) lifted from this paper's linked repositories executed on a synthesized input in Syntology's jail (0 of them constructed an object rather than computing a result; 3 honoured the contract we drafted, 0 violated it and 0 have no contract verdict; 11 failures of our instrument; 4 no recorded run), measured 2026-11-22; repository links from the Papers with Code archive attributed under CC BY-SA, no affiliation; bodies inline only under a permissive licence as GitHub detects it. Not a reproduction of the paper's results.

"Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results. This record, dated, as JSON: /api/ran/2110.09506.json · badge: /api/ran/2110.09506.svg

Each repository's role is a label: a classifier's output recorded on the link, or, where no role is recorded, what the Papers with Code archive marked. The line under it names its basis. Neither says who wrote the code.

RepositoryRoleRan
zhangmarvin/memo canonical (classifier label)
classifier basis not recorded on the link
0 ran · 3 no recorded run
kowshikthopalli/sista community
Papers with Code archive
14 ran · 1 no recorded run
FunctionStatusWhere it lives
_augmix_aug Ran
ran; our contract draft was wrong, not the code
kowshikthopalli/sista/SISTA_DA/image_target_memo.py
pointer only (licence: NONE) · get_code("8483567c5466c7c8")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, kowshikthopalli/sista when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

aug_randconv Ran
ran; our contract draft was wrong, not the code
kowshikthopalli/sista/SISTA_DA/image_target_memo.py
pointer only (licence: NONE) · get_code("89316c660137f3f8")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, kowshikthopalli/sista when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

autocontrast Ran
ran; our contract draft was wrong, not the code
kowshikthopalli/sista/SISTA_DA/image_target_memo.py
pointer only (licence: NONE) · get_code("3ee3bf864db8867f")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, kowshikthopalli/sista when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

equalize Ran
ran; our contract draft was wrong, not the code
kowshikthopalli/sista/SISTA_DA/image_target_memo.py
pointer only (licence: NONE) · get_code("ca3e2158c52023d8")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, kowshikthopalli/sista when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

float_parameter Ran
ran, honoured the contract we drafted
kowshikthopalli/sista/SISTA_DA/image_target_memo.py
pointer only (licence: NONE) · get_code("d6ad456eb790edde")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, kowshikthopalli/sista when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

int_parameter Ran
ran, honoured the contract we drafted
kowshikthopalli/sista/SISTA_DA/image_target_memo.py
pointer only (licence: NONE) · get_code("cce32b359dda4b20")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, kowshikthopalli/sista when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

posterize Ran
ran; our contract draft was wrong, not the code
kowshikthopalli/sista/SISTA_DA/image_target_memo.py
pointer only (licence: NONE) · get_code("c9440646eb995ea0")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, kowshikthopalli/sista when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

rand_lvl Ran
ran, honoured the contract we drafted
kowshikthopalli/sista/SISTA_DA/image_target_memo.py
pointer only (licence: NONE) · get_code("4eaeb136b1e28c9e")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, kowshikthopalli/sista when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

rotate Ran
ran; our contract draft was wrong, not the code
kowshikthopalli/sista/SISTA_DA/image_target_memo.py
pointer only (licence: NONE) · get_code("344ae735e72e78f3")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, kowshikthopalli/sista when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

shear_x Ran
ran; our contract draft was wrong, not the code
kowshikthopalli/sista/SISTA_DA/image_target_memo.py
pointer only (licence: NONE) · get_code("4e80aa228ea65fb6")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, kowshikthopalli/sista when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

shear_y Ran
ran; our contract draft was wrong, not the code
kowshikthopalli/sista/SISTA_DA/image_target_memo.py
pointer only (licence: NONE) · get_code("137c0aa9944debc9")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, kowshikthopalli/sista when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

solarize Ran
ran; our contract draft was wrong, not the code
kowshikthopalli/sista/SISTA_DA/image_target_memo.py
pointer only (licence: NONE) · get_code("7d16ac5dad904d6e")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, kowshikthopalli/sista when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

translate_x Ran
ran; our contract draft was wrong, not the code
kowshikthopalli/sista/SISTA_DA/image_target_memo.py
pointer only (licence: NONE) · get_code("b462f8c8b2eb6462")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, kowshikthopalli/sista when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

translate_y Ran
ran; our contract draft was wrong, not the code
kowshikthopalli/sista/SISTA_DA/image_target_memo.py
pointer only (licence: NONE) · get_code("9680c9d24fbc511b")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, kowshikthopalli/sista when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

adapt_single Not yet run
unverified (harvested, no recorded run)
kowshikthopalli/sista/SISTA_DA/image_target_memo.py
pointer only (licence: NONE) · get_code("4f66e7faa13aae34")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, kowshikthopalli/sista when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. No invocation recorded.

build_model Not yet run
unverified (harvested, no recorded run)
zhangmarvin/memo/imagenet-exps/utils/train_helpers.py
code served (permissive licence) · get_code("51595c44d66f1ef9")
How it ran

no invocation recorded.

prepare_test_data Not yet run
unverified (harvested, no recorded run)
zhangmarvin/memo/imagenet-exps/utils/train_helpers.py
code served (permissive licence) · get_code("cf7f3571664dea5d")
How it ran

no invocation recorded.

prepare_test_data Not yet run
unverified (harvested, no recorded run)
zhangmarvin/memo/cifar-10-exps/utils/prepare_dataset.py
code served (permissive licence) · get_code("66aed7eda3403742")
How it ran

no invocation recorded.

Also present in other papers' code

Of 18 samples lifted from this paper's linked repositories, 18 carry a function identity and 0 do not. Of the 18 distinct functions with an identity, 8 are also present in other papers whose code we hold (8 with at least one paper dated earlier, 2 the same month, 5 later) and 10 are only here among the 52,977 papers whose code Syntology holds (as of 2026-09-26).

Only here means: among the 52,977 papers whose code Syntology holds (51,887 with lifted samples, 1,090 through their assemblies only), as of 2026-09-26, no other paper's lifted samples or current assembly bricks contain an identical function body after normalisation.

FunctionAlso present inEarliest-datedOthers named
float_parameter
brick of this paper's assembly: helper
19 other papers
5 dated earlier, 2 the same month, 11 later, 1 same year, order not determinable · 2 only as an assembly brick
1912.02781 (2019-12)
AugMix: A Simple Data Processing Method to Improve Robustness and Uncertainty
2006.16241 (2020-06)
The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalization
2009.09238 (2020-09)
EfficientDeRain: Learning Pixel-wise Dilation Filtering for High-Efficiency Single-Image Deraining
and 16 more not named here
int_parameter
brick of this paper's assembly: helper
19 other papers
5 dated earlier, 2 the same month, 11 later, 1 same year, order not determinable · 2 only as an assembly brick
1912.02781 (2019-12)
AugMix: A Simple Data Processing Method to Improve Robustness and Uncertainty
2006.16241 (2020-06)
The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalization
2009.09238 (2020-09)
EfficientDeRain: Learning Pixel-wise Dilation Filtering for High-Efficiency Single-Image Deraining
and 16 more not named here
autocontrast
brick of this paper's assembly: helper
4 other papers
1 dated earlier, 3 later
2006.16241 (2020-06)
The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalization
2310.20199 (2023-10)
In Search of Lost Online Test-time Adaptation: A Survey
2401.08328 (2024-01)
Un-Mixing Test-Time Normalization Statistics: Combatting Label Temporal Correlation
and 1 more not named here
equalize
brick of this paper's assembly: helper
4 other papers
1 dated earlier, 3 later
2006.16241 (2020-06)
The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalization
2310.20199 (2023-10)
In Search of Lost Online Test-time Adaptation: A Survey
2401.08328 (2024-01)
Un-Mixing Test-Time Normalization Statistics: Combatting Label Temporal Correlation
and 1 more not named here
rotate
brick of this paper's assembly: helper
4 other papers
1 dated earlier, 3 later
2006.16241 (2020-06)
The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalization
2310.20199 (2023-10)
In Search of Lost Online Test-time Adaptation: A Survey
2401.08328 (2024-01)
Un-Mixing Test-Time Normalization Statistics: Combatting Label Temporal Correlation
and 1 more not named here
posterize
brick of this paper's assembly: helper
1 other paper
1 dated earlier
2006.16241 (2020-06)
The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalization
rand_lvl
brick of this paper's assembly: helper
1 other paper
1 dated earlier · 1 only as an assembly brick
2006.16241 (2020-06)
The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalization
solarize
brick of this paper's assembly: helper
1 other paper
1 dated earlier
2006.16241 (2020-06)
The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalization

Presence, not direction: an identical function body in two papers' repositories does not say who wrote it, which came from which, or that either paper's method rests on it. Matching is exact after normalisation, so a renamed or edited function is not matched. Dates are when papers appeared, not when code was written. Only .py files the harvester lifted are covered; notebooks are not read. A new-style arXiv id YYMM.NNNN dates a paper to the month 20YY-MM; otherwise Paper.year dates it to the year; otherwise it is undated. Dates are when the paper appeared, not when the code was written. Read 2026-11-22.

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

While deep neural networks can attain good accuracy on in-distribution test points, many applications require robustness even in the face of unexpected perturbations in the input, changes in the domain, or other sources of distribution shift. We study the problem of test time robustification, i.e., using the test input to improve model robustness. Recent prior works have proposed methods for test time adaptation, however, they each introduce additional assumptions, such as access to multiple test points, that prevent widespread adoption. In this work, we aim to study and devise methods that make no assumptions about the model training process and are broadly applicable at test time. We propose a simple approach that can be used in any test setting where the model is probabilistic and adaptable: when presented with a test example, perform different data augmentations on the data point, and then adapt (all of) the model parameters by minimizing the entropy of the model's average, or marginal, output distribution across the augmentations. Intuitively, this objective encourages the model to make the same prediction across different augmentations, thus enforcing the invariances encoded in these augmentations, while also maintaining confidence in its predictions. In our experiments, we evaluate two baseline ResNet models, two robust ResNet-50 models, and a robust vision transformer model, and we demonstrate that this approach achieves accuracy gains of 1-8% over standard model evaluation and also generally outperforms prior augmentation and adaptation strategies. For the setting in which only one test point is available, we achieve state-of-the-art results on the ImageNet-C, ImageNet-R, and, among ResNet-50 models, ImageNet-A distribution shift benchmarks.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2110.09506")
get_code_for_paper("2110.09506")
have("2110.09506")

The run record, dated, one paper per request, free:

curl https://syntology.ai/api/ran/2110.09506.json

A badge for a README (the split and the date, never a ratio):

[![Syntology run record](https://syntology.ai/api/ran/2110.09506.svg)](https://syntology.ai/paper/2110.09506)

Connect an agent — have() is free.