SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2207.08050 · ICLR · 2022

Repairing Systematic Outliers by Learning Clean Subspaces in VAEs

Charles Sutton, Kai Xu, Alfredo Nazábal

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 20 functions out of this paper's own repositories and ran 16 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
sfme/clsvae-error-repair — 15 of 19
copy not recorded — 1 of 1
FunctionStatusWhere it lives
BernoulliDistModule Ran sfme/clsvae-error-repair/src/repair_syserr_models/semi_y_CLSVAE.py
code served (permissive licence) · get_code("8481946e737c208b")
GaussDiagDistModule Ran sfme/clsvae-error-repair/src/repair_syserr_models/semi_y_CLSVAE.py
code served (permissive licence) · get_code("cfb56fff21e907ec")
baseDecoder Ran sfme/clsvae-error-repair/src/repair_syserr_models/semi_y_CLSVAE.py
code served (permissive licence) · get_code("531f02e64d7cb8c2")
baseEncoder Ran sfme/clsvae-error-repair/src/repair_syserr_models/semi_y_CLSVAE.py
code served (permissive licence) · get_code("a49e297e81d9704b")
distance_correlation Ran sfme/clsvae-error-repair/src/repair_syserr_models/semi_y_CLSVAE.py
code served (permissive licence) · get_code("e043d45b15d6b755")
kl_bern Ran sfme/clsvae-error-repair/src/repair_syserr_models/semi_y_CLSVAE.py
code served (permissive licence) · get_code("53481f45062c91b6")
kl_gauss_diag Ran sfme/clsvae-error-repair/src/repair_syserr_models/semi_y_CLSVAE.py
code served (permissive licence) · get_code("e9f356ae0089c419")
logit_fn Ran sfme/clsvae-error-repair/src/repair_syserr_models/semi_y_CLSVAE.py
code served (permissive licence) · get_code("5dad1c9bfeeba510")
masker Ran sfme/clsvae-error-repair/src/repair_syserr_models/semi_y_CLSVAE.py
code served (permissive licence) · get_code("f44725a1fe393af6")
merge_leading_dims Ran sfme/clsvae-error-repair/src/repair_syserr_models/semi_y_CLSVAE.py
code served (permissive licence) · get_code("b6cc480db383d7f8")
modSeq Ran sfme/clsvae-error-repair/src/repair_syserr_models/semi_y_CLSVAE.py
code served (permissive licence) · get_code("015859f1f739f8d4")
nll_binary_global Ran sfme/clsvae-error-repair/src/repair_syserr_models/semi_y_CLSVAE.py
code served (permissive licence) · get_code("8f191236fc907a34")
nll_categ_global Ran sfme/clsvae-error-repair/src/repair_syserr_models/semi_y_CLSVAE.py
code served (permissive licence) · get_code("d4257574f5fb26e9")
nll_gauss_global Ran sfme/clsvae-error-repair/src/repair_syserr_models/semi_y_CLSVAE.py
code served (permissive licence) · get_code("494226cd33056112")
repeat_rows Ran sfme/clsvae-error-repair/src/repair_syserr_models/semi_y_CLSVAE.py
code served (permissive licence) · get_code("82ebdfc64ea97bb7")
split_leading_dim Ran this paper's copy was not recorded; identical code first harvested from johnpjust/nsf
pointer only · get_code("a27183852b672b4c")
VAE Not yet run sfme/clsvae-error-repair/src/repair_syserr_models/semi_y_CLSVAE.py
code served (permissive licence) · get_code("7b62da118d40ebcf")
nll_batch_noreduce Not yet run sfme/clsvae-error-repair/src/repair_syserr_models/semi_y_CLSVAE.py
code served (permissive licence) · get_code("4084058cfba14167")
semi_y_vae_partitioned_ELBO Not yet run sfme/clsvae-error-repair/src/repair_syserr_models/semi_y_CLSVAE.py
code served (permissive licence) · get_code("93debe3df0d62ace")
y_weighted_nll Not yet run sfme/clsvae-error-repair/src/repair_syserr_models/semi_y_CLSVAE.py
code served (permissive licence) · get_code("ecb04549beebc113")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Data cleaning often comprises outlier detection and data repair. Systematic errors result from nearly deterministic transformations that occur repeatedly in the data, e.g. specific image pixels being set to default values or watermarks. Consequently, models with enough capacity easily overfit to these errors, making detection and repair difficult. Seeing as a systematic outlier is a combination of patterns of a clean instance and systematic error patterns, our main insight is that inliers can be modelled by a smaller representation (subspace) in a model than outliers. By exploiting this, we propose Clean Subspace Variational Autoencoder (CLSVAE), a novel semi-supervised model for detection and automated repair of systematic errors. The main idea is to partition the latent space and model inlier and outlier patterns separately. CLSVAE is effective with much less labelled data compared to previous related models, often with less than 2% of the data. We provide experiments using three image datasets in scenarios with different levels of corruption and labelled set sizes, comparing to relevant baselines. CLSVAE provides superior repairs without human intervention, e.g. with just 0.25% of labelled data we see a relative error decrease of 58% compared to the closest baseline. * Work carried out while AN was at the Alan Turing Institute.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2207.08050")
get_code_for_paper("2207.08050")
have("2207.08050")

Connect an agent — have() is free.