SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2401.17879 · CVPR · 2024

AEROBLADE: Training-Free Detection of Latent Diffusion Images Using Autoencoder Reconstruction Error

Asja Fischer, Denis Lukovnikov, Jonas Ricker

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 7 functions out of this paper's own repositories and ran 7 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
jonasricker/aeroblade canonical 7 of 7
FunctionStatusWhere it lives
colorbar Ran jonasricker/aeroblade/src/aeroblade/paper.py
pointer only (licence: NONE) · get_code("664cc438d8ceb3b4")
compute_diff Ran jonasricker/aeroblade/src/aeroblade/inversion.py
pointer only (licence: NONE) · get_code("44676333bce8f50d")
extract_patches Ran jonasricker/aeroblade/src/aeroblade/image.py
pointer only (licence: NONE) · get_code("19475527a36172a4")
get_nice_name Ran jonasricker/aeroblade/src/aeroblade/paper.py
pointer only (licence: NONE) · get_code("91f685ec15f82d5e")
read_files Ran jonasricker/aeroblade/src/aeroblade/data.py
pointer only (licence: NONE) · get_code("69ebaa037f89e634")
tpr_at_max_fpr Ran jonasricker/aeroblade/src/aeroblade/evaluation.py
pointer only (licence: NONE) · get_code("296d845b5510229a")
transform_from_config Ran jonasricker/aeroblade/src/aeroblade/transforms.py
pointer only (licence: NONE) · get_code("f7378b86f5547412")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

With recent text-to-image models, anyone can generate deceptively realistic images with arbitrary contents, fueling the growing threat of visual disinformation. A key enabler for generating high-resolution images with low computational cost has been the development of latent diffusion models (LDMs). In contrast to conventional diffusion models, LDMs perform the denoising process in the low-dimensional latent space of a pre-trained autoencoder (AE) instead of the high-dimensional image space. Despite their relevance, the forensic analysis of LDMs is still in its infancy. In this work we propose AEROBLADE, a novel detection method which exploits an inherent component of LDMs: the AE used to transform images between image and latent space. We find that generated images can be more accurately reconstructed by the AE than real images, allowing for a simple detection approach based on the reconstruction error. Most importantly, our method is easy to implement and does not require any training, yet nearly matches the performance of detectors that rely on extensive training. We empirically demonstrate that AEROBLADE is effective against state-of-the-art LDMs, including Stable Diffusion and Midjourney. Beyond detection, our approach allows for the qualitative analysis of images, which can be leveraged for identifying inpainted regions. We release our code and data at https://github.com/jonasricker/aeroblade.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2401.17879")
get_code_for_paper("2401.17879")
have("2401.17879")

Connect an agent — have() is free.