SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2406.19435 · 2024

A Sanity Check for AI-generated Image Detection

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 8 functions out of this paper's own repositories and ran 6 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
shilinyan99/aide canonical 6 of 8
FunctionStatusWhere it lives
all_reduce_mean Ran shilinyan99/aide/utils.py
code served (permissive licence) · get_code("3dc19396537db789")
conv1x1 Ran shilinyan99/aide/models/AIDE.py
code served (permissive licence) · get_code("d9def42110729a85")
conv3x3 Ran shilinyan99/aide/models/AIDE.py
code served (permissive licence) · get_code("fac5364e2f53c6db")
get_num_layer_for_convnext_single Ran shilinyan99/aide/optim_factory.py
code served (permissive licence) · get_code("3d3fed5c8d06128f")
get_parameter_groups Ran shilinyan99/aide/optim_factory.py
code served (permissive licence) · get_code("dd7ffb8631ae8a47")
str2bool Ran shilinyan99/aide/utils.py
code served (permissive licence) · get_code("082f6dc078195aeb")
get_grad_norm_ Not yet run shilinyan99/aide/utils.py
code served (permissive licence) · get_code("ba1356e8ceb654d2")
get_num_layer_for_convnext Not yet run shilinyan99/aide/optim_factory.py
code served (permissive licence) · get_code("199223de2f9704cf")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

With the rapid development of generative models, discerning AI-generated content has evoked increasing attention from both industry and academia. In this paper, we conduct a sanity check on "whether the task of AI-generated image detection has been solved". To start with, we present Chameleon dataset, consisting AIgenerated images that are genuinely challenging for human perception. To quantify the generalization of existing methods, we evaluate 9 off-the-shelf AI-generated image detectors on Chameleon dataset. Upon analysis, almost all models classify AI-generated images as real ones. Later, we propose AIDE (AI-generated Image DEtector with Hybrid Features), which leverages multiple experts to simultaneously extract visual artifacts and noise patterns. Specifically, to capture the high-level semantics, we utilize CLIP to compute the visual embedding. This effectively enables the model to discern AI-generated images based on semantics or contextual information; Secondly, we select the highest frequency patches and the lowest frequency patches in the image, and compute the low-level patchwise features, aiming to detect AI-generated images by low-level artifacts, for example, noise pattern, anti-aliasing, etc. While evaluating on existing benchmarks, for example, AIGCDetectBenchmark and GenImage, AIDE achieves +3.5% and +4.6% improvements to state-of-the-art methods, and on our proposed challenging Chameleon benchmarks, it also achieves the promising results, despite this problem for detecting AI-generated images is far from being solved.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2406.19435")
get_code_for_paper("2406.19435")
have("2406.19435")

Connect an agent — have() is free.