SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2303.11916 · 2023

CompoDiff: Versatile Composed Image Retrieval With Latent Diffusion

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 6 functions out of this paper's own repositories and ran 4 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
navervision/compodiff canonical 4 of 6
FunctionStatusWhere it lives
identity Ran navervision/compodiff/compodiff/models.py
code served (permissive licence) · get_code("7f1040f5e3991d5e")
exists Ran navervision/compodiff/compodiff/models.py
code served (permissive licence) · get_code("aa5486a3650902d8")
first Ran navervision/compodiff/compodiff/models.py
code served (permissive licence) · get_code("3072294c9b32cf4b")
l2norm Ran navervision/compodiff/demo_search.py
code served (permissive licence) · get_code("95b6310f5a3397be")
build_model Not yet run navervision/compodiff/compodiff/model_loader.py
code served (permissive licence) · get_code("34e095c973aa68ab")
predict Not yet run navervision/compodiff/demo_search.py
code served (permissive licence) · get_code("63a099788570229c")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

This paper proposes a novel diffusion-based model, CompoDiff, for solving zero-shot Composed Image Retrieval (ZS-CIR) with latent diffusion. This paper also introduces a new synthetic dataset, named SynthTriplets18M, with 18.8 million reference images, conditions, and corresponding target image triplets to train CIR models. CompoDiff and SynthTriplets18M tackle the shortages of the previous CIR approaches, such as poor generalizability due to the small dataset scale and the limited types of conditions. CompoDiff not only achieves a new state-of-the-art on four ZS-CIR benchmarks, including FashionIQ, CIRR, CIRCO, and GeneCIS, but also enables a more versatile and controllable CIR by accepting various conditions, such as negative text, and image mask conditions. CompoDiff also shows the controllability of the condition strength between text and image queries and the trade-off between inference speed and performance, which are unavailable with existing CIR methods. The code and dataset are available at https://github.com/navervision/CompoDiff

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2303.11916")
get_code_for_paper("2303.11916")
have("2303.11916")

Connect an agent — have() is free.