SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2408.03558 · 2024

D2Styler: Advancing Arbitrary Style Transfer with Discrete Diffusion Methods

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 4 functions out of this paper's own repositories and ran 1 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
onkarsus13/d2styler canonical 1 of 4
FunctionStatusWhere it lives
poly_to_mask Ran onkarsus13/d2styler/Train_Styler.py
code served (permissive licence) · get_code("c4b92150d431c3a1")
get_down_block Not yet run onkarsus13/d2styler/models/unet_blocks.py
code served (permissive licence) · get_code("47ccb78720fa43a4")
get_up_block Not yet run onkarsus13/d2styler/models/unet_blocks.py
code served (permissive licence) · get_code("17bb6aea1323b38f")
zero_module Not yet run onkarsus13/d2styler/sparse_controlnet.py
code served (permissive licence) · get_code("da94debb8019ad46")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

In image processing, one of the most challenging tasks is to render an image's semantic meaning using a variety of artistic approaches. Existing techniques for arbitrary style transfer (AST) frequently experience mode-collapse, over-stylization, or under-stylization due to a disparity between the style and content images. We propose a novel framework called D$^2$Styler (Discrete Diffusion Styler) that leverages the discrete representational capability of VQ-GANs and the advantages of discrete diffusion, including stable training and avoidance of mode collapse. Our method uses Adaptive Instance Normalization (AdaIN) features as a context guide for the reverse diffusion process. This makes it easy to move features from the style image to the content image without bias. The proposed method substantially enhances the visual quality of style-transferred images, allowing the combination of content and style in a visually appealing manner. We take style images from the WikiArt dataset and content images from the COCO dataset. Experimental results demonstrate that D$^2$Styler produces high-quality style-transferred images and outperforms twelve existing methods on nearly all the metrics. The qualitative results and ablation studies provide further insights into the efficacy of our technique. The code is available at https://github.com/Onkarsus13/D2Styler.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2408.03558")
get_code_for_paper("2408.03558")
have("2408.03558")

Connect an agent — have() is free.