SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2309.00216 · ICCV · 2023

Human-Inspired Facial Sketch Synthesis with Dynamic Adaptation

Yifan Zhu, Nannan Wang, Fei Gao, Chang Jiang

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 9 functions out of this paper's own repositories and ran 5 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
AiArt-HDU/HIDA canonical 5 of 9
FunctionStatusWhere it lives
calculate_activation_statistics Ran AiArt-HDU/HIDA/evaluation/dirs_fid_score.py
code served (permissive licence) · get_code("f3e49f0668d3e617")
calculate_frechet_distance Ran AiArt-HDU/HIDA/evaluation/dirs_fid_score.py
code served (permissive licence) · get_code("8d95781d86480c5f")
get_activations Ran AiArt-HDU/HIDA/evaluation/dirs_fid_score.py
code served (permissive licence) · get_code("bbf0f49edc553919")
process_img Ran AiArt-HDU/HIDA/SIFID/sifid_score_unet.py
code served (permissive licence) · get_code("9700906f2822ce75")
unet Ran AiArt-HDU/HIDA/SIFID/sifid_unet.py
code served (permissive licence) · get_code("6dabcfa4fdc06477")
calculate_activation_statistics Not yet run AiArt-HDU/HIDA/SIFID/sifid_score.py
code served (permissive licence) · get_code("ad99ad5ed3ed94c9")
calculate_frechet_distance Not yet run AiArt-HDU/HIDA/SIFID/sifid_score.py
code served (permissive licence) · get_code("0def50a351111624")
get_activations Not yet run AiArt-HDU/HIDA/SIFID/sifid_score.py
code served (permissive licence) · get_code("747615e2328307c2")
get_activations Not yet run AiArt-HDU/HIDA/SIFID/sifid_score_unet.py
code served (permissive licence) · get_code("ffc8d712b766ae09")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Facial sketch synthesis (FSS) aims to generate a vivid sketch portrait from a given facial photo. Existing FSS methods merely rely on 2D representations of facial semantic or appearance. However, professional human artists usually use outlines or shadings to covey 3D geometry. Thus facial 3D geometry (e.g. depth map) is extremely important for FSS. Besides, different artists may use diverse drawing techniques and create multiple styles of sketches; but the style is globally consistent in a sketch. Inspired by such observations, in this paper, we propose a novel Human-Inspired Dynamic Adaptation (HIDA) method. Specially, we propose to dynamically modulate neuron activations based on a joint consideration of both facial 3D geometry and 2D appearance, as well as globally consistent style control. Besides, we use deformable convolutions at coarse-scales to align deep features, for generating abstract and distinct outlines. Experiments show that HIDA can generate high-quality sketches in multiple styles, and significantly outperforms previous methods, over a large range of challenging faces. Besides, HIDA allows precise style control of the synthesized sketch, and generalizes well to natural scenes and other artistic styles. Our code and results have been released online at: https: //github.com/AiArt-HDU/HIDA.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2309.00216")
get_code_for_paper("2309.00216")
have("2309.00216")

Connect an agent — have() is free.