SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2306.00926 · 2023

Inserting Anybody in Diffusion Models via Celeb Basis

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 11 functions out of this paper's own repositories and ran 5 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
ygtxr1997/celebbasis canonical 5 of 11
FunctionStatusWhere it lives
default Ran ygtxr1997/celebbasis/ldm/modules/attention.py
code served (permissive licence) · get_code("424012cb37b31172")
exists Ran ygtxr1997/celebbasis/ldm/modules/attention.py
code served (permissive licence) · get_code("aa5486a3650902d8")
get_clip_token_for_string Ran ygtxr1997/celebbasis/merge_embeddings.py
code served (permissive licence) · get_code("e466f56ae7a8bea6")
get_placeholder_loop Ran ygtxr1997/celebbasis/merge_embeddings.py
code served (permissive licence) · get_code("cb1a19e61d70046b")
uniq Ran ygtxr1997/celebbasis/ldm/modules/attention.py
code served (permissive licence) · get_code("9a299fe5ae09e407")
get_bert_token_for_string Not yet run ygtxr1997/celebbasis/merge_embeddings.py
code served (permissive licence) · get_code("91610d6e2f2a67b4")
get_pos_neg_temps Not yet run ygtxr1997/celebbasis/evaluation/prompt_templates.py
code served (permissive licence) · get_code("128130f54ff26d81")
nondefault_trainer_args Not yet run ygtxr1997/celebbasis/main_id_embed.py
code served (permissive licence) · get_code("87fbedd0c27cf378")
parser_eval Not yet run ygtxr1997/celebbasis/evaluation/parse_args.py
code served (permissive licence) · get_code("c62aef587185be0c")
parser_gen Not yet run ygtxr1997/celebbasis/evaluation/parse_args.py
code served (permissive licence) · get_code("474846246b7ef9f2")
parser_main Not yet run ygtxr1997/celebbasis/evaluation/parse_args.py
code served (permissive licence) · get_code("5a38b008bf39e5d8")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Exquisite demand exists for customizing the pretrained large text-to-image model, $\textit{e.g.}$, Stable Diffusion, to generate innovative concepts, such as the users themselves. However, the newly-added concept from previous customization methods often shows weaker combination abilities than the original ones even given several images during training. We thus propose a new personalization method that allows for the seamless integration of a unique individual into the pre-trained diffusion model using just $\textbf{one facial photograph}$ and only $\textbf{1024 learnable parameters}$ under $\textbf{3 minutes}$. So as we can effortlessly generate stunning images of this person in any pose or position, interacting with anyone and doing anything imaginable from text prompts. To achieve this, we first analyze and build a well-defined celeb basis from the embedding space of the pre-trained large text encoder. Then, given one facial photo as the target identity, we generate its own embedding by optimizing the weight of this basis and locking all other parameters. Empowered by the proposed celeb basis, the new identity in our customized model showcases a better concept combination ability than previous personalization methods. Besides, our model can also learn several new identities at once and interact with each other where the previous customization model fails to. The code will be released.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2306.00926")
get_code_for_paper("2306.00926")
have("2306.00926")

Connect an agent — have() is free.