Xiangyu Zhao, Wenlong Zhang, Xiao-Ming Wu, Yuehan Zhang
We lifted 11 functions out of this paper's own repositories and ran 8 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.
| Repository | Role | Ran |
|---|---|---|
| xiangyu-mm/UniFashion | canonical | 8 of 11 |
| Function | Status | Where it lives |
|---|---|---|
| HWC3 | Ran | xiangyu-mm/UniFashion/src/UNIStableVITON/dataset.py pointer only (licence: NONE) · get_code("f9ec7d70add02b6f") |
| collate_fn | Ran | xiangyu-mm/UniFashion/src/data_utils.py pointer only (licence: NONE) · get_code("b6c1f837e6faaeba") |
| generate_randomized_fiq_caption | Ran | xiangyu-mm/UniFashion/src/data_utils.py pointer only (licence: NONE) · get_code("2d7caa5e94094b6d") |
| generate_randomized_fiq_caption | Ran | xiangyu-mm/UniFashion/src/predict.py pointer only (licence: NONE) · get_code("e120c2f0865756b1") |
| imread | Ran | xiangyu-mm/UniFashion/src/UNIStableVITON/dataset.py pointer only (licence: NONE) · get_code("0b909bb609d6fdce") |
| imread_for_albu | Ran | xiangyu-mm/UniFashion/src/UNIStableVITON/dataset.py pointer only (licence: NONE) · get_code("dfb6556db838ffdf") |
| squarepad_transform | Ran | xiangyu-mm/UniFashion/src/data_utils.py pointer only (licence: NONE) · get_code("a1580dd1883758f6") |
| str2bool | Ran | xiangyu-mm/UniFashion/src/cirr_test_submission.py pointer only (licence: NONE) · get_code("7c508037b40522af") |
| get_peft_state_maybe_zero_3 | Not yet run | xiangyu-mm/UniFashion/src/blip_fine_tune_2.py pointer only (licence: NONE) · get_code("55fe1b6faccdb503") |
| get_peft_state_non_lora_maybe_zero_3 | Not yet run | xiangyu-mm/UniFashion/src/blip_fine_tune_2.py pointer only (licence: NONE) · get_code("b6d749eb9a3b3158") |
| maybe_zero_3 | Not yet run | xiangyu-mm/UniFashion/src/blip_fine_tune_2.py pointer only (licence: NONE) · get_code("7890d7ff378dc2fc") |
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
The fashion domain includes a range of realworld multimodal tasks, such as multimodal retrieval and generation. Recent advancements in AI-generated content, particularly large language models for text and diffusion models for visuals, have spurred significant research interest in applying these multimodal models to fashion. However, fashion models must also effectively handle embedding tasks, like imageto-text and text-to-image retrieval. Moreover, current unified fashion models often lack the capability for image generation. In this work, we present UniFashion, a unified framework that tackles the challenges of multimodal generation and retrieval tasks in the fashion domain, by integrating image and text generation with retrieval tasks. UniFashion unifies embedding and generative processes through the use of a diffusion model and LLM, enabling controllable and high-fidelity generation. Our model significantly outperforms previous state-of-the-art models focused on single tasks across various fashion-related challenges and can be easily adapted to manage complex vision-language tasks. This study highlights the synergistic potential between multimodal generation and retrieval, offering a promising avenue for future research in the fashion domain. The source code is available at https: //github.com/xiangyu-mm/UniFashion.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2408.11305")
get_code_for_paper("2408.11305")
have("2408.11305")
Connect an agent — have() is free.