Kevin Lin, Mike Shou, Jinheng Xie, Zechen Bai, Zhenheng Yang, Zhijie Chen, Weijia Mao, Junhao Zhang, Weihao Wang, Yuchao Gu, David
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. If it links a repository, it is listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
We present a unified transformer, i.e., Show-o, that unifies multimodal understanding and generation. Unlike fully autoregressive models, Show-o unifies autoregressive and (discrete) diffusion modeling to adaptively handle inputs and outputs of various and mixed modalities. The unified model flexibly supports a wide range of vision-language tasks including visual question-answering, text-to-image generation, text-guided inpainting/extrapolation, and mixed-modality generation. Across various benchmarks, it demonstrates comparable or superior performance to existing individual models with an equivalent or larger number of parameters tailored for understanding or generation. This significantly highlights its potential as a next-generation foundation model. Code and models are released at https://github.com/showlab/Show-o.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2408.12528")
get_code_for_paper("2408.12528")
have("2408.12528")
Connect an agent — have() is free.