SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2306.17843 · 2023

Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priors

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 6 functions out of this paper's own repositories and ran 2 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
guochengqian/magic123 canonical 2 of 6
FunctionStatusWhere it lives
biased_softplus Ran guochengqian/magic123/activation.py
code served (permissive licence) · get_code("fb07704f3a4c0430")
unflatten_with_named_tensor Ran guochengqian/magic123/dpt.py
code served (permissive licence) · get_code("f2952bdbf9446f24")
forward_flex Not yet run guochengqian/magic123/dpt.py
code served (permissive licence) · get_code("e243c3c7c7f3110a")
forward_vit Not yet run guochengqian/magic123/dpt.py
code served (permissive licence) · get_code("47594f898e209e22")
get_encoder Not yet run guochengqian/magic123/encoding.py
code served (permissive licence) · get_code("9d6732ad20b669d3")
poisson_mesh_reconstruction Not yet run guochengqian/magic123/meshutils.py
code served (permissive licence) · get_code("b7f0e912438abda8")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

We present Magic123, a two-stage coarse-to-fine approach for high-quality, textured 3D meshes generation from a single unposed image in the wild using both2D and 3D priors. In the first stage, we optimize a neural radiance field to produce a coarse geometry. In the second stage, we adopt a memory-efficient differentiable mesh representation to yield a high-resolution mesh with a visually appealing texture. In both stages, the 3D content is learned through reference view supervision and novel views guided by a combination of 2D and 3D diffusion priors. We introduce a single trade-off parameter between the 2D and 3D priors to control exploration (more imaginative) and exploitation (more precise) of the generated geometry. Additionally, we employ textual inversion and monocular depth regularization to encourage consistent appearances across views and to prevent degenerate solutions, respectively. Magic123 demonstrates a significant improvement over previous image-to-3D techniques, as validated through extensive experiments on synthetic benchmarks and diverse real-world images. Our code, models, and generated 3D assets are available at https://github.com/guochengqian/Magic123.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2306.17843")
get_code_for_paper("2306.17843")
have("2306.17843")

Connect an agent — have() is free.