We lifted 11 functions out of this paper's own repositories and ran 7 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.
| Repository | Role | Ran |
|---|---|---|
| GaussianObject/GaussianObject | canonical | 4 of 8 |
| chensjtu/gaussianobject | canonical | 3 of 3 |
| Function | Status | Where it lives |
|---|---|---|
| apply_log_to_norm | Ran | GaussianObject/GaussianObject/mast3r/losses.py pointer only (licence: NONE) · get_code("f3fd659d5f95c771") |
| batch_projection | Ran | chensjtu/gaussianobject/visual_hull.py pointer only (licence: NONE) · get_code("a673c40fbe4e0587") |
| fov2focal | Ran | chensjtu/gaussianobject/visual_hull.py pointer only (licence: NONE) · get_code("85342d2483112eb6") |
| get_similarities | Ran | GaussianObject/GaussianObject/mast3r/losses.py pointer only (licence: NONE) · get_code("6e6b3f8c6d2c3d69") |
| load_statistics_info | Ran | GaussianObject/GaussianObject/dataset_lora.py pointer only (licence: NONE) · get_code("9c4099e8c285bb34") |
| points2homopoints | Ran | chensjtu/gaussianobject/visual_hull.py pointer only (licence: NONE) · get_code("eeec85946a481520") |
| qvec2rvec | Ran | GaussianObject/GaussianObject/pred_poses.py pointer only (licence: NONE) · get_code("e2a5b00a511b5119") |
| get_state_dict | Not yet run | GaussianObject/GaussianObject/cldm/model.py pointer only (licence: NONE) · get_code("cfc17707f35e7ec4") |
| load_model | Not yet run | GaussianObject/GaussianObject/mast3r/model.py pointer only (licence: NONE) · get_code("1e3f140b86bb9a08") |
| load_state_dict | Not yet run | GaussianObject/GaussianObject/cldm/model.py pointer only (licence: NONE) · get_code("df733a879693145d") |
| prepare_output_and_logger | Not yet run | GaussianObject/GaussianObject/leave_one_out_stage1.py pointer only (licence: NONE) · get_code("5b1fcb50d8a9ca48") |
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Reconstructing and rendering 3D objects from highly sparse views is of critical importance for promoting applications of 3D vision techniques and improving user experience. However, images from sparse views only contain very limited 3D information, leading to two significant challenges: 1) Difficulty in building multi-view consistency as images for matching are too few; 2) Partially omitted or highly compressed object information as view coverage is insufficient. To tackle these challenges, we propose GaussianObject, a framework to represent and render the 3D object with Gaussian splatting that achieves high rendering quality with only 4 input images. We first introduce techniques of visual hull and floater elimination, which explicitly inject structure priors into the initial optimization process to help build multi-view consistency, yielding a coarse 3D Gaussian representation. Then we construct a Gaussian repair model based on diffusion models to supplement the omitted object information, where Gaussians are further refined. We design a self-generating strategy to obtain image pairs for training the repair model. We further design a COLMAP-free variant, where pre-given accurate camera poses are not required, which achieves competitive quality and facilitates wider applications. GaussianObject is evaluated on several challenging datasets, including MipNeRF360, OmniObject3D, OpenIllumination, and our-collected unposed images, achieving superior performance from only four views and significantly outperforming previous SOTA methods. Our demo is available at https://gaussianobject.github.io/, and the code has been released at https://github.com/GaussianObject/GaussianObject.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2402.10259")
get_code_for_paper("2402.10259")
have("2402.10259")
Connect an agent — have() is free.