SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2406.02968 · NeurIPS · 2024

GSGAN: Adversarial Learning for Hierarchical Generation of 3D Gaussian Splats

Sangeek Hyun, Jae-Pil Heo

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 16 functions out of this paper's own repositories and ran 11 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

FunctionStatusWhere it lives
FOV_to_intrinsics Ran hse1032/Adversarial-Generation-of-Hierarchical-Gaussians-for-3D-Generative-Model/camera_utils.py
pointer only (licence: NONE) · get_code("eef98780cbfa6ee7")
build_rotation Ran hse1032/Adversarial-Generation-of-Hierarchical-Gaussians-for-3D-Generative-Model/training/gaussian3d_splatting/gaussian_model.py
pointer only (licence: NONE) · get_code("470f3cd8086ba7a2")
create_samples Ran hse1032/Adversarial-Generation-of-Hierarchical-Gaussians-for-3D-Generative-Model/gen_videos_gsparams.py
pointer only (licence: NONE) · get_code("eae3d419e3bac1bb")
file_ext Ran hse1032/Adversarial-Generation-of-Hierarchical-Gaussians-for-3D-Generative-Model/dataset_tool.py
pointer only (licence: NONE) · get_code("a2b45afa097b55b6")
layout_grid Ran hse1032/Adversarial-Generation-of-Hierarchical-Gaussians-for-3D-Generative-Model/gen_videos_gsparams.py
pointer only (licence: NONE) · get_code("456c172851946697")
maybe_min Ran hse1032/Adversarial-Generation-of-Hierarchical-Gaussians-for-3D-Generative-Model/dataset_tool.py
pointer only (licence: NONE) · get_code("dd1dc700e87f36cc")
parse_comma_separated_list Ran hse1032/Adversarial-Generation-of-Hierarchical-Gaussians-for-3D-Generative-Model/calc_metrics.py
pointer only (licence: NONE) · get_code("d01b68a634f71551")
parse_range Ran hse1032/Adversarial-Generation-of-Hierarchical-Gaussians-for-3D-Generative-Model/gen_videos_gsparams.py
pointer only (licence: NONE) · get_code("0cb0302229a63afb")
parse_range Ran hse1032/Adversarial-Generation-of-Hierarchical-Gaussians-for-3D-Generative-Model/run_projector.py
pointer only (licence: NONE) · get_code("8472aff56a2005d0")
parse_tuple Ran hse1032/Adversarial-Generation-of-Hierarchical-Gaussians-for-3D-Generative-Model/dataset_tool.py
pointer only (licence: NONE) · get_code("1116ca96f6d276ff")
parse_tuple Ran hse1032/Adversarial-Generation-of-Hierarchical-Gaussians-for-3D-Generative-Model/run_projector.py
pointer only (licence: NONE) · get_code("4f8f5943cf11cbc3")
ask_yes_no Not yet run hse1032/Adversarial-Generation-of-Hierarchical-Gaussians-for-3D-Generative-Model/dnnlib/util.py
pointer only (licence: NONE) · get_code("9d31d2c4cd16bb2d")
compute_is Not yet run hse1032/Adversarial-Generation-of-Hierarchical-Gaussians-for-3D-Generative-Model/metrics/inception_score.py
pointer only (licence: NONE) · get_code("fc49fa553c005268")
format_time Not yet run hse1032/Adversarial-Generation-of-Hierarchical-Gaussians-for-3D-Generative-Model/dnnlib/util.py
pointer only (licence: NONE) · get_code("053fc534bc6bb989")
format_time_brief Not yet run hse1032/Adversarial-Generation-of-Hierarchical-Gaussians-for-3D-Generative-Model/dnnlib/util.py
pointer only (licence: NONE) · get_code("77f4aa0649e7f404")
project_batched_3d_to_2d Not yet run hse1032/Adversarial-Generation-of-Hierarchical-Gaussians-for-3D-Generative-Model/custom_utils.py
pointer only (licence: NONE) · get_code("b39719cedd4b6bff")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Most advances in 3D Generative Adversarial Networks (3D GANs) largely depend on ray casting-based volume rendering, which incurs demanding rendering costs. One promising alternative is rasterization-based 3D Gaussian Splatting (3D-GS), providing a much faster rendering speed and explicit 3D representation. In this paper, we exploit Gaussian as a 3D representation for 3D GANs by leveraging its efficient and explicit characteristics. However, in an adversarial framework, we observe that a naïve generator architecture suffers from training instability and lacks the capability to adjust the scale of Gaussians. This leads to model divergence and visual artifacts due to the absence of proper guidance for initialized positions of Gaussians and densification to manage their scales adaptively. To address these issues, we introduce GSGAN, a generator architecture with a hierarchical multiscale Gaussian representation that effectively regularizes the position and scale of generated Gaussians. Specifically, we design a hierarchy of Gaussians where finerlevel Gaussians are parameterized by their coarser-level counterparts; the position of finer-level Gaussians would be located near their coarser-level counterparts, and the scale would monotonically decrease as the level becomes finer, modeling both coarse and fine details of the 3D scene. Experimental results demonstrate that ours achieves a significantly faster rendering speed (×100) compared to state-of-the-art 3D consistent GANs with comparable 3D generation capability. Project page: https://hse1032.github.io/gsgan.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2406.02968")
get_code_for_paper("2406.02968")
have("2406.02968")

Connect an agent — have() is free.