SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2410.08107 · 2024

IncEventGS: Pose-Free Gaussian Splatting from a Single Event Camera

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 13 functions out of this paper's own repositories and ran 12 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
wu-cvgl/inceventgs canonical 12 of 13
FunctionStatusWhere it lives
apply_colormap Ran wu-cvgl/inceventgs/colormaps.py
pointer only (licence: NONE) · get_code("c5d089b2c4818e43")
apply_depth_colormap Ran wu-cvgl/inceventgs/colormaps.py
pointer only (licence: NONE) · get_code("d7a16b08f68fbd98")
apply_float_colormap Ran wu-cvgl/inceventgs/colormaps.py
pointer only (licence: NONE) · get_code("25ea9b1b619339d8")
compute_gradients Ran wu-cvgl/inceventgs/tikhonov_regularizor.py
pointer only (licence: NONE) · get_code("e9df74b8b772c7cb")
compute_white_balance_loss Ran wu-cvgl/inceventgs/loss_utils.py
pointer only (licence: NONE) · get_code("93c62d41a8965062")
coordinates Ran wu-cvgl/inceventgs/model/utils.py
pointer only (licence: NONE) · get_code("22e5fca7dae2c8e6")
load_config Ran wu-cvgl/inceventgs/config.py
pointer only (licence: NONE) · get_code("005bffee10b3fe2b")
mid Ran wu-cvgl/inceventgs/model/spline_utils.py
pointer only (licence: NONE) · get_code("b9b4e8156dcded4f")
mid_pose Ran wu-cvgl/inceventgs/model/spline_utils.py
pointer only (licence: NONE) · get_code("a79cf17bf5a2a32e")
mse2psnr Ran wu-cvgl/inceventgs/model/utils.py
pointer only (licence: NONE) · get_code("c478fd7d4cef9120")
reblur Ran wu-cvgl/inceventgs/model/spline_utils.py
pointer only (licence: NONE) · get_code("c8a12fabe121365c")
tikhonov_regularization Ran wu-cvgl/inceventgs/tikhonov_regularizor.py
pointer only (licence: NONE) · get_code("73a9c6705403a4c6")
sample_pdf Not yet run wu-cvgl/inceventgs/model/utils.py
pointer only (licence: NONE) · get_code("d4896cfe59df5f36")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Implicit neural representation and explicit 3D Gaussian Splatting (3D-GS) for novel view synthesis have achieved remarkable progress with frame-based camera (e.g. RGB and RGB-D cameras) recently. Compared to frame-based camera, a novel type of bio-inspired visual sensor, i.e. event camera, has demonstrated advantages in high temporal resolution, high dynamic range, low power consumption and low latency. Due to its unique asynchronous and irregular data capturing process, limited work has been proposed to apply neural representation or 3D Gaussian splatting for an event camera. In this work, we present IncEventGS, an incremental 3D Gaussian Splatting reconstruction algorithm with a single event camera. To recover the 3D scene representation incrementally, we exploit the tracking and mapping paradigm of conventional SLAM pipelines for IncEventGS. Given the incoming event stream, the tracker firstly estimates an initial camera motion based on prior reconstructed 3D-GS scene representation. The mapper then jointly refines both the 3D scene representation and camera motion based on the previously estimated motion trajectory from the tracker. The experimental results demonstrate that IncEventGS delivers superior performance compared to prior NeRF-based methods and other related baselines, even we do not have the ground-truth camera poses. Furthermore, our method can also deliver better performance compared to state-of-the-art event visual odometry methods in terms of camera motion estimation. Code is publicly available at: https://github.com/wu-cvgl/IncEventGS.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2410.08107")
get_code_for_paper("2410.08107")
have("2410.08107")

Connect an agent — have() is free.