SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2407.10267 · 2024

RS-NeRF: Neural Radiance Fields from Rolling Shutter Images

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 13 functions out of this paper's own repositories and ran 8 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
myniuuu/rs-nerf canonical 8 of 13
FunctionStatusWhere it lives
get_embedder Ran myniuuu/rs-nerf/nerf.py
pointer only (licence: NONE) · get_code("f33c022650827208")
get_rays Ran myniuuu/rs-nerf/run_nerf_helpers.py
pointer only (licence: NONE) · get_code("492a3bd403592338")
normalize Ran myniuuu/rs-nerf/load_llff.py
pointer only (licence: NONE) · get_code("1d6f8390d799f055")
pose_spherical Ran myniuuu/rs-nerf/load_blender.py
pointer only (licence: NONE) · get_code("8313c1fb69b28c8e")
skew_symmetric Ran myniuuu/rs-nerf/Spline.py
pointer only (licence: NONE) · get_code("b591621bce049f0c")
taylor_A Ran myniuuu/rs-nerf/Spline.py
pointer only (licence: NONE) · get_code("34b0e999b42270f7")
taylor_B Ran myniuuu/rs-nerf/Spline.py
pointer only (licence: NONE) · get_code("4e73dc814d75e741")
viewmatrix Ran myniuuu/rs-nerf/load_llff.py
pointer only (licence: NONE) · get_code("aa52acee18f54d38")
compute_img_metric Not yet run myniuuu/rs-nerf/metrics.py
pointer only (licence: NONE) · get_code("7ef64e41224b81bf")
imread Not yet run myniuuu/rs-nerf/run_nerf_helpers.py
pointer only (licence: NONE) · get_code("79619ac934ccc01b")
load_blender_data Not yet run myniuuu/rs-nerf/load_blender.py
pointer only (licence: NONE) · get_code("ebcb91c8e73d73ab")
load_imgs Not yet run myniuuu/rs-nerf/run_nerf_helpers.py
pointer only (licence: NONE) · get_code("06ee9f41f1549653")
ptstocam Not yet run myniuuu/rs-nerf/load_llff.py
pointer only (licence: NONE) · get_code("36f5de7a0aae4a9b")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Neural Radiance Fields (NeRFs) have become increasingly popular because of their impressive ability for novel view synthesis. However, their effectiveness is hindered by the Rolling Shutter (RS) effects commonly found in most camera systems. To solve this, we present RS-NeRF, a method designed to synthesize normal images from novel views using input with RS distortions. This involves a physical model that replicates the image formation process under RS conditions and jointly optimizes NeRF parameters and camera extrinsic for each image row. We further address the inherent shortcomings of the basic RS-NeRF model by delving into the RS characteristics and developing algorithms to enhance its functionality. First, we impose a smoothness regularization to better estimate trajectories and improve the synthesis quality, in line with the camera movement prior. We also identify and address a fundamental flaw in the vanilla RS model by introducing a multi-sampling algorithm. This new approach improves the model's performance by comprehensively exploiting the RGB data across different rows for each intermediate camera pose. Through rigorous experimentation, we demonstrate that RS-NeRF surpasses previous methods in both synthetic and real-world scenarios, proving its ability to correct RS-related distortions effectively. Codes and data available: https://github.com/MyNiuuu/RS-NeRF

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2407.10267")
get_code_for_paper("2407.10267")
have("2407.10267")

Connect an agent — have() is free.