SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2204.00559 · ECCV · 2022

DFNet: Enhance Absolute Pose Regression with Direct Feature Matching

Xinghui Li, Victor Prisacariu, Zirui Wang, Shuai Chen

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 17 functions out of this paper's own repositories and ran 15 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
activevisionlab/dfnet canonical 15 of 17
FunctionStatusWhere it lives
batchify Ran activevisionlab/dfnet/script/models/nerf.py
code served (permissive licence) · get_code("fd57e365830d09de")
camera_frustum_initializer Ran activevisionlab/dfnet/dataset_loaders/load_7Scenes.py
code served (permissive licence) · get_code("c9625d568955ffac")
disable_model_grad Ran activevisionlab/dfnet/script/dm/direct_pose_model.py
code served (permissive licence) · get_code("5ebe28260a0e2f2e")
filter_hook Ran activevisionlab/dfnet/script/dm/pose_model.py
code served (permissive licence) · get_code("c7bea2e25b534df3")
generate_sampling_frustum Ran activevisionlab/dfnet/dataset_loaders/load_Cambridge.py
code served (permissive licence) · get_code("1fc1ac3d7fc531a9")
initK Ran activevisionlab/dfnet/dataset_loaders/load_7Scenes.py
code served (permissive licence) · get_code("13be307ef0c24c0e")
is_inside_frustum Ran activevisionlab/dfnet/dataset_loaders/load_7Scenes.py
code served (permissive licence) · get_code("f869aad3a90d4156")
load_image Ran activevisionlab/dfnet/dataset_loaders/cambridge_scenes.py
code served (permissive licence) · get_code("9b5a8fceac6859e6")
mse Ran activevisionlab/dfnet/script/models/metrics.py
code served (permissive licence) · get_code("c832923b546e9fb3")
preprocess_data Ran activevisionlab/dfnet/script/dm/pose_model.py
code served (permissive licence) · get_code("1d4f466dd0b12111")
process_poses_rotmat Ran activevisionlab/dfnet/dataset_loaders/seven_scenes.py
code served (permissive licence) · get_code("ecb54915a44f88b3")
process_poses_rotmat Ran activevisionlab/dfnet/dataset_loaders/cambridge_scenes.py
code served (permissive licence) · get_code("aba0c9bab294b165")
psnr Ran activevisionlab/dfnet/script/models/metrics.py
code served (permissive licence) · get_code("b5b388448f22219a")
qlog Ran activevisionlab/dfnet/dataset_loaders/cambridge_scenes.py
code served (permissive licence) · get_code("667f7d75349dad79")
run_network Ran activevisionlab/dfnet/script/models/nerf.py
code served (permissive licence) · get_code("8f235fb889b93174")
run_network_DNeRF Not yet run activevisionlab/dfnet/script/models/nerf.py
code served (permissive licence) · get_code("b2c204ce6bb5f30e")
ssim Not yet run activevisionlab/dfnet/script/models/metrics.py
code served (permissive licence) · get_code("895ffdb66b75e1b4")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

We introduce a camera relocalization pipeline that combines absolute pose regression (APR) and direct feature matching. By incorporating exposure-adaptive novel view synthesis, our method successfully addresses photometric distortions in outdoor environments that existing photometric-based methods fail to handle. With domain-invariant feature matching, our solution improves pose regression accuracy using semi-supervised learning on unlabeled data. In particular, the pipeline consists of two components: Novel View Synthesizer and DFNet. The former synthesizes novel views compensating for changes in exposure and the latter regresses camera poses and extracts robust features that close the domain gap between real images and synthetic ones. Furthermore, we introduce an online synthetic data generation scheme. We show that these approaches effectively enhance camera pose estimation both in indoor and outdoor scenes. Hence, our method achieves a state-of-the-art accuracy by outperforming existing single-image APR methods by as much as 56%, comparable to 3D structure-based methods. 1

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2204.00559")
get_code_for_paper("2204.00559")
have("2204.00559")

Connect an agent — have() is free.