SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2403.11193 · CVPR · 2024

Neural Markov Random Field for Stereo Matching

Chen Wang, Yun-Hui Liu, Tongfan Guan

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 13 functions out of this paper's own repositories and ran 12 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
aeolusguan/NMRF canonical 12 of 13
FunctionStatusWhere it lives
build_correlation_volume Ran aeolusguan/NMRF/nmrf/models/submodule.py
code served (permissive licence) · get_code("a29583ee331c3c8f")
checkpoint_filter_fn Ran aeolusguan/NMRF/nmrf/models/backbone.py
code served (permissive licence) · get_code("0cd7e6af2fb6aac5")
create_backbone Ran aeolusguan/NMRF/nmrf/models/backbone.py
code served (permissive licence) · get_code("ab6f27224a5ec3af")
deform_inputs_dn Ran aeolusguan/NMRF/nmrf/models/adaptor_modules.py
code served (permissive licence) · get_code("eb21e258888f2695")
drop_path Ran aeolusguan/NMRF/nmrf/models/NMP.py
code served (permissive licence) · get_code("2721b1ad15d4ab2a")
fourier_coord_embed Ran aeolusguan/NMRF/nmrf/models/NMP.py
code served (permissive licence) · get_code("1460480e875a9469")
fourier_grid_embed Ran aeolusguan/NMRF/nmrf/models/NMP.py
code served (permissive licence) · get_code("4164fde725f42a75")
gather Ran aeolusguan/NMRF/nmrf/utils/dist_utils.py
code served (permissive licence) · get_code("7780de4d44f9b787")
get_reference_points Ran aeolusguan/NMRF/nmrf/models/adaptor_modules.py
code served (permissive licence) · get_code("8073d48cbfc0f7ad")
groupwise_correlation Ran aeolusguan/NMRF/nmrf/models/submodule.py
code served (permissive licence) · get_code("2e5c0e4dfa009847")
window_partition Ran aeolusguan/NMRF/nmrf/models/swin.py
code served (permissive licence) · get_code("f9fd6241d935f07b")
window_reverse Ran aeolusguan/NMRF/nmrf/models/swin.py
code served (permissive licence) · get_code("fb32094c6dbece71")
configurable Not yet run aeolusguan/NMRF/nmrf/config/config.py
code served (permissive licence) · get_code("e2498bf585aeddb8")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Stereo matching is a core task for many computer vision and robotics applications. Despite their dominance in traditional stereo methods, the hand-crafted Markov Random Field (MRF) models lack sufficient modeling accuracy compared to end-to-end deep models. While deep learning representations have greatly improved the unary terms of the MRF models, the overall accuracy is still severely limited by the hand-crafted pairwise terms and message passing. To address these issues, we propose a neural MRF model, where both potential functions and message passing are designed using data-driven neural networks. Our fully data-driven model is built on the foundation of variational inference theory, to prevent convergence issues and retain stereo MRF's graph inductive bias. To make the inference tractable and scale well to high-resolution images, we also propose a Disparity Proposal Network (DPN) to adaptively prune the search space of disparity. The proposed approach ranks 1 st on both KITTI 2012 and 2015 leaderboards among all published methods while running faster than 100 ms. This approach significantly outperforms prior global methods, e.g., lowering D1 metric by more than 50% on KITTI 2015. In addition, our method exhibits strong cross-domain generalization and can recover sharp edges. The codes at https://github.com/aeolusguan/NMRF.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2403.11193")
get_code_for_paper("2403.11193")
have("2403.11193")

Connect an agent — have() is free.