SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2108.08258 · ICCV · 2021

LIGA-Stereo: Learning LiDAR Geometry Aware Representations for Stereo-based 3D Detector

Hongsheng Li, Xiaogang Wang, Shaoshuai Shi, Xiaoyang Guo

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 8 functions out of this paper's own repositories and ran 4 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
xy-guo/LIGA-Stereo canonical 4 of 8
FunctionStatusWhere it lives
convbn Ran xy-guo/LIGA-Stereo/liga/models/backbones_3d_stereo/submodule.py
code served (permissive licence) · get_code("576fc9a704db460c")
convbn_3d Ran xy-guo/LIGA-Stereo/liga/models/backbones_3d_stereo/submodule.py
code served (permissive licence) · get_code("480bf7306505e398")
project_pseudo_lidar_to_rectcam Ran xy-guo/LIGA-Stereo/liga/models/backbones_3d_stereo/liga_backbone.py
code served (permissive licence) · get_code("a5a2d3ad76c124dc")
project_rectcam_to_pseudo_lidar Ran xy-guo/LIGA-Stereo/liga/models/backbones_3d_stereo/liga_backbone.py
code served (permissive licence) · get_code("370605cfbaea4721")
cfg_from_yaml_file Not yet run xy-guo/LIGA-Stereo/liga/config.py
code served (permissive licence) · get_code("696fe155f9990d38")
get_corner_loss_lidar Not yet run xy-guo/LIGA-Stereo/liga/utils/loss_utils.py
code served (permissive licence) · get_code("8a7cbf962b631fa2")
merge_new_config Not yet run xy-guo/LIGA-Stereo/liga/config.py
code served (permissive licence) · get_code("392c0cf3a1b07b12")
project_rect_to_image Not yet run xy-guo/LIGA-Stereo/liga/models/backbones_3d_stereo/liga_backbone.py
code served (permissive licence) · get_code("ccdb34a9a05a58c5")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Stereo-based 3D detection aims at detecting 3D objects from stereo images, which provides a low-cost solution for 3D perception. However, its performance is still inferior compared with LiDAR-based detection algorithms. To detect and localize accurate 3D bounding boxes, LiDARbased detectors encode high-level representations from Li-DAR point clouds, such as accurate object boundaries and surface normal directions. In contrast, high-level features learned by stereo-based detectors are easily affected by the erroneous depth estimation due to the limitation of stereo matching. To solve the problem, we propose LIGA-Stereo (LiDAR Geometry Aware Stereo Detector) to learn stereo-based 3D detectors under the guidance of high-level geometry-aware representations of LiDAR-based detection models. In addition, we found existing voxel-based stereo detectors failed to learn semantic features effectively from indirect 3D supervisions. We attach an auxiliary 2D detection head to provide direct 2D semantic supervisions. Experiment results show that the above two strategies improved the geometric and semantic representation capabilities. Compared with the state-of-the-art stereo detector, our method has improved the 3D detection performance of cars, pedestrians, cyclists by 10.44%, 5.69%, 5.97% mAP respectively on the official KITTI benchmark. The gap between stereo-based and LiDAR-based 3D detectors is further narrowed. The code is available at https: //xy-guo.github.io/liga/.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2108.08258")
get_code_for_paper("2108.08258")
have("2108.08258")

Connect an agent — have() is free.