Vitor Rares, Gaidon, Wolfram Ambrus, Adrien Burgard
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Estimating scene geometry from data obtained with costeffective sensors is key for robots and self-driving cars. In this paper, we study the problem of predicting dense depth from a single RGB image (monodepth) with optional sparse measurements from low-cost active depth sensors. We introduce Sparse Auxiliary Networks (SANs), a new module enabling monodepth networks to perform both the tasks of depth prediction and completion, depending on whether only RGB images or also sparse point clouds are available at inference time. First, we decouple the image and depth map encoding stages using sparse convolutions to process only the valid depth map pixels. Second, we inject this information, when available, into the skip connections of the depth prediction network, augmenting its features. Through extensive experimental analysis on one indoor (NYUv2) and two outdoor (KITTI and DDAD) benchmarks, we demonstrate that our proposed SAN architecture is able to simultaneously learn both tasks, while achieving a new state of the art in depth prediction by a significant margin.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2103.16690")
get_code_for_paper("2103.16690")
have("2103.16690")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2103.16690.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2103.16690)
Connect an agent — have() is free.