Victor Prisacariu, Ucl, Mohamed Sayed, John Gibson, Jamie Watson, Michael Firman, Clément Godard, Niantic
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Traditionally, 3D indoor scene reconstruction from posed images happens in two phases: per-image depth estimation, followed by depth merging and surface reconstruction. Recently, a family of methods have emerged that perform reconstruction directly in final 3D volumetric feature space. While these methods have shown impressive reconstruction results, they rely on expensive 3D convolutional layers, limiting their application in resource-constrained environments. In this work, we instead go back to the traditional route, and show how focusing on high quality multi-view depth prediction leads to highly accurate 3D reconstructions using simple off-the-shelf depth fusion. We propose a simple state-ofthe-art multi-view depth estimator with two main contributions: 1) a carefully-designed 2D CNN which utilizes strong image priors alongside a plane-sweep feature volume and geometric losses, combined with 2) the integration of keyframe and geometric metadata into the cost volume which allows informed depth plane scoring. Our method achieves a significant lead over the current state-of-the-art for depth estimation and close or better for 3D reconstruction on ScanNet and 7-Scenes, yet still allows for online real-time low-memory reconstruction. Code, models and results are available at https://nianticlabs.github.io/simplerecon
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2208.14743")
get_code_for_paper("2208.14743")
have("2208.14743")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2208.14743.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2208.14743)
Connect an agent — have() is free.