Jie Li, Dian Chen, Vitor Rares, Adrien Ambrus, Gaidon
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
3D object detection from visual sensors is a cornerstone capability of robotic systems. State-of-the-art methods focus on reasoning and decoding object bounding boxes from multi-view camera input. In this work we gain intuition from the integral role of multi-view consistency in 3D scene understanding and geometric learning. To this end, we introduce VEDet, a novel 3D object detection framework that exploits 3D multi-view geometry to improve localization through viewpoint awareness and equivariance. VEDet leverages a query-based transformer architecture and encodes the 3D scene by augmenting image features with positional encodings from their 3D perspective geometry. We design view-conditioned queries at the output level, which enables the generation of multiple virtual frames during training to learn viewpoint equivariance by enforcing multi-view consistency. The multi-view geometry injected at the input level as positional encodings and regularized at the loss level provides rich geometric cues for 3D object detection, leading to state-of-the-art performance on the nuScenes benchmark. The code and model are made available at https://github.com/TRI-ML/VEDet.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2303.14548")
get_code_for_paper("2303.14548")
have("2303.14548")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2303.14548.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2303.14548)
Connect an agent — have() is free.