SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2203.09510 · ECCV · 2022

DetMatch: Two Teachers are Better Than One for Joint 2D and 3D Semi-Supervised Object Detection

Masayoshi Tomizuka, Wei Zhan, Yiyang Zhou, Chenfeng Xu, Jinhyung Park

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 3 functions out of this paper's own repositories and ran 3 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
Divadi/DetMatch canonical 3 of 3
FunctionStatusWhere it lives
get_final_epoch Ran Divadi/DetMatch/.dev_scripts/gather_models.py
code served (permissive licence) · get_code("5a5bcd643adcbecc")
get_model_dataset Ran Divadi/DetMatch/.dev_scripts/gather_models.py
code served (permissive licence) · get_code("266b220fd05d5e7f")
process_checkpoint Ran Divadi/DetMatch/.dev_scripts/gather_models.py
code served (permissive licence) · get_code("e76a491553cf9fcf")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

While numerous 3D detection works leverage the complementary relationship between RGB images and point clouds, developments in the broader framework of semi-supervised object recognition remain uninfluenced by multi-modal fusion. Current methods develop independent pipelines for 2D and 3D semi-supervised learning despite the availability of paired image and point cloud frames. Observing that the distinct characteristics of each sensor cause them to be biased towards detecting different objects, we propose DetMatch, a flexible framework for joint semi-supervised learning on 2D and 3D modalities. By identifying objects detected in both sensors, our pipeline generates a cleaner, more robust set of pseudo-labels that both demonstrates stronger performance and stymies single-modality error propagation. Further, we leverage the richer semantics of RGB images to rectify incorrect 3D class predictions and improve localization of 3D boxes. Evaluating our method on the challenging KITTI and Waymo datasets, we improve upon strong semisupervised learning methods and observe higher quality pseudo-labels. Code will be released here: https://github.com/Divadi/DetMatch.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2203.09510")
get_code_for_paper("2203.09510")
have("2203.09510")

Connect an agent — have() is free.