Joshua Tenenbaum, Jiajun Wu, Daniel Yamins, Daniel Bear, Honglin Chen, Rahul Venkatesh, Yoni Friedman
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. If it links a repository, it is listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Self-supervised, category-agnostic segmentation of real-world images is a challenging open problem in computer vision. Here, we show how to learn static grouping priors from motion self-supervision by building on the cognitive science concept of a Spelke Object: a set of physical stu↵ that moves together. We introduce the Excitatory-Inhibitory Segment Extraction Network (EISEN), which learns to extract pairwise a nity graphs for static scenes from motion-based training signals. EISEN then produces segments from a nities using a novel graph propagation and competition network. During training, objects that undergo correlated motion (such as robot arms and the objects they move) are decoupled by a bootstrapping process: EISEN explains away the motion of objects it has already learned to segment. We show that EISEN achieves a substantial improvement in the state of the art for self-supervised image segmentation on challenging synthetic and real-world robotics datasets.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2205.08515")
get_code_for_paper("2205.08515")
have("2205.08515")
Connect an agent — have() is free.