We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Material recognition can help inform robots about how to properly interact with and manipulate real-world objects. In this paper, we present a multimodal sensing technique, leveraging near-infrared spectroscopy and close-range high resolution texture imaging, that enables robots to estimate the materials of household objects. We release a dataset of high resolution texture images and spectral measurements collected from a mobile manipulator that interacted with 144 household objects. We then present a neural network architecture that learns a compact multimodal representation of spectral measurements and texture images. When generalizing material classification to new objects, we show that this multimodal representation enables a robot to recognize materials with greater performance as compared to prior state-of-the-art approaches. Finally, we present how a robot can combine this high resolution local sensing with images from the robot's head-mounted camera to achieve accurate material classification over a scene of objects on a table.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2004.01160")
get_code_for_paper("2004.01160")
have("2004.01160")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2004.01160.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2004.01160)
Connect an agent — have() is free.