Zhongyu Wei, Xuanjing Huang, Zejun Li, Binhao Wu, Mengfei Du
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
The recent rapid development of Large Vision-Language Models (LVLMs) has indicated their potential for embodied tasks. However, the critical skill of spatial understanding in embodied environments has not been thoroughly evaluated, leaving the gap between current LVLMs and qualified embodied intelligence unknown. Therefore, we construct EmbSpatial-Bench, a benchmark for evaluating embodied spatial understanding of LVLMs. The benchmark is automatically derived from embodied scenes and covers 6 spatial relationships from an egocentric perspective. Experiments expose the insufficient capacity of current LVLMs (even GPT-4V). We further present EmbSpatial-SFT, an instruction-tuning dataset designed to improve LVLMs' embodied spatial understanding.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2406.05756")
get_code_for_paper("2406.05756")
have("2406.05756")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2406.05756.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2406.05756)
Connect an agent — have() is free.