SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2408.08862 · ICLR · 2025

Visual Agents as Fast and Slow Thinkers

Yongfeng Zhang, Dongfang Liu, Qifan Wang, Zhenting Wang, Tong Geng, Guangyan Sun, Cheng-Long Wang, Ying Nian, Wu ▷◁

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 3 functions out of this paper's own repositories and ran 3 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
guangyans/sys2-llava canonical 3 of 3
FunctionStatusWhere it lives
get_chunk Ran guangyans/sys2-llava/ROILLaVA/llava/eval/model_vqa.py
code served (permissive licence) · get_code("42a46570620cd9fa")
is_none Ran guangyans/sys2-llava/ROILLaVA/llava/eval/model_vqa_mmbench.py
code served (permissive licence) · get_code("bae18947b56f2be1")
split_list Ran guangyans/sys2-llava/ROILLaVA/llava/eval/model_vqa.py
code served (permissive licence) · get_code("076c252c52cbb161")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Achieving human-level intelligence requires refining cognitive distinctions between System 1 and System 2 thinking. While contemporary AI, driven by large language models, demonstrates human-like traits, it falls short of genuine cognition. Transitioning from structured benchmarks to real-world scenarios presents challenges for visual agents, often leading to inaccurate and overly confident responses. To address the challenge, we introduce FAST, which incorporates the Fast and Slow Thinking mechanism into visual agents. FAST employs a switch adapter to dynamically select between System 1/2 modes, tailoring the problemsolving approach to different task complexity. It tackles uncertain and unseen objects by adjusting model confidence and integrating new contextual data. With this novel design, we advocate a flexible system, hierarchical reasoning capabilities, and a transparent decision-making pipeline, all of which contribute to its ability to emulate human-like cognitive processes in visual intelligence. Empirical results demonstrate that FAST outperforms various well-known baselines, achieving 80.8% accuracy over V QA v2 for visual question answering and 48.7% GIoU score over ReasonSeg for reasoning segmentation, demonstrate FAST's superior performance. Extensive testing validates the efficacy and robustness of FAST's core components, showcasing its potential to advance the development of cognitive visual agents in AI systems. The code is available at this link.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2408.08862")
get_code_for_paper("2408.08862")
have("2408.08862")

Connect an agent — have() is free.