SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2501.07572 · ACL · 2025

WebWalker: Benchmarking LLMs in Web Traversal

Yong Jiang, Pengjun Xie, Fei Huang, Jialong Wu, Yulan He, Runnan Fang, Zekun Xi, Wenbiao Yin, Linhai Zhang, Deyu Zhou, Zhenglin Wang

arXiv · PDF · Open in the Atlas

Code that ran

We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Retrieval-augmented generation (RAG) demonstrates remarkable performance across tasks in open-domain question-answering. However, traditional search engines may retrieve shallow content, limiting the ability of LLMs to handle complex, multi-layered information. To address it, we introduce WebWalkerQA, a benchmark designed to assess the ability of LLMs to perform web traversal. It evaluates the capacity of LLMs to traverse a website's subpages to extract high-quality data systematically. We propose WebWalker, which is a multi-agent framework that mimics humanlike web navigation through an explore-critic paradigm. Extensive experimental results show that WebWalkerQA is challenging and demonstrates the effectiveness of RAG combined with WebWalker, through the horizontal and vertical integration in real-world scenarios. 1

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2501.07572")
get_code_for_paper("2501.07572")
have("2501.07572")

The run record, dated, one paper per request, free:

curl https://syntology.ai/api/ran/2501.07572.json

A badge for a README (the split and the date, never a ratio):

[![Syntology run record](https://syntology.ai/api/ran/2501.07572.svg)](https://syntology.ai/paper/2501.07572)

Connect an agent — have() is free.