Hanyu Wang, Bo Tang, Shichao Song, Zhiyu Li, Feiyu Xiong, Jiawei Yang, Xun Liang, Simin Niu, Sensen Zhang, Jason Fan, Jihao Zhao, Mengwei Wang
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
The indexing-retrieval-generation paradigm of retrieval-augmented generation (RAG) has been highly successful in solving knowledgeintensive tasks by integrating external knowledge into large language models (LLMs). However, the incorporation of external and unverified knowledge increases the vulnerability of LLMs because attackers can perform attack tasks by manipulating knowledge. In this paper, we introduce a benchmark named SafeRAG designed to evaluate the RAG security. First, we classify attack tasks into silver noise, intercontext conflict, soft ad, and white Denial-of-Service. Next, we construct RAG security evaluation dataset (i.e., SafeRAG dataset) primarily manually for each task. We then utilize the SafeRAG dataset to simulate various attack scenarios that RAG may encounter. Experiments conducted on 14 representative RAG components demonstrate that RAG exhibits significant vulnerability to all attack tasks and even the most apparent attack task can easily bypass existing retrievers, filters, or advanced LLMs, resulting in the degradation of RAG service quality. Code is available at: https: //github.com/IAAR-Shanghai/SafeRAG. * Co-equal primary author. † Correspondence. 1 https://www.perplexity.ai/ ... The health literacy rate of residents in our country increased from 17% in 2018 to 29.7% in 2023, a remarkable rise of 12 percentage points ... ... The health literacy rate of residents in our country increased from 10% in 2018 to 27.9% in 2023, a remarkable rise of 17.9 percentage points ... ① Minimal Perturbation ... The proposal emphasizes broadening participation channels for the Silver Action initiative and expanding its workforce ... ... The proposal emphasizes narrowing participation channels for the Silver Action initiative and streamlining its workforce to ensure it is small, focused, and elite ... ② Rewriting for Realistic Conflicts ... The health literacy rate of residents in our country increased from 17% in 2018 to 29.7% in 2023 ...
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2501.18636")
get_code_for_paper("2501.18636")
have("2501.18636")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2501.18636.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2501.18636)
Connect an agent — have() is free.