papersSEP 10 04:00 UTC
Study Measures RAG Robustness Against Document Poisoning Attacks
A new arXiv paper examines a security weakness in retrieval-augmented generation: adversaries can inject a small number of crafted documents into the corpus a system retrieves from. The authors quantify how reliably such tampering causes a language model to repeat false statements drawn from the poisoned sources. The work underscores that grounding model outputs in retrieved text does not by itself guard against planted misinformation.