paper
arXiv cs.CL
November 2nd, 2026 at 5:00 AM

From Association to Causation: Improving Retrieval Precision of Retrieval-Augmented Generation via Causal Relations and an Attention Mechanism

arXiv:2608.21702v2 Announce Type: replace-cross Abstract: Retrieval-Augmented Generation (RAG) grounds LLM generation on retrieved documents, but the standard terminal retrieval stage--dense-vector similarity, optionally followed by reranking--often returns documents that share keywords with the query without containing the needed information, a failure mode that grows with the knowledge base. We trace it to a conceptual gap: similarity captures only associational relations, whereas the documents that matter are linked to the query causally. We model the terminal retrieval stage with a causal graph grounded in Reichenbach's common cause principle: the keywords shared by the query and a retrieved document form a latent common cause A, and the document's residual keywords form a latent set B linking the document to the ideal output. Since a retrieved document is a collider (A -> d = 95% reliability. A fully local testbed demonstrates deployability.

#ai
#llm

Get stories like this every Monday

The week's most important AI news in one email. Free, unsubscribe anytime.

Score: 2.75

Engagement proxy: 0

Canonical link: https://arxiv.org/abs/2608.21702