Cost-Aware Query Routing in RAG: Empirical Analysis of Retrieval Depth Tradeoffs 事件

Cost-Aware Query Routing in RAG: Empirical Analysis of Retrieval Depth Tradeoffs arXiv:2606.02581v1 Announce Type: cross Abstract: Retrieval-augmented generation (RAG) faces a fundamental three-way tension: deeper retrieval improves factual grounding but inflates token costs and end-to-end latency. Static retrieval configurations cannot resolve this tension across heterogeneous query workloads -- simple definitional queries waste budget on unnecessary context, while complex analytical prompts a