SPECTRA: Synthetic IR Test Collections with Relevance Oracles and Controlled Distractor Diagnostics 事件
PRODUCT_LAUNCH2026-06-01影响: MEDIUM
SPECTRA: Synthetic IR Test Collections with Relevance Oracles and Controlled Distractor Diagnostics arXiv:2605.31575v1 Announce Type: cross Abstract: Scalable information retrieval testing needs corpora that are large enough to stress index construction, ranking latency, query routing, and evaluation tooling, yet human-judged test collections remain expensive and may be unavailable when documents are private or still under design. This paper introduces SPECTRA, a reproducible framework for gene