UPDF AI

Overview of the TREC 2025 Retrieval Augmented Generation (RAG) Track

Shivani Upadhyay,Nandan Thakur,3 Authors,Jimmy Lin

2026 · DOI: 10.48550/arXiv.2603.09891
arXiv.org · 3 Citations

TLDR

This year's TREC 2025 RAG Track introduces long, multi-sentence narrative queries to better reflect the deep search task with the growing demand for reasoning-driven responses.

Abstract

The second edition of the TREC Retrieval Augmented Generation (RAG) Track advances research on systems that integrate retrieval and generation to address complex, real-world information needs. Building on the foundation of the inaugural 2024 track, this year's challenge introduces long, multi-sentence narrative queries to better reflect the deep search task with the growing demand for reasoning-driven responses. Participants are tasked with designing pipelines that combine retrieval and generation while ensuring transparency and factual grounding. The track leverages the MS MARCO V2.1 corpus and employs a multi-layered evaluation framework encompassing relevance assessment, response completeness, attribution verification, and agreement analysis. By emphasizing multi-faceted narratives and attribution-rich answers from over 150 submissions this year, the TREC 2025 RAG Track aims to foster innovation in creating trustworthy, context-aware systems for retrieval augmented generation.