Generative Retrieval with Few-shot Indexing

arXiv (Cornell University)

Abstract

Existing generative retrieval (GR) methods rely on training-based indexing, which fine-tunes a model to memorise associations between queries and the document identifiers (docids) of relevant documents. Training-based indexing suffers from high training costs, under-utilisation of pre-trained knowledge in large language models (LLMs), and limited adaptability to dynamic document corpora. To address the issues, we propose a few-shot indexing-based GR framework (Few-Shot GR). It has a few-shot indexing process without any training, where we prompt an LLM to generate docids for all documents in a corpus, ultimately creating a docid bank for the entire corpus. During retrieval, we feed a query to the same LLM and constrain it to generate a docid within the docid bank created during indexing, and then map the generated docid back to its corresponding document. Moreover, we devise few-shot indexing with one-to-many mapping to further enhance Few-Shot GR. Experiments show that Few-Shot GR achieves superior performance to state-of-the-art GR methods requiring heavy training.

Authors 6

1. Arian Askari Aachen

   Leiden University

   Affiliation as printed

   Leiden University , Leiden , The Netherlands

2. Chuan Meng
3. Mohammad Aliannejadi

   University of Amsterdam

   Affiliation as printed

   University of Amsterdam , Amsterdam , The Netherlands

4. Zhaochun Ren Aachen

   Leiden University

   Affiliation as printed

   Leiden University , Leiden , The Netherlands

5. Evangelos Kanoulas

   University of Amsterdam

   Affiliation as printed

   University of Amsterdam , Amsterdam , The Netherlands

6. Suzan Verberne Aachen

   Leiden University

   Affiliation as printed

   Leiden University , Leiden , The Netherlands