RECAP

Zenodo (CERN European Organization for Nuclear Research)

Abstract

An automated pipeline for evaluating the reproducibility of academic papers using LLM-based analysis. This tool analyzes research papers against a comprehensive reproducibility checklist, examining methodology documentation, experimental setup, result reporting, and artifact availability. Please, download the zip file and unzip it. Specifications on the content and on how to run the code are reported in the associated README.md file. This version of RECAP has been used in the following paper: Assessing Reproducibility in Evolutionary Computation: A Case Study using Human- and LLM-based Assessment, Da Ros, Začiragić, Plaat, Bäck, and van Stein, accepted at GECCO 2026.

Authors 5

1. Tarik Začiragić Aachen

   Leiden University

   Affiliation as printed

   Leiden University

2. Francesca Da Ros

   University of Udine

   Affiliation as printed

   University of Udine

3. Aske Plaat Aachen

   Leiden University

   Affiliation as printed

   Leiden University

4. Thomas Bäck Aachen

   Leiden University

   Affiliation as printed

   Leiden University

5. Bas van Stein Aachen

   Leiden University

   Affiliation as printed

   Leiden University