EC2Seq2Sql: Patient-trial matching with LLM agents

PLoS ONE, vol. 21, pp. e0341827

Abstract

Timely identification of patients who meet clinical trial eligibility criteria is a persistent bottleneck in trial recruitment because the criteria are written in flexible natural language, while hospital EHRs are stored in structured schemas. To bridge this gap, we propose EC2Seq2Sql, an end-to-end, two-stage framework that automatically converts narrative eligibility criteria into executable SQL queries for EHR-based patient screening. In the first stage, a BART-based semantic parser transforms free-text trial criteria into lightweight structured pattern sequences defined over seven common clinical domains. In the second stage, an LLM-based agent, guided by system- and human-designed prompts, grounds these structured patterns to the target database schema and generates syntactically valid and logically coherent SQL statements. We evaluated the framework on the ClinicalTrials.gov eligibility-criteria dataset and further validated it on a de-identified real-world hepatocellular carcinoma EHR cohort from Zhongshan Hospital, Fudan University. The BART parser outperformed representative Seq2Seq baselines, achieving ROUGE_L 0.8067 and BLEU 0.8427, while the SQL generation stage reached an exact-match accuracy of 0.84 and an execution accuracy of 0.91 after SQL normalization. On the real-world cohort, the generated queries achieved a clinical match accuracy of 0.88 after expert review, indicating that the proposed pipeline can retrieve trial-eligible patients from operational EHR data. These results suggest that EC2Seq2Sql can substantially reduce manual screening effort and provide a reproducible path from narrative criteria to database-level cohort identification, although broader multi-center validation and ontology-based normalization will be needed for large-scale deployment.

Authors 7

1. Liu Yang

   Shanghai University of Engineering Science

   Affiliation as printed

   School of Electronic and Electrical Engineering, Shanghai University of Engineering Science, Shanghai, China

2. Yongzhong Han

   Shanghai University of Engineering Science

   Affiliation as printed

   School of Electronic and Electrical Engineering, Shanghai University of Engineering Science, Shanghai, China

3. Liang Liu

   Fudan University · Zhongshan Hospital

   Affiliation as printed

   Clinical Research Unit, Institute of Clinical Science, Zhongshan Hospital, Fudan University, Shanghai, China

4. Xiaoyan Jiang Aachen Leiden Institute of Advanced Computer Science

   Leiden University · Shanghai University of Engineering Science

   Affiliation as printed

   Leiden Institute of Advanced Computer Science, Leiden University, Leiden, Netherlands

   School of Electronic and Electrical Engineering, Shanghai University of Engineering Science, Shanghai, China

5. Ying Li

   Shanghai University of Traditional Chinese Medicine · Longhua Hospital Shanghai University of Traditional Chinese Medicine

   Affiliation as printed

   Department of Hepatology Longhua Hospital, Shanghai University of Traditional Chinese Medicine, Shanghai, China

6. Jihan Huang

   Shanghai University of Traditional Chinese Medicine

   Affiliation as printed

   Center for Drug Clinical Research, Shanghai University of Traditional Chinese Medicine, Shanghai, China

7. Qianmin Su corresponding

   Shanghai University of Engineering Science

   Affiliation as printed

   School of Electronic and Electrical Engineering, Shanghai University of Engineering Science, Shanghai, China