Implementation of delineation error detection systems in time-critical radiotherapy: Do AI-supported optimization and human preferences meet?
Cognition Technology & Work, vol. 27, pp. 41–57
Abstract
Artificial Intelligence (AI)-based auto-delineation technologies rapidly delineate multiple structures of interest like organs-at-risk and tumors in 3D medical images, reducing personnel load and facilitating time-critical therapies. Despite its accuracy, the AI may produce flawed delineations, requiring clinician attention. Quality assessment (QA) of these delineations is laborious and demanding. Delineation error detection systems (DEDS) aim to aid QA, yet questions linger about potential challenges to their adoption and time-saving potential. To address these queries, we first conducted a user study with two clinicians from Holland Proton Therapy Center, a Dutch cancer treatment center. Based on the study’s findings about the clinicians’ error detection workflows with and without DEDS assistance, we developed a simulation model of the QA process, which we used to assess different error detection workflows on a retrospective cohort of 42 head and neck cancer patients. Results suggest possible time savings, provided the per-slice analysis time stays close to the current baseline and trading-off delineation quality is acceptable. Our findings encourage the development of user-centric delineation error detection systems and provide a new way to model and evaluate these systems’ potential clinical value.
Authors 9
-
Nicolas F. Chaves-de-Plaza corresponding
Holland Particle Therapy Center · Delft University of Technology
Affiliation as printed
Computer Graphics and Visualization Lab, TU Delft, Delft, The Netherlands
HollandPTC, Delft, The Netherlands
-
Leiden University Medical Center · Holland Particle Therapy Center
Affiliation as printed
Department of Radiology, Leiden University Medical Center, Leiden, The Netherlands
HollandPTC, Delft, The Netherlands
-
Delft University of Technology
Affiliation as printed
Computer Graphics and Visualization Lab, TU Delft, Delft, The Netherlands
-
Marius Staring Aachen Department of Radiation Oncology Department of Radiology, Leiden University Medical Center
Leiden University Medical Center
Affiliation as printed
Department of Radiation Oncology, Leiden University Medical Center, Leiden, The Netherlands
Department of Radiology, Leiden University Medical Center, Leiden, The Netherlands
-
Leiden University Medical Center
Affiliation as printed
Department of Radiation Oncology, Leiden University Medical Center, Leiden, The Netherlands
-
University Medical Center Utrecht
Affiliation as printed
Department of Radiotherapy, University Medical Center Utrecht, Utrecht, The Netherlands
-
Delft University of Technology
Affiliation as printed
Industrial Design Engineering, TU Delft, Delft, The Netherlands
-
Eindhoven University of Technology
Affiliation as printed
Department of Mathematics and Computer Science, TU Eindhoven, Eindhoven, The Netherlands
-
Delft University of Technology
Affiliation as printed
Industrial Design Engineering, TU Delft, Delft, The Netherlands
Cited by 1 stored of 1
1 result
No patents citing this paper on Lens.org (checked 2026-10-11).