TY - JOUR
T1 - Implementation of delineation error detection systems in time-critical radiotherapy
T2 - Do AI-supported optimization and human preferences meet?
AU - Chaves-de-Plaza, Nicolas F.
AU - Mody, Prerak
AU - Hildebrandt, Klaus
AU - Staring, Marius
AU - Astreinidou, Eleftheria
AU - de Ridder, Mischa
AU - de Ridder, Huib
AU - Vilanova, Anna
AU - van Egmond, René
PY - 2024
Y1 - 2024
N2 - Artificial Intelligence (AI)-based auto-delineation technologies rapidly delineate multiple structures of interest like organs-at-risk and tumors in 3D medical images, reducing personnel load and facilitating time-critical therapies. Despite its accuracy, the AI may produce flawed delineations, requiring clinician attention. Quality assessment (QA) of these delineations is laborious and demanding. Delineation error detection systems (DEDS) aim to aid QA, yet questions linger about potential challenges to their adoption and time-saving potential. To address these queries, we first conducted a user study with two clinicians from Holland Proton Therapy Center, a Dutch cancer treatment center. Based on the study’s findings about the clinicians’ error detection workflows with and without DEDS assistance, we developed a simulation model of the QA process, which we used to assess different error detection workflows on a retrospective cohort of 42 head and neck cancer patients. Results suggest possible time savings, provided the per-slice analysis time stays close to the current baseline and trading-off delineation quality is acceptable. Our findings encourage the development of user-centric delineation error detection systems and provide a new way to model and evaluate these systems’ potential clinical value.
AB - Artificial Intelligence (AI)-based auto-delineation technologies rapidly delineate multiple structures of interest like organs-at-risk and tumors in 3D medical images, reducing personnel load and facilitating time-critical therapies. Despite its accuracy, the AI may produce flawed delineations, requiring clinician attention. Quality assessment (QA) of these delineations is laborious and demanding. Delineation error detection systems (DEDS) aim to aid QA, yet questions linger about potential challenges to their adoption and time-saving potential. To address these queries, we first conducted a user study with two clinicians from Holland Proton Therapy Center, a Dutch cancer treatment center. Based on the study’s findings about the clinicians’ error detection workflows with and without DEDS assistance, we developed a simulation model of the QA process, which we used to assess different error detection workflows on a retrospective cohort of 42 head and neck cancer patients. Results suggest possible time savings, provided the per-slice analysis time stays close to the current baseline and trading-off delineation quality is acceptable. Our findings encourage the development of user-centric delineation error detection systems and provide a new way to model and evaluate these systems’ potential clinical value.
KW - Auto-delineation
KW - Information integration
KW - Process optimization
KW - Quality assessment
KW - Radiotherapy center
KW - Time pressure
UR - http://www.scopus.com/inward/record.url?scp=85210377513&partnerID=8YFLogxK
U2 - 10.1007/s10111-024-00784-4
DO - 10.1007/s10111-024-00784-4
M3 - Article
AN - SCOPUS:85210377513
SN - 1435-5558
JO - Cognition, Technology and Work
JF - Cognition, Technology and Work
ER -