Towards fully automated Inner Ear Analysis: Deep-Learning-based Joint Segmentation and Landmark Detection Framework

Research Square

Abstract

Abstract Automated analysis of the inner ear anatomy in radiological data instead of time-consuming manual assessment is a worthwhile goal that could facilitate preoperative planning and clinical research. We propose a framework encompassing joint semantic segmentation and anatomical landmark detection. A fully automated pipeline with a single, dual-headed volumetric 3D U-Net was implemented, trained and evaluated using manually labeled in-house datasets from cadaveric specimen (N = 44) and clinical practice (N = 10). The model robustness was further evaluated on two independent open-source datasets (N = 23 + 7 scans). For the in-house datasets, Dice scores of 0.965 and 0.9505, intersection-over-union scores of 0.934 and 0.906 and average Hausdorff distances of 0.085 and 0.096 voxel units were achieved. The landmark localization task was performed automatically with an average localization error of 5.36 and 5.77 voxel units. A robust, but reduced performance could be attained for the two open-source datasets. The feasibility of the suggested integrated segmentation and landmark detection framework was experimentally evident by achieving competitive, efficient and consistent performance across a multitude of realistic, clinically relevant datasets and evaluation metrics. Based on these results, the applications in clinical practice and research beyond the data selection utilized in this study can be accomplishable.

Authors 6

1. Jannik Stebani

   Fraunhofer Institute for Integrated Circuits

   Affiliation as printed

   Fraunhofer IIS, Magnetic Resonance and X-Ray Imaging Department

2. Martin Blaimer

   Fraunhofer Institute for Integrated Circuits

   Affiliation as printed

   Fraunhofer IIS, Magnetic Resonance and X-Ray Imaging Department

3. Simon Zabler

   Fraunhofer Institute for Integrated Circuits

   Affiliation as printed

   Fraunhofer IIS, Magnetic Resonance and X-Ray Imaging Department

4. Tilmann Neun

   University of Würzburg · Universitätsklinikum Würzburg

   Affiliation as printed

   Universitätsklinikum Würzburg, Institute for Diagnostic and Interventional Neuroradiology

5. Daniël M. Pelt Aachen Leiden Institute of Advanced Computer Science

   Leiden University

   Affiliation as printed

   Universiteit Leiden, Leiden Institute of Advanced Computer Science (LIACS)

   Universiteit Leiden, Leiden Institute of Advanced Computer Science (LIACS), 2333 CA Leiden, The Netherlands

6. Kristen Rak

   Universitätsklinikum Würzburg

   Affiliation as printed

   Universitätsklinikum Würzburg, Department of Oto-Rhino-Laryngology, Plastic, Aesthetic and Reconstructive Head and Neck Surgery and the Comprehensive Hearing Center