Artificial intelligence-assisted spatial correction of augmented reality projections; implementing radiation mapping during radioguided robotic surgery
npj Digital Surgery, vol. 1, pp. 26
Abstract
Abstract Translation of the drop-in gamma probe transformed radioguided robot-assisted prostate cancer (PCa) surgery. This study evaluated whether digitization of radiometric signals could allow conversion into more easier to interpret Augmented Reality radiation mapping (AR RM ) displays. 20 PCa patients were included who underwent robot-assisted sentinel node (SN)- and prostate-specific membrane antigen (PSMA) radioguided resections (24 SNs, 16 PSMA-avid nodes and 1 PSMA-avid primary tumor). Radiometric probe counts/s (dimensionless) synchronized with positional probe data allowed the retrospective creation of dynamic AR RM overlays in two dimensions. Artificial intelligence was used to segment out, and automatically track, surgical instruments and dynamically de-occlude the AR RM displays accordingly. Retrospective scoring by end-users indicated a 72.5% preference for the AR RM displays compared to the currently available radiometric display (bipolar scale; median ≥2; p < 0.001). Thus, indicating that video-feed embedded AR RM visualizations provide a digital means to further advance the surgeon’s perception of intraoperative molecular imaging.
Authors 13
-
Déan van Tuil Aachen Interventional Molecular Imaging Laboratory Department of Neurosurgery, Leiden University Medical Center
Leiden University Medical Center · Netherlands Cancer Institute-Antoni van Leeuwenhoek Hospital
Affiliation as printed
Department of Urology, Netherlands Cancer Institute, Antoni van Leeuwenhoek Ziekenhuis, Amsterdam, the Netherlands
Interventional Molecular Imaging Laboratory, Department of Neurosurgery, Leiden University Medical Center, Leiden, the Netherlands
-
Vera A. Ottens Aachen Interventional Molecular Imaging Laboratory Department of Neurosurgery, Leiden University Medical Center
Leiden University Medical Center · Netherlands Cancer Institute-Antoni van Leeuwenhoek Hospital
Affiliation as printed
Department of Urology, Netherlands Cancer Institute, Antoni van Leeuwenhoek Ziekenhuis, Amsterdam, the Netherlands
Interventional Molecular Imaging Laboratory, Department of Neurosurgery, Leiden University Medical Center, Leiden, the Netherlands
-
Kateryna Pirkovets Aachen Interventional Molecular Imaging Laboratory Department of Neurosurgery, Leiden University Medical Center
Leiden University Medical Center · Netherlands Cancer Institute-Antoni van Leeuwenhoek Hospital
Affiliation as printed
Department of Urology, Netherlands Cancer Institute, Antoni van Leeuwenhoek Ziekenhuis, Amsterdam, the Netherlands
Interventional Molecular Imaging Laboratory, Department of Neurosurgery, Leiden University Medical Center, Leiden, the Netherlands
-
Berkay Alp Çakal Aachen Interventional Molecular Imaging Laboratory Department of Neurosurgery, Leiden University Medical Center
Leiden University Medical Center
Affiliation as printed
Crystal Photonics GmbH, Berlin, Germany
Interventional Molecular Imaging Laboratory, Department of Neurosurgery, Leiden University Medical Center, Leiden, the Netherlands
-
Giusi Pisano Aachen Interventional Molecular Imaging Laboratory Department of Neurosurgery, Leiden University Medical Center
Leiden University Medical Center · Agostino Gemelli University Polyclinic
Affiliation as printed
Interventional Molecular Imaging Laboratory, Department of Neurosurgery, Leiden University Medical Center, Leiden, the Netherlands
Nuclear Medicine Unit, Fondazione Policlinico Universitario A. Gemelli IRCCS, Rome, Italy
-
Affiliation as printed
Department of Urology, St. Antonius hospital, Nieuwegein, the Netherlands
-
Daphne D. D. Rietbergen Aachen Department of Radiology, Leiden University Medical Center Interventional Molecular Imaging Laboratory Department of Neurosurgery, Leiden University Medical Center
Leiden University Medical Center
Affiliation as printed
Department of Radiology, Leiden University Medical Center, Leiden, the Netherlands
Interventional Molecular Imaging Laboratory, Department of Neurosurgery, Leiden University Medical Center, Leiden, the Netherlands
-
Paolo Dell’Oglio Aachen Interventional Molecular Imaging Laboratory Department of Neurosurgery, Leiden University Medical Center
Leiden University Medical Center · Azienda Socio Sanitaria Territoriale Grande Ospedale Metropolitano Niguarda
Affiliation as printed
Department of Urology, ASST Grande Ospedale Metropolitano Niguarda, Milan, Italy
Interventional Molecular Imaging Laboratory, Department of Neurosurgery, Leiden University Medical Center, Leiden, the Netherlands
-
Elio Mazzone Aachen Interventional Molecular Imaging Laboratory Department of Neurosurgery, Leiden University Medical Center
Leiden University Medical Center · Azienda Socio Sanitaria Territoriale Grande Ospedale Metropolitano Niguarda
Affiliation as printed
Department of Urology, ASST Grande Ospedale Metropolitano Niguarda, Milan, Italy
Interventional Molecular Imaging Laboratory, Department of Neurosurgery, Leiden University Medical Center, Leiden, the Netherlands
-
Pim J. van Leeuwen corresponding
Netherlands Cancer Institute-Antoni van Leeuwenhoek Hospital
Affiliation as printed
Department of Urology, Netherlands Cancer Institute, Antoni van Leeuwenhoek Ziekenhuis, Amsterdam, the Netherlands
-
Netherlands Cancer Institute-Antoni van Leeuwenhoek Hospital · Amsterdam University Medical Centers
Affiliation as printed
Department of Urology, Amsterdam University Medical Centers, Amsterdam, the Netherlands
Department of Urology, Netherlands Cancer Institute, Antoni van Leeuwenhoek Ziekenhuis, Amsterdam, the Netherlands
-
Matthias N. van Oosterom Aachen Interventional Molecular Imaging Laboratory Department of Neurosurgery, Leiden University Medical Center
Leiden University Medical Center · Netherlands Cancer Institute-Antoni van Leeuwenhoek Hospital
Affiliation as printed
Department of Urology, Netherlands Cancer Institute, Antoni van Leeuwenhoek Ziekenhuis, Amsterdam, the Netherlands
Interventional Molecular Imaging Laboratory, Department of Neurosurgery, Leiden University Medical Center, Leiden, the Netherlands
-
Fijs W. B. van Leeuwen corresponding Aachen Interventional Molecular Imaging Laboratory Department of Neurosurgery, Leiden University Medical Center
Leiden University Medical Center · Netherlands Cancer Institute-Antoni van Leeuwenhoek Hospital
Affiliation as printed
Department of Urology, Netherlands Cancer Institute, Antoni van Leeuwenhoek Ziekenhuis, Amsterdam, the Netherlands
Interventional Molecular Imaging Laboratory, Department of Neurosurgery, Leiden University Medical Center, Leiden, the Netherlands