Geometric Deep Learning Methods for Improved Generalizability in Medical Computer Vision: Hyperbolic Convolutional Neural Networks in Multi-Modality Neuroimaging

medRxiv

Abstract

Abstract Objective This study investigates the potential advantages of hyperbolic convolutional neural networks (HCNNs) over traditional convolutional neural networks (CNNs) in neuroimaging tasks. Materials and Methods We conducted a comparative analysis of HCNNs and CNNs across various medical imaging modalities and diseases, with a focus on a compiled multi-modality neuroimaging dataset. The models were assessed for performance parity, robustness to adversarial attacks, semantic organization of embedding spaces, and generalizability. Zero-shot evaluations were also performed with ischemic stroke non-contrast CT images. Results HCNNs matched CNN performance on less complex settings and demonstrated superior semantic organization, and robustness to adversarial attacks. While HCNNs equaled CNNs in out-of-sample datasets identifying Alzheimer’s disease, in zero-shot evaluations, HCNNs outperformed CNNs and radiologists. Discussion HCNNs deliver enhanced robustness and organization in the neuroimaging data. This likely underlies why while HCNNs perform similarly to CNNs with respect to in-sample tasks, they confer improved generalizability. Nevertheless, HCNNs encounter efficiency and performance challenges with larger, complex datasets. These limitations underline the need for further optimization of HCNN architectures. Conclusion HCNNs present promising improvements in generalizability and resilience for medical imaging applications, particularly in neuroimaging. Despite challenges with larger datasets, HCNNs enhance performance under adversarial conditions and offer better semantic organization, suggesting valuable potential in generalizable deep learning models in medical imaging and neuroimaging diagnostics.

Authors 10

1. Cyrus Ayubcha

   Brigham and Women's Hospital · Harvard University

   Affiliation as printed

   Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, MA, United States

   Department of Neurosurgery, Cushing Neurosurgical Outcomes Center, Brigham and Women’s Hospital, Harvard Medical School, Boston, MA, United States

   Harvard Medical School, Boston, MA, United States

   Department of Epidemiology, Harvard T.H. Chan School of Public Health

   Department of Neurosurgery, Cushing Neurosurgical Outcomes Center, Brigham and Women's Hospital

   Harvard Medical School

2. Sulaiman Sajed

   Boston University · Brigham and Women's Hospital · Harvard University

   Affiliation as printed

   Department of Medical Science, Boston University, Boston, USA

   Department of Neurosurgery, Cushing Neurosurgical Outcomes Center, Brigham and Women’s Hospital, Harvard Medical School, Boston, MA, United States

   Department of Neurosurgery, Cushing Neurosurgical Outcomes Center, Brigham and Women's Hospital

3. Chady Omara Aachen Department of Neurosurgery, Leiden University Medical Center

   Brigham and Women's Hospital · Harvard University · Leiden University Medical Center

   Affiliation as printed

   Department of Neurosurgery, Cushing Neurosurgical Outcomes Center, Brigham and Women’s Hospital, Harvard Medical School, Boston, MA, United States

   Department of Neurosurgery, Leiden University Medical Center, Leiden, the Netherlands

   Department of Neurosurgery, Cushing Neurosurgical Outcomes Center, Brigham and Women's Hospital

   Department of Neurosurgery, Leiden University Medical Center

4. Anna B. Veldman Aachen Department of Neurosurgery, Leiden University Medical Center

   Brigham and Women's Hospital · Harvard University · Leiden University Medical Center

   Affiliation as printed

   Department of Neurosurgery, Cushing Neurosurgical Outcomes Center, Brigham and Women’s Hospital, Harvard Medical School, Boston, MA, United States

   Department of Neurosurgery, Leiden University Medical Center, Leiden, the Netherlands

5. Shashi B. Singh

   Stanford Medicine · Stanford University

   Affiliation as printed

   Stanford University School of Medicine, Stanford, CA, 94305

   Stanford University School of Medicine

6. Yashas Ullas Lokesha

   Sri Devaraj Urs Medical College

   Affiliation as printed

   Department of Radiology, Sri Devaraj Urs Medical College, Karnataka, India

   Department of Radiology, Sri Devaraj Urs Medical College

7. Alex X. Liu

   Temple University

   Affiliation as printed

   Department of Computer and Information Sciences, Temple University, Philadelphia, PA, USA

   Department of Computer and Information Sciences, Temple University

8. Mohammad Ali Aziz‐Sultan

   Brigham and Women's Hospital · Harvard University

   Affiliation as printed

   Department of Neurosurgery, Cushing Neurosurgical Outcomes Center, Brigham and Women’s Hospital, Harvard Medical School, Boston, MA, United States

   Department of Neurosurgery, Cushing Neurosurgical Outcomes Center, Brigham and Women's Hospital

9. Timothy R. Smith

   Brigham and Women's Hospital · Harvard University

   Affiliation as printed

   Department of Neurosurgery, Cushing Neurosurgical Outcomes Center, Brigham and Women’s Hospital, Harvard Medical School, Boston, MA, United States

   Department of Neurosurgery, Cushing Neurosurgical Outcomes Center, Brigham and Women's Hospital

10. Andrew L. Beam corresponding

    Harvard University

    Affiliation as printed

    Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, MA, United States

    Department of Epidemiology, Harvard T.H. Chan School of Public Health