Deep learning in rheumatological image interpretation

Nature Reviews Rheumatology, vol. 20, pp. 182–195

Abstract

Artificial intelligence techniques, specifically deep learning, have already affected daily life in a wide range of areas. Likewise, initial applications have been explored in rheumatology. Deep learning might not easily surpass the accuracy of classic techniques when performing classification or regression on low-dimensional numerical data. With images as input, however, deep learning has become so successful that it has already outperformed the majority of conventional image-processing techniques developed during the past 50 years. As with any new imaging technology, rheumatologists and radiologists need to consider adapting their arsenal of diagnostic, prognostic and monitoring tools, and even their clinical role and collaborations. This adaptation requires a basic understanding of the technical background of deep learning, to efficiently utilize its benefits but also to recognize its drawbacks and pitfalls, as blindly relying on deep learning might be at odds with its capabilities. To facilitate such an understanding, it is necessary to provide an overview of deep-learning techniques for automatic image analysis in detecting, quantifying, predicting and monitoring rheumatic diseases, and of currently published deep-learning applications in radiological imaging for rheumatology, with critical assessment of possible limitations, errors and confounders, and conceivable consequences for rheumatologists and radiologists in clinical practice. Deep learning is a powerful technique with great potential for the analysis and interpretation of rheumatological images. To successfully use deep learning, rheumatologists should understand the tasks involved in image processing and the potential confounders and limitations that can affect the analysis of clinical data.

Authors 4

1. Berend C. Stoel corresponding Aachen Division of Image Processing (LKEB) Department of Radiology, Leiden University Medical Center

   Leiden University Medical Center

   Affiliation as printed

   Division of Image Processing, Department of Radiology, Leiden University Medical Center, Leiden, the Netherlands. b.c.stoel@lumc.nl

   Division of Image Processing, Department of Radiology, Leiden University Medical Center, Leiden, the Netherlands

2. Marius Staring Aachen Division of Image Processing (LKEB) Department of Radiology, Leiden University Medical Center

   Leiden University Medical Center

   Affiliation as printed

   Division of Image Processing, Department of Radiology, Leiden University Medical Center, Leiden, the Netherlands

3. M. Reijnierse Aachen Department of Radiology, Leiden University Medical Center

   Leiden University Medical Center

   Affiliation as printed

   Department of Radiology, Leiden University Medical Center, Leiden, the Netherlands

4. Annette H M van der Helm–van Mil Aachen Department of Rheumatology, Leiden University Medical Center

   Leiden University Medical Center

   Affiliation as printed

   Department of Rheumatology, Leiden University Medical Center, Leiden, the Netherlands