Using histopathology latent diffusion models as privacy-preserving dataset augmenters improves downstream classification performance
Computers in Biology and Medicine, vol. 175, pp. 108410
Abstract
Latent diffusion models (LDMs) have emerged as a state-of-the-art image generation method, outperforming previous Generative Adversarial Networks (GANs) in terms of training stability and image quality. In computational pathology, generative models are valuable for data sharing and data augmentation. However, the impact of LDM-generated images on histopathology tasks compared to traditional GANs has not been systematically studied. We trained three LDMs and a styleGAN2 model on histology tiles from nine colorectal cancer (CRC) tissue classes. The LDMs include 1) a fine-tuned version of stable diffusion v1.4, 2) a Kullback-Leibler (KL)-autoencoder (KLF8-DM), and 3) a vector quantized (VQ)-autoencoder deploying LDM (VQF8-DM). We assessed image quality through expert ratings, dimensional reduction methods, distribution similarity measures, and their impact on training a multiclass tissue classifier. Additionally, we investigated image memorization in the KLF8-DM and styleGAN2 models. All models provided a high image quality, with the KLF8-DM achieving the best Frechet Inception Distance (FID) and expert rating scores for complex tissue classes. For simpler classes, the VQF8-DM and styleGAN2 models performed better. Image memorization was negligible for both styleGAN2 and KLF8-DM models. Classifiers trained on a mix of KLF8-DM generated and real images achieved a 4% improvement in overall classification accuracy, highlighting the usefulness of these images for dataset augmentation. Our systematic study of generative methods showed that KLF8-DM produces the highest quality images with negligible image memorization. The higher classifier performance in the generatively augmented dataset suggests that this augmentation technique can be employed to enhance histopathology classifiers for various tasks.
Authors 12
-
Universitätsklinikum Aachen · RWTH Aachen University
Affiliation as printed
Department of Diagnostic and Interventional Radiology, University Hospital RWTH Aachen, Aachen, Germany
-
The Netherlands Cancer Institute · Else Kröner Fresenius Center for Digital Health · Technische Universität Dresden · University of Amsterdam
Affiliation as printed
Else Kroener Fresenius Center for Digital Health, Technical University Dresden, Dresden, Germany; Netherlands Cancer Institute, 1066 CX, Amsterdam, the Netherlands; University of Amsterdam, 1012 WP, Amsterdam, the Netherlands
Else Kroener Fresenius Center for Digital Health, Technical University Dresden, Dresden, Germany
Netherlands Cancer Institute, 1066 CX, Amsterdam, the Netherlands
University of Amsterdam, 1012 WP, Amsterdam, the Netherlands
-
Helmholtz Munich · Else Kröner Fresenius Center for Digital Health · Technical University of Munich · Technische Universität Dresden
Affiliation as printed
Else Kroener Fresenius Center for Digital Health, Technical University Dresden, Dresden, Germany; Helmholtz Munich - German Research Center for Environment and Health, Munich, Germany; School of Computation, Information and Technology, Technical University of Munich, Munich, Germany
Else Kroener Fresenius Center for Digital Health, Technical University Dresden, Dresden, Germany
Helmholtz Munich – German Research Center for Environment and Health, Munich, Germany
School of Computation, Information and Technology, Technical University of Munich, Munich, Germany
-
University Hospital Heidelberg
Affiliation as printed
Institute of Pathology, University Hospital Heidelberg, Heidelberg, Germany
-
University Hospital Heidelberg
Affiliation as printed
Institute of Pathology, University Hospital Heidelberg, Heidelberg, Germany
-
Affiliation as printed
Department of Medicine, University of Chicago, Chicago, USA
-
Universitätsklinikum Aachen · Else Kröner Fresenius Center for Digital Health · Technische Universität Dresden · RWTH Aachen University
Affiliation as printed
Else Kroener Fresenius Center for Digital Health, Technical University Dresden, Dresden, Germany; Department of Medicine III, University Hospital RWTH Aachen, Aachen, Germany
Department of Medicine III, University Hospital RWTH Aachen, Aachen, Germany
Else Kroener Fresenius Center for Digital Health, Technical University Dresden, Dresden, Germany
-
Universitätsklinikum Aachen · Else Kröner Fresenius Center for Digital Health · Technische Universität Dresden · RWTH Aachen University
Affiliation as printed
Else Kroener Fresenius Center for Digital Health, Technical University Dresden, Dresden, Germany; Department of Medicine III, University Hospital RWTH Aachen, Aachen, Germany
Department of Medicine III, University Hospital RWTH Aachen, Aachen, Germany
Else Kroener Fresenius Center for Digital Health, Technical University Dresden, Dresden, Germany
-
Universitätsklinikum Aachen · Else Kröner Fresenius Center for Digital Health · Technische Universität Dresden · RWTH Aachen University
Affiliation as printed
Else Kroener Fresenius Center for Digital Health, Technical University Dresden, Dresden, Germany; Department of Medicine III, University Hospital RWTH Aachen, Aachen, Germany
Department of Medicine III, University Hospital RWTH Aachen, Aachen, Germany
Else Kroener Fresenius Center for Digital Health, Technical University Dresden, Dresden, Germany
-
Else Kröner Fresenius Center for Digital Health
Affiliation as printed
Else Kroener Fresenius Center for Digital Health, Technical University Dresden, Dresden, Germany
-
Universitätsklinikum Aachen · RWTH Aachen University
Affiliation as printed
Department of Diagnostic and Interventional Radiology, University Hospital RWTH Aachen, Aachen, Germany
-
Jakob Nikolas Kather corresponding
University of Leeds · Heidelberg University · University Hospital Heidelberg · National Center for Tumor Diseases · University Hospital Carl Gustav Carus · Else Kröner Fresenius Center for Digital Health · Technische Universität Dresden
Affiliation as printed
Else Kroener Fresenius Center for Digital Health, Technical University Dresden, Dresden, Germany; Pathology & Data Analytics, Leeds Institute of Medical Research at St James's, University of Leeds, Leeds, United Kingdom; Department of Medicine I, University Hospital Dresden, Dresden, Germany; Medical Oncology, National Center for Tumor Diseases (NCT), University Hospital Heidelberg, Heidelberg, Germany. Electronic address: jakob-nikolas.kather@alumni.dkfz.de
Department of Medicine I, University Hospital Dresden, Dresden, Germany
Else Kroener Fresenius Center for Digital Health, Technical University Dresden, Dresden, Germany
Medical Oncology, National Center for Tumor Diseases (NCT), University Hospital Heidelberg, Heidelberg, Germany
Pathology & Data Analytics, Leeds Institute of Medical Research at St James's, University of Leeds, Leeds, United Kingdom
Cited by 13 stored of 13
13 results
No patents citing this paper on Lens.org (checked 2026-10-06).