UCITransNet: A Deep Neural Model with FC-CRFs and Object-Level Data Augmentation for Cell Instance Segmentation

IEEE International Symposium on Biomedical Imaging (ISBI), pp. 1–5

Abstract

U-Net and its variants have been the mainstream model paradigm for a wide spectrum of semantic segmentation tasks. A recent proposal was to replace the skip connections of U-Net with a multi-scale Channel Cross fusion with Transformer (CCT) module, forming a so-called UCTransNet architecture with SOTA performance on several tasks. The characteristics of the multi-head attention module adopted in CCT lead to the fusion of multi-channel information, but it also loses some valuable feature information in the fusion calculation process, putting much pressure on the backbone network. We propose Channel-wise Isomerism fusion Transformer (CIT) module to replace the CCT module, yielding the UCITransNet model. We adopt an FC-CRF module as a single channel enhancement module to work in coordination with the CCT. The motivation has been retaining the function of channel integration as much as possible while taking into account the significance of conveying multi-scale features. In addition, we propose an object-level data augmentation method, named cell instance augmentation (CIA), to enhance the quantity and diversity of the training data, coupled with the enhanced model architecture. The proposed method was validated on two datasets, including the Gland Segmentation in Colon Histology Images Challenge (GlaS) dataset and the Multi-Organ Nucleus Segmentation Challenge (MoNuSeg) dataset using the Dice and IoU performance metrics. On both datasets, our method presents superior performance compared to the SOTA and other benchmark methods.

Authors 4

1. Zequan Liu Aachen

   RWTH Aachen University

   Affiliation as printed

   RWTH Aachen University,Aachen,Germany

   RWTH Aachen University, Aachen, Germany

2. Suhong Wang
   Affiliation as printed

   Baixing AI Lab,Beijing,China

   Baixing AI Lab, Beijing, China

3. Zidong Chen
   Affiliation as printed

   Baixing AI Lab,Beijing,China

   Baixing AI Lab, Beijing, China

4. Zhifeng Xiao

   Pennsylvania State University

   Affiliation as printed

   The Behrend College,School of Engineering, Penn State Erie,Erie,PA,USA

   School of Engineering, Penn State Erie, The Behrend College, Erie, PA, USA