Accelerated quantification of reinforcement degradation in additively manufactured Ni-WC metal matrix composites via SEM and vision transformers

Materials Characterization, vol. 229, pp. 115645

Abstract

Machine learning (ML) applications have shown potential in analyzing complex patterns in additively manufactured (AMed) structures. Metal matrix composites (MMC) offer the potential to enhance functional parts through a metal matrix and reinforcement particles. However, their processing can induce several co-existing anomalies in the microstructure, which are difficult to analyze through optical metallography. Scanning electron microscopy (SEM) can better highlight the degradation of reinforcement particles, but the analysis can be labor-intensive, time-consuming, and highly dependent on expert knowledge. Deep learning-based semantic segmentation has the potential to expedite the analysis of SEM images and hence support their characterization in the industry. This capability is particularly desired for rapid and precise quantification of defect features from the SEM images. In this study, key state-of-the-art semantic segmentation methods from self-attention-based vision transformers (ViTs) are investigated for their segmentation performance on SEM images with a focus on segmenting defect pixels. Specifically, SegFormer, MaskFormer, Mask2Former, UPerNet, DPT, Segmenter, and SETR models were evaluated. A reference fully convolutional model, DeepLabV3+, widely used on semantic segmentation tasks, is also included in the comparison. A SEM dataset representing AMed MMCs was generated through extensive experimentation and is made available in this work. Our comparison shows that several transformer-based models perform better than the reference CNN model with UPerNet (94.33 % carbide dilution accuracy) and SegFormer (93.46 % carbide dilution accuracy) consistently outperformed the other models in segmenting damage to the carbide particles in the SEM images. The findings on the validation and test sets highlight the most frequent misclassification errors at the boundaries of defective and defect-free pixels. The models were also evaluated based on their prediction confidence as a practical measure to support decision-making and model selection. As a result, the UPerNet model with the Swin backbone is recommended for segmenting SEM images from AMed MMCs in scenarios where accuracy and robustness are desired whereas the SegFormer model is recommended for its lighter design and competitive performance. In the future, the analysis can be extended by including higher capacity as well as smaller models in the comparison. Similarly, variations in specific hyperparameters can be investigated to reinforce the rationale of selecting a specific configuration. • Damaged carbide phases are identified from scanning electron microscopy to assess thermal effects during processing. • A deep learning framework is developed to segment and quantify reinforcement degradation in metal matrix composites. • Predicted segmentations closely match expert labels, confirming the model's accuracy across microstructural classes. • Transformer-based models show better performance than conventional methods in identifying degraded carbide regions. • A labeled dataset of microscopy images is provided to support further research on automated microstructural analysis.

Authors 9

1. Mutahar Safdar

   McGill University · National Research Council Canada

   Affiliation as printed

   Department of Mechanical Engineering, McGill University, Montreal, QC H3A 0C3, Canada

   National Research Council Canada, Montreal, QC H3T 1J4, Canada

2. Bashir Kazimi

   Forschungszentrum Jülich

   Affiliation as printed

   Institute for Advanced Simulation – Materials Data Science and Informatics (IAS-9), Forschungszentrum Jülich GmbH, Jülich 52425, Germany

3. Karina Ruzaeva

   Forschungszentrum Jülich

   Affiliation as printed

   Institute for Advanced Simulation – Materials Data Science and Informatics (IAS-9), Forschungszentrum Jülich GmbH, Jülich 52425, Germany

4. Gentry Wood
   Affiliation as printed

   Apollo-Clad Laser Cladding, a division of Apollo Machine and Welding Ltd., Edmonton, AB T6E 5V2, Canada

5. Max Zimmermann Aachen Fraunhofer Institute for Laser Technology ILT

   Fraunhofer Institute for Laser Technology

   Affiliation as printed

   Fraunhofer Institute for Laser Technology ILT, Aachen 52074, Germany

6. Guy Lamouche

   National Research Council Canada

   Affiliation as printed

   National Research Council Canada, Montreal, QC H3T 1J4, Canada

7. Priti Wanjara

   National Research Council Canada

   Affiliation as printed

   National Research Council Canada, Montreal, QC H3T 1J4, Canada

8. Stefan Sandfeld Aachen Chair of Materials Data Science and Materials Informatics Faculty 5 – Georesources and Materials Engineering

   RWTH Aachen University · Forschungszentrum Jülich

   Affiliation as printed

   Chair of Materials Data Science and Materials Informatics, Faculty 5 – Georesources and Materials Engineering, RWTH Aachen University, Aachen 52056, Germany

   Institute for Advanced Simulation – Materials Data Science and Informatics (IAS-9), Forschungszentrum Jülich GmbH, Jülich 52425, Germany

9. Yaoyao Fiona Zhao corresponding

   McGill University

   Affiliation as printed

   Department of Mechanical Engineering, McGill University, Montreal, QC H3A 0C3, Canada