Towards Supporting Non-Destructive Testing Inspectors with a Multi-Modal Generative AI Copilot

e-Journal of Nondestructive Testing, vol. 31

Abstract

Non-destructive testing (NDT) involves complex processes that are subject to numerous standards and expert knowledge. In addition, inspectors must handle heterogeneous inspection data, while existing digital tools typically support only isolated tasks, which motivates the need for an integrated and context-aware support system. To support inspectors through planning, analysis, and documentation in NDT, this work presents a concept of a multi-modal generative AI copilot tailored to computed tomography (CT) NDT inspections. Through workshops with related-industrial stakeholders and analyzing state-of-the-art literature, requirements and potentials of the generative AI copilot were derived and assessed. Based on the requirements an agent-based system architecture combining language processing and computer vision components was conceptualized and demonstrated in a prototype. Initial feedback from industry partners confirmed the relevance of the concept, verified that their requirements had been met, and provided information on further improvements and suggestions.

Authors 9

1. Pia Carina Pickmann Aachen Chair of Intelligence in Quality Sensing

   RWTH Aachen University

   Affiliation as printed

   Chair of Intelligence in Quality Sensing , RWTH Aachen University , Campus-Boulevard 30 , 52074 Aachen , Germany,

2. Jan-Henrik Woltersmann Aachen Chair of Intelligence in Quality Sensing

   RWTH Aachen University

   Affiliation as printed

   Chair of Intelligence in Quality Sensing , RWTH Aachen University , Campus-Boulevard 30 , 52074 Aachen , Germany,

3. Jonas Werheid Aachen Chair of Intelligence in Quality Sensing

   RWTH Aachen University

   Affiliation as printed

   Chair of Intelligence in Quality Sensing , RWTH Aachen University , Campus-Boulevard 30 , 52074 Aachen , Germany,

4. Hannes Behnen Aachen Chair of Intelligence in Quality Sensing

   RWTH Aachen University

   Affiliation as printed

   Chair of Intelligence in Quality Sensing , RWTH Aachen University , Campus-Boulevard 30 , 52074 Aachen , Germany,

5. Sylwia Olbrych Aachen Chair of Intelligence in Quality Sensing

   RWTH Aachen University

   Affiliation as printed

   Chair of Intelligence in Quality Sensing , RWTH Aachen University , Campus-Boulevard 30 , 52074 Aachen , Germany,

6. Jörg Weißer
   Affiliation as printed

   Messtronik GmbH , Im Tal 22 , 78112 St. Georgen , Germany,

7. Tobias Hamann Aachen Chair of Intelligence in Quality Sensing

   RWTH Aachen University

   Affiliation as printed

   Chair of Intelligence in Quality Sensing , RWTH Aachen University , Campus-Boulevard 30 , 52074 Aachen , Germany,

8. Anas Abdelrazeq Aachen Chair of Intelligence in Quality Sensing

   RWTH Aachen University

   Affiliation as printed

   Chair of Intelligence in Quality Sensing , RWTH Aachen University , Campus-Boulevard 30 , 52074 Aachen , Germany,

9. Robert H. Schmitt Aachen Chair of Intelligence in Quality Sensing

   RWTH Aachen University

   Affiliation as printed

   Chair of Intelligence in Quality Sensing , RWTH Aachen University , Campus-Boulevard 30 , 52074 Aachen , Germany,