Approach to Generate a Simple Semantic Data Model from 2D Bridge Plans using AI-based Text Recognition

European Safety and Reliability Conference (ESREL), pp. 3006–3013

Abstract

The digital twin is intended to serve as the basis for an improved maintenance management.However, in the case of existing bridges, a digital model of the physical structure rarely exists.Various research approaches are currently addressing this problem using advanced technologies (laser scan, AI, photogrammetry).An essential part of these efforts is the transfer of relevant semantic information from an analogue source into the digital model.This paper deals with the question of how textual information from 2D drawings of bridges can be recognised and translated into a semantic data model.For this purpose, an OCR algorithm was utilized to translate printed and handwritten textual information into machine-readable text.The information pertaining to the material properties of the examined component was subsequently assigned to its respective component and stored in a structured data table.The choice of the OCR algorithm, the post-processing of the text recognition results, the identification of relevant information and the translation into a semantic data model are the key findings presented in this paper.It was shown that while the approach is operational, the reliable identification of information is highly dependent on the nature and form of its representation in the drawings.While text recognition has been shown to be reliable, further research is needed to process and interpret the extracted semantic information to enable a broader approach to semantic enrichment.

Authors 5

1. Peter Gölzhäuser Aachen ICoM

   RWTH Aachen University

   Affiliation as printed

   ICoM , RWTH Aachen University , Germany

   RWTH Aachen University, Germany

2. Mengyan Peng Aachen

   Technische Universität Dresden · RWTH Aachen University

   Affiliation as printed

   IMB , Technische Universität Dresden , Germany

   RWTH Aachen University, Germany

3. Jan‐Iwo Jäkel Aachen ICoM

   Technische Universität Dresden · RWTH Aachen University

   Affiliation as printed

   ICoM , RWTH Aachen University , Germany

   IMB, Technische Universität Dresden, Germany

4. Katharina Klemt‐Albert Aachen ICoM

   RWTH Aachen University

   Affiliation as printed

   ICoM , RWTH Aachen University , Germany

   ICoM, RWTH Aachen University, Germany

5. Steffen Marx Aachen ICoM

   Technische Universität Dresden · RWTH Aachen University

   Affiliation as printed

   IMB , Technische Universität Dresden , Germany

   ICoM, RWTH Aachen University, Germany