Dynamics Modeling of Industrial Robots Using Transformer Networks

IEEE International Conference on Robotic Computing (IRC), vol. 37, pp. 164–171

Abstract

Dynamics modeling of industrial robots using analytical models requires the complex identification of relevant parameters such as masses, centers of gravity as well as inertia tensors, which is often prone to error. Deep learning approaches have recently been used as an alternative. Here, the challenge lies not only in learning the temporal dependencies between the data points but also the dependencies between the attributes of each point. Long Short-term Memory networks (LSTMs) have been applied to this problem as the standard architecture for time series processing. However, LSTMs are not able to fully exploit parallellization capabilities that have emerged in the past decade leading to a time consuming training process. Transformer networks (transformers) have recently been introduced to overcome the long training times while learning temporal dependencies in the data. They can be further combined with convolutional layers to learn the dependencies between attributes for multivariate time series problems. In this paper we show that these transformers can be used to accurately learn the dynamics model of a robot. We train and test two variations of transformers, with and without convolutional layers, and compare their results to other models such as vector autoregression, extreme gradient boosting, and LSTM networks. The transformers, especially with convolution, outperformed the other models in terms of performance and prediction accuracy. Finally, the best performing network is evaluated regarding its prediction plausibility using a method from explainable artificial intelligence in order to increase the user’s trust.

Authors 6

1. Minh Trinh Aachen Laboratory of Machine Tools

   RWTH Aachen University

   Affiliation as printed

   RWTH Aachen University,Laboratory of Machine Tools,Aachen,Germany

   Laboratory of Machine Tools, RWTH Aachen University, Aachen, Germany

2. Mohamed Behery Aachen Knowledge-Based Systems Group

   RWTH Aachen University

   Affiliation as printed

   RWTH Aachen University,Knowledge-Based Systems Group,Aachen,Germany

   Knowledge-Based Systems Group, RWTH Aachen University, Aachen, Germany

3. Mahmoud Emara Aachen

   RWTH Aachen University

   Affiliation as printed

   RWTH Aachen University,Aachen,Germany

   RWTH Aachen University, Aachen, Germany

4. Gerhard Lakemeyer Aachen Knowledge-Based Systems Group

   RWTH Aachen University

   Affiliation as printed

   RWTH Aachen University,Knowledge-Based Systems Group,Aachen,Germany

   Knowledge-Based Systems Group, RWTH Aachen University, Aachen, Germany

5. Simon Storms Aachen Laboratory of Machine Tools

   RWTH Aachen University

   Affiliation as printed

   RWTH Aachen University,Laboratory of Machine Tools,Aachen,Germany

   Laboratory of Machine Tools, RWTH Aachen University, Aachen, Germany

6. Christian Brecher Aachen Laboratory of Machine Tools

   RWTH Aachen University

   Affiliation as printed

   RWTH Aachen University,Laboratory of Machine Tools,Aachen,Germany

   Laboratory of Machine Tools, RWTH Aachen University, Aachen, Germany