Video Representation Learning for Decoupled Deep Reinforcement Learning Applied to Autonomous Driving

IEEE/SICE International Symposium on System Integration (SII), vol. 144, pp. 1–6

Abstract

This work focuses on using Deep Reinforcement Learning (DRL) to control an autonomous vehicle in the hyper-realistic urban simulation LGSVL. Classical control systems such as MPC maneuver vehicles based on a given trajectory, current velocity, position, distances, and more. Our approach does not pass this information to the DRL agent but only images provided by the camera. Current DRL efforts also exploit similar approaches for autonomous driving, but they are only suitable for small, simple tasks using simple simulations. Our approach consists of two differently trained neural networks (NN), a perceptual NN for representation learning and an actor NN for selecting the correct action. The perception NN will be trained via representation and self-supervised learning to strengthen our DRL agent's understanding of the scene. It can recognize temporal information and the dynamics of a complex environment. This work shows the importance of decoupling the perception and decision (actor) model for autonomous driving. All in all, we could drive autonomously in a hyper-realistic urban simulation using our modular DRL framework. Moreover, our approach also provides a solution for other similar tasks in the field of robotics based on images.

Authors 4

1. Shawan Taha Mohammed Aachen Faculty of Electrical Engineering

   RWTH Aachen University

   Affiliation as printed

   RWTH Aachen University,Faculty of Electrical Engineering, Communication Technologies and Embedded Systems,Aachen,Germany,52074

2. Mohamed Kastouri Aachen Faculty of Electrical Engineering

   RWTH Aachen University

   Affiliation as printed

   RWTH Aachen University,Faculty of Electrical Engineering, Mathematics and Computer Science,Aachen,Germany,52074

3. Artur Niederfahrenhorst Aachen Faculty of Electrical Engineering

   RWTH Aachen University

   Affiliation as printed

   RWTH Aachen University,Faculty of Electrical Engineering, Communication Technologies and Embedded Systems,Aachen,Germany,52074

4. Gerd Ascheid Aachen Faculty of Electrical Engineering

   RWTH Aachen University

   Affiliation as printed

   RWTH Aachen University,Faculty of Electrical Engineering, Communication Technologies and Embedded Systems,Aachen,Germany,52074