Reliability-Optimal Offloading in Low-Latency Edge Computing Networks: Analytical and Reinforcement Learning Based Designs

IEEE Transactions on Vehicular Technology, vol. 70, pp. 6058–6072

Abstract

In this paper, we consider a multi-access edge computing (MEC) network with multiple servers. Due to the low latency constraints, the wireless data transmission/offloading is carried by finite blocklength codes. We characterize the reliability of the transmission phase in the finite blocklength regime and investigate the extreme event of queue length violation in the computation phase by applying extreme value theory. Under the assumption of perfect channel state information (CSI), we follow the obtained characterizations and provide an optimal framework design including server selection and time allocation aiming to minimize the overall error probability. Moreover, when only the outdated CSI is available, a deep reinforcement learning based design is proposed applying the deep deterministic policy gradient method. Via simulations, we validate the convexity proven in our analytical model and show the performance advantage of proposed analytical solution and learning-based solution comparing to the benchmark for perfect CSI and outdated CSI, respectively.

Authors 6

1. Yao Lin Zhu Aachen ISEK Research Area/Lab

   Wuhan University · RWTH Aachen University

   Affiliation as printed

   ISEK Research Area/Lab, RWTH Aachen University, Aachen, Germany

   School of Electronic Information, Wuhan University, Wuhan, China

2. Yulin Hu Aachen ISEK Research Area/Lab

   Wuhan University · RWTH Aachen University

   Affiliation as printed

   ISEK Research Area/Lab, RWTH Aachen University, Aachen, Germany

   School of Electronic Information, Wuhan University, Wuhan, China

3. Tianyu Yang

   Fudan University · Technische Universität Berlin

   Affiliation as printed

   Fudan University, Shanghai, China

   TU Berlin, Berlin, Germany

4. Tao Yang

   Fudan University · Technische Universität Berlin

   Affiliation as printed

   Fudan University, Shanghai, China

   TU Berlin, Berlin, Germany

5. Jannik Vogt Aachen ISEK Research Area/Lab

   RWTH Aachen University

   Affiliation as printed

   ISEK Research Area/Lab, RWTH Aachen University, Aachen, Germany

6. Anke Schmeink Aachen ISEK Research Area/Lab

   RWTH Aachen University

   Affiliation as printed

   ISEK Research Area/Lab, RWTH Aachen University, Aachen, Germany