Cricket: A virtualization layer for distributed execution of CUDA applications with checkpoint/restart support

Concurrency and Computation Practice and Experience, vol. 34

Abstract

Abstract In high‐performance computing and cloud computing the introduction of heterogeneous computing resources, such as GPU accelerator have led to a dramatic increase in performance and efficiency. While the benefits of virtualization features in these environments are well researched, GPUs do not offer virtualization support that enables fine‐grained control, increased flexibility, and fault tolerance. In this article, we present Cricket: A transparent and low‐overhead solution to GPU virtualization that enables future research into other virtualization techniques, due to its open‐source nature. Cricket supports remote execution and checkpoint/restart of CUDA applications. Both features enable the distribution of GPU tasks dynamically and flexibly across computing nodes and the multitenant usage of GPU resources, thereby improving flexibility and utilization for high‐performance and cloud computing.

Authors 4

1. Niklas Eiling corresponding Aachen E.ON Energy Research Center Institute for Automation of Complex Power Systems

   RWTH Aachen University

   Affiliation as printed

   E.ON Energy Research Center, Institute for Automation of Complex Power Systems RWTH Aachen University Aachen Germany

   E.ON Energy Research Center, Institute for Automation of Complex Power Systems, RWTH Aachen University, Aachen, Germany

2. Jonas Baude Aachen E.ON Energy Research Center Institute for Automation of Complex Power Systems

   RWTH Aachen University

   Affiliation as printed

   E.ON Energy Research Center, Institute for Automation of Complex Power Systems RWTH Aachen University Aachen Germany

   E.ON Energy Research Center, Institute for Automation of Complex Power Systems, RWTH Aachen University, Aachen, Germany

3. Stefan Lankes Aachen E.ON Energy Research Center Institute for Automation of Complex Power Systems

   RWTH Aachen University

   Affiliation as printed

   E.ON Energy Research Center, Institute for Automation of Complex Power Systems RWTH Aachen University Aachen Germany

   E.ON Energy Research Center, Institute for Automation of Complex Power Systems, RWTH Aachen University, Aachen, Germany

4. Antonello Monti Aachen E.ON Energy Research Center Institute for Automation of Complex Power Systems

   RWTH Aachen University

   Affiliation as printed

   E.ON Energy Research Center, Institute for Automation of Complex Power Systems RWTH Aachen University Aachen Germany

   E.ON Energy Research Center, Institute for Automation of Complex Power Systems, RWTH Aachen University, Aachen, Germany