Multi-SPMD Programming Model with YML and XcalableMP

Springer eBooks, pp. 219–243

Abstract

Abstract This chapter describes a multi-SPMD (mSPMD) programming model and a set of software and libraries to support the mSPMD programming model. The mSPMD programming model has been proposed to realize scalable applications on huge and hierarchical systems. It has been evident that simple SPMD programs such as MPI, XMP, or hybrid programs such as OpenMP/MPI cannot exploit the postpeta- or exascale systems efficiently due to the increasing complexity of applications and systems. The mSPMD programming model has been designed to adopt multiple programming models across different architecture levels. Instead of invoking a single parallel program on millions of processor cores, multiple SPMD programs of moderate sizes can be worked together in the mSPMD programming model. As components of the mSPMD programming model, XMP has been supported. Fault-tolerance features, correctness checks, and some numerical libraries’ implementations in the mSPMD programming model have been presented.

Authors 10

1. Miwako Tsuji corresponding

   RIKEN Center for Computational Science

   Affiliation as printed

   RIKEN Center for Computational Science, Kobe, Japan

   RIKEN CCS - RIKEN Center for Computational Science [Kobe] (7 Chome-1-26 Minatojima Minamimachi, Chuo Ward, Kobe, Hyogo 650-0047, Japon - Japan)

2. Hitoshi Murai

   RIKEN Center for Computational Science

   Affiliation as printed

   RIKEN Center for Computational Science, Kobe, Japan

   RIKEN CCS - RIKEN Center for Computational Science [Kobe] (7 Chome-1-26 Minatojima Minamimachi, Chuo Ward, Kobe, Hyogo 650-0047, Japon - Japan)

3. Taisuke Boku

   University of Tsukuba

   Affiliation as printed

   Center for Computational Sciences, University of Tsukuba, Tsukuba, Japan

   CCS - Center for Computational Sciences [Tsukuba] (University of Tsukuba 1-1-1 Tennodai, Tsukuba, Ibaraki 3058577 Japan - Japan)

4. Mitsuhisa Sato

   RIKEN Center for Computational Science

   Affiliation as printed

   RIKEN Center for Computational Science, Kobe, Japan

   RIKEN CCS - RIKEN Center for Computational Science [Kobe] (7 Chome-1-26 Minatojima Minamimachi, Chuo Ward, Kobe, Hyogo 650-0047, Japon - Japan)

5. Serge G. Petiton

   Centre National de la Recherche Scientifique · Université de Lille · Centre de Recherche en Informatique, Signal et Automatique de Lille · Laboratoire d'Informatique Fondamentale de Lille

   Affiliation as printed

   LIFL, Université de Lille, Lille, France

   CNRS - Centre National de la Recherche Scientifique (France)

   CRIStAL - Centre de Recherche en Informatique, Signal et Automatique de Lille - UMR 9189 (Université de Lille - Campus scientifique - Bâtiment ESPRIT - Avenue Henri Poincaré - 59655 Villeneuve d’Ascq - France)

6. Nahid Emad

   Commissariat à l'Énergie Atomique et aux Énergies Alternatives · CEA Paris-Saclay · Université de Versailles Saint-Quentin-en-Yvelines · Maison de la Simulation · Laboratoire d’informatique Parallélisme Réseaux Algorithmes Distribués

   Affiliation as printed

   Li-Parad, UVSQ, Versailles, France

   LI-PaRAD - Laboratoire d'Informatique Parallélisme Réseaux Algorithmes Distribués (45 avenue des Etats-Unis 78035 Versailles - France)

   MDLS - Maison de la Simulation (USR 3441 bât. 565 CEA Saclay 91191 Gif-sur-Yvette cedex - France)

7. Thomas Dufaud

   Commissariat à l'Énergie Atomique et aux Énergies Alternatives · CEA Paris-Saclay · Université de Versailles Saint-Quentin-en-Yvelines · Maison de la Simulation · Laboratoire d’informatique Parallélisme Réseaux Algorithmes Distribués

   Affiliation as printed

   Li-Parad, UVSQ, Versailles, France

   LI-PaRAD - Laboratoire d'Informatique Parallélisme Réseaux Algorithmes Distribués (45 avenue des Etats-Unis 78035 Versailles - France)

   MDLS - Maison de la Simulation (USR 3441 bât. 565 CEA Saclay 91191 Gif-sur-Yvette cedex - France)

8. Joachim Protze Aachen

   RWTH Aachen University

   Affiliation as printed

   RWTH Aachen University, Aachen, Germany

   RWTH - Rheinisch-Westfälische Technische Hochschule Aachen University (RWTH Aachen Templergraben 55 52062 Aachen (Hausanschrift) 52056 Aachen (Postanschrift) - Germany)

9. Christian Terboven Aachen

   RWTH Aachen University

   Affiliation as printed

   RWTH Aachen University, Aachen, Germany

   RWTH - Rheinisch-Westfälische Technische Hochschule Aachen University (RWTH Aachen Templergraben 55 52062 Aachen (Hausanschrift) 52056 Aachen (Postanschrift) - Germany)

10. Matthias Müller Aachen

    RWTH Aachen University · University of Tsukuba · RIKEN Center for Computational Science

    Affiliation as printed

    Boku Center for Computational Sciences , University of Tsukuba , Tsukuba , Japan

    RIKEN Center for Computational Science , Kobe , Japan

    RWTH - Rheinisch-Westfälische Technische Hochschule Aachen University (RWTH Aachen Templergraben 55 52062 Aachen (Hausanschrift) 52056 Aachen (Postanschrift) - Germany)