Evaluating the usability of open source frameworks in energy system modelling

Renewable and Sustainable Energy Reviews, vol. 159, pp. 112174

Abstract

Usability is considered one of the key factors in determining the success of Open Source Software, but is it sufficiently addressed within the development process as of yet? Thus far, there are no studies on record that explicitly examine the usability of Open Source Software in the field of Energy System Modelling. In this paper, we publish a novel method, the Energy System Modelling Usability Testing (ESMUT), including a step-by-step guide on how to apply the method and the corresponding usability questionnaire (ESMUQ). The questionnaire is based on the Post Study System Usability Questionnaire and adopted for quantitative usability testing of Open Source Energy System Modelling frameworks. To illustrate its usage and show its applicability, we apply the method in a case study with five frameworks (Balmorel, GENeSYS-MOD, GENESYS-2, oemof, and urbs) and within a group of eight framework developers. Based on the case study results, we find that the participants were largely satisfied in working with the frameworks analysed, and identify correct handling of input data and error messages as the most frequently mentioned problems when working with the frameworks. Consequently, we find that the usability of the frameworks analysed in the case study requires further improvement. Due to the fact that only the developer perspective was taken into account, and the number of participants involved in the study was limited, further research is required to assess the usability of Open Source Energy System Modelling frameworks.

Authors 8

1. Sarah Berendes corresponding

   Reiner Lemoine Institute

   Affiliation as printed

   Reiner Lemoine Institut gGmbH, Rudower Chaussee 12, 12489 Berlin, Germany

2. Simon Hilpert

   Europa-Universität Flensburg

   Affiliation as printed

   Europa-Universität Flensburg, Auf dem Campus 1, 24943 Flensburg, Germany

3. Christoph Muschner

   Reiner Lemoine Institute

   Affiliation as printed

   Reiner Lemoine Institut gGmbH, Rudower Chaussee 12, 12489 Berlin, Germany

4. Soner Candas

   Technical University of Munich

   Affiliation as printed

   Chair of Renewable and Sustainable Energy Systems, Technical University of Munich, Lichtenbergstrasse 4a, 85748, Garching bei München, Germany

5. Karlo Hainsch

   Technische Universität Berlin

   Affiliation as printed

   Fachgebiet Wirtschafts- und Infrastrukturpolitik (WIP), Technische Universität Berlin, Straße des 17. Juni 135, 10623 Berlin, Germany

6. Jonas van Ouwerkerk Aachen Institute for Power Electronics and Electrical Drives (ISEA) Institute for Power Generation and Storage Systems (PGS)

   Jülich Aachen Research Alliance · RWTH Aachen University

   Affiliation as printed

   Institute for Power Electronics and Electrical Drives (ISEA), RWTH Aachen University, Jägerstraße 17-19, 52066 Aachen, Germany

   Institute for Power Generation and Storage Systems (PGS), E.ON ERC, RWTH Aachen University, Mathieustraße 10, 52074 Aachen, Germany

   Jülich Aachen Research Alliance, JARA-Energy, Germany

7. Stefanie Buchholz

   Technical University of Denmark

   Affiliation as printed

   Technical University of Denmark, Produktionstorvet Bygning 424, 2800 Kgs. Lyngby, Denmark

8. Martin Söthe

   Europa-Universität Flensburg

   Affiliation as printed

   Europa-Universität Flensburg, Auf dem Campus 1, 24943 Flensburg, Germany