Data imputation methods for intermittent renewable energy sources: Implications for energy system modeling

Energy Conversion and Management, vol. 339, pp. 119857

Abstract

To incorporate a high share of intermittent renewable sources in energy systems, energy system optimization models rely on weather and climate time series data. However, data for renewable energy sources often contains missing values due to sensor or transmission faults. This study evaluates various data imputation methods for minutely-resolved global horizontal irradiance, direct normal irradiance, and wind speed time series, with missingness ranging from two to ninety percent. Alongside standard statistical tests, a novel validation criterion is introduced by directly evaluating the impact of imputation methods on energy system modeling. While certain imputation methods demonstrate strong point-wise statistical accuracy, they do not necessarily preserve the underlying data distribution. The performance of these methods is strongly influenced by the type of time series and the missingness mechanism, either continuous gaps or randomly missing data points. In energy system optimization, multiple imputation by chained equations, k -nearest neighbors, linear interpolation, and simple moving average yield the best results, outperforming more sophisticated deep learning-based methods. Overall, k -nearest neighbors consistently outperformed the other approaches across all validation criteria. By comprehensively evaluating the statistical performance of imputation methods and their impact on energy system modeling, this study offers valuable insights for researchers and practitioners addressing missing data in energy system applications.

Authors 6

1. Claudio Mantuano

   Forschungszentrum Jülich · Sapienza University of Rome

   Affiliation as printed

   Forschungszentrum Jülich GmbH, Institute of Climate and Energy Systems – Jülich Systems Analysis (ICE-2), 52425 Jülich, Germany

   Sapienza University of Rome, Department of Computer, Control, and Management Engineering (DIAG), 00185 Rome, Italy

2. Olalekan Omoyele corresponding Aachen Chair for Fuel Cells Faculty of Mechanical Engineering

   Forschungszentrum Jülich · RWTH Aachen University

   Affiliation as printed

   Forschungszentrum Jülich GmbH, Institute of Climate and Energy Systems – Jülich Systems Analysis (ICE-2), 52425 Jülich, Germany

   RWTH Aachen University, Chair for Fuel Cells, Faculty of Mechanical Engineering, 52062 Aachen, Germany

3. Maximilian Hoffmann

   Forschungszentrum Jülich

   Affiliation as printed

   Forschungszentrum Jülich GmbH, Institute of Climate and Energy Systems – Jülich Systems Analysis (ICE-2), 52425 Jülich, Germany

4. Jann Michael Weinand

   Forschungszentrum Jülich

   Affiliation as printed

   Forschungszentrum Jülich GmbH, Institute of Climate and Energy Systems – Jülich Systems Analysis (ICE-2), 52425 Jülich, Germany

5. Massimo Panella

   Sapienza University of Rome

   Affiliation as printed

   Sapienza University of Rome, Department of Information Engineering, Electronics, and Telecommunications (DIET), 00184 Rome, Italy

6. Detlef Stolten Aachen Chair for Fuel Cells Faculty of Mechanical Engineering

   Forschungszentrum Jülich · RWTH Aachen University

   Affiliation as printed

   Forschungszentrum Jülich GmbH, Institute of Climate and Energy Systems – Jülich Systems Analysis (ICE-2), 52425 Jülich, Germany

   RWTH Aachen University, Chair for Fuel Cells, Faculty of Mechanical Engineering, 52062 Aachen, Germany