Evolutionary Algorithms for Parameter Optimization—Thirty Years Later

Evolutionary Computation, vol. 31, pp. 81–122

Abstract

Thirty years, 1993-2023, is a huge time frame in science. We address some major developments in the field of evolutionary algorithms, with applications in parameter optimization, over these 30 years. These include the covariance matrix adaptation evolution strategy and some fast-growing fields such as multimodal optimization, surrogate-assisted optimization, multiobjective optimization, and automated algorithm design. Moreover, we also discuss particle swarm optimization and differential evolution, which did not exist 30 years ago, either. One of the key arguments made in the paper is that we need fewer algorithms, not more, which, however, is the current trend through continuously claiming paradigms from nature that are suggested to be useful as new optimization algorithms. Moreover, we argue that we need proper benchmarking procedures to sort out whether a newly proposed algorithm is useful or not. We also briefly discuss automated algorithm design approaches, including configurable algorithm design frameworks, as the proposed next step toward designing optimization algorithms automatically, rather than by hand.

Authors 10

1. Thomas Bäck corresponding Aachen Leiden Institute of Advanced Computer Science

   Leiden University

   Affiliation as printed

   Leiden Institute of Advanced Computer Science, Leiden University, Netherlands t.h.w.baeck@liacs.leidenuniv.nl

2. Anna V. Kononova corresponding Aachen Leiden Institute of Advanced Computer Science

   Leiden University

   Affiliation as printed

   Leiden Institute of Advanced Computer Science, Leiden University, Netherlands a.kononova@liacs.leidenuniv.nl

3. Bas van Stein corresponding Aachen Leiden Institute of Advanced Computer Science

   Leiden University

   Affiliation as printed

   Leiden Institute of Advanced Computer Science, Leiden University, Netherlands b.van.stein@liacs.leidenuniv.nl

4. Hao Wang corresponding Aachen Leiden Institute of Advanced Computer Science

   Leiden University

   Affiliation as printed

   Leiden Institute of Advanced Computer Science, Leiden University, Netherlands h.wang@liacs.leidenuniv.nl

5. Kirill Antonov corresponding Aachen Leiden Institute of Advanced Computer Science

   Leiden University

   Affiliation as printed

   Leiden Institute of Advanced Computer Science, Leiden University, Netherlands k.antonov@liacs.leidenuniv.nl

6. Roman Kalkreuth corresponding Aachen Leiden Institute of Advanced Computer Science

   Leiden University

   Affiliation as printed

   Leiden Institute of Advanced Computer Science, Leiden University, Netherlands r.t.kalkreuth@liacs.leidenuniv.nl

7. Jacob de Nobel corresponding Aachen Leiden Institute of Advanced Computer Science

   Leiden University

   Affiliation as printed

   Leiden Institute of Advanced Computer Science, Leiden University, Netherlands j.p.de.nobel@liacs.leidenuniv.nl

8. Diederick Vermetten corresponding Aachen Leiden Institute of Advanced Computer Science

   Leiden University

   Affiliation as printed

   Leiden Institute of Advanced Computer Science, Leiden University, Netherlands d.l.vermetten@liacs.leidenuniv.nl

9. Roy de Winter corresponding Aachen Leiden Institute of Advanced Computer Science

   Leiden University

   Affiliation as printed

   Leiden Institute of Advanced Computer Science, Leiden University, Netherlands r.de.winter@liacs.leidenuniv.nl

10. Furong Ye corresponding Aachen Leiden Institute of Advanced Computer Science

    Leiden University

    Affiliation as printed

    Leiden Institute of Advanced Computer Science, Leiden University, Netherlands f.ye@liacs.leidenuniv.nl