IOHexperimenter: Benchmarking Platform for Iterative Optimization Heuristics

Evolutionary Computation, vol. 32, pp. 205–210

Abstract

We present IOHexperimenter, the experimentation module of the IOHprofiler project. IOHexperimenter aims at providing an easy-to-use and customizable toolbox for benchmarking iterative optimization heuristics such as local search, evolutionary and genetic algorithms, and Bayesian optimization techniques. IOHexperimenter can be used as a stand-alone tool or as part of a benchmarking pipeline that uses other modules of the IOHprofiler environment. IOHexperimenter provides an efficient interface between optimization problems and their solvers while allowing for granular logging of the optimization process. Its logs are fully compatible with existing tools for interactive data analysis, which significantly speeds up the deployment of a benchmarking pipeline. The main components of IOHexperimenter are the environment to build customized problem suites and the various logging options that allow users to steer the granularity of the data records.

Authors 6

1. Jacob de Nobel corresponding Aachen

   Leiden University

   Affiliation as printed

   LIACS, Leiden University, the Netherlands j.p.de.nobel@liacs.leidenuniv.nl

2. Furong Ye corresponding Aachen

   Leiden University

   Affiliation as printed

   LIACS, Leiden University, the Netherlands f.ye@liacs.leidenuniv.nl

3. Diederick Vermetten corresponding Aachen

   Leiden University

   Affiliation as printed

   LIACS, Leiden University, the Netherlands d.l.vermetten@liacs.leidenuniv.nl

4. Hao Wang corresponding Aachen

   Leiden University

   Affiliation as printed

   LIACS, Leiden University, the Netherlands h.wang@liacs.leidenuniv.nl

5. Carola Doerr corresponding

   Centre National de la Recherche Scientifique · Sorbonne Université · LIP6

   Affiliation as printed

   Sorbonne Université, CNRS, LIP6, Paris, France Carola.Doerr@lip6.fr

6. Thomas Bäck corresponding Aachen

   Leiden University

   Affiliation as printed

   LIACS, Leiden University, the Netherlands t.h.w.baeck@liacs.leidenuniv.nl