Parallel Adaptive Multi-Objective Evolutionary Learning of Discretized Bayesian Network Classifiers for Clinical Data

Genetic and Evolutionary Computation Conference Companion (GECCO Companion), pp. 1112–1121

Abstract

Bayesian Networks (BNs) are of interest from an explainable AI viewpoint, offering transparent probabilistic models for decision support. Baymex is a recently introduced multi-objective evolutionary algorithm for learning discretized BNs, enabling experts to trade-off different objectives of interest, such as likelihood, model complexity, and prior beliefs. While Baymex has been shown to outperform state-of-the-art BN learning approaches, Baymex still 1) requires a lot of computation time and 2) has only been evaluated on synthetic data. To improve scalability, we introduce a parallelization strategy as well as a mechanism that enables adaptively steering optimization toward networks that overfit less. We furthermore reconfigure Baymex to train a BN classifier through multi-objective optimization of cross-entropy loss and the BIC complexity term so as to evaluate its performance on real-world clinical classification tasks. Besides observing speedups up to over 54 times on a 16-core CPU, comparisons against clinically familiar baselines (decision trees, logistic regression, naive Bayes, and random forests) on two open-source (RADCURE and SUPPORT) and one in-house dataset, show that Baymex obtains statistically similar or better predictive performance while producing compact, clinically inspectable BNs. Importantly, Baymex finds multiple plausible BN classifiers that contain predictors consistent with established clinical factors.

Authors 5

1. Damy M. F. Ha Aachen

   Leiden University Medical Center

   Affiliation as printed

   Leiden University Medical Center, Leiden, Netherlands

2. Thalea Schlender Aachen

   Leiden University Medical Center

   Affiliation as printed

   Leiden University Medical Center, Leiden, Netherlands

3. Yvette M. van der Linden Aachen

   Leiden University Medical Center

   Affiliation as printed

   Leiden University Medical Center, Leiden, Netherlands

4. Peter A. N. Bosman

   Centrum Wiskunde & Informatica

   Affiliation as printed

   Centrum Wiskunde & Informatica (CWI), Amsterdam, Netherlands

5. Tanja Alderliesten Aachen

   Leiden University Medical Center

   Affiliation as printed

   Leiden University Medical Center, Leiden, Netherlands