Machine Learning‐Based Model Selection and Averaging Outperform Single‐Model Approaches for a Priori Vancomycin Precision Dosing

CPT Pharmacometrics & Systems Pharmacology, vol. 14, pp. 1650–1660

Abstract

Selecting an appropriate population pharmacokinetic (PK) model for individual patients in model-informed precision dosing (MIPD) can be challenging, particularly in the absence of therapeutic drug monitoring (TDM) samples. We developed a machine learning (ML) model to guide individualized PK model selection for a priori MIPD of vancomycin based on routinely recorded patient characteristics. This retrospective analysis included 343,636 vancomycin TDM records, each from a distinct adult patient across 156 healthcare centers, along with a priori predictions from six PK models. A multi-label classification approach was applied, labeling PK model predictions based on whether they fell within 80%-125% of observed TDM values. Various modeling strategies were evaluated using XGBoost as the base algorithm, with binary relevance selected for the final model. At the prediction stage, PK models were ranked and averaged for each patient based on ML-predicted probabilities that predictions would fall within 80%-125% of the observed concentration. Selecting the highest ranked PK model for each patient and ML-based model averaging outperformed all single PK models, body mass index-based selection, and naive averaging. On a population level, these ML approaches resulted in more accurate predictions, a higher proportion of predictions within 80%-125% of observed vancomycin concentrations, and no systematic bias. Predictive performance declined with lower ML-assigned rankings, and selecting the lowest-ranked PK model for each patient resulted in worse performance than the worst-performing single PK model. By guiding the selection of appropriate models and avoiding less suitable ones, ML approaches for a priori MIPD may improve early dosing decisions.

Authors 8

1. Wisse van Os corresponding Aachen Division of Systems Pharmacology & Pharmacy Leiden Academic Centre for Drug Research

   Leiden University · Medical University of Vienna

   Affiliation as printed

   Department of Clinical Pharmacology Medical University of Vienna Vienna Austria

   Division of Systems Pharmacology & Pharmacy Leiden Academic Centre for Drug Research, Leiden University Leiden the Netherlands

   Department of Clinical Pharmacology, Medical University of Vienna, Vienna, Austria

   Division of Systems Pharmacology & Pharmacy Leiden Academic Centre for Drug Research, Leiden University Leiden the Netherlands

2. Amaury O’Jeanson

   Uppsala University

   Affiliation as printed

   Department of Pharmacy Uppsala University Uppsala Sweden

   Department of Pharmacy, Uppsala University, Uppsala, Sweden

3. Carla Troisi

   University of Bologna

   Affiliation as printed

   Department of Medical and Surgical Sciences Alma Mater Studiorum‐University of Bologna Bologna Italy

   Department of Medical and Surgical Sciences, Alma Mater Studiorum-University of Bologna, Bologna, Italy

4. Chun Liu

   University of Bologna

   Affiliation as printed

   Department of Medical and Surgical Sciences Alma Mater Studiorum‐University of Bologna Bologna Italy

   Department of Medical and Surgical Sciences, Alma Mater Studiorum-University of Bologna, Bologna, Italy

5. Jordan T. Brooks
   Affiliation as printed

   InsightRX San Francisco California USA

   InsightRX, San Francisco, California, USA

6. Jasmine H. Hughes
   Affiliation as printed

   InsightRX San Francisco California USA

   InsightRX, San Francisco, California, USA

7. Dominic M. H. Tong
   Affiliation as printed

   InsightRX San Francisco California USA

   InsightRX, San Francisco, California, USA

8. Ron J. Keizer
   Affiliation as printed

   InsightRX San Francisco California USA

   InsightRX, San Francisco, California, USA