Machine Learning for Violence Risk Assessment Using Dutch Clinical Notes

Journal of Artificial Intelligence for Medical Sciences, vol. 2, pp. 44–54

Abstract

Violence risk assessment in psychiatric institutions enables interventions to avoid violence incidents.Clinical notes written by practitioners and available in electronic health records are valuable resources capturing unique information, but are seldom used to their full potential.We explore conventional and deep machine learning methods to assess violence risk in psychiatric patients using practitioner notes.The performance of our best models is comparable to the currently used questionnaire-based method, with an area under the Receiver Operating Characteristic curve of approximately 0.8.We find that the deep-learning model BERTje performs worse than conventional machine learning methods.We also evaluate our data and our classifiers to understand the performance of our models better.This is particularly important for the applicability of evaluated classifiers to new data, and is also of great interest to practitioners, due to the increased availability of new data in electronic format.

Authors 6

1. Pablo J. Mosteiro corresponding

   Utrecht University

   Affiliation as printed

   Utrecht University , Utrecht , The Netherlands

   Utrecht University, Utrecht, The Netherlands

2. Emil Rijcken

   Utrecht University · Eindhoven University of Technology

   Affiliation as printed

   Eindhoven University of Technology , Eindhoven , The Netherlands

   Utrecht University , Utrecht , The Netherlands

   Eindhoven University of Technology, Eindhoven, The Netherlands

   Utrecht University, Utrecht, The Netherlands

3. Kalliopi Zervanou

   Eindhoven University of Technology

   Affiliation as printed

   Eindhoven University of Technology , Eindhoven , The Netherlands

   Eindhoven University of Technology, Eindhoven, The Netherlands

4. Uzay Kaymak

   Eindhoven University of Technology

   Affiliation as printed

   Eindhoven University of Technology , Eindhoven , The Netherlands

   Eindhoven University of Technology, Eindhoven, The Netherlands

5. Floortje E. Scheepers

   University Medical Center Utrecht

   Affiliation as printed

   University Medical Center Utrecht , Utrecht , The Netherlands

   University Medical Center Utrecht, Utrecht, The Netherlands

6. Marco René Spruit Aachen Leiden Institute of Advanced Computer Science

   Leiden University · Utrecht University · Leiden University Medical Center

   Affiliation as printed

   Leiden Institute of Advanced Computer Science, Leiden, The Netherlands

   Leiden University Medical Center, Leiden, The Netherlands

   Utrecht University, Utrecht, The Netherlands