Exploring Embedding Spaces for more Coherent Topic Modeling in Electronic Health Records

Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics, vol. 427, pp. 2669–2674

Abstract

The written notes in the Electronic Health Records contain a vast amount of information about patients. Implementing automated approaches for text classification tasks requires the automated methods to be well-interpretable, and topic models can be used for this goal as they can indicate what topics in a text are relevant to making a decision. We propose a new topic modeling algorithm, FLSA-E, and compare it with another state-of-the-art algorithm FLSA-W. In FLSA-E, topics are found by fuzzy clustering in a word embedding space. Since we use word embeddings as the basis for our clustering, we extend our evaluation with word-embeddings-based evaluation metrics. We find that different evaluation metrics favour different algorithms. Based on the results, there is evidence that FLSA-E has fewer outliers in its topics, a desirable property, given that within-topic words need to be semantically related.

Authors 6

1. Emil Rijcken

   Eindhoven University of Technology

   Affiliation as printed

   Eindhoven University of Technology,Jheronimus Academy of Data Science,Eindhoven,The Netherlands

   Jheronimus Academy of Data Science, Eindhoven University of Technology, Eindhoven, The Netherlands

2. Kalliopi Zervanou Aachen

   Leiden University · Leiden University Medical Center

   Affiliation as printed

   Leiden University Medical Centre,Public Health & Primary Care,Leiden,The Netherlands

3. Marco René Spruit Aachen

   Leiden University · Leiden University Medical Center

   Affiliation as printed

   Leiden University Medical Centre,Public Health & Primary Care,Leiden,The Netherlands

4. Pablo J. Mosteiro

   Utrecht University

   Affiliation as printed

   Utrecht University,Information and Computing Sciences,Utrecht,The Netherlands

   Information and Computing Sciences, Utrecht University, Utrecht, The Netherlands

5. Floortje E. Scheepers

   University Medical Center Utrecht

   Affiliation as printed

   Psychiatry University Medical Centre Utrecht,Utrecht,The Netherlands

   Psychiatry University Medical Centre Utrecht, Utrecht, The Netherlands

6. Uzay Kaymak

   Eindhoven University of Technology

   Affiliation as printed

   Eindhoven University of Technology,Jheronimus Academy of Data Science,Eindhoven,The Netherlands

   Jheronimus Academy of Data Science, Eindhoven University of Technology, Eindhoven, The Netherlands