Effect of Calculating Pointwise Mutual Information using a Fuzzy Sliding Window in Topic Modeling
Proceedings of ... IEEE International Conference on Fuzzy Systems, pp. 1–6
Abstract
Topic modeling is a popular method for analysing large amounts of unstructured text data and extracting meaningful insights. The coherence of the generated topics is a critical metric for determining the model quality and measuring the semantic relatedness of the words in a topic. The distributional hypothesis, a fundamental theory in linguistics, states that words occurring in the same contexts tend to have similar meanings. Based on this theory, word co-occurrence in a given context is often used to reflect word association in coherence scores. To this end, many coherence scores use Normalised Pointwise Mutual Information (NPMI), which uses a sliding window to describe the neighbourhood that defines the context. It is assumed that there is no other structure in the neighbourhood except for the presence of words. Inspired by the distributional hypothesis, we hypothesise the word distance to be relevant for determining the word association. Hence, we propose using a fuzzy sliding window to define a neighbourhood in which the association between words depends on the membership of the words in the fuzzy sliding window. To this end, we propose Fuzzy Normalized Pointwise Mutual Information (FNPMI) to calculate fuzzy coherence scores. We implement two different neighbourhood structures by the definition of the membership function of the sliding window. In the first implementation, the association between two words correlates positively with the distance, whereas the correlation is negative in the second. We compare the correlation of our proposed new coherence metrics with human judgment. We find that the use of a fuzzy sliding window correlates less with human judgment than a crisp sliding window. This finding indicates that word distance within a window is less important than defining the window size itself.
Authors 5
-
Utrecht University · Eindhoven University of Technology
Affiliation as printed
Jheronimus Academy of Data Science, Eindhoven University of Technology,Eindhoven,The Netherlands
Department of Information and Computing Sciences, Utrecht University, Utrecht, The Netherlands
Jheronimus Academy of Data Science, Eindhoven University of Technology, Eindhoven, The Netherlands
-
Affiliation as printed
Leiden Institute of Advanced Computer Science, Leiden University,Leiden,The Netherlands
Leiden Institute of Advanced Computer Science, Leiden University, Leiden, The Netherlands
-
Affiliation as printed
Leiden Institute of Advanced Computer Science, Leiden University,Leiden,The Netherlands
Leiden Institute of Advanced Computer Science, Leiden University, Leiden, The Netherlands
-
University Medical Center Utrecht
Affiliation as printed
Psychiatry, University Medical Centre Utrecht,Utrecht,The Netherlands
Psychiatry, University Medical Centre Utrecht, Utrecht, The Netherlands
-
Eindhoven University of Technology
Affiliation as printed
Jheronimus Academy of Data Science, Eindhoven University of Technology,Eindhoven,The Netherlands
Jheronimus Academy of Data Science, Eindhoven University of Technology, Eindhoven, The Netherlands
Cited by 1 stored of 1
1 result
No patents citing this paper on Lens.org (checked 2026-10-11).