Couto, ManuelParapar, JavierLosada, David E.Universidade da Coruña. Facultade de Informática2026-07-062026-07-062026-05Couto, M., Parapar, J. & Losada, D.E. A study of word embedding models for measuring topic coherence. Knowl Inf Syst 68, 160 (2026). https://doi.org/10.1007/s10115-026-02782-60219-3116https://hdl.handle.net/2183/48777Financiado para publicación en acceso aberto: CRUE-CSIC Data: The datasets (20NG, NYT, Geno) used in this study are publicly available. The code to reproduce the experiments is available at Github: https://github.com/manucouto1/A-Study-of-Word-Embedding-Models-for-Measuring-Topic-Coherence[Abstract]: Topic modeling has emerged as a crucial tool in the field of natural language processing, enabling the automatic discovery of latent structures in large textual corpora. However, determining the quality of the topics remains a significant challenge, particularly in measuring the coherence of the top words of the extracted topics. Early efforts relied on human judgments, but these approaches are resource-intensive. Automated coherence metrics have since been developed. For example, some measures exploit word co-occurrence, while other methods are grounded in distributional semantics (e.g., employing word embeddings). In this study, we thoroughly explore the application of embedded representations to evaluate the quality of topics. While a number of isolated studies have analyzed the role of specific word representation techniques for measuring topic coherence, a complete picture of their effectiveness is still lacking. This work brings together different embedding-based approaches, including Word2Vec, FastText, GloVe, and BERT, which had been studied separately, and extends prior research by incorporating additional models, such as RoBERTa, ALBERT and MPNET. Topic coherence is measured by computing similarity scores between word embeddings, thus obtaining rich semantic associations that traditional measures may overlook. Our analysis demonstrates that these methods are as effective as, and often surpass, classical coherence measures. Our results contribute to a growing body of research advocating for advanced semantic representations as robust alternatives to traditional approaches in evaluating topic model coherence.engAttribution 4.0 Internationalhttp://creativecommons.org/licenses/by/4.0/TopicCoherenceEmbeddingsMetricsjournal articleopen access10.1007/s10115-026-02782-6