UPDF AI

A modified model for topic detection from a corpus and a new metric evaluating the understandability of topics

Tomoya Kitano,Yuto Miyatake,Daisuke Furihata

2023 · DOI: 10.48550/arXiv.2306.04941
JSIAM Letters · 1 Citations

TLDR

A modified neural model for topic detection from a corpus is presented and a new metric to evaluate the detected topics is proposed, which can be computed more efficiently than widely-used metrics such as topic coherence.

Abstract

This paper presents a modified neural model for topic detection from a corpus and proposes a new metric to evaluate the detected topics. The new model builds upon the embedded topic model incorporating some modifications such as document clustering. Numerical experiments suggest that the new model performs favourably regardless of the document's length. The new metric, which can be computed more efficiently than widely-used metrics such as topic coherence, provides variable information regarding the understandability of the detected topics.