Topic Stability over Noisy Sources
Topic modelling techniques such as LDA have recently been applied to speech transcripts and OCR output. These corpora may contain noisy or erroneous texts which may undermine topic stability. Therefore, it is important to know how well a topic modelling algorithm will perform when applied to noisy data. In this paper we show that different types of textual noise will have diverse effects on the stability of different topic models. From these observations, we propose guidelines for text corpus generation, with a focus on automatic speech transcription. We also suggest topic model selection methods for noisy corpora.
Code (0)
등록된 구현이 없습니다.
Tasks
Model SelectionOptical Character Recognition (OCR)Topic ModelsMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A Topical Approach to Capturing Customer Insight In Social Media
The age of social media has opened new opportunities for businesses. This flourishing wealth of information is outside traditional channels and frameworks of classical marketing research, including that of Marketing Mix …
MarketingTransfer LearningWord EmbeddingsRobust Data-Driven Tube-Based Zonotopic Predictive Control with Closed-Loop Guarantees
This work proposes a robust data-driven tube-based zonotopic predictive control (TZPC) approach for discrete-time linear systems, designed to ensure stability and recursive feasibility in the presence of bounded noise. T…
NoisyMix: Boosting Model Robustness to Common Corruptions
For many real-world applications, obtaining stable and robust statistical performance is more important than simply achieving state-of-the-art predictive test accuracy, and thus robustness of neural networks is an increa…
Data AugmentationmodelMeasuring LDA Topic Stability from Clusters of Replicated Runs
Background: Unstructured and textual data is increasing rapidly and Latent Dirichlet Allocation (LDA) topic modeling is a popular data analysis methods for it. Past work suggests that instability of LDA topics may lead t…
ClusteringSparsemax and Relaxed Wasserstein for Topic Sparsity
Topic sparsity refers to the observation that individual documents usually focus on several salient topics instead of covering a wide variety of topics, and a real topic adopts a narrow range of terms instead of a wide c…