paper-with-me

Papers

From Noise to Signal: When Outliers Seed New Topics

2026-03-18 · Evangelia Zve, Gauvain Bourgne, Benjamin Icard, Jean-Gabriel Ganascia arxiv

Outliers in dynamic topic modeling are typically treated as noise, yet we show that some can serve as early signals of emerging topics. We introduce a temporal taxonomy of news-document trajectories that defines how documents relate to topic formation over time. It distinguishes anticipatory outliers, which precede the topics they later join, from documents that either reinforce existing topics or remain isolated. By capturing these trajectories, the taxonomy links weak-signal detection with temporal topic modeling and clarifies how individual articles anticipate, initiate, or drift within evolving clusters. We implement it in a cumulative clustering setting using document embeddings from eleven state-of-the-art language models and evaluate it retrospectively on HydroNewsFr, a French news corpus on the hydrogen economy. Inter-model agreement reveals a small, high-consensus subset of anticipatory outliers, increasing confidence in these labels. Qualitative case studies further illustrate these trajectories through concrete topic developments.

📄 PDF Abstract BibTeX arXiv:2603.18358

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

From Outliers to Topics in Language Models: Anticipating Trends in News Corpora

2025-09-26 · Evangelia Zve, Benjamin Icard, Alice Breton, Lila Sainero 외 arxiv

This paper examines how outliers, often dismissed as noise in topic modeling, can act as weak signals of emerging topics in dynamic news corpora. Using vector embeddings from state-of-the-art language models and a cumula…

Effective Seed-Guided Topic Discovery by Integrating Multiple Types of Contexts

2022-12-12 · Yu Zhang, Yunyi Zhang, Martin Michalski, Yucheng Jiang 외

Instead of mining coherent topics from a given text corpus in a completely unsupervised manner, seed-guided topic discovery methods leverage user-provided seed words to extract distinctive and coherent topics so that the…

Language ModellingWord Embeddings

Improved Outlier Robust Seeding for k-means

2023-09-06 · Amit Deshpande, Rameshwar Pratap

The $k$-means is a popular clustering objective, although it is inherently non-robust and sensitive to outliers. Its popular seeding or initialization called $k$-means++ uses $D^{2}$ sampling and comes with a provable $O…

Regularization of $\ell_1$ minimization for dealing with outliers and noise in Statistics and Signal Recovery

2013-10-28 · Salvador Flores, Luis M. Briceno-Arias

We study the robustness properties of $\ell_1$ norm minimization for the classical linear regression problem with a given design matrix and contamination restricted to the dependent variable. We perform a fine error anal…

regression

Subspace Learning in The Presence of Sparse Structured Outliers and Noise

2017-03-14 · Shervin Minaee, Yao Wang

Subspace learning is an important problem, which has many applications in image and video processing. It can be used to find a low-dimensional representation of signals and images. But in many applications, the desired s…

ClusteringImage SegmentationSegmentationSemantic Segmentation