Multilingual Clustering of Streaming News
Clustering news across languages enables efficient media monitoring by aggregating articles from multilingual sources into coherent stories. Doing so in an online setting allows scalable processing of massive news streams. To this end, we describe a novel method for clustering an incoming stream of multilingual documents into monolingual and crosslingual story clusters. Unlike typical clustering approaches that consider a small and known number of labels, we tackle the problem of discovering an ever growing number of cluster labels in an online fashion, using real news datasets in multiple languages. Our method is simple to implement, computationally efficient and produces state-of-the-art results on datasets in German, English and Spanish.
Code (2)
Tasks
ArticlesClusteringSimilar Papers 제목 키워드 기반
Batch Clustering for Multilingual News Streaming
Nowadays, digital news articles are widely available, published by various editors and often written in different languages. This large volume of diverse and unorganized information makes human reading very difficult or …
ArticlesClusteringSimplifying Multilingual News Clustering Through Projection From a Shared Space
The task of organizing and clustering multilingual news articles for media monitoring is essential to follow news stories in real time. Most approaches to this task focus on high-resource languages (mostly English), with…
ArticlesClusteringHierarchical Level-Wise News Article Clustering via Multilingual Matryoshka Embeddings
Contextual large language model embeddings are increasingly utilized for topic modeling and clustering. However, current methods often scale poorly, rely on opaque similarity metrics, and struggle in multilingual setting…
ArticlesClusteringLanguage ModelingLanguage Modelling+1Testing pre-trained Transformer models for Lithuanian news clustering
A recent introduction of Transformer deep learning architecture made breakthroughs in various natural language processing tasks. However, non-English languages could not leverage such new opportunities with the English t…
ClusteringXLM-RFact Check: Analyzing Financial Events from Multilingual News Sources
The explosion in the sheer magnitude and complexity of financial news data in recent years makes it increasingly challenging for investment analysts to extract valuable insights and perform analysis. We propose FactCheck…
ArticlesClustering