paper-with-me

Papers

News Without Borders: Domain Adaptation of Multilingual Sentence Embeddings for Cross-lingual News Recommendation

2024-06-18 · Andreea Iana, Fabian David Schmidt, Goran Glavaš, Heiko Paulheim

Rapidly growing numbers of multilingual news consumers pose an increasing challenge to news recommender systems in terms of providing customized recommendations. First, existing neural news recommenders, even when powered by multilingual language models (LMs), suffer substantial performance losses in zero-shot cross-lingual transfer (ZS-XLT). Second, the current paradigm of fine-tuning the backbone LM of a neural recommender on task-specific data is computationally expensive and infeasible in few-shot recommendation and cold-start setups, where data is scarce or completely unavailable. In this work, we propose a news-adapted sentence encoder (NaSE), domain-specialized from a pretrained massively multilingual sentence encoder (SE). To this end, we construct and leverage PolyNews and PolyNewsParallel, two multilingual news-specific corpora. With the news-adapted multilingual SE in place, we test the effectiveness of (i.e., question the need for) supervised fine-tuning for news recommendation, and propose a simple and strong baseline based on (i) frozen NaSE embeddings and (ii) late click-behavior fusion. We show that NaSE achieves state-of-the-art performance in ZS-XLT in true cold-start and few-shot news recommendation.

📄 PDF Abstract BibTeX arXiv:2406.12634

Code (1)

andreeaiana/nase 공식 구현 pytorch

Tasks

Cross-Lingual TransferDomain AdaptationMultilingual NLPNews RecommendationNews RetrievalRecommendation SystemsSemantic SimilaritySentenceSentence EmbeddingsText RetrievalTranslationZero-Shot Cross-Lingual Transfer

Similar Papers 제목 키워드 기반

Fake News Classification in Urdu: A Domain Adaptation Approach for a Low-Resource Language

2025-12-28 · Muhammad Zain Ali, Bernhard Pfahringer, Tony Smith arxiv

Misinformation on social media is a widely acknowledged issue, and researchers worldwide are actively engaged in its detection. However, low-resource languages such as Urdu have received limited attention in this domain.…

News ClassificationDomain Adaptation

OEKG: The Open Event Knowledge Graph

2023-02-28 · Simon Gottschalk, Endri Kacupaj, Sara Abdollahi, Diego Alves 외

Accessing and understanding contemporary and historical events of global impact such as the US elections and the Olympic Games is a major prerequisite for cross-lingual event analytics that investigate event causes, perc…

ArticlesImage RetrievalKnowledge Graphsnamed-entity-recognition+4

M2QA: Multi-domain Multilingual Question Answering

2024-07-01 · Leon Engländer, Hannah Sterz, Clifton Poth, Jonas Pfeiffer 외

Generalization and robustness to input variation are core desiderata of machine learning research. Language varies along several axes, most importantly, language instance (e.g. French) and domain (e.g. news). While adapt…

Question Answering

Global Voices: Crossing Borders in Automatic News Summarization

2019-10-01 · WS 2019 11 · Khanh Nguyen, Hal Daumé III

We construct Global Voices, a multilingual dataset for evaluating cross-lingual summarization methods. We extract social-network descriptions of Global Voices news articles to cheaply collect evaluation data for into-Eng…

ArticlesNews SummarizationTranslation

Leveraging Contextual Embeddings for Detecting Diachronic Semantic Shift

2019-12-02 · LREC 2020 5 · Matej Martinc, Petra Kralj Novak, Senja Pollak

We propose a new method that leverages contextual embeddings for the task of diachronic semantic shift detection by generating time specific word representations from BERT embeddings. The results of our experiments in th…

Domain AdaptationSemantic Shift Detection