A data-driven strategy to combine word embeddings in information retrieval
Word embeddings are vital descriptors of words in unigram representations of documents for many tasks in natural language processing and information retrieval. The representation of queries has been one of the most critical challenges in this area because it consists of a few terms and has little descriptive capacity. Strategies such as average word embeddings can enrich the queries' descriptive capacity since they favor the identification of related terms from the continuous vector representations that characterize these approaches. We propose a data-driven strategy to combine word embeddings. We use Idf combinations of embeddings to represent queries, showing that these representations outperform the average word embeddings recently proposed in the literature. Experimental results on benchmark data show that our proposal performs well, suggesting that data-driven combinations of word embeddings are a promising line of research in ad-hoc information retrieval.
Code (0)
등록된 구현이 없습니다.
Tasks
Ad-Hoc Information RetrievalDescriptiveInformation RetrievalRetrievalWord EmbeddingsSimilar Papers 제목 키워드 기반
Data-Driven Mitigation of Adversarial Text Perturbation
Social networks have become an indispensable part of our lives, with billions of people producing ever-increasing amounts of text. At such scales, content policies and their enforcement become paramount. To automate mode…
Adversarial TextClassificationRobust classificationWord EmbeddingsThe Unreasonable Effectiveness of Random Target Embeddings for Continuous-Output Neural Machine Translation
Continuous-output neural machine translation (CoNMT) replaces the discrete next-word prediction problem with an embedding prediction. The semantic structure of the target embedding space (i.e., closeness of related words…
Machine TranslationPredictionTranslationSolving Hard Analogy Questions with Relation Embedding Chains
Modelling how concepts are related is a central topic in Lexical Semantics. A common strategy is to rely on knowledge graphs (KGs) such as ConceptNet, and to model the relation between two concepts as a set of paths. How…
Knowledge GraphsLanguage ModelingLanguage ModellingRelationAtalaya at TASS 2019: Data Augmentation and Robust Embeddings for Sentiment Analysis
In this article we describe our participation in TASS 2019, a shared task aimed at the detection of sentiment polarity of Spanish tweets. We combined different representations such as bag-of-words, bag-of-characters, and…
Data AugmentationSentiment AnalysisTranslationWord EmbeddingsBeyond Bilingual: Multi-sense Word Embeddings using Multilingual Context
Word embeddings, which represent a word as a point in a vector space, have become ubiquitous to several NLP tasks. A recent line of work uses bilingual (two languages) corpora to learn a different vector for each sense o…
Representation LearningWord Embeddings