Multi-View Domain Adapted Sentence Embeddings for Low-Resource Unsupervised Duplicate Question Detection
We address the problem of Duplicate Question Detection (DQD) in low-resource domain-specific Community Question Answering forums. Our multi-view framework MV-DASE combines an ensemble of sentence encoders via Generalized Canonical Correlation Analysis, using unlabeled data only. In our experiments, the ensemble includes generic and domain-specific averaged word embeddings, domain-finetuned BERT and the Universal Sentence Encoder. We evaluate MV-DASE on the CQADupStack corpus and on additional low-resource Stack Exchange forums. Combining the strengths of different encoders, we significantly outperform BM25, all single-view systems as well as a recent supervised domain-adversarial DQD method.
Code (0)
등록된 구현이 없습니다.
Tasks
Community Question AnsweringQuestion AnsweringSentenceSentence EmbeddingsWord EmbeddingsMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Efficient Domain Adaptation of Sentence Embeddings Using Adapters
Sentence embeddings enable us to capture the semantic similarity of short texts. Most sentence embedding models are trained for general semantic textual similarity tasks. Therefore, to use sentence embeddings in a partic…
Domain AdaptationSemantic SimilaritySemantic Textual SimilaritySentence+4Domain Adapted Word Embeddings for Improved Sentiment Classification
Generic word embeddings are trained on large-scale generic corpora; Domain Specific (DS) word embeddings are trained only on data from a domain of interest. This paper proposes a method to combine the breadth of generic …
ClassificationGeneral ClassificationSentenceSentiment Analysis+3Contrasting distinct structured views to learn sentence embeddings
We propose a self-supervised method that builds sentence embeddings from the combination of diverse explicit syntactic structures of a sentence. We assume structure is crucial to build consistent representations as we e…
SentenceSentence EmbeddingSentence-EmbeddingSentence EmbeddingsTowards Understanding Domain Adapted Sentence Embeddings for Document Retrieval
A plethora of sentence embedding models makes it challenging to choose one, especially for technical domains rich with specialized vocabulary. In this work, we domain adapt embeddings using telecom, health and science da…
Domain AdaptationQuestion AnsweringRetrievalSentence+3News Without Borders: Domain Adaptation of Multilingual Sentence Embeddings for Cross-lingual News Recommendation
Rapidly growing numbers of multilingual news consumers pose an increasing challenge to news recommender systems in terms of providing customized recommendations. First, existing neural news recommenders, even when powere…
Cross-Lingual TransferDomain AdaptationMultilingual NLPNews Recommendation+8