Embedding Space Correlation as a Measure of Domain Similarity
Prior work has determined domain similarity using text-based features of a corpus. However, when using pre-trained word embeddings, the underlying text corpus might not be accessible anymore. Therefore, we propose the CCA measure, a new measure of domain similarity based directly on the dimension-wise correlations between corresponding embedding spaces. Our results suggest that an inherent notion of domain can be captured this way, as we are able to reproduce our findings for different domain comparisons for English, German, Spanish and Czech as well as in cross-lingual comparisons. We further find a threshold at which the CCA measure indicates that two corpora come from the same domain in a monolingual setting by applying permutation tests. By evaluating the usability of the CCA measure in a domain adaptation application, we also show that it can be used to determine which corpora are more similar to each other in a cross-domain sentiment detection task.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationWord EmbeddingsSimilar Papers 제목 키워드 기반
The Secret is in the Spectra: Predicting Cross-lingual Task Performance with Spectral Similarity Measures
Performance in cross-lingual NLP tasks is impacted by the (dis)similarity of languages at hand: e.g., previous work has suggested there is a connection between the expected success of bilingual lexicon induction (BLI) an…
Bilingual Lexicon InductionMachine TranslationPOSPOS TaggingBeyond Correlation: A Path-Invariant Measure for Seismogram Similarity
Similarity search is a popular technique for seismic signal processing, with template matching, matched filters and subspace detectors being utilized for a wide variety of tasks, including both signal detection and sourc…
Template MatchingTripletImproving Correlation with Human Judgments by Integrating Semantic Similarity with Second--Order Vectors
Vector space methods that measure semantic similarity and relatedness often rely on distributional information such as co--occurrence frequencies or statistical measures of association to weight the importance of particu…
Semantic SimilaritySemantic Textual SimilarityCalibrated Similarity for Reliable Geometric Analysis of Embedding Spaces
While raw cosine similarity in pretrained embedding spaces exhibits strong rank correlation with human judgments, anisotropy induces systematic miscalibration of absolute values: scores concentrate in a narrow high-simil…
A Correlation Maximization Approach for Cross Domain Co-Embeddings
Although modern recommendation systems can exploit the structure in users' item feedback, most are powerless in the face of new users who provide no structure for them to exploit. In this paper we introduce ImplicitCE, a…
Recommendation Systems