No Word is an Island -- A Transformation Weighting Model for Semantic Composition
Composition models of distributional semantics are used to construct phrase representations from the representations of their words. Composition models are typically situated on two ends of a spectrum. They either have a small number of parameters but compose all phrases in the same way, or they perform word-specific compositions at the cost of a far larger number of parameters. In this paper we propose transformation weighting (TransWeight), a composition model that consistently outperforms existing models on nominal compounds, adjective-noun phrases and adverb-adjective phrases in English, German and Dutch. TransWeight drastically reduces the number of parameters needed compared to the best model in the literature by composing similar words in the same way.
Code (1)
Tasks
Semantic CompositionSimilar Papers 제목 키워드 기반
No Word is an Island---A Transformation Weighting Model for Semantic Composition
Composition models of distributional semantics are used to construct phrase representations from the representations of their words. Composition models are typically situated on two ends of a spectrum. They either have a…
Semantic CompositionLinear Transformations for Cross-lingual Semantic Textual Similarity
Cross-lingual semantic textual similarity systems estimate the degree of the meaning similarity between two sentences, each in a different language. State-of-the-art algorithms usually employ machine translation and comb…
Cross-Lingual Semantic Textual SimilarityMachine TranslationSemantic Textual SimilaritySentence+2MELODI: Semantic Similarity of Words and Compositional Phrases using Latent Vector Weighting
Representing Syntax and Composition with Geometric Transformations
The exploitation of syntactic graphs (SyGs) as a word's context has been shown to be beneficial for distributional semantic models (DSMs), both at the level of individual word representations and in deriving phrasal repr…
Knowledge GraphsCultivating Archipelago of Forests: Evolving Robust Decision Trees through Island Coevolution
Decision trees are widely used in machine learning due to their simplicity and interpretability, but they often lack robustness to adversarial attacks and data perturbations. The paper proposes a novel island-based coevo…
DiversityInterpretable Machine Learning