In Search for Linear Relations in Sentence Embedding Spaces
We present an introductory investigation into continuous-space vector representations of sentences. We acquire pairs of very similar sentences differing only by a small alterations (such as change of a noun, adding an adjective, noun or punctuation) from datasets for natural language inference using a simple pattern method. We look into how such a small change within the sentence text affects its representation in the continuous space and how such alterations are reflected by some of the popular sentence embedding models. We found that vector differences of some embeddings actually reflect small changes within a sentence.
Code (0)
등록된 구현이 없습니다.
Tasks
Natural Language InferenceSentenceSentence EmbeddingSentence-EmbeddingSimilar Papers 제목 키워드 기반
Topological Interpretations of GPT-3
This is an experiential study of investigating a consistent method for deriving the correlation between sentence vector and semantic meaning of a sentence. We first used three state-of-the-art word/sentence embedding met…
SentenceSentence EmbeddingSentence-EmbeddingClustering and Network Analysis for the Embedding Spaces of Sentences and Sub-Sentences
Sentence embedding methods offer a powerful approach for working with short textual constructs or sequences of words. By representing sentences as dense numerical vectors, many natural language processing (NLP) applicati…
ClusteringSentenceSentence EmbeddingSentence-Embedding+1A Comparative Study on Structural and Semantic Properties of Sentence Embeddings
Sentence embeddings encode natural language sentences as low-dimensional dense vectors. A great deal of effort has been put into using sentence embeddings to improve several important natural language processing tasks. R…
Knowledge GraphsRelationRelation ExtractionSentence+3Sentence Analogies: Exploring Linguistic Relationships and Regularities in Sentence Embeddings
While important properties of word vector representations have been studied extensively, far less is known about the properties of sentence vector representations. Word vectors are often evaluated by assessing to what de…
SentenceSentence EmbeddingSentence-EmbeddingSentence EmbeddingsImposing Relation Structure in Language-Model Embeddings Using Contrastive Learning
Though language model text embeddings have revolutionized NLP research, their ability to capture high-level semantic information, such as relations between entities in text, is limited. In this paper, we propose a novel …
Contrastive LearningLanguage ModelingLanguage Modellingnamed-entity-recognition+6