Learning Semantic Textual Similarity from Conversations
We present a novel approach to learn representations for sentence-level semantic similarity using conversational data. Our method trains an unsupervised model to predict conversational input-response pairs. The resulting sentence embeddings perform well on the semantic textual similarity (STS) benchmark and SemEval 2017's Community Question Answering (CQA) question similarity subtask. Performance is further improved by introducing multitask training combining the conversational input-response prediction task and a natural language inference task. Extensive experiments show the proposed model achieves the best performance among all neural models on the STS benchmark and is competitive with the state-of-the-art feature engineered and mixed systems in both tasks.
Code (1)
Tasks
Community Question AnsweringNatural Language InferenceQuestion AnsweringQuestion SimilaritySemantic SimilaritySemantic Textual SimilaritySentenceSentence EmbeddingsSTSSTS BenchmarkSimilar Papers 제목 키워드 기반
Brotherhood at WMT 2024: Leveraging LLM-Generated Contextual Conversations for Cross-Lingual Image Captioning
In this paper, we describe our system under the team name Brotherhood for the English-to-Lowres Multi-Modal Translation Task. We participate in the multi-modal translation tasks for English-Hindi, English-Hausa, English-…
Image CaptioningSemantic SimilaritySemantic Textual SimilarityTranslationUsing Summarization to Discover Argument Facets in Online Ideological Dialog
More and more of the information available on the web is dialogic, and a significant portion of it takes place in online forum conversations about current social and political topics. We aim to develop tools to summarize…
Semantic Textual SimilarityDecoding Emotional Experiences in Dyadic Conversations of Married Couples: Leveraging Semantic Similarity through Sentence Embedding
Recent advancements in Natural Language Processing (NLP) have highlighted the potential of sentence embeddings in measuring semantic similarity (hereafter similarity). Yet, whether this approach can be used to analyze re…
Semantic SimilaritySemantic Textual SimilaritySentenceSentence Embedding+3TaskDiff: A Similarity Metric for Task-Oriented Conversations
The popularity of conversational digital assistants has resulted in the availability of large amounts of conversational data which can be utilized for improved user experience and personalized response generation. Buildi…
Prompt EngineeringResponse GenerationBeyond Static: Related Questions Retrieval Through Conversations in Community Question Answering
In community question answering (cQA) platforms like Stack Overflow, related question retrieval is recognized as a fundamental task that allows users to retrieve related questions to answer user queries automatically. Al…
Community Question AnsweringSemantic Similarity