Correcting the Common Discourse Bias in Linear Representation of Sentences using Conceptors
Distributed representations of words, better known as word embeddings, have become important building blocks for natural language processing tasks. Numerous studies are devoted to transferring the success of unsupervised word embeddings to sentence embeddings. In this paper, we introduce a simple representation of sentences in which a sentence embedding is represented as a weighted average of word vectors followed by a soft projection. We demonstrate the effectiveness of this proposed method on the clinical semantic textual similarity task of the BioCreative/OHNLP Challenge 2018.
Code (0)
등록된 구현이 없습니다.
Tasks
Semantic Textual SimilaritySentenceSentence EmbeddingSentence-EmbeddingSentence EmbeddingsWord EmbeddingsSimilar Papers 제목 키워드 기반
DRS at MRP 2020: Dressing up Discourse Representation Structures as Graphs
Discourse Representation Theory (DRT) is a formal account for representing the meaning of natural language discourse. Meaning in DRT is modeled via a Discourse Representation Structure (DRS), a meaning representation wit…
Correcting Length Bias in Neural Machine Translation
We study two problems in neural machine translation (NMT). First, in beam search, whereas a wider beam should in principle help translation, it often hurts NMT. Second, NMT has a tendency to produce translations that are…
Machine TranslationNMTTranslationDisentangled Variational Auto-encoder Enhanced by Counterfactual Data for Debiasing Recommendation
Recommender system always suffers from various recommendation biases, seriously hindering its development. In this light, a series of debias methods have been proposed in the recommender system, especially for two most c…
counterfactualRecommendation SystemsMasculine Defaults via Gendered Discourse in Podcasts and Large Language Models
Masculine defaults are widely recognized as a significant type of gender bias, but they are often unseen as they are under-researched. Masculine defaults involve three key parts: (i) the cultural context, (ii) the mascul…
Correcting Texts Generated by Transformers using Discourse Features and Web Mining
Recent transformer-based approaches to NLG like GPT-2 can generate syntactically coherent original texts. However, these generated texts have serious flaws: global discourse incoherence and meaninglessness of sentences i…