Learning Phrase Embeddings from Paraphrases with GRUs
Learning phrase representations has been widely explored in many Natural Language Processing (NLP) tasks (e.g., Sentiment Analysis, Machine Translation) and has shown promising improvements. Previous studies either learn non-compositional phrase representations with general word embedding learning techniques or learn compositional phrase representations based on syntactic structures, which either require huge amounts of human annotations or cannot be easily generalized to all phrases. In this work, we propose to take advantage of large-scaled paraphrase database and present a pair-wise gated recurrent units (pairwise-GRU) framework to generate compositional phrase representations. Our framework can be re-used to generate representations for any phrases. Experimental results show that our framework achieves state-of-the-art results on several phrase similarity tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine TranslationSentiment AnalysisTranslationSimilar Papers 제목 키워드 기반
Using Paraphrases to Study Properties of Contextual Embeddings
We use paraphrases as a unique source of data to analyze contextualized embeddings, with a particular focus on BERT. Because paraphrases naturally encode consistent word and phrase semantics, they provide a unique lens f…
Unsupervised Syntactically Controlled Paraphrase Generation with Abstract Meaning Representations
Syntactically controlled paraphrase generation has become an emerging research direction in recent years. Most existing approaches require annotated paraphrase pairs for training and are thus costly to extend to new doma…
Data AugmentationDecoderParaphrase GenerationSentenceEvent Coreference Resolution with their Paraphrases and Argument-aware Embeddings
Event coreference resolution aims to classify all event mentions that refer to the same real-world event into the same group, which is necessary to information aggregation and many downstream applications. To resolve eve…
coreference-resolutionCoreference ResolutionEvent Coreference ResolutionParaphrases as Foreign Languages in Multilingual Neural Machine Translation
Paraphrases, the rewordings of the same semantic meaning, are useful for improving generalization and translation. However, prior works only explore paraphrases at the word or phrase level, not at the sentence or corpus …
Machine TranslationNMTSentenceTAG+2Essentia: Mining Domain-Specific Paraphrases with Word-Alignment Graphs
Paraphrases are important linguistic resources for a wide variety of NLP applications. Many techniques for automatic paraphrase mining from general corpora have been proposed. While these techniques are successful at dis…
Paraphrase MiningWord Alignment