From Paraphrase Database to Compositional Paraphrase Model and Back
The Paraphrase Database (PPDB; Ganitkevitch et al., 2013) is an extensive semantic resource, consisting of a list of phrase pairs with (heuristic) confidence estimates. However, it is still unclear how it can best be used, due to the heuristic nature of the confidences and its necessarily incomplete coverage. We propose models to leverage the phrase pairs from the PPDB to build parametric paraphrase models that score paraphrase pairs more accurately than the PPDB's internal scores while simultaneously improving its coverage. They allow for learning phrase embeddings as well as improved word embeddings. Moreover, we introduce two new, manually annotated datasets to evaluate short-phrase paraphrasing models. Using our paraphrase model trained using PPDB, we achieve state-of-the-art results on standard word and bigram similarity tasks and beat strong baselines on our new short phrase paraphrase tasks.
Code (1)
Tasks
Word EmbeddingsSimilar Papers 제목 키워드 기반
Learning Phrase Embeddings from Paraphrases with GRUs
Learning phrase representations has been widely explored in many Natural Language Processing (NLP) tasks (e.g., Sentiment Analysis, Machine Translation) and has shown promising improvements. Previous studies either learn…
Machine TranslationSentiment AnalysisTranslationThe Multilingual Paraphrase Database
We release a massive expansion of the paraphrase database (PPDB) that now includes a collection of paraphrases in 23 different languages. The resource is derived from large volumes of bilingual parallel data. Our collect…
Document SummarizationInformation RetrievalMachine TranslationMulti-Document Summarization+4A Paraphrase and Semantic Similarity Detection System for User Generated Short-Text Content on Microblogs
Existing systems deliver high accuracy and F1-scores for detecting paraphrase and semantic similarity on traditional clean-text corpus. For instance, on the clean-text Microsoft Paraphrase benchmark database, the existin…
Semantic SimilaritySemantic Textual SimilarityEssentia: Mining Domain-Specific Paraphrases with Word-Alignment Graphs
Paraphrases are important linguistic resources for a wide variety of NLP applications. Many techniques for automatic paraphrase mining from general corpora have been proposed. While these techniques are successful at dis…
Paraphrase MiningWord AlignmentMonolingual Phrase Alignment on Parse Forests
We propose an efficient method to conduct phrase alignment on parse forests for paraphrase detection. Unlike previous studies, our method identifies syntactic paraphrases under linguistically motivated grammar. In additi…
Semantic Textual SimilaritySentence Embeddings