Reddit Temporal N-gram Corpus and its Applications on Paraphrase and Semantic Similarity in Social Media using a Topic-based Latent Semantic Analysis
This paper introduces a new large-scale n-gram corpus that is created specifically from social media text. Two distinguishing characteristics of this corpus are its monthly temporal attribute and that it is created from 1.65 billion comments of user-generated text in Reddit. The usefulness of this corpus is exemplified and evaluated by a novel Topic-based Latent Semantic Analysis (TLSA) algorithm. The experimental results show that unsupervised TLSA outperforms all the state-of-the-art unsupervised and semi-supervised methods in SEMEVAL 2015: paraphrase and semantic similarity in Twitter tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
AttributeInformation RetrievalLanguage ModelingLanguage ModellingMachine TranslationNamed Entity Recognition (NER)Paraphrase IdentificationRumour DetectionSemantic SimilaritySemantic Textual SimilaritySpeech RecognitionSimilar Papers 제목 키워드 기반
Corpus-Based Paraphrase Detection Experiments and Review
Paraphrase detection is important for a number of applications, including plagiarism detection, authorship attribution, question answering, text summarization, text mining in general, etc. In this paper, we give a perfor…
Authorship AttributionDeep LearningModel SelectionQuestion Answering+3Paraphrasing verbal metonymy through computational methods
Verbal metonymy has received relatively scarce attention in the field of computational linguistics despite the fact that a model to accurately paraphrase metonymy has applications both in academia and the technology sect…
Turkish Paraphrase Corpus
Paraphrases are alternative syntactic forms in the same language expressing the same semantic content. Speakers of all languages are inherently familiar with paraphrases at different levels of granularity (lexical, phras…
Machine TranslationQuestion AnsweringText GenerationText Summarization+1Paraphrase Generation from Latent-Variable PCFGs for Semantic Parsing
One of the limitations of semantic parsing approaches to open-domain question answering is the lexicosyntactic gap between natural language questions and knowledge base entries -- there are many ways to ask a question, a…
Open-Domain Question AnsweringParaphrase GenerationQuestion AnsweringSemantic Parsing+1Finnish Paraphrase Corpus
In this paper, we introduce the first fully manually annotated paraphrase corpus for Finnish containing 53,572 paraphrase pairs harvested from alternative subtitles and news headings. Out of all paraphrase pairs in our c…
All