Automatically Ranked Russian Paraphrase Corpus for Text Generation

2020-06-17 · WS 2020 7 · Vadim Gudkov, Olga Mitrofanova, Elizaveta Filippskikh

The article is focused on automatic development and ranking of a large corpus for Russian paraphrase generation which proves to be the first corpus of such type in Russian computational linguistics. Existing manually annotated paraphrase datasets for Russian are limited to small-sized ParaPhraser corpus and ParaPlag which are suitable for a set of NLP tasks, such as paraphrase and plagiarism detection, sentence similarity and relatedness estimation, etc. Due to size restrictions, these datasets can hardly be applied in end-to-end text generation solutions. Meanwhile, paraphrase generation requires a large amount of training data. In our study we propose a solution to the problem: we collect, rank and evaluate a new publicly available headline paraphrase corpus (ParaPhraser Plus), and then perform text generation experiments with manual evaluation on automatically ranked corpora using the Universal Transformer architecture.

📄 PDF Abstract BibTeX arXiv:2006.09719

Code (0)

등록된 구현이 없습니다.

Tasks

Paraphrase GenerationSentenceSentence SimilarityText Generation

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Position-Wise Feed-Forward Layer 설명 없음

Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…

Residual Connection 설명 없음

Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Multi-Head Attention 설명 없음

Adam 설명 없음

Russian Paraphrasers: Paraphrase with Transformers

2021-04-01 · BSNLP 2021 4 · Alena Fenogenova

This paper studies the generation methods for paraphrasing in the Russian language. There are several transformer-based models (Russian and multilingual) trained on a collected corpus of paraphrases. We compare different…

Open Subtitles Paraphrase Corpus for Six Languages

2018-09-17 · LREC 2018 5 · Mathias Creutz

This paper accompanies the release of Opusparcus, a new paraphrase corpus for six European languages: German, English, Finnish, French, Russian, and Swedish. The corpus consists of paraphrases, that is, pairs of sentence…

Sentence

The Multilingual Paraphrase Database

2014-05-01 · LREC 2014 5 · Juri Ganitkevitch, Chris Callison-Burch

We release a massive expansion of the paraphrase database (PPDB) that now includes a collection of paraphrases in 23 different languages. The resource is derived from large volumes of bilingual parallel data. Our collect…

Document Summarization Information Retrieval Machine Translation Multi-Document Summarization+4

ParaCotta: Synthetic Multilingual Paraphrase Corpora from the Most Diverse Translation Sample Pair

2022-05-10 · PACLIC 2021 11 · Alham Fikri Aji, Tirana Noor Fatyanosa, Radityo Eko Prasojo, Philip Arthur 외

We release our synthetic parallel paraphrase corpus across 17 languages: Arabic, Catalan, Czech, German, English, Spanish, Estonian, French, Hindi, Indonesian, Italian, Dutch, Romanian, Russian, Swedish, Vietnamese, and …

Machine Translation Sentence Translation

DaNetQA: a yes/no Question Answering Dataset for the Russian Language

2020-10-06 · Taisia Glushkova, Alexey Machnev, Alena Fenogenova, Tatiana Shavrina 외

DaNetQA, a new question-answering corpus, follows (Clark et. al, 2019) design: it comprises natural yes/no questions. Each question is paired with a paragraph from Wikipedia and an answer, derived from the paragraph. The…

Question Answering Sentence Transfer Learning Translation