paper-with-me

홈 › Papers

Finding Friends and Flipping Frenemies: Automatic Paraphrase Dataset Augmentation Using Graph Theory

2020-11-03 · Findings of the Association for Computational Linguistics 2020 · Hannah Chen, Yangfeng Ji, David Evans

Most NLP datasets are manually labeled, so suffer from inconsistent labeling or limited size. We propose methods for automatically improving datasets by viewing them as graphs with expected semantic properties. We construct a paraphrase graph from the provided sentence pair labels, and create an augmented dataset by directly inferring labels from the original sentence pairs using a transitivity property. We use structural balance theory to identify likely mislabelings in the graph, and flip their labels. We evaluate our methods on paraphrase models trained using these datasets starting from a pretrained BERT model, and find that the automatically-enhanced training sets result in more accurate models.

📄 PDF Abstract BibTeX arXiv:2011.01856

Code (1)

hannahxchen/automatic-paraphrase-dataset-augmentation 공식 구현 pytorch

Tasks

Sentence

Methods 이 논문이 사용한 방법론

FLIP https://developer.nvidia.com/blog/flip-a-difference-evaluator-for-alternating-images/
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
WordPiece 설명 없음
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Weight Decay 설명 없음

Similar Papers 제목 키워드 기반

Human-Paraphrased References Improve Neural Machine Translation

2020-10-20 · WMT (EMNLP) 2020 11 · Markus Freitag, George Foster, David Grangier, Colin Cherry

Automatic evaluation comparing candidate translations to human-generated paraphrases of reference translations has recently been proposed by Freitag et al. When used in place of original references, the paraphrased versi…

Machine TranslationNMTTranslation

On the Evaluation Metrics for Paraphrase Generation

2022-02-17 · Lingfeng Shen, Lemao Liu, Haiyun Jiang, Shuming Shi

In this paper we revisit automatic metrics for paraphrase evaluation and obtain two findings that disobey conventional wisdom: (1) Reference-free metrics achieve better performance than their reference-based counterparts…

Machine TranslationParaphrase Generation

Modeling Information Change in Science Communication with Semantically Matched Paraphrases

2022-10-24 · Dustin Wright, Jiaxin Pei, David Jurgens, Isabelle Augenstein

Whether the media faithfully communicate scientific information has long been a core issue to the science community. Automatically identifying paraphrased scientific findings could enable large-scale tracking and analysi…

Fact CheckingRetrieval

A Large-Scale Benchmark for Vietnamese Sentence Paraphrases

2025-02-11 · Sang Quang Nguyen, Kiet Van Nguyen

This paper presents ViSP, a high-quality Vietnamese dataset for sentence paraphrasing, consisting of 1.2M original-paraphrase pairs collected from various domains. The dataset was constructed using a hybrid approach that…

Paraphrase GenerationSentence

Paraphrase Detection: Human vs. Machine Content

2023-03-24 · Jonas Becker, Jan Philip Wahle, Terry Ruas, Bela Gipp

The growing prominence of large language models, such as GPT-4 and ChatGPT, has led to increased concerns over academic integrity due to the potential for machine-generated content and paraphrasing. Although studies have…

Diversity