Polly Want a Cracker: Analyzing Performance of Parroting on Paraphrase Generation Datasets
Paraphrase generation is an interesting and challenging NLP task which has numerous practical applications. In this paper, we analyze datasets commonly used for paraphrase generation research, and show that simply parroting input sentences surpasses state-of-the-art models in the literature when evaluated on standard metrics. Our findings illustrate that a model could be seemingly adept at generating paraphrases, despite only making trivial changes to the input sentence or even none at all.
Code (0)
등록된 구현이 없습니다.
Tasks
Paraphrase GenerationSentenceSimilar Papers 제목 키워드 기반
Context parroting: A simple but tough-to-beat baseline for foundation models in scientific machine learning
Recently-developed time series foundation models for scientific machine learning exhibit emergent abilities to predict physical systems. These abilities include zero-shot forecasting, in which a model forecasts future st…
In-Context LearningTime SeriesTime Series ForecastingCRACKER: Cracking the Language Barrier
CRACKER – cracking the language barrier. Selected results 2015/2016
Customized Monte Carlo Tree Search for LLVM/Polly's Composable Loop Optimization Transformations
Polly is the LLVM project's polyhedral loop nest optimizer. Recently, user-directed loop transformation pragmas were proposed based on LLVM/Clang and Polly. The search space exposed by the transformation pragmas is a tre…