paper-with-me

Papers

Detecting Generated Scientific Papers using an Ensemble of Transformer Models

2022-09-17 · sdp (COLING) 2022 10 · Anna Glazkova, Maksim Glazkov

The paper describes neural models developed for the DAGPap22 shared task hosted at the Third Workshop on Scholarly Document Processing. This shared task targets the automatic detection of generated scientific papers. Our work focuses on comparing different transformer-based models as well as using additional datasets and techniques to deal with imbalanced classes. As a final submission, we utilized an ensemble of SciBERT, RoBERTa, and DeBERTa fine-tuned using random oversampling technique. Our model achieved 99.24% in terms of F1-score. The official evaluation results have put our system at the third place.

📄 PDF Abstract BibTeX arXiv:2209.08283

Code (1)

oldaandozerskaya/dagpap22 공식 구현

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Adam 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

Papilusion at DAGPap24: Paper or Illusion? Detecting AI-generated Scientific Papers

2024-07-24 · Nikita Andreev, Alexander Shirnin, Vladislav Mikhailov, Ekaterina Artemova

This paper presents Papilusion, an AI-generated scientific text detector developed within the DAGPap24 shared task on detecting automatically generated scientific papers. We propose an ensemble-based approach and conduct…

Overview of the DAGPap22 Shared Task on Detecting Automatically Generated Scientific Papers

2022-10-01 · sdp (COLING) 2022 10 · Yury Kashnitsky, Drahomira Herrmannova, Anita de Waard, George Tsatsaronis 외

This paper provides an overview of the DAGPap22 shared task on the detection of automatically generated scientific papers at the Scholarly Document Process workshop colocated with COLING. We frame the detection problem a…

Binary Classification

TAB-AUDIT: Detecting AI-Fabricated Scientific Tables via Multi-View Likelihood Mismatch

2026-03-20 · Shuo Huang, Yan Pen, Lizhen Qu arxiv

AI-generated fabricated scientific manuscripts raise growing concerns with large-scale breaches of academic integrity. In this work, we present the first systematic study on detecting AI-generated fabricated scientific t…

Towards Automatic Curation of Antibiotic Resistance Genes via Statement Extraction from Scientific Papers: A Benchmark Dataset and Models

2022-05-01 · BioNLP (ACL) 2022 5 · Sidhant Chandak, Liqing Zhang, Connor Brown, Lifu Huang

Antibiotic resistance has become a growing worldwide concern as new resistance mechanisms are emerging and spreading globally, and thus detecting and collecting the cause – Antibiotic Resistance Genes (ARGs), have been m…

An Instance-based Plus Ensemble Learning Method for Classification of Scientific Papers

2024-09-21 · Fang Zhang, Shengli Wu

The exponential growth of scientific publications in recent years has posed a significant challenge in effective and efficient categorization. This paper introduces a novel approach that combines instance-based learning …

ClassificationEnsemble Learning