paper-with-me

홈 › Papers

LuxVeri at GenAI Detection Task 3: Cross-Domain Detection of AI-Generated Text Using Inverse Perplexity-Weighted Ensemble of Fine-Tuned Transformer Models

2025-01-21 · Md Kamrujjaman Mobin, Md Saiful Islam

This paper presents our approach for Task 3 of the GenAI content detection workshop at COLING-2025, focusing on Cross-Domain Machine-Generated Text (MGT) Detection. We propose an ensemble of fine-tuned transformer models, enhanced by inverse perplexity weighting, to improve classification accuracy across diverse text domains. For Subtask A (Non-Adversarial MGT Detection), we combined a fine-tuned RoBERTa-base model with an OpenAI detector-integrated RoBERTa-base model, achieving an aggregate TPR score of 0.826, ranking 10th out of 23 detectors. In Subtask B (Adversarial MGT Detection), our fine-tuned RoBERTa-base model achieved a TPR score of 0.801, securing 8th out of 22 detectors. Our results demonstrate the effectiveness of inverse perplexity-based weighting for enhancing generalization and performance in both non-adversarial and adversarial MGT detection, highlighting the potential for transformer models in cross-domain AI-generated content detection.

📄 PDF Abstract BibTeX arXiv:2501.11918

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

LuxVeri at GenAI Detection Task 1: Inverse Perplexity Weighted Ensemble for Robust Detection of AI-Generated Text across English and Multilingual Contexts

2025-01-21 · Md Kamrujjaman Mobin, Md Saiful Islam

This paper presents a system developed for Task 1 of the COLING 2025 Workshop on Detecting AI-Generated Content, focusing on the binary classification of machine-generated versus human-written text. Our approach utilizes…

Binary ClassificationText Detection

Understanding Student and Academic Staff Perceptions of AI Use in Assessment and Feedback

2024-06-22 · Jasper Roe, Mike Perkins, Daniel Ruelle

The rise of Artificial Intelligence (AI) and Generative Artificial Intelligence (GenAI) in higher education necessitates assessment reform. This study addresses a critical gap by exploring student and academic staff expe…

DescriptiveText Detection

Advacheck at GenAI Detection Task 1: AI Detection Powered by Domain-Aware Multi-Tasking

2024-11-18 · German Gritsai, Anastasia Voznyuk, Ildar Khabutdinov, Andrey Grabovoy

The paper describes a system designed by Advacheck team to recognise machine-generated and human-written texts in the monolingual subtask of GenAI Detection Task 1 competition. Our developed system is a multi-task archit…

Binary ClassificationMulti-Task Learning

Paradigm shift on Coding Productivity Using GenAI

2025-04-25 · Liang Yu

Generative AI (GenAI) applications are transforming software engineering by enabling automated code co-creation. However, empirical evidence on GenAI's productivity effects in industrial settings remains limited. This pa…

GenAI Content Detection Task 1: English and Multilingual Machine-Generated Text Detection: AI vs. Human

2025-01-19 · Yuxia Wang, Artem Shelmanov, Jonibek Mansurov, Akim Tsvigun 외

We present the GenAI Content Detection Task~1 -- a shared task on binary machine generated text detection, conducted as a part of the GenAI workshop at COLING 2025. The task consists of two subtasks: Monolingual (English…

Text Detection