paper-with-me

Papers

Team NYCU at Defactify4: Robust Detection and Source Identification of AI-Generated Images Using CNN and CLIP-Based Models

2025-03-13 · Tsan-Tsung Yang, I-Wei Chen, Kuan-Ting Chen, Shang-Hsuan Chiang, Wen-Chih Peng

With the rapid advancement of generative AI, AI-generated images have become increasingly realistic, raising concerns about creativity, misinformation, and content authenticity. Detecting such images and identifying their source models has become a critical challenge in ensuring the integrity of digital media. This paper tackles the detection of AI-generated images and identifying their source models using CNN and CLIP-ViT classifiers. For the CNN-based classifier, we leverage EfficientNet-B0 as the backbone and feed with RGB channels, frequency features, and reconstruction errors, while for CLIP-ViT, we adopt a pretrained CLIP image encoder to extract image features and SVM to perform classification. Evaluated on the Defactify 4 dataset, our methods demonstrate strong performance in both tasks, with CLIP-ViT showing superior robustness to image perturbations. Compared to baselines like AEROBLADE and OCC-CLIP, our approach achieves competitive results. Notably, our method ranked Top-3 overall in the Defactify 4 competition, highlighting its effectiveness and generalizability. All of our implementations can be found in https://github.com/uuugaga/Defactify_4

📄 PDF Abstract BibTeX arXiv:2503.10718

Code (1)

uuugaga/defactify_4 공식 구현 pytorch

Tasks

Misinformation

Methods 이 논문이 사용한 방법론

SVM A Support Vector Machine, or SVM, is a non-parametric supervised learning model. For non-linear classification and regression, they utilise the kernel trick to map inputs…
CLIP Contrastive Language-Image Pre-training (CLIP), consisting of a simplified version of ConVIRT trained from scratch, is an efficient method of image representation learning…
ADOPT Please enter a description about the method here

Similar Papers 제목 키워드 기반

Sarang at DEFACTIFY 4.0: Detecting AI-Generated Text Using Noised Data and an Ensemble of DeBERTa Models

2025-02-24 · Avinash Trivedi, Sangeetha Sivanesan

This paper presents an effective approach to detect AI-generated text, developed for the Defactify 4.0 shared task at the fourth workshop on multimodal fact checking and hate speech detection. The task consists of two su…

Fact CheckingHate Speech DetectionLanguage ModelingLanguage Modelling+2

Scalable Framework for Classifying AI-Generated Content Across Modalities

2025-02-01 · Anh-Kiet Duong, Petra Gomez-Krämer

The rapid growth of generative AI technologies has heightened the importance of effectively distinguishing between human and AI-generated content, as well as classifying outputs from diverse generative models. This paper…

image-classificationImage Classification

NYCU ML Lab LLAMA: Prefix tuning using LLAMA for Informationa Retrieval

2023-12-01 · arXiv 2023 12 · Zhi-Xuan Tai, Yu-Che Chang

TBD

Retrieval

Camera Model Identification Using Convolutional Neural Networks

2018-10-06 · Artur Kuzin, Artur Fattakhov, Ilya Kibardin, Vladimir Iglovikov 외

Source camera identification is the process of determining which camera or model has been used to capture an image. In the recent years, there has been a rapid growth of research interest in the domain of forensics. In t…

model

Findings of the Counter Turing Test: AI-Generated Image Detection

2026-05-20 · Rajarshi Roy, Nasrin Imanpour, Ashhar Aziz, Shashwat Bajpai 외 arxiv

The rapid advancements in generative AI technologies, such as Stable Diffusion, DALL-E, and Midjourney, have significantly transformed the creation of synthetic visual content. While these models enable innovation across…

Adversarial RobustnessBinary ClassificationContrastive Learning