paper-with-me

Papers

CLOFAI: A Dataset of Real And Fake Image Classification Tasks for Continual Learning

2025-01-19 · William Doherty, Anton Lee, Heitor Murilo Gomes

The rapid advancement of generative AI models capable of creating realistic media has led to a need for classifiers that can accurately distinguish between genuine and artificially-generated images. A significant challenge for these classifiers emerges when they encounter images from generative models that are not represented in their training data, usually resulting in diminished performance. A typical approach is to periodically update the classifier's training data with images from the new generative models then retrain the classifier on the updated dataset. However, in some real-life scenarios, storage, computational, or privacy constraints render this approach impractical. Additionally, models used in security applications may be required to rapidly adapt. In these circumstances, continual learning provides a promising alternative, as the classifier can be updated without retraining on the entire dataset. In this paper, we introduce a new dataset called CLOFAI (Continual Learning On Fake and Authentic Images), which takes the form of a domain-incremental image classification problem. Moreover, we showcase the applicability of this dataset as a benchmark for evaluating continual learning methodologies. In doing this, we set a baseline on our novel dataset using three foundational continual learning methods -- EWC, GEM, and Experience Replay -- and find that EWC performs poorly, while GEM and Experience Replay show promise, performing significantly better than a Naive baseline. The dataset and code to run the experiments can be accessed from the following GitHub repository: https://github.com/Will-Doherty/CLOFAI.

📄 PDF Abstract BibTeX arXiv:2501.11140

Code (1)

will-doherty/clofai 공식 구현 pytorch

Tasks

Continual Learningimage-classificationImage Classification

Methods 이 논문이 사용한 방법론

Experience Replay Experience Replay is a replay memory technique used in reinforcement learning where we store the agent’s experiences at each time-step, $e\_{t} = \left(s\_{t}, a\_{t}, r\_{t},…
EWC The methon to overcome catastrophic forgetting in neural network while continual learning
SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Towards Universal Fake Image Detectors that Generalize Across Generative Models

2023-02-20 · CVPR 2023 1 · Utkarsh Ojha, Yuheng Li, Yong Jae Lee

With generative models proliferating at a rapid rate, there is a growing need for general purpose fake image detectors. In this work, we first show that the existing paradigm, which consists of training a deep network fo…

ClassificationLanguage ModelingLanguage Modelling

Level Up the Deepfake Detection: a Method to Effectively Discriminate Images Generated by GAN Architectures and Diffusion Models

2023-03-01 · Luca Guarnera, Oliver Giudice, Sebastiano Battiato

The image deepfake detection task has been greatly addressed by the scientific community to discriminate real images from those generated by Artificial Intelligence (AI) models: a binary classification task. In this work…

Binary ClassificationDeepFake DetectionFace SwappingGenerative Adversarial Network

On Improving Cross-dataset Generalization of Deepfake Detectors

2022-04-08 · Aakash Varma Nadimpalli, Ajita Rattani

Facial manipulation by deep fake has caused major security risks and raised severe societal concerns. As a countermeasure, a number of deep fake detection methods have been proposed recently. Most of them model deep fake…

Binary ClassificationClassificationFace SwappingReinforcement Learning (RL)

Parents and Children: Distinguishing Multimodal DeepFakes from Natural Images

2023-04-02 · Roberto Amoroso, Davide Morelli, Marcella Cornia, Lorenzo Baraldi 외

Recent advancements in diffusion models have enabled the generation of realistic deepfakes from textual prompts in natural language. While these models have numerous benefits across various sectors, they have also raised…

DeepFake DetectionFace SwappingFake Image Detectionimage-classification+1

ForgeryNet: A Versatile Benchmark for Comprehensive Forgery Analysis

2021-03-09 · CVPR 2021 1 · Yinan He, Bei Gan, Siyu Chen, Yichun Zhou 외

The rapid progress of photorealistic synthesis techniques has reached at a critical point where the boundary between real and manipulated images starts to blur. Thus, benchmarking and advancing digital forgery analysis h…

BenchmarkingClassificationGeneral ClassificationTemporal Forgery Localization