paper-with-me

Papers

Frequency-Guided Diffusion Model with Perturbation Training for Skeleton-Based Video Anomaly Detection

2024-12-04 · Xiaofeng Tan, Hongsong Wang, Xin Geng, Liang Wang

Video anomaly detection (VAD) is a vital yet complex open-set task in computer vision, commonly tackled through reconstruction-based methods. However, these methods struggle with two key limitations: (1) insufficient robustness in open-set scenarios, where unseen normal motions are frequently misclassified as anomalies, and (2) an overemphasis on, but restricted capacity for, local motion reconstruction, which are inherently difficult to capture accurately due to their diversity. To overcome these challenges, we introduce a novel frequency-guided diffusion model with perturbation training. First, we enhance robustness by training a generator to produce perturbed samples, which are similar to normal samples and target the weakness of the reconstruction model. This training paradigm expands the reconstruction domain of the model, improving its generalization to unseen normal motions. Second, to address the overemphasis on motion details, we employ the 2D Discrete Cosine Transform (DCT) to separate high-frequency (local) and low-frequency (global) motion components. By guiding the diffusion model with observed high-frequency information, we prioritize the reconstruction of low-frequency components, enabling more accurate and robust anomaly detection. Extensive experiments on five widely used VAD datasets demonstrate that our approach surpasses state-of-the-art methods, underscoring its effectiveness in open-set scenarios and diverse motion contexts. Our project website is https://xiaofeng-tan.github.io/projects/FG-Diff/index.html.

📄 PDF Abstract BibTeX arXiv:2412.03044

Code (1)

xiaofeng-tan/fgdmad-code 공식 구현 pytorch

Tasks

Anomaly DetectionVideo Anomaly Detection

Methods 이 논문이 사용한 방법론

Discrete Cosine Transform Discrete Cosine Transform (DCT) is an orthogonal transformation method that decomposes an image to its spatial frequency spectrum. It expresses a finite sequence of data…
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…
Focus 설명 없음

Similar Papers 제목 키워드 기반

Frequency-Enhanced Diffusion Models: Curriculum-Guided Semantic Alignment for Zero-Shot Skeleton Action Recognition

2026-04-10 · Yuxi Zhou, Zhengbo Zhang, Jingyu Pan, Zhiyu Lin 외 arxiv

Human action recognition is pivotal in computer vision, with applications ranging from surveillance to human-robot interaction. Despite the effectiveness of supervised skeleton-based methods, their reliance on exhaustive…

Action Recognition

Highly Efficient Test-Time Scaling for T2I Diffusion Models with Text Embedding Perturbation

2025-12-03 · Hang Xu, Linjiang Huang, Feng Zhao arxiv

Test-time scaling (TTS) aims to achieve better results by increasing random sampling and evaluating samples based on rules and metrics. However, in text-to-image(T2I) diffusion models, most related works focus on search …

FIRE: Robust Detection of Diffusion-Generated Images via Frequency-Guided Reconstruction Error

2024-12-10 · CVPR 2025 1 · Beilin Chu, Xuan Xu, Xin Wang, Yufei Zhang 외

The rapid advancement of diffusion models has significantly improved high-quality image generation, making generated content increasingly challenging to distinguish from real images and raising concerns about potential m…

Image Forensics

HumanSD: A Native Skeleton-Guided Diffusion Model for Human Image Generation

2023-04-09 · ICCV 2023 1 · Xuan Ju, Ailing Zeng, Chenchen Zhao, Jianan Wang 외

Controllable human image generation (HIG) has numerous real-life applications. State-of-the-art solutions, such as ControlNet and T2I-Adapter, introduce an additional learnable branch on top of the frozen pre-trained sta…

DenoisingImage Generation

Adversarial-Guided Diffusion for Multimodal LLM Attacks

2025-07-31 · Chengwei Xia, Fan Ma, Ruijie Quan, Kun Zhan 외 arxiv

This paper addresses the challenge of generating adversarial image using a diffusion model to deceive multimodal large language models (MLLMs) into generating the targeted responses, while avoiding significant distortion…

Adversarial Attack