paper-with-me

Papers

HAODiff: Human-Aware One-Step Diffusion via Dual-Prompt Guidance

2025-05-26 · Jue Gong, Tingyu Yang, Jingkai Wang, Zheng Chen, Xing Liu, Hong Gu, Yulun Zhang, Xiaokang Yang

Human-centered images often suffer from severe generic degradation during transmission and are prone to human motion blur (HMB), making restoration challenging. Existing research lacks sufficient focus on these issues, as both problems often coexist in practice. To address this, we design a degradation pipeline that simulates the coexistence of HMB and generic noise, generating synthetic degraded data to train our proposed HAODiff, a human-aware one-step diffusion. Specifically, we propose a triple-branch dual-prompt guidance (DPG), which leverages high-quality images, residual noise (LQ minus HQ), and HMB segmentation masks as training targets. It produces a positive-negative prompt pair for classifier-free guidance (CFG) in a single diffusion step. The resulting adaptive dual prompts let HAODiff exploit CFG more effectively, boosting robustness against diverse degradations. For fair evaluation, we introduce MPII-Test, a benchmark rich in combined noise and HMB cases. Extensive experiments show that our HAODiff surpasses existing state-of-the-art (SOTA) methods in terms of both quantitative metrics and visual quality on synthetic and real-world datasets, including our introduced MPII-Test. Code is available at: https://github.com/gobunu/HAODiff.

📄 PDF Abstract BibTeX arXiv:2505.19742

Code (1)

gobunu/haodiff 공식 구현

Methods 이 논문이 사용한 방법론

Focus 설명 없음
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Compression-Aware One-Step Diffusion Model for JPEG Artifact Removal

2025-02-14 · Jinpei Guo, Zheng Chen, Wenbo Li, Yong Guo 외

Diffusion models have demonstrated remarkable success in image restoration tasks. However, their multi-step denoising process introduces significant computational overhead, limiting their practical deployment. Furthermor…

DenoisingImage RestorationJPEG Artifact Removal

Input-Aware Sparse Attention for Real-Time Co-Speech Video Generation

2025-10-02 · Beijia Lu, Ziyi Chen, Jing Xiao, Jun-Yan Zhu arxiv

Diffusion models can synthesize realistic co-speech video from audio for various applications, such as video creation and virtual agents. However, existing diffusion-based methods are slow due to numerous denoising steps…

Video Generation

FADRA: Frequency-Aware Diffusion with Residual Adaptation for Video Face Restoration

2026-07-07 · Jin Jiang, Jia Wang, Panwen Hu, Weiran Zhao 외 arxiv

Video face restoration (VFR) aims to recover high-quality and temporally consistent facial details from severely degraded video sequences; however, existing methods still struggle to balance spatial fidelity and temporal…

Frequency-Enhanced Diffusion Models: Curriculum-Guided Semantic Alignment for Zero-Shot Skeleton Action Recognition

2026-04-10 · Yuxi Zhou, Zhengbo Zhang, Jingyu Pan, Zhiyu Lin 외 arxiv

Human action recognition is pivotal in computer vision, with applications ranging from surveillance to human-robot interaction. Despite the effectiveness of supervised skeleton-based methods, their reliance on exhaustive…

Action Recognition

ReAlign: Bilingual Text-to-Motion Generation via Step-Aware Reward-Guided Alignment

2025-05-08 · Wanjiang Weng, Xiaofeng Tan, Hongsong Wang, Pan Zhou

Bilingual text-to-motion generation, which synthesizes 3D human motions from bilingual text inputs, holds immense potential for cross-linguistic applications in gaming, film, and robotics. However, this task faces critic…

Motion Generation