paper-with-me

Papers

InterAnimate: Taming Region-aware Diffusion Model for Realistic Human Interaction Animation

2025-04-15 · Yukang Lin, Yan Hong, Zunnan Xu, Xindi Li, Chao Xu, Chuanbiao Song, Ronghui Li, Haoxing Chen, Jun Lan, Huijia Zhu, Weiqiang Wang, Jianfu Zhang, Xiu Li

Recent video generation research has focused heavily on isolated actions, leaving interactive motions-such as hand-face interactions-largely unexamined. These interactions are essential for emerging biometric authentication systems, which rely on interactive motion-based anti-spoofing approaches. From a security perspective, there is a growing need for large-scale, high-quality interactive videos to train and strengthen authentication models. In this work, we introduce a novel paradigm for animating realistic hand-face interactions. Our approach simultaneously learns spatio-temporal contact dynamics and biomechanically plausible deformation effects, enabling natural interactions where hand movements induce anatomically accurate facial deformations while maintaining collision-free contact. To facilitate this research, we present InterHF, a large-scale hand-face interaction dataset featuring 18 interaction patterns and 90,000 annotated videos. Additionally, we propose InterAnimate, a region-aware diffusion model designed specifically for interaction animation. InterAnimate leverages learnable spatial and temporal latents to effectively capture dynamic interaction priors and integrates a region-aware interaction mechanism that injects these priors into the denoising process. To the best of our knowledge, this work represents the first large-scale effort to systematically study human hand-face interactions. Qualitative and quantitative results show InterAnimate produces highly realistic animations, setting a new benchmark. Code and data will be made public to advance research.

📄 PDF Abstract BibTeX arXiv:2504.10905

Code (0)

등록된 구현이 없습니다.

Tasks

DenoisingVideo Generation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Pantheon360: Taming Digital Twin Generation via 3D-Aware 360° Video Diffusion

2026-05-25 · Ting-Hsuan Chen, Ying-Huan Chen, Tao Tu, Jie-Ying Lee 외 arxiv

Generating complete digital twins from videos requires precise camera control, global scene coverage, and strict spatial-temporal consistency constraints that remain challenging for perspective video generators due to th…

Scene GenerationVideo Generation

Taming Stable Diffusion for Text to 360 Panorama Image Generation

2024-01-01 · CVPR 2024 1 · Cheng Zhang, Qianyi Wu, Camilo Cruz Gambardella, Xiaoshui Huang 외

Generative models e.g. Stable Diffusion have enabled the creation of photorealistic images from text prompts. Yet the generation of 360-degree panorama images from text remains a challenge particularly due to the dea…

DenoisingImage Generation

VSDiffusion: Taming Ill-Posed Shadow Generation via Visibility-Constrained Diffusion

2026-03-09 · Jing Li, Jing Zhang arxiv

Generating realistic cast shadows for inserted foreground objects is a crucial yet challenging problem in image composition, where maintaining geometric consistency of shadow and object in complex scenes remains difficul…

Taming Stable Diffusion for Text to 360° Panorama Image Generation

2024-04-11 · Cheng Zhang, Qianyi Wu, Camilo Cruz Gambardella, Xiaoshui Huang 외

Generative models, e.g., Stable Diffusion, have enabled the creation of photorealistic images from text prompts. Yet, the generation of 360-degree panorama images from text remains a challenge, particularly due to the de…

DenoisingImage Generation

Taming Diffusion Models for Image Restoration: A Review

2024-09-16 · Ziwei Luo, Fredrik K. Gustafsson, Zheng Zhao, Jens Sjölund 외

Diffusion models have achieved remarkable progress in generative modelling, particularly in enhancing image quality to conform to human preferences. Recently, these models have also been applied to low-level computer vis…

DeblurringDenoisingImage DenoisingImage Restoration