paper-with-me

Papers

Vanast: Virtual Try-On with Human Image Animation via Synthetic Triplet Supervision

2026-04-06 · Hyunsoo Cha, Wonjung Woo, Byungjun Kim, Hanbyul Joo arxiv

We present Vanast, a unified framework that generates garment-transferred human animation videos directly from a single human image, garment images, and a pose guidance video. Conventional two-stage pipelines treat image-based virtual try-on and pose-driven animation as separate processes, which often results in identity drift, garment distortion, and front-back inconsistency. Our model addresses these issues by performing the entire process in a single unified step to achieve coherent synthesis. To enable this setting, we construct large-scale triplet supervision. Our data generation pipeline includes generating identity-preserving human images in alternative outfits that differ from garment catalog images, capturing full upper and lower garment triplets to overcome the single-garment-posed video pair limitation, and assembling diverse in-the-wild triplets without requiring garment catalog images. We further introduce a Dual Module architecture for video diffusion transformers to stabilize training, preserve pretrained generative quality, and improve garment accuracy, pose adherence, and identity preservation while supporting zero-shot garment interpolation. Together, these contributions allow Vanast to produce high-fidelity, identity-consistent animation across a wide range of garment types.

📄 PDF Abstract BibTeX arXiv:2604.04934

Code (0)

등록된 구현이 없습니다.

Tasks

Virtual Try-on

Similar Papers 제목 키워드 기반

Bring Your Own Character: A Holistic Solution for Automatic Facial Animation Generation of Customized Characters

2024-02-21 · Zechen Bai, Peng Chen, Xiaolan Peng, Lu Liu 외

Animating virtual characters has always been a fundamental research problem in virtual reality (VR). Facial animations play a crucial role as they effectively convey emotions and attitudes of virtual humans. However, cre…

Unity

Quality assessment of 3D human animation: Subjective and objective evaluation

2025-05-29 · Rim Rekik, Stefanie Wuhrer, Ludovic Hoyet, Katja Zibrek 외

Virtual human animations have a wide range of applications in virtual and augmented reality. While automatic generation methods of animated virtual humans have been developed, assessing their quality remains challenging.…

Human Animation

A Review of Deep Learning Techniques for Markerless Human Motion on Synthetic Datasets

2022-01-07 · Doan Duy Vo, Russell Butler

Markerless motion capture has become an active field of research in computer vision in recent years. Its extensive applications are known in a great variety of fields, including computer animation, human motion analysis,…

Markerless Motion Capture

S3: Neural Shape, Skeleton, and Skinning Fields for 3D Human Modeling

2021-01-17 · CVPR 2021 1 · Ze Yang, Shenlong Wang, Sivabalan Manivasagam, Zeng Huang 외

Constructing and animating humans is an important component for building virtual worlds in a wide variety of applications such as virtual reality or robotics testing in simulation. As there are exponentially many variati…

Learning Compositional Radiance Fields of Dynamic Human Heads

2020-12-17 · CVPR 2021 1 · Ziyan Wang, Timur Bagautdinov, Stephen Lombardi, Tomas Simon 외

Photorealistic rendering of dynamic humans is an important ability for telepresence systems, virtual shopping, synthetic data generation, and more. Recently, neural rendering methods, which combine techniques from comput…

NeRFNeural RenderingSynthetic Data Generation