paper-with-me

홈 › Papers

MoST: Motion Style Transformer between Diverse Action Contents

2024-03-10 · CVPR 2024 1 · Boeun Kim, Jungho Kim, Hyung Jin Chang, Jin Young Choi

While existing motion style transfer methods are effective between two motions with identical content, their performance significantly diminishes when transferring style between motions with different contents. This challenge lies in the lack of clear separation between content and style of a motion. To tackle this challenge, we propose a novel motion style transformer that effectively disentangles style from content and generates a plausible motion with transferred style from a source motion. Our distinctive approach to achieving the goal of disentanglement is twofold: (1) a new architecture for motion style transformer with part-attentive style modulator across body parts' and Siamese encoders that encode style and content features separately'; (2) style disentanglement loss. Our method outperforms existing methods and demonstrates exceptionally high quality, particularly in motion pairs with different contents, without the need for heuristic post-processing. Codes are available at https://github.com/Boeun-Kim/MoST.

📄 PDF Abstract BibTeX arXiv:2403.06225

Code (1)

boeun-kim/most 공식 구현 pytorch

Tasks

DisentanglementMotion Style TransferStyle Transfer

Similar Papers 제목 키워드 기반

Learning to Generate Diverse Dance Motions with Transformer

2020-08-18 · Jiaman Li, Yihang Yin, Hang Chu, Yi Zhou 외

With the ongoing pandemic, virtual concerts and live events using digitized performances of musicians are getting traction on massive multiplayer online worlds. However, well choreographed dance movements are extremely c…

Motion Synthesis

MoStGAN-V: Video Generation with Temporal Motion Styles

2023-04-05 · CVPR 2023 1 · Xiaoqian Shen, Xiang Li, Mohamed Elhoseiny

Video generation remains a challenging task due to spatiotemporal complexity and the requirement of synthesizing diverse motions with temporal consistency. Previous works attempt to generate videos in arbitrary lengths e…

Video Generation

VISTA: Triplet-Supervised Video Style Transfer with Diffusion Transformers

2026-05-17 · Yiren Song, Wangzi Yao, Haofan Wang, Mike Zheng Shou arxiv

Video style transfer aims to render videos in a target artistic style while preserving content, structure, and motion. While image stylization has advanced rapidly, video stylization remains challenging due to temporal i…

Style Transfer

StyleTalk: One-shot Talking Head Generation with Controllable Speaking Styles

2023-01-03 · Yifeng Ma, Suzhen Wang, Zhipeng Hu, Changjie Fan 외

Different people speak with diverse personalized speaking styles. Although existing one-shot talking head methods have made significant progress in lip sync, natural facial expressions, and stable head motions, they stil…

DecoderFace GenerationTalking Face GenerationTalking Head Generation

Dance Style Transfer with Cross-modal Transformer

2022-08-19 · Wenjie Yin, Hang Yin, Kim Baraka, Danica Kragic 외

We present CycleDance, a dance style transfer system to transform an existing motion clip in one dance style to a motion clip in another dance style while attempting to preserve motion context of the dance. Our method ex…

Style Transfer