paper-with-me

Papers

D-LORD for Motion Stylization

2024-12-05 · Meenakshi Gupta, Mingyuan Lei, Tat-Jen Cham, Hwee Kuan Lee

This paper introduces a novel framework named D-LORD (Double Latent Optimization for Representation Disentanglement), which is designed for motion stylization (motion style transfer and motion retargeting). The primary objective of this framework is to separate the class and content information from a given motion sequence using a data-driven latent optimization approach. Here, class refers to person-specific style, such as a particular emotion or an individual's identity, while content relates to the style-agnostic aspect of an action, such as walking or jumping, as universally understood concepts. The key advantage of D-LORD is its ability to perform style transfer without needing paired motion data. Instead, it utilizes class and content labels during the latent optimization process. By disentangling the representation, the framework enables the transformation of one motion sequences style to another's style using Adaptive Instance Normalization. The proposed D-LORD framework is designed with a focus on generalization, allowing it to handle different class and content labels for various applications. Additionally, it can generate diverse motion sequences when specific class and content labels are provided. The framework's efficacy is demonstrated through experimentation on three datasets: the CMU XIA dataset for motion style transfer, the MHAD dataset, and the RRIS Ability dataset for motion retargeting. Notably, this paper presents the first generalized framework for motion style transfer and motion retargeting, showcasing its potential contributions in this area.

📄 PDF Abstract BibTeX arXiv:2412.04097

Code (0)

등록된 구현이 없습니다.

Tasks

Disentanglementmotion retargetingMotion Style TransferStyle Transfer

Methods 이 논문이 사용한 방법론

Instance Normalization Instance Normalization (also known as contrast normalization) is a normalization layer where: $$ y_{tijk} = \frac{x_{tijk} - \mu_{ti}}{\sqrt{\sigma_{ti}^2 +…
Adaptive Instance Normalization 설명 없음
Focus 설명 없음

Similar Papers 제목 키워드 기반

ViSt3D: Video Stylization with 3D CNN

2023-09-21 · NeurIPS 2023 11

Visual stylization has been a very popular research area in recent times. While image stylization has seen a rapid advancement in the recent past, video stylization, while being more challenging, is relatively less explo…

Generative Human Motion Stylization in Latent Space

2024-01-24 · Chuan Guo, Yuxuan Mu, Xinxin Zuo, Peng Dai 외

Human motion stylization aims to revise the style of an input motion while keeping its content unaltered. Unlike existing works that operate directly in pose space, we leverage the latent space of pretrained autoencoders…

LILAC: Long-sequence Incremental Low-latency Arbitrary Motion Stylization via Streaming VAE-Diffusion with Causal Decoding

2025-10-17 · Peng Ren, Hai Yang arxiv

Generating long and stylized human motions in real time is critical for applications that demand continuous and responsive character control. Despite its importance, existing streaming approaches often operate directly i…

EmoStyle: Emotion-Driven Image Stylization

2025-12-05 · Jingyuan Yang, Zihuan Bai, Hui Huang arxiv

Art has long been a profound medium for expressing emotions. While existing image stylization methods effectively transform visual appearance, they often overlook the emotional impact carried by styles. To bridge this ga…

Generative Motion Stylization of Cross-structure Characters within Canonical Motion Space

2024-03-18 · Jiaxu Zhang, Xin Chen, Gang Yu, Zhigang Tu

Stylized motion breathes life into characters. However, the fixed skeleton structure and style representation hinder existing data-driven motion synthesis methods from generating stylized motion for various characters. I…

Motion Synthesis