paper-with-me

Papers

HumanMAC: Masked Motion Completion for Human Motion Prediction

2023-02-07 · ICCV 2023 1 · Ling-Hao Chen, Jiawei Zhang, Yewen Li, Yiren Pang, Xiaobo Xia, Tongliang Liu

Human motion prediction is a classical problem in computer vision and computer graphics, which has a wide range of practical applications. Previous effects achieve great empirical performance based on an encoding-decoding style. The methods of this style work by first encoding previous motions to latent representations and then decoding the latent representations into predicted motions. However, in practice, they are still unsatisfactory due to several issues, including complicated loss constraints, cumbersome training processes, and scarce switch of different categories of motions in prediction. In this paper, to address the above issues, we jump out of the foregoing style and propose a novel framework from a new perspective. Specifically, our framework works in a masked completion fashion. In the training stage, we learn a motion diffusion model that generates motions from random noise. In the inference stage, with a denoising procedure, we make motion prediction conditioning on observed motions to output more continuous and controllable predictions. The proposed framework enjoys promising algorithmic properties, which only needs one loss in optimization and is trained in an end-to-end manner. Additionally, it accomplishes the switch of different categories of motions effectively, which is significant in realistic tasks, e.g., the animation task. Comprehensive experiments on benchmarks confirm the superiority of the proposed framework. The project page is available at https://lhchen.top/Human-MAC.

📄 PDF Abstract BibTeX arXiv:2302.03665

Code (1)

linghaochan/humanmac 공식 구현 pytorch

Tasks

DenoisingHuman motion predictionmotion predictionPrediction

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

DiMo: Discrete Diffusion Modeling for Motion Generation and Understanding

2026-02-04 · Ning Zhang, Zhengyu Li, Kwong Weng Loh, Mingxi Xu 외 arxiv

Prior masked modeling motion generation methods predominantly study text-to-motion. We present DiMo, a discrete diffusion-style framework, which extends masked modeling to bidirectional text--motion understanding and gen…

The Emotional Baby Is Truly Deadly: Does your Multimodal Large Reasoning Model Have Emotional Flattery towards Humans?

2025-08-06 · Yuan Xun, Xiaojun Jia, Xinwei Liu, Hua Zhang arxiv

We observe that MLRMs oriented toward human-centric service are highly susceptible to user emotional cues during the deep-thinking stage, often overriding safety protocols or built-in safety checks under high emotional i…

Text-driven Human Motion Generation with Motion Masked Diffusion Model

2024-09-29 · Xingyu Chen

Text-driven human motion generation is a multimodal task that synthesizes human motion sequences conditioned on natural language. It requires the model to satisfy textual descriptions under varying conditional inputs, wh…

DiversityMotion Generation

MoMask: Generative Masked Modeling of 3D Human Motions

2023-11-29 · CVPR 2024 1 · Chuan Guo, Yuxuan Mu, Muhammad Gohar Javed, Sen Wang 외

We introduce MoMask, a novel masked modeling framework for text-driven 3D human motion generation. In MoMask, a hierarchical quantization scheme is employed to represent human motion as multi-layer discrete motion tokens…

Human motion predictionMotion ForecastingMotion GenerationMotion Interpolation+1

A Unified 3D Human Motion Synthesis Model via Conditional Variational Auto-Encoder

2021-01-01 · ICCV 2021 10 · Yujun Cai, Yiwei Wang, Yiheng Zhu, Tat-Jen Cham 외

We present a unified and flexible framework to address the generalized problem of 3D motion synthesis that covers the tasks of motion prediction, completion, interpolation, and spatial-temporal recovery. Since these …

Decodermotion predictionMotion Synthesis