paper-with-me

홈 › Papers

EMoTive: Event-guided Trajectory Modeling for 3D Motion Estimation

2025-03-14 · Zengyu Wan, Wei Zhai, Yang Cao, ZhengJun Zha

Visual 3D motion estimation aims to infer the motion of 2D pixels in 3D space based on visual cues. The key challenge arises from depth variation induced spatio-temporal motion inconsistencies, disrupting the assumptions of local spatial or temporal motion smoothness in previous motion estimation frameworks. In contrast, event cameras offer new possibilities for 3D motion estimation through continuous adaptive pixel-level responses to scene changes. This paper presents EMoTive, a novel event-based framework that models spatio-temporal trajectories via event-guided non-uniform parametric curves, effectively characterizing locally heterogeneous spatio-temporal motion. Specifically, we first introduce Event Kymograph - an event projection method that leverages a continuous temporal projection kernel and decouples spatial observations to encode fine-grained temporal evolution explicitly. For motion representation, we introduce a density-aware adaptation mechanism to fuse spatial and temporal features under event guidance, coupled with a non-uniform rational curve parameterization framework to adaptively model heterogeneous trajectories. The final 3D motion estimation is achieved through multi-temporal sampling of parametric trajectories, yielding optical flow and depth motion fields. To facilitate evaluation, we introduce CarlaEvent3D, a multi-dynamic synthetic dataset for comprehensive validation. Extensive experiments on both this dataset and a real-world benchmark demonstrate the effectiveness of the proposed method.

📄 PDF Abstract BibTeX arXiv:2503.11371

Code (0)

등록된 구현이 없습니다.

Tasks

Motion EstimationOptical Flow EstimationTrajectory Modeling

Similar Papers 제목 키워드 기반

EmoCAST: Emotional Talking Portrait via Emotive Text Description

2025-08-28 · Yiguo Jiang, Xiaodong Cun, Yong Zhang, Yudian Zheng 외 arxiv

Emotional talking head synthesis aims to generate talking portrait videos with vivid expressions. Existing methods still exhibit limitations in control flexibility, motion naturalness, and expression quality. Moreover, c…

Motion Synthesis

Teaching Robots to Span the Space of Functional Expressive Motion

2022-03-04 · Arjun Sripathy, Andreea Bobu, Zhongyu Li, Koushil Sreenath 외

Our goal is to enable robots to perform functional tasks in emotive ways, be it in response to their users' emotional states, or expressive of their confidence levels. Prior work has proposed learning independent cost fu…

EmotiveTalk: Expressive Talking Head Generation through Audio Information Decoupling and Emotional Video Diffusion

2024-11-23 · CVPR 2025 1 · Haotian Wang, Yuzhe Weng, Yueyan Li, Zilu Guo 외

Diffusion models have revolutionized the field of talking head generation, yet still face challenges in expressiveness, controllability, and stability in long-time generation. In this research, we propose an EmotiveTalk …

Talking Head Generation

TVTA: Trajectory-Aware Viseme-Guided Temporal Aggregation for Event-Based Lip Reading

2026-07-09 · Jingrong Zheng, Hongwei Ren, Xiangqian Wu arxiv

Event-based lip reading has recently emerged as a promising direction for visual speech recognition, benefiting from the high temporal resolution and motion sensitivity of event cameras. However, existing methods typical…

Visual Speech RecognitionLip Reading

Propagation of emotions, arousal and polarity in WordNet using Heterogeneous Structured Synset Embeddings

2019-07-01 · GWC 2019 7 · Jan Kocoń, Arkadiusz Janz

In this paper we present a novel method for emotive propagation in a wordnet based on a large emotive seed. We introduce a sense-level emotive lexicon annotated with polarity, arousal and emotions. The data were annotate…

regression