Video Motion Segmentation Using New Adaptive Manifold Denoising Model
Video motion segmentation techniques automatically segment and track objects and regions from videos or image sequences as a primary processing step for many computer vision applications. We propose a novel motion segmentation approach for both rigid and non-rigid objects using adaptive manifold denoising. We first introduce an adaptive kernel space in which two feature trajectories are mapped into the same point if they belong to the same rigid object. After that, we employ an embedded manifold denoising approach with the adaptive kernel to segment the motion of rigid and non-rigid objects. The major observation is that the non-rigid objects often lie on a smooth manifold with deviations which can be removed by manifold denoising. We also show that performing manifold denoising on the kernel space is equivalent to doing so on its range space, which theoretically justifies the embedded manifold denoising on the adaptive kernel space. Experimental results indicate that our algorithm, named Adaptive Manifold Denoising (AMD), is suitable for both rigid and non-rigid motion segmentation. Our algorithm works well in many cases where several state-of-the-art algorithms fail.
Code (0)
등록된 구현이 없습니다.
Tasks
DenoisingMotion SegmentationSegmentationSimilar Papers 제목 키워드 기반
Manifold4D: Denoising on Point Cloud Rendered Manifolds for Video Re-shooting
Video re-shooting re-renders a monocular video of a dynamic scene along a user-specified camera trajectory, and the dominant recipe supplies the target geometry explicitly: per-frame depth lifts the source video into a 4…
Adaptive Latent Trajectory Anchoring for Action Segmentation Dataset Condensation
Dataset condensation for action segmentation synthesizes compact, informative representations of long, untrimmed video datasets. The existing approach relies on Variational Autoencoders and an iterative latent optimizati…
Action SegmentationWhen Distillation Breaks Motion Control: Restoring Generative Trajectories for Fast Video Generators
Training-free motion customization imposes motion patterns from reference videos onto video generators through test-time computation. Most existing methods target full diffusion models, requiring many denoising steps and…
Video GenerationAdaptive Begin-of-Video Tokens for Autoregressive Video Diffusion Models
Recent advancements in diffusion-based video generation have produced impressive and high-fidelity short videos. To extend these successes to generate coherent long videos, most video diffusion models (VDMs) generate vid…
Video GenerationVideo-based Heart Rate Estimation with Angle-guided ROI Optimization and Graph Signal Denoising
Remote photoplethysmography (rPPG) enables non-contact heart rate measurement from facial videos, but its performance is significantly degraded by facial motions such as speaking and head shaking. To address this issue, …
Heart rate estimation