Motion-supervised Co-Part Segmentation
Recent co-part segmentation methods mostly operate in a supervised learning setting, which requires a large amount of annotated data for training. To overcome this limitation, we propose a self-supervised deep learning method for co-part segmentation. Differently from previous works, our approach develops the idea that motion information inferred from videos can be leveraged to discover meaningful object parts. To this end, our method relies on pairs of frames sampled from the same video. The network learns to predict part segments together with a representation of the motion between two frames, which permits reconstruction of the target image. Through extensive experimental evaluation on publicly available video sequences we demonstrate that our approach can produce improved segmentation maps with respect to previous self-supervised co-part segmentation approaches.
Code (2)
Tasks
SegmentationUnsupervised Human Pose EstimationSimilar Papers 제목 키워드 기반
Semi-Weakly Supervised Object Kinematic Motion Prediction
Given a 3D object, kinematic motion prediction aims to identify the mobile parts as well as the corresponding motion parameters. Due to the large variations in both topological structure and geometric details of 3D objec…
Graph Neural Networkmotion predictionObjectPrediction+3Joint Learning of Motion Estimation and Segmentation for Cardiac MR Image Sequences
Cardiac motion estimation and segmentation play important roles in quantitatively assessing cardiac function and diagnosing cardiovascular diseases. In this paper, we propose a novel deep learning method for joint estima…
Cardiac SegmentationMotion EstimationSegmentationWeakly supervised segmentationLearning Motion Flows for Semi-supervised Instrument Segmentation from Robotic Surgical Video
Performing low hertz labeling for surgical videos at intervals can greatly releases the burden of surgeons. In this paper, we study the semi-supervised instrument segmentation from robotic surgical videos with sparse ann…
SegmentationEfficient Unsupervised Temporal Segmentation of Motion Data
We introduce a method for automated temporal segmentation of human motion data into distinct actions and compositing motion primitives based on self-similar structures in the motion sequence. We use neighbourhood graphs …
ClusteringMarkerless Motion CaptureSegmentationSLIM: Self-Supervised LiDAR Scene Flow and Motion Segmentation
Recently, several frameworks for self-supervised learning of 3D scene flow on point clouds have emerged. Scene flow inherently separates every scene into multiple moving agents and a large class of points following a…
Motion SegmentationSegmentationSelf-Supervised Learning