paper-with-me

홈 › Papers

Unsupervised Kinematic Motion Detection for Part-segmented 3D Shape Collections

2022-06-17 · Xianghao Xu, Yifan Ruan, Srinath Sridhar, Daniel Ritchie

3D models of manufactured objects are important for populating virtual worlds and for synthetic data generation for vision and robotics. To be most useful, such objects should be articulated: their parts should move when interacted with. While articulated object datasets exist, creating them is labor-intensive. Learning-based prediction of part motions can help, but all existing methods require annotated training data. In this paper, we present an unsupervised approach for discovering articulated motions in a part-segmented 3D shape collection. Our approach is based on a concept we call category closure: any valid articulation of an object's parts should keep the object in the same semantic category (e.g. a chair stays a chair). We operationalize this concept with an algorithm that optimizes a shape's part motion parameters such that it can transform into other shapes in the collection. We evaluate our approach by using it to re-discover part motions from the PartNet-Mobility dataset. For almost all shape categories, our method's predicted motion parameters have low error with respect to ground truth annotations, outperforming two supervised motion prediction methods.

📄 PDF Abstract BibTeX arXiv:2206.08497

Code (1)

xxh43/ukmd 공식 구현 pytorch

Tasks

Motion Detectionmotion predictionSynthetic Data Generationvalid

Similar Papers 제목 키워드 기반

Unsupervised Temporal Segmentation of Repetitive Human Actions Based on Kinematic Modeling and Frequency Analysis

2015-12-13 · Qifei Wang, Gregorij Kurillo, Ferda Ofli, Ruzena Bajcsy

In this paper, we propose a method for temporal segmentation of human repetitive actions based on frequency analysis of kinematic parameters, zero-velocity crossing detection, and adaptive k-means clustering. Since the h…

ClusteringSegmentation

Machine Learning-Based Automated Assessment of Intracorporeal Suturing in Laparoscopic Fundoplication

2024-12-16 · Shekhar Madhav Khairnar, Huu Phong Nguyen, Alexis Desir, Carla Holcomb 외

Automated assessment of surgical skills using artificial intelligence (AI) provides trainees with instantaneous feedback. After bimanual tool motions are captured, derived kinematic metrics are reliable predictors of per…

Denoising

Neural Kinematic Networks for Unsupervised Motion Retargetting

2018-04-16 · CVPR 2018 6 · Ruben Villegas, Jimei Yang, Duygu Ceylan, Honglak Lee

We propose a recurrent neural network architecture with a Forward Kinematics layer and cycle consistency based adversarial training objective for unsupervised motion retargetting. Our network captures the high-level prop…

Unsupervised Learning of Complex Articulated Kinematic Structures Combining Motion and Skeleton Information

2015-06-01 · CVPR 2015 6 · Hyung Jin Chang, Yiannis Demiris

In this paper we present a novel framework for unsupervised kinematic structure learning of complex articulated objects from a single-view image sequence. In contrast to prior motion information based methods, which esti…

Motion Segmentation

Unsupervised Object-Level Video Summarization with Online Motion Auto-Encoder

2018-01-02 · Yu-jia Zhang, Xiaodan Liang, Dingwen Zhang, Min Tan 외

Unsupervised video summarization plays an important role on digesting, browsing, and searching the ever-growing videos every day, and the underlying fine-grained semantic and motion information (i.e., objects of interest…

ObjectUnsupervised Video SummarizationVideo Summarization