SyncSpecCNN: Synchronized Spectral CNN for 3D Shape Segmentation
In this paper, we study the problem of semantic annotation on 3D models that are represented as shape graphs. A functional view is taken to represent localized information on graphs, so that annotations such as part segment or keypoint are nothing but 0-1 indicator vertex functions. Compared with images that are 2D grids, shape graphs are irregular and non-isomorphic data structures. To enable the prediction of vertex functions on them by convolutional neural networks, we resort to spectral CNN method that enables weight sharing by parameterizing kernels in the spectral domain spanned by graph laplacian eigenbases. Under this setting, our network, named SyncSpecCNN, strive to overcome two key challenges: how to share coefficients and conduct multi-scale analysis in different parts of the graph for a single shape, and how to share information across related but different shapes that may be represented by very different graphs. Towards these goals, we introduce a spectral parameterization of dilated convolutional kernels and a spectral transformer network. Experimentally we tested our SyncSpecCNN on various tasks, including 3D shape part segmentation and 3D keypoint prediction. State-of-the-art performance has been achieved on all benchmark datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Part SegmentationSimilar Papers 제목 키워드 기반
Deep Spectral Models for Robust Dental Shape Generation
Accurate modeling of dental crown morphology is fundamental for diagnosis, orthodontic planning, and computer-aided restoration design. However, datasets suitable for training such models are typically limited in size. W…
Dynamics Enhanced Multi-Camera Motion Segmentation From Unsynchronized Videos
This paper considers the multi-camera motion segmentation problem using unsynchronized videos. Specifically, given two video clips containing several moving objects, captured by unregistered, unsynchronized cameras with …
Motion SegmentationSegmentationLa reconnaissance des sons consonantiques en cas de d\'esynchronisation spectrale : avec et sans information spectrale fine (Recognition of desynchronized consonantics sounds with and without fine spectral structure) [in French]
Multiscale Segmentation via Bregman Distances and Nonlinear Spectral Analysis
In biomedical imaging reliable segmentation of objects (e.g. from small cells up to large organs) is of fundamental importance for automated medical diagnosis. New approaches for multi-scale segmentation can considerably…
Medical DiagnosisSegmentationSpectralWaste Dataset: Multimodal Data for Waste Sorting Automation
The increase in non-biodegradable waste is a worldwide concern. Recycling facilities play a crucial role, but their automation is hindered by the complex characteristics of waste recycling lines like clutter or object de…
ManagementObjectSemantic Segmentation