Neural Descriptors: Self-Supervised Learning of Robust Local Surface Descriptors Using Polynomial Patches
Classical shape descriptors such as Heat Kernel Signature (HKS), Wave Kernel Signature (WKS), and Signature of Histograms of OrienTations (SHOT), while widely used in shape analysis, exhibit sensitivity to mesh connectivity, sampling patterns, and topological noise. While differential geometry offers a promising alternative through its theory of differential invariants, which are theoretically guaranteed to be robust shape descriptors, the computation of these invariants on discrete meshes often leads to unstable numerical approximations, limiting their practical utility. We present a self-supervised learning approach for extracting geometric features from 3D surfaces. Our method combines synthetic data generation with a neural architecture designed to learn sampling-invariant features. By integrating our features into existing shape correspondence frameworks, we demonstrate improved performance on standard benchmarks including FAUST, SCAPE, TOPKIDS, and SHREC'16, showing particular robustness to topological noise and partial shapes.
Code (1)
Tasks
Self-Supervised LearningSynthetic Data GenerationSimilar Papers 제목 키워드 기반
Digging Into Self-Supervised Learning of Feature Descriptors
Fully-supervised CNN-based approaches for learning local image descriptors have shown remarkable results in a wide range of geometric tasks. However, most of them require per-pixel ground-truth keypoint correspondence da…
Image-Based LocalizationImage RetrievalImage StylizationRetrieval+1PUMP: Pyramidal and Uniqueness Matching Priors for Unsupervised Learning of Local Descriptors
Existing approaches for learning local image descriptors have shown remarkable achievements in a wide range of geometric tasks. However, most of them require per-pixel correspondence-level supervision, which is diffi…
Visual LocalizationLearning-Based Dimensionality Reduction for Computing Compact and Effective Local Feature Descriptors
A distinctive representation of image patches in form of features is a key component of many computer vision and robotics tasks, such as image matching, image retrieval, and visual localization. State-of-the-art descript…
Dimensionality ReductionImage RetrievalRetrievalVisual LocalizationPointGame: Geometrically and Adaptively Masked Auto-Encoder on Point Clouds
Self-supervised learning is attracting large attention in point cloud understanding. However, exploring discriminative and transferable features still remains challenging due to their nature of irregularity and sparsity.…
Self-Supervised LearningSelf-Supervised Point Cloud Registration with Deep Versatile Descriptors
As a fundamental yet challenging problem in intelligent transportation systems, point cloud registration attracts vast attention and has been attained with various deep learning-based algorithms. The unsupervised registr…
Computational EfficiencyPoint cloud reconstructionPoint Cloud RegistrationRepresentation Learning