Scale-Free Image Keypoints Using Differentiable Persistent Homology
In computer vision, keypoint detection is a fundamental task, with applications spanning from robotics to image retrieval; however, existing learning-based methods suffer from scale dependency and lack flexibility. This paper introduces a novel approach that leverages Morse theory and persistent homology, powerful tools rooted in algebraic topology. We propose a novel loss function based on the recent introduction of a notion of subgradient in persistent homology, paving the way toward topological learning. Our detector, MorseDet, is the first topology-based learning model for feature detection, which achieves competitive performance in keypoint repeatability and introduces a principled and theoretically robust approach to the problem.
Code (1)
Tasks
Image RetrievalKeypoint DetectionRetrievalSimilar Papers 제목 키워드 기반
FoundHand: Large-Scale Domain-Specific Learning for Controllable Hand Image Generation
Despite remarkable progress in image generation models, generating realistic hands remains a persistent challenge due to their complex articulation, varying viewpoints, and frequent occlusions. We present FoundHand, a la…
Image GenerationDaD: Distilled Reinforcement Learning for Diverse Keypoint Detection
Keypoints are what enable Structure-from-Motion (SfM) systems to scale to thousands of images. However, designing a keypoint detection objective is a non-trivial task, as SfM is non-differentiable. Typically, an auxiliar…
Keypoint Detectionreinforcement-learningReinforcement LearningALIKE: Accurate and Lightweight Keypoint Detection and Descriptor Extraction
Existing methods detect the keypoints in a non-differentiable way, therefore they can not directly optimize the position of keypoints through back-propagation. To address this issue, we present a partially differentiable…
Camera Pose EstimationGPUHomography EstimationKeypoint Detection+2Mesh deformation-based single-view 3D reconstruction of thin eyeglasses frames with differentiable rendering
With the support of Virtual Reality (VR) and Augmented Reality (AR) technologies, the 3D virtual eyeglasses try-on application is well on its way to becoming a new trending solution that offers a "try on" option to selec…
3D ReconstructionSingle-View 3D ReconstructionRaCo: Ranking and Covariance for Practical Learned Keypoints
This paper introduces RaCo, a lightweight neural network designed to learn robust and versatile keypoints suitable for a variety of 3D computer vision tasks. The model integrates three key components: the repeatable keyp…
Data Augmentation