paper-with-me

Papers

Keypoint Autoencoders: Learning Interest Points of Semantics

2020-08-11 · Ruoxi Shi, Zhengrong Xue, Xinyang Li

Understanding point clouds is of great importance. Many previous methods focus on detecting salient keypoints to identity structures of point clouds. However, existing methods neglect the semantics of points selected, leading to poor performance on downstream tasks. In this paper, we propose Keypoint Autoencoder, an unsupervised learning method for detecting keypoints. We encourage selecting sparse semantic keypoints by enforcing the reconstruction from keypoints to the original point cloud. To make sparse keypoint selection differentiable, Soft Keypoint Proposal is adopted by calculating weighted averages among input points. A downstream task of classifying shape with sparse keypoints is conducted to demonstrate the distinctiveness of our selected keypoints. Semantic Accuracy and Semantic Richness are proposed and our method gives competitive or even better performance than state of the arts on these two metrics.

📄 PDF Abstract BibTeX arXiv:2008.04502

Code (1)

strongrex2001/KeypointAutoencoders 공식 구현

Similar Papers 제목 키워드 기반

KptLLM: Unveiling the Power of Large Language Model for Keypoint Comprehension

2024-11-04 · Jie Yang, Wang Zeng, Sheng Jin, Lumin Xu 외

Recent advancements in Multimodal Large Language Models (MLLMs) have greatly improved their abilities in image understanding. However, these models often struggle with grasping pixel-level semantic details, e.g., the key…

Keypoint DetectionLanguage ModelingLanguage ModellingLarge Language Model

OpenKD: Opening Prompt Diversity for Zero- and Few-shot Keypoint Detection

2024-09-30 · Changsheng Lu, Zheyuan Liu, Piotr Koniusz

Exploiting the foundation models (e.g., CLIP) to build a versatile keypoint detector has gained increasing attention. Most existing models accept either the text prompt (e.g., ``the nose of a cat''), or the visual prompt…

DiversityKeypoint DetectionLarge Language ModelSpatial Reasoning

Few-shot Keypoint Detection with Uncertainty Learning for Unseen Species

2021-12-12 · CVPR 2022 1 · Changsheng Lu, Piotr Koniusz

Current non-rigid object keypoint detectors perform well on a chosen kind of species and body parts, and require a large amount of labelled keypoints for training. Moreover, their heatmaps, tailored to specific body part…

Fine-Grained Visual RecognitionKeypoint DetectionRepresentation Learning

KeypointNet: A Large-scale 3D Keypoint Dataset Aggregated from Numerous Human Annotations

2020-02-28 · CVPR 2020 6 · Yang You, Yujing Lou, Chengkun Li, Zhoujun Cheng 외

Detecting 3D objects keypoints is of great interest to the areas of both graphics and computer vision. There have been several 2D and 3D keypoint datasets aiming to address this problem in a data-driven way. These datase…

TUSK: Task-Agnostic Unsupervised Keypoints

2022-06-16 · Yuhe Jin, Weiwei Sun, Jan Hosang, Eduard Trulls 외

Existing unsupervised methods for keypoint learning rely heavily on the assumption that a specific keypoint type (e.g. elbow, digit, abstract geometric shape) appears only once in an image. This greatly limits their appl…

Object DiscoveryUnsupervised Keypoints