Self-Supervised Learning of Image Scale and Orientation
We study the problem of learning to assign a characteristic pose, i.e., scale and orientation, for an image region of interest. Despite its apparent simplicity, the problem is non-trivial; it is hard to obtain a large-scale set of image regions with explicit pose annotations that a model directly learns from. To tackle the issue, we propose a self-supervised learning framework with a histogram alignment technique. It generates pairs of image patches by random rescaling/rotating and then train an estimator to predict their scale/orientation values so that their relative difference is consistent with the rescaling/rotating used. The estimator learns to predict a non-parametric histogram distribution of scale/orientation without any supervision. Experiments show that it significantly outperforms previous methods in scale/orientation estimation and also improves image matching and 6 DoF camera pose estimation by incorporating our patch poses into a matching process.
Code (1)
Tasks
Camera Pose EstimationPose EstimationSelf-Supervised LearningSimilar Papers 제목 키워드 기반
Learning Soft Estimator of Keypoint Scale and Orientation With Probabilistic Covariant Loss
Estimating keypoint scale and orientation is crucial to extracting invariant features under significant geometric changes. Recently, the estimators based on self-supervised learning have been designed to adapt to com…
3D ReconstructionSelf-Supervised LearningSelf-Supervised Equivariant Learning for Oriented Keypoint Detection
Detecting robust keypoints from an image is an integral part of many computer vision problems, and the characteristic orientation and scale of keypoints play an important role for keypoint description and matching. Exist…
Camera Pose EstimationKeypoint DetectionPose EstimationSelf-Supervised Learning+1Orienting Novel 3D Objects Using Self-Supervised Learning of Rotation Transforms
Orienting objects is a critical component in the automation of many packing and assembly tasks. We present an algorithm to orient novel objects given a depth image of the object in its current and desired orientation. We…
Self-Supervised LearningDeep Projective Rotation Estimation through Relative Supervision
Orientation estimation is the core to a variety of vision and robotics tasks such as camera and object pose estimation. Deep learning has offered a way to develop image-based orientation estimators; however, such estimat…
Pose EstimationSelf-Supervised LearningABBSPO: Adaptive Bounding Box Scaling and Symmetric Prior based Orientation Prediction for Detecting Aerial Image Objects
Weakly supervised oriented object detection (WS-OOD) has gained attention as a cost-effective alternative to fully supervised methods, providing both efficiency and high accuracy. Among weakly supervised approaches, hori…
Self-Supervised LearningObject Detection