paper-with-me

홈 › Papers

Deep Projective Rotation Estimation through Relative Supervision

2022-11-21 · Brian Okorn, Chuer Pan, Martial Hebert, David Held

Orientation estimation is the core to a variety of vision and robotics tasks such as camera and object pose estimation. Deep learning has offered a way to develop image-based orientation estimators; however, such estimators often require training on a large labeled dataset, which can be time-intensive to collect. In this work, we explore whether self-supervised learning from unlabeled data can be used to alleviate this issue. Specifically, we assume access to estimates of the relative orientation between neighboring poses, such that can be obtained via a local alignment method. While self-supervised learning has been used successfully for translational object keypoints, in this work, we show that naively applying relative supervision to the rotational group $SO(3)$ will often fail to converge due to the non-convexity of the rotational space. To tackle this challenge, we propose a new algorithm for self-supervised orientation estimation which utilizes Modified Rodrigues Parameters to stereographically project the closed manifold of $SO(3)$ to the open manifold of $\mathbb{R}^{3}$, allowing the optimization to be done in an open Euclidean space. We empirically validate the benefits of the proposed algorithm for rotational averaging problem in two settings: (1) direct optimization on rotation parameters, and (2) optimization of parameters of a convolutional neural network that predicts object orientations from images. In both settings, we demonstrate that our proposed algorithm is able to converge to a consistent relative orientation frame much faster than algorithms that purely operate in the $SO(3)$ space. Additional information can be found at https://sites.google.com/view/deep-projective-rotation/home .

📄 PDF Abstract BibTeX arXiv:2211.11182

Code (0)

등록된 구현이 없습니다.

Tasks

Pose EstimationSelf-Supervised Learning

Methods 이 논문이 사용한 방법론

fail 설명 없음

Similar Papers 제목 키워드 기반

Projective Manifold Gradient Layer for Deep Rotation Regression

2021-10-22 · CVPR 2022 1 · Jiayi Chen, Yingda Yin, Tolga Birdal, Baoquan Chen 외

Regressing rotations on SO(3) manifold using deep neural networks is an important yet unsolved problem. The gap between the Euclidean network output space and the non-Euclidean SO(3) manifold imposes a severe challenge f…

regressionRiemannian optimization

As-Projective-As-Possible Image Stitching with Moving DLT

2013-06-01 · CVPR 2013 6 · Julio Zaragoza, Tat-Jun Chin, Michael S. Brown, David Suter

We investigate projective estimation under model inadequacies, i.e., when the underpinning assumptions of the projective model are not fully satisfied by the data. We focus on the task of image stitching which is customa…

Image Stitching

IUP-Pose: Decoupled Iterative Uncertainty Propagation for Real-time Relative Pose Regression via Implicit Dense Alignment v1

2026-03-20 · Jun Wang, Xiaoyan Huang arxiv

Relative pose estimation is fundamental for SLAM, visual localization, and 3D reconstruction. Existing Relative Pose Regression (RPR) methods face a key trade-off: feature-matching pipelines achieve high accuracy but blo…

Visual Localization3D ReconstructionPose Estimation

RayRoPE: Projective Ray Positional Encoding for Multi-view Attention

2026-01-21 · Yu Wu, Minsik Jeon, Jen-Hao Rick Chang, Oncel Tuzel 외 arxiv

We study positional encodings for multi-view transformers that process tokens from a set of posed input images, and seek a mechanism that encodes patches uniquely, allows SE(3)-invariant attention with multi-frequency si…

Stereo Depth Estimation

NeRF-Supervised Feature Point Detection and Description

2024-03-13 · Ali Youssef, Francisco Vasconcelos

Feature point detection and description is the backbone for various computer vision applications, such as Structure-from-Motion, visual SLAM, and visual place recognition. While learning-based methods have surpassed trad…

Homography EstimationNeRFPoint Cloud RegistrationPose Estimation+1