paper-with-me

Papers

Object Pose Transformer: Unifying Unseen Object Pose Estimation

2026-03-24 · Weihang Li, Lorenzo Garattoni, Fabien Despinoy, Nassir Navab, Benjamin Busam arxiv

Learning model-free object pose estimation for unseen instances remains a fundamental challenge in 3D vision. Existing methods typically fall into two disjoint paradigms: category-level approaches predict absolute poses in a canonical space but rely on predefined taxonomies, while relative pose methods estimate cross-view transformations but cannot recover single-view absolute pose. In this work, we propose Object Pose Transformer (\ours{}), a unified feed-forward framework that bridges these paradigms through task factorization within a single model. \ours{} jointly predicts depth, point maps, camera parameters, and normalized object coordinates (NOCS) from RGB inputs, enabling both category-level absolute SA(3) pose and unseen-object relative SE(3) pose. Our approach leverages contrastive object-centric latent embeddings for canonicalization without requiring semantic labels at inference time, and uses point maps as a camera-space representation to enable multi-view relative geometric reasoning. Through cross-frame feature interaction and shared object embeddings, our model leverages relative geometric consistency across views to improve absolute pose estimation, reducing ambiguity in single-view predictions. Furthermore, \ours{} is camera-agnostic, learning camera intrinsics on-the-fly and supporting optional depth input for metric-scale recovery, while remaining fully functional in RGB-only settings. Extensive experiments on diverse benchmarks (NOCS, HouseCat6D, Omni6DPose, Toyota-Light) demonstrate state-of-the-art performance in both absolute and relative pose estimation tasks within a single unified architecture.

📄 PDF Abstract BibTeX arXiv:2603.23370

Code (0)

등록된 구현이 없습니다.

Tasks

Pose Estimation

Similar Papers 제목 키워드 기반

Mean Shift Mask Transformer for Unseen Object Instance Segmentation

2022-11-21 · Yangxiao Lu, Yuqiao Chen, Nicholas Ruozzi, Yu Xiang

Segmenting unseen objects from images is a critical perception skill that a robot needs to acquire. In robot manipulation, it can facilitate a robot to grasp and manipulate unseen objects. Mean shift clustering is a wide…

ClusteringImage SegmentationInstance SegmentationObject+4

MaskWAM: Unifying Mask Prompting and Prediction for World-Action Models

2026-06-11 · Hanyang Yu, Haitao Lin, Jingbo Zhang, Wenyao Zhang 외 arxiv

World Action Models (WAMs) present a promising paradigm for robotic control via video prediction. However, current WAMs suffer from fundamental spatial bottlenecks: standard text inputs introduce referential ambiguity in…

Video Prediction

StructDiffusion: Language-Guided Creation of Physically-Valid Structures using Unseen Objects

2022-11-08 · Weiyu Liu, Yilun Du, Tucker Hermans, Sonia Chernova 외

Robots operating in human environments must be able to rearrange objects into semantically-meaningful configurations, even if these objects are previously unseen. In this work, we focus on the problem of building physica…

valid

ET tu, CLIP? Addressing Common Object Errors for Unseen Environments

2024-06-25 · Ye Won Byun, Cathy Jiao, Shahriar Noroozizadeh, Jimin Sun 외

We introduce a simple method that employs pre-trained CLIP encoders to enhance model generalization in the ALFRED task. In contrast to previous literature where CLIP replaces the visual encoder, we suggest using CLIP as …

Objectobject-detectionObject Detection

PADRe: A Unifying Polynomial Attention Drop-in Replacement for Efficient Vision Transformer

2024-07-16 · Pierre-David Letourneau, Manish Kumar Singh, Hsin-Pai Cheng, Shizhong Han 외

We present Polynomial Attention Drop-in Replacement (PADRe), a novel and unifying framework designed to replace the conventional self-attention mechanism in transformer models. Notably, several recent alternative attenti…

2D Object DetectionComputational EfficiencyGPUimage-classification+4