T6D-Direct: Transformers for Multi-Object 6D Pose Direct Regression

2021-09-22 · Arash Amini, Arul Selvam Periyasamy, Sven Behnke

6D pose estimation is the task of predicting the translation and orientation of objects in a given input image, which is a crucial prerequisite for many robotics and augmented reality applications. Lately, the Transformer Network architecture, equipped with a multi-head self-attention mechanism, is emerging to achieve state-of-the-art results in many computer vision tasks. DETR, a Transformer-based model, formulated object detection as a set prediction problem and achieved impressive results without standard components like region of interest pooling, non-maximal suppression, and bounding box proposals. In this work, we propose T6D-Direct, a real-time single-stage direct method with a transformer-based architecture built on DETR to perform 6D multi-object pose direct estimation. We evaluate the performance of our method on the YCB-Video dataset. Our method achieves the fastest inference time, and the pose estimation accuracy is comparable to state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:2109.10948

Code (0)

등록된 구현이 없습니다.

Tasks

6D Pose Estimation object-detection Object Detection Pose Estimation regression Translation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음

Attention 설명 없음

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Residual Connection 설명 없음

Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Algebraic Dead Directions in LayerNorm Transformers: A Forward-Pass-Only Diagnostic at LLM Scale

2026-06-17 · Tejas Pradeep Shirodkar, P. J. Narayanan arxiv

Pretrained transformers sit near singular minima of the loss, where the Fisher information metric degenerates along dead directions: directions in parameter space along which the directional Fisher vanishes. Locating suc…

Spiral RoPE: Rotate Your Rotary Positional Embeddings in the 2D Plane

2026-02-03 · Haoyu Liu, Sucheng Ren, Tingyu Zhu, Peng Wang 외 arxiv

Rotary Position Embedding (RoPE) is the de facto positional encoding in large language models due to its ability to encode relative positions and support length extrapolation. When adapted to vision transformers, the sta…

Bidirectional Alignment for Domain Adaptive Detection with Transformers

2023-01-01 · ICCV 2023 1 · Liqiang He, Wei Wang, Albert Chen, Min Sun 외

We propose a Bidirectional Alignment for domain adaptive Detection with Transformers (BiADT) to improve cross domain object detection performance. Existing adversarial learning based methods use gradient reverse laye…

Object object-detection Object Detection

End-to-End Trainable Multi-Instance Pose Estimation with Transformers

2021-03-22 · Lucas Stoffl, Maxime Vidal, Alexander Mathis

We propose a new end-to-end trainable approach for multi-instance pose estimation by combining a convolutional neural network with a transformer. We cast multi-instance pose estimation from images as a direct set predict…

Decoder Keypoint Detection object-detection Object Detection+1

Self-Supervised Video Hashing via Bidirectional Transformers

2021-06-19 · CVPR 2021 1 · Shuyan Li, Xiu Li, Jiwen Lu, Jie zhou

Most existing unsupervised video hashing methods are built on unidirectional models with less reliable training objectives, which underuse the correlations among frames and the similarity structure between videos. To…

Decoder Retrieval Video Retrieval