Video based Object 6D Pose Estimation using Transformers
We introduce a Transformer based 6D Object Pose Estimation framework VideoPose, comprising an end-to-end attention based modelling architecture, that attends to previous frames in order to estimate accurate 6D Object Poses in videos. Our approach leverages the temporal information from a video sequence for pose refinement, along with being computationally efficient and robust. Compared to existing methods, our architecture is able to capture and reason from long-range dependencies efficiently, thus iteratively refining over video sequences. Experimental evaluation on the YCB-Video dataset shows that our approach is on par with the state-of-the-art Transformer methods, and performs significantly better relative to CNN based approaches. Further, with a speed of 33 fps, it is also more efficient and therefore applicable to a variety of applications that require real-time object pose estimation. Training code and pretrained models are available at https://github.com/ApoorvaBeedu/VideoPose
Code (1)
Tasks
6D Pose Estimation6D Pose Estimation using RGBObjectPose EstimationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
RayTran: 3D pose estimation and shape reconstruction of multiple objects from videos with ray-traced transformers
We propose a transformer-based neural network architecture for multi-object 3D reconstruction from RGB videos. It relies on two alternative ways to represent its knowledge: as a global 3D grid of features and an array of…
3D Pose Estimation3D ReconstructionPose EstimationPSVT: End-to-End Multi-person 3D Pose and Shape Estimation with Progressive Video Transformers
Existing methods of multi-person video 3D human Pose and Shape Estimation (PSE) typically adopt a two-stage strategy, which first detects human instances in each frame and then performs single-person PSE with temporal mo…
3D human pose and shape estimation3D Human Pose EstimationDecoderT6D-Direct: Transformers for Multi-Object 6D Pose Direct Regression
6D pose estimation is the task of predicting the translation and orientation of objects in a given input image, which is a crucial prerequisite for many robotics and augmented reality applications. Lately, the Transforme…
6D Pose Estimationobject-detectionObject DetectionPose Estimation+23D Human Pose Estimation with Spatial and Temporal Transformers
Transformer architectures have become the model of choice in natural language processing and are now being introduced into computer vision tasks such as image classification, object detection, and semantic segmentation. …
3D Human Pose Estimationimage-classificationImage ClassificationMonocular 3D Human Pose Estimation+4Object-Region Video Transformers
Recently, video transformers have shown great success in video understanding, exceeding CNN performance; yet existing video transformer models do not explicitly model objects, although objects can be essential for recogn…
Action DetectionAction RecognitionFew-Shot action recognitionFew Shot Action Recognition+2