paper-with-me

Papers

Learning Markerless Robot-Depth Camera Calibration and End-Effector Pose Estimation

2022-12-15 · Bugra C. Sefercik, Baris Akgun

Traditional approaches to extrinsic calibration use fiducial markers and learning-based approaches rely heavily on simulation data. In this work, we present a learning-based markerless extrinsic calibration system that uses a depth camera and does not rely on simulation data. We learn models for end-effector (EE) segmentation, single-frame rotation prediction and keypoint detection, from automatically generated real-world data. We use a transformation trick to get EE pose estimates from rotation predictions and a matching algorithm to get EE pose estimates from keypoint predictions. We further utilize the iterative closest point algorithm, multiple-frames, filtering and outlier detection to increase calibration robustness. Our evaluations with training data from multiple camera poses and test data from previously unseen poses give sub-centimeter and sub-deciradian average calibration and pose estimation errors. We also show that a carefully selected single training pose gives comparable results.

📄 PDF Abstract BibTeX arXiv:2212.07567

Code (0)

등록된 구현이 없습니다.

Tasks

Camera CalibrationKeypoint DetectionOutlier DetectionPose Estimation

Methods 이 논문이 사용한 방법론

Test 설명 없음

Similar Papers 제목 키워드 기반

ARC-Calib: Autonomous Markerless Camera-to-Robot Calibration via Exploratory Robot Motions

2025-03-18 · Podshara Chanrungmaneekul, Yiting Chen, Joshua T. Grace, Aaron M. Dollar 외

Camera-to-robot (also known as eye-to-hand) calibration is a critical component of vision-based robot manipulation. Traditional marker-based methods often require human intervention for system setup. Furthermore, existin…

ARCRobot Manipulation

CtRNet-X: Camera-to-Robot Pose Estimation in Real-world Conditions Using a Single Camera

2024-09-16 · Jingpei Lu, Zekai Liang, Tristin Xie, Florian Ritcher 외

Camera-to-robot calibration is crucial for vision-based robot control and requires effort to make it accurate. Recent advancements in markerless pose estimation methods have eliminated the need for time-consuming physica…

Pose EstimationRobot Pose Estimation

Foundation Feature-Driven Online End-Effector Pose Estimation: A Marker-Free and Learning-Free Approach

2025-03-18 · Tianshu Wu, Jiyao Zhang, Shiqian Liang, Zhengxiao Han 외

Accurate transformation estimation between camera space and robot space is essential. Traditional methods using markers for hand-eye calibration require offline image collection, limiting their suitability for online sel…

6D Pose EstimationPose EstimationRobot Pose EstimationZero-shot Generalization

PlaneHEC: Efficient Hand-Eye Calibration for Multi-view Robotic Arm via Any Point Cloud Plane Detection

2025-07-26 · Ye Wang, Haodong Jing, Yang Liao, Yongqiang Ma 외 arxiv

Hand-eye calibration is an important task in vision-guided robotic systems and is crucial for determining the transformation matrix between the camera coordinate system and the robot end-effector. Existing methods, for m…

From Fixed to Free Cameras: Calibration-Free View-Robust Vision-Language-Action Model

2026-07-06 · Wenhao Li, Xueying Jiang, Quanhao Qian, Deli Zhao 외 arxiv

Real-world robot deployment rarely maintains the training-stage camera setup, where cameras often experience repositioning or remounting depending on actual scenarios. Existing view-robust Vision-Language-Action (VLA) po…