Robust Visual Servoing under Human Supervision for Assembly Tasks
We propose a framework enabling mobile manipulators to reliably complete pick-and-place tasks for assembling structures from construction blocks. The picking uses an eye-in-hand visual servoing controller for object tracking with Control Barrier Functions (CBFs) to ensure fiducial markers in the blocks remain visible. An additional robot with an eye-to-hand setup ensures precise placement, critical for structural stability. We integrate human-in-the-loop capabilities for flexibility and fault correction and analyze robustness to camera pose errors, proposing adapted barrier functions to handle them. Lastly, experiments validate the framework on 6-DoF mobile arms.
Code (0)
등록된 구현이 없습니다.
Tasks
Object TrackingSimilar Papers 제목 키워드 기반
GoferBot: A Visual Guided Human-Robot Collaborative Assembly System
The current transformation towards smart manufacturing has led to a growing demand for human-robot collaboration (HRC) in the manufacturing process. Perceiving and understanding the human co-worker's behaviour introduces…
Action RecognitionSelf-supervised Wide Baseline Visual Servoing via 3D Equivariance
One of the challenging input settings for visual servoing is when the initial and goal camera views are far apart. Such settings are difficult because the wide baseline can cause drastic changes in object appearance and …
ObjectA Closed-Loop Multi-perspective Visual Servoing Approach with Reinforcement Learning
Traditional visual servoing methods suffer from serving between scenes from multiple perspectives, which humans can complete with visual signals alone. In this paper, we investigated how multi-perspective visual servoing…
OpenAI Gymreinforcement-learningSim2Real Viewpoint Invariant Visual Servoing by Recurrent Control
Humans are remarkably proficient at controlling their limbs and tools from a wide range of viewpoints. In robotics, this ability is referred to as visual servoing: moving a tool or end-point to a desired location using p…
Reinforcement LearningRobot ManipulationDIViS: Domain Invariant Visual Servoing for Collision-Free Goal Reaching
Robots should understand both semantics and physics to be functional in the real world. While robot platforms provide means for interacting with the physical world they cannot autonomously acquire object-level semantics …