paper-with-me

홈 › Papers

Visual Servoing for Pose Control of Soft Continuum Arm in a Structured Environment

2022-02-10 · Shivani Kamtikar, Samhita Marri, Benjamin Walt, Naveen Kumar Uppalapati, Girish Krishnan, Girish Chowdhary

For soft continuum arms, visual servoing is a popular control strategy that relies on visual feedback to close the control loop. However, robust visual servoing is challenging as it requires reliable feature extraction from the image, accurate control models and sensors to perceive the shape of the arm, both of which can be hard to implement in a soft robot. This letter circumvents these challenges by presenting a deep neural network-based method to perform smooth and robust 3D positioning tasks on a soft arm by visual servoing using a camera mounted at the distal end of the arm. A convolutional neural network is trained to predict the actuations required to achieve the desired pose in a structured environment. Integrated and modular approaches for estimating the actuations from the image are proposed and are experimentally compared. A proportional control law is implemented to reduce the error between the desired and current image as seen by the camera. The model together with the proportional feedback control makes the described approach robust to several variations such as new targets, lighting, loads, and diminution of the soft arm. Furthermore, the model lends itself to be transferred to a new environment with minimal effort.

📄 PDF Abstract BibTeX arXiv:2202.05200

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

3D Shape Control of Extensible Multi-Section Soft Continuum Robots via Visual Servoing

2026-02-22 · Abhinav Gandhi, Shou-Shan Chiang, Cagdas D. Onal, Berk Calli arxiv

In this paper, we propose a novel vision-based control algorithm for regulating the whole body shape of extensible multisection soft continuum manipulators. Contrary to existing vision-based control algorithms in the lit…

Hybrid Visual Servoing of Tendon-driven Continuum Robots

2025-02-19 · Rana Danesh, Farrokh Janabi-Sharifi, Farhad Aghili

This paper introduces a novel Hybrid Visual Servoing (HVS) approach for controlling tendon-driven continuum robots (TDCRs). The HVS system combines Image-Based Visual Servoing (IBVS) with Deep Learning-Based Visual Servo…

Markerless 6D Pose Estimation and Position-Based Visual Servoing for Endoscopic Continuum Manipulators

2026-02-18 · Junhyun Park, Chunggil An, Myeongbo Park, Ihsan Ullah 외 arxiv

Continuum manipulators in flexible endoscopic surgical systems offer high dexterity for minimally invasive procedures; however, accurate pose estimation and closed-loop control remain challenging due to hysteresis, compl…

6D Pose Estimation

Strain-Parameterized Coupled Dynamics and Dual-Camera Visual Servoing for Aerial Continuum Manipulators

2026-03-24 · Niloufar Amiri, Farrokh Janabi-Sharifi arxiv

Tendon-driven aerial continuum manipulators (TD-ACMs) combine the maneuverability of uncrewed aerial vehicles (UAVs) with the compliance of lightweight continuum robots (CRs). Existing coupled dynamic modeling approaches…

Perception-Control Coupled Visual Servoing for Textureless Objects Using Keypoint-Based EKF

2026-02-06 · Allen Tao, Jun Yang, Stanko Oparnica, Wenjie Xue arxiv

Visual servoing is fundamental to robotic applications, enabling precise positioning and control. However, applying it to textureless objects remains a challenge due to the absence of reliable visual features. Moreover, …

Keypoint Detection