paper-with-me

홈 › Papers

Accurate Vision-based Manipulation through Contact Reasoning

2019-11-08 · Alina Kloss, Maria Bauza, Jiajun Wu, Joshua B. Tenenbaum, Alberto Rodriguez, Jeannette Bohg

Planning contact interactions is one of the core challenges of many robotic tasks. Optimizing contact locations while taking dynamics into account is computationally costly and, in environments that are only partially observable, executing contact-based tasks often suffers from low accuracy. We present an approach that addresses these two challenges for the problem of vision-based manipulation. First, we propose to disentangle contact from motion optimization. Thereby, we improve planning efficiency by focusing computation on promising contact locations. Second, we use a hybrid approach for perception and state estimation that combines neural networks with a physically meaningful state representation. In simulation and real-world experiments on the task of planar pushing, we show that our method is more efficient and achieves a higher manipulation accuracy than previous vision-based approaches.

📄 PDF Abstract BibTeX arXiv:1911.03112

Code (0)

등록된 구현이 없습니다.

Tasks

State Estimation

Similar Papers 제목 키워드 기반

Contact SLAM: An Active Tactile Exploration Policy Based on Physical Reasoning Utilized in Robotic Fine Blind Manipulation Tasks

2025-12-11 · Gaozhao Wang, Xing Liu, Zhenduo Ye, Zhengxiong Liu 외 arxiv

Contact-rich manipulation is difficult for robots to execute and requires accurate perception of the environment. In some scenarios, vision is occluded. The robot can then no longer obtain real-time scene state informati…

ViTaSCOPE: Visuo-tactile Implicit Representation for In-hand Pose and Extrinsic Contact Estimation

2025-06-13 · Jayjun Lee, Nima Fazeli

Mastering dexterous, contact-rich object manipulation demands precise estimation of both in-hand object poses and external contact locations$\unicode{x2013}$tasks particularly challenging due to partial and noisy observa…

3D geometryObjectPose Estimation

UniTacVLA: Unified Tactile Understanding and Prediction in Vision Language Action Models

2026-06-30 · Xidong Zhang, Yichi Zhang, Jiaxin Shi, Fucai Zhu 외 arxiv

Vision-language-action (VLA) models have achieved strong performance in many robotic manipulation tasks, yet remain limited in contact-rich dexterous manipulation. To overcome this limitation, recent vision-tactile-langu…

TONAV: Task-Oriented Navigation and Action-Velocity Chunk Learning for Articulated Object Quadrupedal Mobile Manipulation

2026-08-23 · Haoran Lin, Mingyu Yang, Pengfei Qi, Kehan Chen 외 arxiv

Quadruped mobile manipulation requires two tightly coupled capabilities: reaching manipulation-ready configurations and maintaining stable contact throughout articulated-object interaction. However, existing methods ofte…

NeuralTouch: Neural Descriptors for Precise Sim-to-Real Tactile Robot Control

2025-10-23 · Yijiong Lin, Bowen Deng, Keju Pu, Chenghua Lu 외 arxiv

Grasping accuracy is a critical prerequisite for precise object manipulation, often requiring careful alignment between the robot hand and object. Neural Descriptor Fields (NDF) offer a promising vision-based method to g…

Reinforcement LearningPoint Clouds