paper-with-me

홈 › Papers

Tactile Active Inference Reinforcement Learning for Efficient Robotic Manipulation Skill Acquisition

2023-11-19 · Zihao Liu, Xing Liu, Yizhai Zhang, Zhengxiong Liu, Panfeng Huang

Robotic manipulation holds the potential to replace humans in the execution of tedious or dangerous tasks. However, control-based approaches are not suitable due to the difficulty of formally describing open-world manipulation in reality, and the inefficiency of existing learning methods. Thus, applying manipulation in a wide range of scenarios presents significant challenges. In this study, we propose a novel method for skill learning in robotic manipulation called Tactile Active Inference Reinforcement Learning (Tactile-AIRL), aimed at achieving efficient training. To enhance the performance of reinforcement learning (RL), we introduce active inference, which integrates model-based techniques and intrinsic curiosity into the RL process. This integration improves the algorithm's training efficiency and adaptability to sparse rewards. Additionally, we utilize a vision-based tactile sensor to provide detailed perception for manipulation tasks. Finally, we employ a model-based approach to imagine and plan appropriate actions through free energy minimization. Simulation results demonstrate that our method achieves significantly high training efficiency in non-prehensile objects pushing tasks. It enables agents to excel in both dense and sparse reward tasks with just a few interaction episodes, surpassing the SAC baseline. Furthermore, we conduct physical experiments on a gripper screwing task using our method, which showcases the algorithm's rapid learning capability and its potential for practical applications.

📄 PDF Abstract BibTeX arXiv:2311.11287

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learningReinforcement LearningReinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Dilated Convolution 설명 없음
1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…
Global Average Pooling Global Average Pooling is a pooling operation designed to replace fully connected layers in classical CNNs. The idea is to generate one feature map for each corresponding…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Average Pooling 설명 없음
SAC 설명 없음

Similar Papers 제목 키워드 기반

Active Perception for Tactile Sensing: A Task-Agnostic Attention-Based Approach

2025-05-09 · Tim Schneider, Cristiana de Farias, Roberto Calandra, Liming Chen 외

Humans make extensive use of haptic exploration to map and identify the properties of the objects that we touch. In robotics, active tactile perception has emerged as an important research domain that complements vision …

Decision MakingPose EstimationReinforcement Learning (RL)

TIAGo RL: Simulated Reinforcement Learning Environments with Tactile Data for Mobile Robots

2023-11-13 · Luca Lach, Francesco Ferro, Robert Haschke

Tactile information is important for robust performance in robotic tasks that involve physical interaction, such as object manipulation. However, with more data included in the reasoning and control process, modeling beh…

Deep Reinforcement Learningreinforcement-learningReinforcement LearningTransfer Learning

T-Rex: Tactile-Reactive Dexterous Manipulation

2026-06-15 · Dantong Niu, Zhuoyang Liu, Zekai Wang, Boning Shao 외 arxiv

The ability to react dynamically to tactile signals has long been considered crucial to agile human-level dexterity. Yet contemporary learning-based Vision-Language-Action (VLA) models for robotic manipulation generally …

AcTExplore: Active Tactile Exploration of Unknown Objects

2023-10-12 · Amir-Hossein Shahidzadeh, Seong Jong Yoo, Pavan Mantripragada, Chahat Deep Singh 외

Tactile exploration plays a crucial role in understanding object structures for fundamental robotics tasks such as grasping and manipulation. However, efficiently exploring such objects using tactile sensors is challengi…

ObjectObject Reconstruction

On Policy Learning Robust to Irreversible Events: An Application to Robotic In-Hand Manipulation

2019-11-20 · Pietro Falco, Abdallah Attawia, Matteo Saveriano, Dongheui Lee

In this letter, we present an approach for learning in-hand manipulation skills with a low-cost, underactuated prosthetic hand in the presence of irreversible events. Our approach combines reinforcement learning based on…

reinforcement-learningReinforcement LearningReinforcement Learning (RL)