A Novel Sample-efficient Deep Reinforcement Learning with Episodic Policy Transfer for PID-Based Control in Cardiac Catheterization Robots

2021-10-28 · Olatunji Mumini Omisore, Toluwanimi Akinyemi, Wenke Duan, Wenjing Du, Lei Wang

Robotic catheterization is typically used for percutaneous coronary intervention procedures nowadays and it involves steering flexible endovascular tools to open up occlusion in the coronaries. In this study, a sample-efficient deep reinforcement learning with episodic policy transfer is, for the first time, used for motion control during robotic catheterization with fully adaptive PID tuning strategy. The reinforcement model aids the agent to continuously learn from its interactions in its environment and adaptively tune PID control gains for axial navigation of endovascular tool. The model was validated for axial motion control of a robotic system designed for intravascular catheterization. Simulation and experimental trials were done to validate the application of the model, and results obtained shows it could self-tune PID gains appropriately for motion control of a robotic catheter system. Performance comparison with conventional methods in average of 10 trials shows the agent tunes the gain better with error of 0.003 mm. Thus, the proposed model would offer more stable set-point motion control robotic catheterization.

📄 PDF Abstract BibTeX arXiv:2110.14941

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learning

Successor Feature Neural Episodic Control

2021-11-04 · David Emukpere, Xavier Alameda-Pineda, Chris Reinke

A longstanding goal in reinforcement learning is to build intelligent agents that show fast learning and a flexible transfer of skills akin to humans and animals. This paper investigates the integration of two frameworks…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Transfer Learning

Sample-Efficient Reinforcement Learning with Maximum Entropy Mellowmax Episodic Control

2019-11-21 · Marta Sarrico, Kai Arulkumaran, Andrea Agostinelli, Pierre Richemond 외

Deep networks have enabled reinforcement learning to scale to more complex and challenging domains, but these methods typically require large quantities of training data. An alternative is to use sample-efficient episodi…

Atari Games reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Solving Continuous Control with Episodic Memory

2021-06-16 · Igor Kuznetsov, Andrey Filchenkov

Episodic memory lets reinforcement learning algorithms remember and exploit promising experience from the past to improve agent performance. Previous works on memory mechanisms show benefits of using episodic-based data …

continuous-control Continuous Control OpenAI Gym Reinforcement Learning (RL)

Episodic Self-Imitation Learning with Hindsight

2020-11-26 · Tianhong Dai, Hengyan Liu, Anil Anthony Bharath

Episodic self-imitation learning, a novel self-imitation algorithm with a trajectory selection module and an adaptive loss function, is proposed to speed up reinforcement learning. Compared to the original self-imitation…

continuous-control Continuous Control Imitation Learning

Model-Based Episodic Memory Induces Dynamic Hybrid Controls

2021-11-03 · NeurIPS 2021 12 · Hung Le, Thommen Karimpanal George, Majid Abdolshah, Truyen Tran 외

Episodic control enables sample efficiency in reinforcement learning by recalling past experiences from an episodic memory. We propose a new model-based episodic memory of trajectories addressing current limitations of e…

model reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)