Robotic endoscopes play a crucial role in diagnosing gastrointestinal disease and performing tumor resections. While current research primarily focuses on autonomously controlling rigid robots, establishing control models for flexible robots remains challenging. To address this, model-free deep reinforcement learning (DRL) presents a promising approach for enabling agents to make decisions under uncertainty. In this paper, we investigate the control policy of a flexible endoscope using Simulation Open Framework Architecture (SOFA) platform. We design a flexible tendon-driven robotic endoscope (TDRE) and develop a custom simulation environment within SOFA to train DRL agents. Our approach involves implementing the Proximal Policy Optimization (PPO) algorithm to approximate an optimal policy for trajectory planning. The optimal policy facilitates trajectory tracking tasks for the TDRE’s end-effector, such as circle trajectories and action disturbances, without requiring fine-tuning policy network parameters. Experimental results demonstrate that our approach achieves near real-time performance (30 FPS). The feedforward neural network of the policy provides feedback, enabling closed-loop control of TDRE. Furthermore, our experiments show that the navigation success rate of TDRE exceeds 90% within a tolerant error of 3 mm in free space. Notably, compared to direct training with contact, navigation tasks with contact retrained by a pre-trained policy in free space exhibit enhanced navigation capabilities.
Navigation of Tendon-driven Flexible Robotic Endoscope through Deep Reinforcement Learning
2024-05-20
1982475 byte
Aufsatz (Konferenz)
Elektronische Ressource
Englisch
A reinforcement learning based robotic navigation system
IEEE | 2014
|Robotic Arm Control and Task Training Through Deep Reinforcement Learning
BASE | 2022
|Kinematic and compliance analysis for tendon-driven robotic mechanisms with flexible tendons
Online Contents | 2005
|Modeling of the dynamics of tendon-driven robotic mechanisms with flexible tendons
Online Contents | 2003
|Automatic navigation using deep reinforcement learning
Europäisches Patentamt | 2023
|