Deep EndoVO: A Recurrent Convolutional Neural Network (RCNN) based Visual Odometry Approach for Endoscopic Capsule Robots
Ingestible wireless capsule endoscopy is an emerging minimally invasive diagnostic technology for inspection of the GI tract and diagnosis of a wide range of diseases and pathologies. Medical device companies and many research groups have recently made substantial progresses in converting passive capsule endoscopes to active capsule robots, enabling more accurate, precise, and intuitive detection of the location and size of the diseased areas. Since a reliable real time pose estimation functionality is crucial for actively controlled endoscopic capsule robots, in this study, we propose a monocular visual odometry (VO) method for endoscopic capsule robot operations. Our method lies on the application of the deep Recurrent Convolutional Neural Networks (RCNNs) for the visual odometry task, where Convolutional Neural Networks (CNNs) and Recurrent Neural Networks (RNNs) are used for the feature extraction and inference of dynamics across the frames, respectively. Detailed analyses and evaluations made on a real pig stomach dataset proves that our system achieves high translational and rotational accuracies for different types of endoscopic capsule robot trajectories.
Code (0)
등록된 구현이 없습니다.
Tasks
DiagnosticMonocular Visual OdometryPose EstimationVisual OdometrySimilar Papers 제목 키워드 기반
DeepVO: Towards End-to-End Visual Odometry with Deep Recurrent Convolutional Neural Networks
This paper studies monocular visual odometry (VO) problem. Most of existing VO algorithms are developed under a standard pipeline including feature extraction, feature matching, motion estimation, local optimisation, etc…
Monocular Visual OdometryMotion EstimationVisual OdometryConvolutional Neural Networks with Gated Recurrent Connections
The convolutional neural network (CNN) has become a basic model for solving many computer vision problems. In recent years, a new class of CNNs, recurrent convolution neural network (RCNN), inspired by abundant recurrent…
object-detectionObject DetectionObject RecognitionScene Text RecognitionDeep Global-Relative Networks for End-to-End 6-DoF Visual Localization and Odometry
Although a wide variety of deep neural networks for robust Visual Odometry (VO) can be found in the literature, they are still unable to solve the drift problem in long-term robot navigation. Thus, this paper aims to pro…
Autonomous NavigationPose EstimationRobot NavigationVisual Localization+1Learning by Inertia: Self-supervised Monocular Visual Odometry for Road Vehicles
In this paper, we present iDVO (inertia-embedded deep visual odometry), a self-supervised learning based monocular visual odometry (VO) for road vehicles. When modelling the geometric consistency within adjacent frames, …
BlockingMonocular Visual OdometrySelf-Supervised LearningVisual OdometryRecurrent Convolutional Neural Network for Object Recognition
In recent years, the convolutional neural network (CNN) has achieved great success in many computer vision tasks. Partially inspired by neuroscience, CNN shares many properties with the visual system of the brain. A prom…
ObjectObject Recognition