Efficient Camera Exposure Control for Visual Odometry via Deep Reinforcement Learning
The stability of visual odometry (VO) systems is undermined by degraded image quality, especially in environments with significant illumination changes. This study employs a deep reinforcement learning (DRL) framework to train agents for exposure control, aiming to enhance imaging performance in challenging conditions. A lightweight image simulator is developed to facilitate the training process, enabling the diversification of image exposure and sequence trajectory. This setup enables completely offline training, eliminating the need for direct interaction with camera hardware and the real environments. Different levels of reward functions are crafted to enhance the VO systems, equipping the DRL agents with varying intelligence. Extensive experiments have shown that our exposure control agents achieve superior efficiency-with an average inference duration of 1.58 ms per frame on a CPU-and respond more quickly than traditional feedback control schemes. By choosing an appropriate reward function, agents acquire an intelligent understanding of motion trends and anticipate future illumination changes. This predictive capability allows VO systems to deliver more stable and precise odometry results. The codes and datasets are available at https://github.com/ShuyangUni/drl_exposure_ctrl.
Code (1)
Tasks
CPUDeep Reinforcement LearningVisual OdometrySimilar Papers 제목 키워드 기반
MBA-VO: Motion Blur Aware Visual Odometry
Motion blur is one of the major challenges remaining for visual odometry methods. In low-light conditions where longer exposure times are necessary, motion blur can appear even for relatively slow camera motions. In this…
BenchmarkingVisual OdometryOnline Photometric Calibration for Auto Exposure Video for Realtime Visual Odometry and SLAM
Recent direct visual odometry and SLAM algorithms have demonstrated impressive levels of precision. However, they require a photometric camera calibration in order to achieve competitive results. Hence, the respective al…
Camera CalibrationVisual OdometryGradient-based Camera Exposure Control for Outdoor Mobile Platforms
We introduce a novel method to automatically adjust camera exposure for image processing and computer vision applications on mobile robot platforms. Because most image processing algorithms rely heavily on low-level imag…
Pedestrian DetectionStereo MatchingStereo Matching HandVisual OdometryLearned Camera Gain and Exposure Control for Improved Visual Feature Detection and Matching
Successful visual navigation depends upon capturing images that contain sufficient useful information. In this letter, we explore a data-driven approach to account for environmental lighting changes, improving the qualit…
Simultaneous Localization and MappingVisual NavigationVisual OdometryPersonalized Exposure Control Using Adaptive Metering and Reinforcement Learning
We propose a reinforcement learning approach for real-time exposure control of a mobile camera that is personalizable. Our approach is based on Markov Decision Process (MDP). In the camera viewfinder or live preview mode…
reinforcement-learningReinforcement LearningReinforcement Learning (RL)