paper-with-me

Papers

Efficient Camera Exposure Control for Visual Odometry via Deep Reinforcement Learning

2024-08-30 · Shuyang Zhang, Jinhao He, Yilong Zhu, Jin Wu, Jie Yuan

The stability of visual odometry (VO) systems is undermined by degraded image quality, especially in environments with significant illumination changes. This study employs a deep reinforcement learning (DRL) framework to train agents for exposure control, aiming to enhance imaging performance in challenging conditions. A lightweight image simulator is developed to facilitate the training process, enabling the diversification of image exposure and sequence trajectory. This setup enables completely offline training, eliminating the need for direct interaction with camera hardware and the real environments. Different levels of reward functions are crafted to enhance the VO systems, equipping the DRL agents with varying intelligence. Extensive experiments have shown that our exposure control agents achieve superior efficiency-with an average inference duration of 1.58 ms per frame on a CPU-and respond more quickly than traditional feedback control schemes. By choosing an appropriate reward function, agents acquire an intelligent understanding of motion trends and anticipate future illumination changes. This predictive capability allows VO systems to deliver more stable and precise odometry results. The codes and datasets are available at https://github.com/ShuyangUni/drl_exposure_ctrl.

📄 PDF Abstract BibTeX arXiv:2408.17005

Code (1)

shuyanguni/drl_exposure_ctrl 공식 구현 pytorch

Tasks

CPUDeep Reinforcement LearningVisual Odometry

Similar Papers 제목 키워드 기반

MBA-VO: Motion Blur Aware Visual Odometry

2021-03-25 · ICCV 2021 10 · Peidong Liu, Xingxing Zuo, Viktor Larsson, Marc Pollefeys

Motion blur is one of the major challenges remaining for visual odometry methods. In low-light conditions where longer exposure times are necessary, motion blur can appear even for relatively slow camera motions. In this…

BenchmarkingVisual Odometry

Online Photometric Calibration for Auto Exposure Video for Realtime Visual Odometry and SLAM

2017-10-05 · Paul Bergmann, Rui Wang, Daniel Cremers

Recent direct visual odometry and SLAM algorithms have demonstrated impressive levels of precision. However, they require a photometric camera calibration in order to achieve competitive results. Hence, the respective al…

Camera CalibrationVisual Odometry

Gradient-based Camera Exposure Control for Outdoor Mobile Platforms

2017-08-24 · Inwook Shim, Tae-Hyun Oh, Joon-Young Lee, Jinwook Choi 외

We introduce a novel method to automatically adjust camera exposure for image processing and computer vision applications on mobile robot platforms. Because most image processing algorithms rely heavily on low-level imag…

Pedestrian DetectionStereo MatchingStereo Matching HandVisual Odometry

Learned Camera Gain and Exposure Control for Improved Visual Feature Detection and Matching

2021-02-08 · Justin Tomasi, Brandon Wagstaff, Steven L. Waslander, Jonathan Kelly

Successful visual navigation depends upon capturing images that contain sufficient useful information. In this letter, we explore a data-driven approach to account for environmental lighting changes, improving the qualit…

Simultaneous Localization and MappingVisual NavigationVisual Odometry

Personalized Exposure Control Using Adaptive Metering and Reinforcement Learning

2018-03-06 · Huan Yang, Baoyuan Wang, Noranart Vesdapunt, Minyi Guo 외

We propose a reinforcement learning approach for real-time exposure control of a mobile camera that is personalizable. Our approach is based on Markov Decision Process (MDP). In the camera viewfinder or live preview mode…

reinforcement-learningReinforcement LearningReinforcement Learning (RL)