Learned Camera Gain and Exposure Control for Improved Visual Feature Detection and Matching
Successful visual navigation depends upon capturing images that contain sufficient useful information. In this letter, we explore a data-driven approach to account for environmental lighting changes, improving the quality of images for use in visual odometry (VO) or visual simultaneous localization and mapping (SLAM). We train a deep convolutional neural network model to predictively adjust camera gain and exposure time parameters such that consecutive images contain a maximal number of matchable features. The training process is fully self-supervised: our training signal is derived from an underlying VO or SLAM pipeline and, as a result, the model is optimized to perform well with that specific pipeline. We demonstrate through extensive real-world experiments that our network can anticipate and compensate for dramatic lighting changes (e.g., transitions into and out of road tunnels), maintaining a substantially higher number of inlier feature matches than competing camera parameter control algorithms.
Code (0)
등록된 구현이 없습니다.
Tasks
Simultaneous Localization and MappingVisual NavigationVisual OdometrySimilar Papers 제목 키워드 기반
High Dynamic Range SLAM with Map-Aware Exposure Time Control
The research in dense online 3D mapping is mostly focused on the geometrical accuracy and spatial extent of the reconstructions. Their color appearance is often neglected, leading to inconsistent colors and noticeable ar…
Vocal Bursts Intensity PredictionGeneric Camera Attribute Control using Bayesian Optimization
Cameras are the most widely exploited sensor in both robotics and computer vision communities. Despite their popularity, two dominant attributes (i.e., gain and exposure time) have been determined empirically and images …
AttributeBayesian OptimizationImage GenerationFrom Cheap to Pro: A Learning-based Adaptive Camera Parameter Network for Professional-Style Imaging
Consumer-grade camera systems often struggle to maintain stable image quality under complex illumination conditions such as low light, high dynamic range, and backlighting, as well as spatial color temperature variation.…
Image EnhancementSparse Light Field Sampling Improves Casual 3D and 4D Reconstruction
Many consumer smartphones, stereo cameras, and light field cameras record multiple synchronized viewpoints in a single exposure event. However, novel view synthesis pipelines commonly use only a monocular stream and rely…
Novel View SynthesisLearning to Control Camera Exposure via Reinforcement Learning
Adjusting camera exposure in arbitrary lighting conditions is the first step to ensure the functionality of computer vision applications. Poorly adjusted camera exposure often leads to critical failure and performance de…
AttributeDeep Reinforcement Learningobject-detectionObject Detection+2