Personalized Exposure Control Using Adaptive Metering and Reinforcement Learning

2018-03-06 · Huan Yang, Baoyuan Wang, Noranart Vesdapunt, Minyi Guo, Sing Bing Kang

We propose a reinforcement learning approach for real-time exposure control of a mobile camera that is personalizable. Our approach is based on Markov Decision Process (MDP). In the camera viewfinder or live preview mode, given the current frame, our system predicts the change in exposure so as to optimize the trade-off among image quality, fast convergence, and minimal temporal oscillation. We model the exposure prediction function as a fully convolutional neural network that can be trained through Gaussian policy gradient in an end-to-end fashion. As a result, our system can associate scene semantics with exposure values; it can also be extended to personalize the exposure adjustments for a user and device. We improve the learning performance by incorporating an adaptive metering module that links semantics with exposure. This adaptive metering module generalizes the conventional spot or matrix metering techniques. We validate our system using the MIT FiveK and our own datasets captured using iPhone 7 and Google Pixel. Experimental results show that our system exhibits stable real-time behavior while improving visual quality compared to what is achieved through native camera control.

📄 PDF Abstract BibTeX arXiv:1803.02269

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

A Deep Reinforcement Learning Approach for Ramp Metering Based on Traffic Video Data

2020-12-09 · Bing Liu, Yu Tang, Yuxiong Ji, Yu Shen 외

Ramp metering that uses traffic signals to regulate vehicle flows from the on-ramps has been widely implemented to improve vehicle mobility of the freeway. Previous studies generally update signal timings in real-time ba…

Deep Reinforcement Learning Reinforcement Learning (RL)

Analyzing Robustness of the Deep Reinforcement Learning Algorithm in Ramp Metering Applications Considering False Data Injection Attack and Defense

2023-01-28 · Diyi Liu, Lanmin Liu, Lee D Han

Ramp metering is the act of controlling on-going vehicles to the highway mainlines. Decades of practices of ramp metering have proved that ramp metering can decrease total travel time, mitigate shockwaves, decrease rear-…

Adversarial Attack Deep Reinforcement Learning Q-Learning

Simulation to Scaled City: Zero-Shot Policy Transfer for Traffic Control via Autonomous Vehicles

2018-12-14 · Kathy Jang, Eugene Vinitsky, Behdad Chalaki, Ben Remer 외

Using deep reinforcement learning, we train control policies for autonomous vehicles leading a platoon of vehicles onto a roundabout. Using Flow, a library for deep reinforcement learning in micro-simulators, we train tw…

Autonomous Vehicles Deep Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Perimeter Control with Heterogeneous Metering Rates for Cordon Signals: A Physics-Regularized Multi-Agent Reinforcement Learning Approach

2023-08-24 · Jiajie Yu, Pierre-Antoine Laharotte, Yu Han, Wei Ma 외

Perimeter Control (PC) strategies have been proposed to address urban road network control in oversaturated situations by regulating the transfer flow of the Protected Network (PN) based on the Macroscopic Fundamental Di…

Multi-agent Reinforcement Learning Traffic Signal Control

Adaptive Tuning of Parameterized Traffic Controllers via Multi-Agent Reinforcement Learning

2025-12-08 · Giray Önür, Azita Dabiri, Bart De Schutter arxiv

Effective traffic control is essential for mitigating congestion in transportation networks. Conventional traffic management strategies, including route guidance and ramp metering, often rely on state feedback controller…

Multi-agent Reinforcement Learning