paper-with-me

홈 › Papers

Dynamic Weight Adjusting Deep Q-Networks for Real-Time Environmental Adaptation

2024-11-04 · Xinhao Zhang, Jinghan Zhang, Wujun Si, Kunpeng Liu

Deep Reinforcement Learning has shown excellent performance in generating efficient solutions for complex tasks. However, its efficacy is often limited by static training modes and heavy reliance on vast data from stable environments. To address these shortcomings, this study explores integrating dynamic weight adjustments into Deep Q-Networks (DQN) to enhance their adaptability. We implement these adjustments by modifying the sampling probabilities in the experience replay to make the model focus more on pivotal transitions as indicated by real-time environmental feedback and performance metrics. We design a novel Interactive Dynamic Evaluation Method (IDEM) for DQN that successfully navigates dynamic environments by prioritizing significant transitions based on environmental feedback and learning progress. Additionally, when faced with rapid changes in environmental conditions, IDEM-DQN shows improved performance compared to baseline methods. Our results indicate that under circumstances requiring rapid adaptation, IDEM-DQN can more effectively generalize and stabilize learning. Extensive experiments across various settings confirm that IDEM-DQN outperforms standard DQN models, particularly in environments characterized by frequent and unpredictable changes.

📄 PDF Abstract BibTeX arXiv:2411.02559

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learning

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
DQN A DQN, or Deep Q-Network, approximates a state-value function in a Q-Learning framework with a neural network. In the Atari…
Focus 설명 없음
Experience Replay Experience Replay is a replay memory technique used in reinforcement learning where we store the agent’s experiences at each time-step, $e\_{t} = \left(s\_{t}, a\_{t}, r\_{t},…

Similar Papers 제목 키워드 기반

Cognitive-Driven Optimization of Sparse Array Transceiver for MIMO Radar Beamforming

2021-03-04 · Weitong Zhai, Xiangrong Wang, Syed A. Hamza, Moeness G. Amin

Cognitive multiple-input multiple-output (MIMO) radar is capable of adjusting system parameters adaptively by sensing and learning in complex dynamic environment. Beamforming performance of MIMO radar is guided by both b…

E-Navi: Environmental Adaptive Navigation for UAVs on Resource Constrained Platforms

2025-12-16 · Boyang Li, Zhongpeng Jin, Shuai Zhao, Jiahui Liao 외 arxiv

The ability to adapt to changing environments is crucial for the autonomous navigation systems of Unmanned Aerial Vehicles (UAVs). However, existing navigation systems adopt fixed execution configurations without conside…

LCD-Net: A Lightweight Remote Sensing Change Detection Network Combining Feature Fusion and Gating Mechanism

2024-10-14 · Wenyu Liu, Jindong Li, Haoji Wang, Run Tan 외

Remote sensing image change detection (RSCD) is crucial for monitoring dynamic surface changes, with applications ranging from environmental monitoring to disaster assessment. While traditional CNN-based methods have imp…

Change DetectionDecoder

Enhancing Video Analytics Accuracy via Real-time Automated Camera Parameter Tuning

2021-07-08 · Sibendu Paul, Kunal Rao, Giuseppe Coviello, Murugan Sankaradas 외

In Video Analytics Pipelines (VAP), Analytics Units (AUs) such as object detection and face recognition running on remote servers critically rely on surveillance cameras to capture high-quality video streams in order to …

Face DetectionFace RecognitionHuman Detectionobject-detection+3

Practical Handling of Dynamic Environments in Decentralised Multi-Robot Patrol

2025-09-16 · James C. Ward, Arthur Richards, Edmund R. Hunt arxiv

Persistent monitoring using robot teams is of interest in fields such as security, environmental monitoring, and disaster recovery. Performing such monitoring in a fully on-line decentralised fashion has significant pote…