Reconfigurable Digital Channelizer Design Using Factored Markov Decision Processes
In this work, a novel digital channelizer design is developed through the use of a compact, system-level modeling approach. The model efficiently captures key properties of a digital channelizer system and its time-varying operation. The model applies powerful Markov Decision Process (MDP) techniques in new ways for design optimization of reconfigurable channelization processing. The result is a promising methodology for design and implementation of digital channelizers that adapt dynamically to changing use cases and stochastic environments while optimizing simultaneously for multiple conflicting performance goals. The method is used to employ an MDP to generate a runtime reconfiguration policy for a time-varying environment. Through extensive simulations, the robustness of the adaptation is demonstrated in comparison with the prior state of the art.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Low Complexity Reconfigurable Modified FRM Architecture with Full Spectral Utilization for Efficient Channelizers
This paper proposes a design of low complexity, reconfigurable and narrow transition band (NTB) filter bank (FB). In our proposed Modified Frequency Response Masking (ModFRM) architecture, the modal filter and complement…
Novel Deep Learning Framework for Wideband Spectrum Characterization at Sub-Nyquist Rate
Introduction of spectrum-sharing in 5G and subsequent generation networks demand base-station(s) with the capability to characterize the wideband spectrum spanned over licensed, shared and unlicensed non-contiguous frequ…
General ClassificationTowards Minimax Optimal Reinforcement Learning in Factored Markov Decision Processes
We study minimax optimal reinforcement learning in episodic factored Markov decision processes (FMDPs), which are MDPs with conditionally independent transition components. Assuming the factorization is known, we propose…
reinforcement-learningReinforcement LearningReinforcement Learning (RL)A low complexity and high modularity design for continuously variable bandwidth digital filters
Digital filters with variable bandwidth can be used for a variety of applications. Arbitrary change in the bandwidth of a digital Finite Impulse Response (FIR) filter can be acquired using sampling rate converters. In th…
Causal Markov Decision Processes: Learning Good Interventions Efficiently
We introduce causal Markov Decision Processes (C-MDPs), a new formalism for sequential decision making which combines the standard MDP formulation with causal structures over state transition and reward functions. Many c…
Decision MakingMarketingSequential Decision Making