paper-with-me

홈 › Papers

Deep Spectral Q-learning with Application to Mobile Health

2023-01-03 · Yuhe Gao, Chengchun Shi, Rui Song

Dynamic treatment regimes assign personalized treatments to patients sequentially over time based on their baseline information and time-varying covariates. In mobile health applications, these covariates are typically collected at different frequencies over a long time horizon. In this paper, we propose a deep spectral Q-learning algorithm, which integrates principal component analysis (PCA) with deep Q-learning to handle the mixed frequency data. In theory, we prove that the mean return under the estimated optimal policy converges to that under the optimal one and establish its rate of convergence. The usefulness of our proposal is further illustrated via simulations and an application to a diabetes dataset.

📄 PDF Abstract BibTeX arXiv:2301.00927

Code (0)

등록된 구현이 없습니다.

Tasks

Q-Learning

Methods 이 논문이 사용한 방법론

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Similar Papers 제목 키워드 기반

Field Calibration of Hyperspectral Cameras for Terrain Inference

2025-09-30 · Nathaniel Hanson, Benjamin Pyatski, Samuel Hibbard, Gary Lvov 외 arxiv

Intra-class terrain differences such as water content directly influence a vehicle's ability to traverse terrain, yet RGB vision systems may fail to distinguish these properties. Evaluating a terrain's spectral content b…

WaDeNet: Wavelet Decomposition based CNN for Speech Processing

2020-11-11 · Prithvi Suresh, Abhijith Ragav

Existing speech processing systems consist of different modules, individually optimized for a specific task such as acoustic modelling or feature extraction. In addition to not assuring optimality of the system, the disj…

Acoustic ModellingEmotion Recognition

Joint RGB-Spectral Decomposition Model Guided Image Enhancement in Mobile Photography

2024-07-25 · Kailai Zhou, Lijing Cai, Yibo Wang, Mengya Zhang 외

The integration of miniaturized spectrometers into mobile devices offers new avenues for image quality enhancement and facilitates novel downstream tasks. However, the broader application of spectral sensors in mobile ph…

Image Enhancement

GreenScan: Towards large-scale terrestrial monitoring the health of urban trees using mobile sensing

2023-12-22 · Akshit Gupta, Simone Mora, Fan Zhang, Martine Rutten 외

Healthy urban greenery is a fundamental asset to mitigate climate change phenomena such as extreme heat and air pollution. However, urban trees are often affected by abiotic and biotic stressors that hamper their functio…

User Engagement in Mobile Health Applications

2022-06-16 · Babaniyi Yusuf Olaniyi, Ana Fernández del Río, África Periáñez, Lauren Bellhouse

Mobile health apps are revolutionizing the healthcare ecosystem by improving communication, efficiency, and quality of service. In low- and middle-income countries, they also play a unique role as a source of information…

Survival AnalysisTime SeriesTime Series Analysis