Seasonal Station-Keeping of Short Duration High Altitude Balloons using Deep Reinforcement Learning

2025-02-07 · Tristan K. Schuler, Chinthan Prasad, Georgiy Kiselev, Donald Sofge

Station-Keeping short-duration high-altitude balloons (HABs) in a region of interest is a challenging path-planning problem due to partially observable, complex, and dynamic wind flows. Deep reinforcement learning is a popular strategy for solving the station-keeping problem. A custom simulation environment was developed to train and evaluate Deep Q-Learning (DQN) for short-duration HAB agents in the simulation. To train the agents on realistic winds, synthetic wind forecasts were generated from aggregated historical radiosonde data to apply horizontal kinematics to simulated agents. The synthetic forecasts were closely correlated with ECWMF ERA5 Reanalysis forecasts, providing a realistic simulated wind field and seasonal and altitudinal variances between the wind models. DQN HAB agents were then trained and evaluated across different seasonal months. To highlight differences and trends in months with vastly different wind fields, a Forecast Score algorithm was introduced to independently classify forecasts based on wind diversity, and trends between station-keeping success and the Forecast Score were evaluated across all seasons.

📄 PDF Abstract BibTeX arXiv:2502.05014

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement LearningDiversityQ-Learning

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

DQN A DQN, or Deep Q-Network, approximates a state-value function in a Q-Learning framework with a neural network. In the Atari…

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

DCD: Decomposition-based Causal Discovery from Autocorrelated and Non-Stationary Temporal Data

2026-02-01 · Muhammad Hasan Ferdous, Md Osman Gani arxiv

Multivariate time series in domains such as finance, climate science, and healthcare often exhibit long-term trends, seasonal patterns, and short-term fluctuations, complicating causal inference under non-stationarity an…

Causal Inference

Emergence of stylized facts during the opening of stock markets

2018-12-18

Financial markets show a number of non-stationarities, ranging from volatility fluctuations over ever changing technical and regulatory market conditions to seasonalities. On the other hand, financial markets show variou…

DaYu: Data-Driven Model for Geostationary Satellite Observed Cloud Images Forecasting

2024-11-15 · Xujun Wei, Feng Zhang, Renhe Zhang, Wenwen Li 외

In the past few years, Artificial Intelligence (AI)-based weather forecasting methods have widely demonstrated strong competitiveness among the weather forecasting systems. However, these methods are insufficient for hig…

Weather Forecasting

Evaluating Simplification Algorithms for Interpretability of Time Series Classification

2025-05-13 · Felix Marti-Perez, Brigt Håvardstun, Cèsar Ferri, Carlos Monserrat 외

In this work, we introduce metrics to evaluate the use of simplified time series in the context of interpretability of a TSC - a Time Series Classifier. Such simplifications are important because time series data, in con…

Time Series Time Series Classification

How fast does the clock of Finance run? - A time-definition enforcing scale invariance and quantifying overnights

2017-08-11

A symmetry-guided definition of time may enhance and simplify the analysis of historical series with recurrent patterns and seasonalities. By enforcing simple-scaling and stationarity of the distributions of returns, we …