paper-with-me

홈 › Papers

Stone Soup Multi-Target Tracking Feature Extraction For Autonomous Search And Track In Deep Reinforcement Learning Environment

2025-03-03 · Jan-Hendrik Ewers, Joe Gibbs, David Anderson

Management of sensing resources is a non-trivial problem for future military air assets with future systems deploying heterogeneous sensors to generate information of the battlespace. Machine learning techniques including deep reinforcement learning (DRL) have been identified as promising approaches, but require high-fidelity training environments and feature extractors to generate information for the agent. This paper presents a deep reinforcement learning training approach, utilising the Stone Soup tracking framework as a feature extractor to train an agent for a sensor management task. A general framework for embedding Stone Soup tracker components within a Gymnasium environment is presented, enabling fast and configurable tracker deployments for RL training using Stable Baselines3. The approach is demonstrated in a sensor management task where an agent is trained to search and track a region of airspace utilising track lists generated from Stone Soup trackers. A sample implementation using three neural network architectures in a search-and-track scenario demonstrates the approach and shows that RL agents can outperform simple sensor search and track policies when trained within the Gymnasium and Stone Soup environment.

📄 PDF Abstract BibTeX arXiv:2503.01293

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement LearningManagementreinforcement-learningReinforcement Learning

Similar Papers 제목 키워드 기반

Stone Soup: ADS-B-based Multi-Target Tracking with Stochastic Integration Filter

2025-06-09 · John Hiles, Jakub Matousek, Erik Blasch, Ruixin Niu 외

This paper focuses on the multi-target tracking using the Stone Soup framework. In particular, we aim at evaluation of two multi-target tracking scenarios based on the simulated class-B dataset and ADS-B class-A dataset …

Context-Aware Sensor Modeling for Asynchronous Multi-Sensor Tracking in Stone Soup

2026-03-16 · Martin Vonheim Larsen, Kim Mathiassen arxiv

Multi-sensor tracking in the real world involves asynchronous sensors with partial coverage and heterogeneous detection performance. Although probabilistic tracking methods permit detection probability and clutter intens…

Stochastic Integration Based Estimator: Robust Design and Stone Soup Implementation

2024-12-10 · Jindrich Dunik, Jakub Matousek, Ondrej Straka, Erik Blasch 외

This paper deals with state estimation of nonlinear stochastic dynamic models. In particular, the stochastic integration rule, which provides asymptotically unbiased estimates of the moments of nonlinearly transformed Ga…

Robust DesignState Estimation

Dungeon Crawl Stone Soup as an Evaluation Domain for Artificial Intelligence

2019-02-05 · Dustin Dannenhauer, Michael W. Floyd, Jonathan Decker, David W. Aha

Dungeon Crawl Stone Soup is a popular, single-player, free and open-source rogue-like video game with a sufficiently complex decision space that makes it an ideal testbed for research in cognitive systems and, more gener…

StarcraftStarcraft II

Descriptor and Word Soups: Overcoming the Parameter Efficiency Accuracy Tradeoff for Out-of-Distribution Few-shot Learning

2023-11-21 · CVPR 2024 1 · Christopher Liao, Theodoros Tsiligkaridis, Brian Kulis

Over the past year, a large body of multimodal research has emerged around zero-shot evaluation using GPT descriptors. These studies boost the zero-shot accuracy of pretrained VL models with an ensemble of label-specific…

Domain GeneralizationFew-Shot LearningGPU