Active hypothesis testing in unknown environments using recurrent neural networks and model free reinforcement learning

2023-03-19 · George Stamatelis, Nicholas Kalouptsidis

A combination of deep reinforcement learning and supervised learning is proposed for the problem of active sequential hypothesis testing in completely unknown environments. We make no assumptions about the prior probability, the action and observation sets, and the observation generating process. Our method can be used in any environment even if it has continuous observations or actions, and performs competitively and sometimes better than the Chernoff test, in both finite and infinite horizon problems, despite not having access to the environment dynamics.

📄 PDF Abstract BibTeX arXiv:2303.10623

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

In-Context Learning for Pure Exploration in Continuous Spaces

2026-02-20 · Alessio Russo, Yin-Ching Lee, Ryan Welch, Aldo Pacchiano arxiv

In active sequential testing, also termed pure exploration, a learner is tasked with the goal to adaptively acquire information so as to identify an unknown ground-truth hypothesis with as few queries as possible. This p…

Statistical Limits for Testing Correlation of Hypergraphs

2022-02-11 · Mingao Yuan, Zuofeng Shang

In this paper, we consider the hypothesis testing of correlation between two $m$-uniform hypergraphs on $n$ unlabelled nodes. Under the null hypothesis, the hypergraphs are independent, while under the alternative hypoth…

Active Hypothesis Testing for Correlated Combinatorial Anomaly Detection

2026-01-24 · Zichuan Yang, Yiming Xing arxiv

We study the problem of identifying an anomalous subset of streams under correlated noise, motivated by monitoring and security in cyber-physical systems. This problem can be viewed as a form of combinatorial pure explor…

Anomaly Detection

Bayesian Hypothesis Testing for Block Sparse Signal Recovery

2015-08-22 · Mehdi Korki, Hadi Zayyani, Jingxin Zhang

This letter presents a novel Block Bayesian Hypothesis Testing Algorithm (Block-BHTA) for reconstructing block sparse signals with unknown block structures. The Block-BHTA comprises the detection and recovery of the supp…

Two-sample testing

Finite-Sample Analysis of Elimination in Active Hypothesis Testing

2026-05-01 · Ziyuan Lin, Hoang Ngoc Nguyen, Jie Xu, Ivan Ruchkin arxiv

A fixed-confidence, finite-sample problem of active hypothesis testing arises in many safety-critical applications. Situated in the context of sequential hypothesis testing, this paper studies the effect of hypothesis el…