Chernoff Sampling for Active Testing and Extension to Active Regression
Active learning can reduce the number of samples needed to perform a hypothesis test and to estimate the parameters of a model. In this paper, we revisit the work of Chernoff that described an asymptotically optimal algorithm for performing a hypothesis test. We obtain a novel sample complexity bound for Chernoff's algorithm, with a non-asymptotic term that characterizes its performance at a fixed confidence level. We also develop an extension of Chernoff sampling that can be used to estimate the parameters of a wide variety of models and we obtain a non-asymptotic bound on the estimation error. We apply our extension of Chernoff sampling to actively learn neural network models and to estimate parameters in real-data linear and non-linear regression problems, where our approach performs favorably to state-of-the-art methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Active LearningExperimental DesignregressionSimilar Papers 제목 키워드 기반
Active hypothesis testing in unknown environments using recurrent neural networks and model free reinforcement learning
A combination of deep reinforcement learning and supervised learning is proposed for the problem of active sequential hypothesis testing in completely unknown environments. We make no assumptions about the prior probabil…
Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Deep Actor-Critic Reinforcement Learning for Anomaly Detection
Anomaly detection is widely applied in a variety of domains, involving for instance, smart home systems, network traffic monitoring, IoT applications and sensor networks. In this paper, we study deep reinforcement learni…
Anomaly DetectionDeep Reinforcement Learningreinforcement-learningReinforcement Learning+1Improved Active Learning via Dependent Leverage Score Sampling
We show how to obtain improved active learning methods in the agnostic (adversarial noise) setting by combining marginal leverage score sampling with non-independent sampling strategies that promote spatial coverage. In …
Active LearningUncertainty QuantificationActive Hypothesis Testing for Correlated Combinatorial Anomaly Detection
We study the problem of identifying an anomalous subset of streams under correlated noise, motivated by monitoring and security in cyber-physical systems. This problem can be viewed as a form of combinatorial pure explor…
Anomaly DetectionDistributed Chernoff Test: Optimal decision systems over networks
We study "active" decision making over sensor networks where the sensors' sequential probing actions are actively chosen by continuously learning from past observations. We consider two network settings: with and without…
Decision MakingQuantizationTwo-sample testing