paper-with-me

홈 › Papers

Active Learning for Level Set Estimation Using Randomized Straddle Algorithms

2024-08-06 · Yu Inatsu, Shion Takeno, Kentaro Kutsukake, Ichiro Takeuchi

Level set estimation (LSE), the problem of identifying the set of input points where a function takes value above (or below) a given threshold, is important in practical applications. When the function is expensive-to-evaluate and black-box, the \textit{straddle} algorithm, which is a representative heuristic for LSE based on Gaussian process models, and its extensions having theoretical guarantees have been developed. However, many of existing methods include a confidence parameter $\beta^{1/2}_t$ that must be specified by the user, and methods that choose $\beta^{1/2}_t$ heuristically do not provide theoretical guarantees. In contrast, theoretically guaranteed values of $\beta^{1/2}_t$ need to be increased depending on the number of iterations and candidate points, and are conservative and not good for practical performance. In this study, we propose a novel method, the \textit{randomized straddle} algorithm, in which $\beta_t$ in the straddle algorithm is replaced by a random sample from the chi-squared distribution with two degrees of freedom. The confidence parameter in the proposed method has the advantages of not needing adjustment, not depending on the number of iterations and candidate points, and not being conservative. Furthermore, we show that the proposed method has theoretical guarantees that depend on the sample complexity and the number of iterations. Finally, we confirm the usefulness of the proposed method through numerical experiments using synthetic and real data.

📄 PDF Abstract BibTeX arXiv:2408.03144

Code (0)

등록된 구현이 없습니다.

Tasks

Active Learning

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Similar Papers 제목 키워드 기반

Active Fairness Auditing

2022-06-16 · Tom Yan, Chicheng Zhang

The fast spreading adoption of machine learning (ML) by companies across industries poses significant regulatory challenges. One such challenge is scalability: how can regulatory bodies efficiently audit these ML models,…

Fairness

Maximum Consensus Parameter Estimation by Reweighted $\ell_1$ Methods

2018-03-22 · Pulak Purkait, Christopher Zach, Anders Eriksson

Robust parameter estimation in computer vision is frequently accomplished by solving the maximum consensus (MaxCon) problem. Widely used randomized methods for MaxCon, however, can only produce {random} approximate solut…

parameter estimation

Using linear initialisation to improve speed of convergence and fully-trained error in Autoencoders

2023-11-17 · Marcel Marais, Mate Hartstein, George Cevora

Good weight initialisation is an important step in successful training of Artificial Neural Networks. Over time a number of improvements have been proposed to this process. In this paper we introduce a novel weight initi…

Efficient error and variance estimation for randomized matrix computations

2022-07-13 · Ethan N. Epperly, Joel A. Tropp

Randomized matrix algorithms have become workhorse tools in scientific computing and machine learning. To use these algorithms safely in applications, they should be coupled with posterior error estimates to assess the q…

Supervised machine learning classification for short straddles on the S&P500

2022-04-26 · Alexander Brunhuemer, Lukas Larcher, Philipp Seidl, Sascha Desmettre 외

In this working paper we present our current progress in the training of machine learning models to execute short option strategies on the S&P500. As a first step, this paper is breaking this problem down to a supervised…

BIG-bench Machine Learning