paper-with-me

홈 › Papers

When three experiments are better than two: Avoiding intractable correlated aleatoric uncertainty by leveraging a novel bias--variance tradeoff

2025-09-04 · Paul Scherer, Andreas Kirsch, Jake P. Taylor-King arxiv

Real-world experimental scenarios are characterized by the presence of heteroskedastic aleatoric uncertainty, and this uncertainty can be correlated in batched settings. The bias--variance tradeoff can be used to write the expected mean squared error between a model distribution and a ground-truth random variable as the sum of an epistemic uncertainty term, the bias squared, and an aleatoric uncertainty term. We leverage this relationship to propose novel active learning strategies that directly reduce the bias between experimental rounds, considering model systems both with and without noise. Finally, we investigate methods to leverage historical data in a quadratic manner through the use of a novel cobias--covariance relationship, which naturally proposes a mechanism for batching through an eigendecomposition strategy. When our difference-based method leveraging the cobias--covariance relationship is utilized in a batched setting (with a quadratic estimator), we outperform a number of canonical methods including BALD and Least Confidence.

📄 PDF Abstract BibTeX arXiv:2509.04363

Code (0)

등록된 구현이 없습니다.

Tasks

Active Learning

Similar Papers 제목 키워드 기반

Interpreting A Pre-trained Model Is A Key For Model Architecture Optimization: A Case Study On Wav2Vec 2.0

2021-04-07 · Liu Chen, Meysam Asgari

A deep Transformer model with good evaluation score does not mean each subnetwork (a.k.a transformer block) learns reasonable representation. Diagnosing abnormal representation and avoiding it can contribute to achieving…

Language ModelingLanguage Modellingmodel

DC4GS: Directional Consistency-Driven Adaptive Density Control for 3D Gaussian Splatting

2025-10-30 · Moonsoo Jeong, Dongbeen Kim, Minseong Kim, Sungkil Lee arxiv

We present a Directional Consistency (DC)-driven Adaptive Density Control (ADC) for 3D Gaussian Splatting (DC4GS). Whereas the conventional ADC bases its primitive splitting on the magnitudes of positional gradients, we …

Continuous Dropout

2019-11-28 · Xu Shen, Xinmei Tian, Tongliang Liu, Fang Xu 외

Dropout has been proven to be an effective algorithm for training robust deep networks because of its ability to prevent overfitting by avoiding the co-adaptation of feature detectors. Current explanations of dropout inc…

PackNet: Adding Multiple Tasks to a Single Network by Iterative Pruning

2017-11-15 · CVPR 2018 6 · Arun Mallya, Svetlana Lazebnik

This paper presents a method for adding multiple tasks to a single deep neural network while avoiding catastrophic forgetting. Inspired by network pruning techniques, we exploit redundancies in large deep networks to fre…

Continual LearningNetwork Pruning

Stronger Random Baselines for In-Context Learning

2024-04-19 · Gregory Yauney, David Mimno

Evaluating the in-context learning classification performance of language models poses challenges due to small dataset sizes, extensive prompt-selection using the validation set, and intentionally difficult tasks that le…

In-Context Learning