paper-with-me

홈 › Papers

Test-Time Augmentation Meets Variational Bayes

2024-09-19 · Masanari Kimura, Howard Bondell

Data augmentation is known to contribute significantly to the robustness of machine learning models. In most instances, data augmentation is utilized during the training phase. Test-Time Augmentation (TTA) is a technique that instead leverages these data augmentations during the testing phase to achieve robust predictions. More precisely, TTA averages the predictions of multiple data augmentations of an instance to produce a final prediction. Although the effectiveness of TTA has been empirically reported, it can be expected that the predictive performance achieved will depend on the set of data augmentation methods used during testing. In particular, the data augmentation methods applied should make different contributions to performance. That is, it is anticipated that there may be differing degrees of contribution in the set of data augmentation methods used for TTA, and these could have a negative impact on prediction performance. In this study, we consider a weighted version of the TTA based on the contribution of each data augmentation. Some variants of TTA can be regarded as considering the problem of determining the appropriate weighting. We demonstrate that the determination of the coefficients of this weighted TTA can be formalized in a variational Bayesian framework. We also show that optimizing the weights to maximize the marginal log-likelihood suppresses candidates of unwanted data augmentations at the test phase.

📄 PDF Abstract BibTeX arXiv:2409.12587

Code (0)

등록된 구현이 없습니다.

Tasks

Data Augmentation

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Algorithms of the LDA model [REPORT]

2013-07-01 · Jaka Špeh, Andrej Muhič, Jan Rupnik

We review three algorithms for Latent Dirichlet Allocation (LDA). Two of them are variational inference algorithms: Variational Bayesian inference and Online Variational Bayesian inference and one is Markov Chain Monte C…

Bayesian InferencemodelVariational Inference

Enhanced uncertainty quantification variational autoencoders for the solution of Bayesian inverse problems

2025-02-18 · Andrea Tonini, Luca Dede'

Among other uses, neural networks are a powerful tool for solving deterministic and Bayesian inverse problems in real-time. In the Bayesian framework, variational autoencoders, a specialized type of neural network, enabl…

Uncertainty Quantification

Variational Continual Test-Time Adaptation

2024-02-13 · Fan Lyu, Kaile Du, Yuyang Li, Hanyu Zhao 외

The prior drift is crucial in Continual Test-Time Adaptation (CTTA) methods that only use unlabeled test data, as it can cause significant error propagation. In this paper, we introduce VCoTTA, a variational Bayesian app…

Test-time AdaptationVariational Inference

Variational multiple shooting for Bayesian ODEs with Gaussian processes

2021-06-21 · Pashupati Hegde, Çağatay Yıldız, Harri Lähdesmäki, Samuel Kaski 외

Recent machine learning advances have proposed black-box estimation of unknown continuous-time system dynamics directly from data. However, earlier works are based on approximative ODE solutions or point estimates. We pr…

Bayesian InferenceGaussian ProcessesVariational Inference

Global inducing point variational posteriors for Bayesian neural networks and deep Gaussian processes

2020-05-17 · Sebastian W. Ober, Laurence Aitchison

We consider the optimal approximate posterior over the top-layer weights in a Bayesian neural network for regression, and show that it exhibits strong dependencies on the lower-layer weights. We adapt this result to deve…

Data AugmentationGaussian Processes