paper-with-me

Papers

BBOmix: A Tabular Benchmark for Hyperparameter Optimization of Unsupervised Biological Representation Learning

2026-06-03 · Luca Thale-Bombien, Jan Ewald, Ralf König, Aaron Klein arxiv

The rapid advancement of high-throughput sequencing has led to large, high-dimensional omics datasets. Deep unsupervised learning architectures, particularly Autoencoders (AEs), are increasingly used for dimensionality reduction and representation learning in this domain. However, AEs are highly sensitive to architectural choices and hyperparameters, and unsupervised optimization typically relies on reconstruction loss, which may be a poor proxy for downstream utility. Exhaustive hyperparameter optimization (HPO) is computationally expensive, leading researchers to frequently rely on suboptimal default configurations. To democratize access to large-scale unsupervised HPO research, we introduce $\textbf{BBOmix}$, the first open-source tabular benchmark for unsupervised representation learning on real-world biological data. Our benchmark includes 105,000 evaluations across four AE architectures and seven multi-omics modalities from the TCGA and SCHC datasets. We quantify the correlation between reconstruction loss and downstream task performance and provide an extensive evaluation of state-of-the-art single-fidelity, multi-fidelity, and transfer learning HPO methods, establishing a rigorous baseline for future research in unsupervised biological representation learning.

📄 PDF Abstract BibTeX arXiv:2606.05139

Code (0)

등록된 구현이 없습니다.

Tasks

Hyperparameter OptimizationDimensionality ReductionRepresentation LearningTransfer Learning

Similar Papers 제목 키워드 기반

Tabular Benchmarks for Joint Architecture and Hyperparameter Optimization

2019-05-13 · Aaron Klein, Frank Hutter

Due to the high computational demands executing a rigorous comparison between hyperparameter optimization (HPO) methods is often cumbersome. The goal of this paper is to facilitate a better empirical evaluation of HPO me…

Hyperparameter Optimization

YAHPO Gym -- An Efficient Multi-Objective Multi-Fidelity Benchmark for Hyperparameter Optimization

2021-09-08 · Florian Pfisterer, Lennart Schneider, Julia Moosbauer, Martin Binder 외

When developing and analyzing new hyperparameter optimization methods, it is vital to empirically evaluate and compare them on well-curated benchmark suites. In this work, we propose a new set of challenging and relevant…

Hyperparameter Optimization

Scaling Laws for Hyperparameter Optimization

2023-09-21 · NeurIPS 2023 11

Hyperparameter optimization is an important subfield of machine learning that focuses on tuning the hyperparameters of a chosen algorithm to achieve peak performance. Recently, there has been a stream of methods that tac…

Auto-PyTorch Tabular: Multi-Fidelity MetaLearning for Efficient and Robust AutoDL

2020-06-24 · Lucas Zimmer, Marius Lindauer, Frank Hutter

While early AutoML frameworks focused on optimizing traditional ML pipelines and their hyperparameters, a recent trend in AutoML is to focus on neural architecture search. In this paper, we introduce Auto-PyTorch, which …

AutoMLNeural Architecture Search

Multi-Objective Optimization of Performance and Interpretability of Tabular Supervised Machine Learning Models

2023-07-17 · Lennart Schneider, Bernd Bischl, Janek Thomas

We present a model-agnostic framework for jointly optimizing the predictive performance and interpretability of supervised machine learning models for tabular data. Interpretability is quantified via three measures: feat…

feature selectionHyperparameter Optimization