paper-with-me

Papers

Tuning structure learning algorithms with out-of-sample and resampling strategies

2023-06-24 · Kiattikun Chobtham, Anthony C. Constantinou

One of the challenges practitioners face when applying structure learning algorithms to their data involves determining a set of hyperparameters; otherwise, a set of hyperparameter defaults is assumed. The optimal hyperparameter configuration often depends on multiple factors, including the size and density of the usually unknown underlying true graph, the sample size of the input data, and the structure learning algorithm. We propose a novel hyperparameter tuning method, called the Out-of-sample Tuning for Structure Learning (OTSL), that employs out-of-sample and resampling strategies to estimate the optimal hyperparameter configuration for structure learning, given the input data set and structure learning algorithm. Synthetic experiments show that employing OTSL as a means to tune the hyperparameters of hybrid and score-based structure learning algorithms leads to improvements in graphical accuracy compared to the state-of-the-art. We also illustrate the applicability of this approach to real datasets from different disciplines.

📄 PDF Abstract BibTeX arXiv:2306.13932

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

An extensive simulation study evaluating the interaction of resampling techniques across multiple causal discovery contexts

2025-03-19 · Ritwick Banerjee, Bryan Andrews, Erich Kummerfeld

Despite the accelerating presence of exploratory causal analysis in modern science and medicine, the available non-experimental methods for validating causal models are not well characterized. One of the most popular met…

Causal Discovery

Machine Learning Assessment: implications to cybersecurity

2019-07-30 · Waleed A. Yousef

This chapter is dedicated to the assessment and performance estimation of machine learning (ML) algorithms, a topic that is equally important to the construction of these algorithms, in particular in the context of cyber…

BIG-bench Machine Learning

Neural Network Based Undersampling Techniques

2019-08-18 · Md. Adnan Arefeen, Sumaiya Tabassum Nimi, M. Sohel Rahman

Class imbalance problem is commonly faced while developing machine learning models for real-life issues. Due to this problem, the fitted model tends to be biased towards the majority class data, which leads to lower prec…

Overtuning in Hyperparameter Optimization

2025-06-24 · Lennart Schneider, Bernd Bischl, Matthias Feurer

Hyperparameter optimization (HPO) aims to identify an optimal hyperparameter configuration (HPC) such that the resulting model generalizes well to unseen data. As the expected generalization error cannot be optimized dir…

AutoMLHyperparameter Optimization

Meta-Learning for Resampling Recommendation Systems

2017-06-06 · Smolyakov Dmitry, Alexander Korotin, Pavel Erofeev, Artem Papanov 외

One possible approach to tackle the class imbalance in classification tasks is to resample a training dataset, i.e., to drop some of its elements or to synthesize new ones. There exist several widely-used resampling meth…

ClassificationGeneral ClassificationMeta-LearningRecommendation Systems