paper-with-me

홈 › Papers

Generalizing Machine Learning Evaluation through the Integration of Shannon Entropy and Rough Set Theory

2024-04-18 · Olga Cherednichenko, Dmytro Chernyshov, Dmytro Sytnikov, Polina Sytnikova

This research paper delves into the innovative integration of Shannon entropy and rough set theory, presenting a novel approach to generalize the evaluation approach in machine learning. The conventional application of entropy, primarily focused on information uncertainty, is extended through its combination with rough set theory to offer a deeper insight into data's intrinsic structure and the interpretability of machine learning models. We introduce a comprehensive framework that synergizes the granularity of rough set theory with the uncertainty quantification of Shannon entropy, applied across a spectrum of machine learning algorithms. Our methodology is rigorously tested on various datasets, showcasing its capability to not only assess predictive performance but also to illuminate the underlying data complexity and model robustness. The results underscore the utility of this integrated approach in enhancing the evaluation landscape of machine learning, offering a multi-faceted perspective that balances accuracy with a profound understanding of data attributes and model dynamics. This paper contributes a groundbreaking perspective to machine learning evaluation, proposing a method that encapsulates a holistic view of model performance, thereby facilitating more informed decision-making in model selection and application.

📄 PDF Abstract BibTeX arXiv:2404.12511

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingModel SelectionUncertainty Quantification

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Enhancing Understanding of Driving Attributes through Quantitative Assessment of Driver Cognition

2023-11-03 · Pallabjyoti Kakoti, Mukesh Kumar Kamti, Rauf Iqbal, Eeshankur Saikia

This paper presents a novel approach for analysing EEG data from drivers in a simulated driving test. We focused on the Hurst exponent, Shannon entropy, and fractal dimension as markers of the nonlinear dynamics of the b…

EEG

Information entropy as an anthropomorphic concept

2015-03-06 · Panteleimon Rodis

According to E.T. Jaynes and E.P. Wigner, entropy is an anthropomorphic concept in the sense that in a physical system correspond many thermodynamic systems. The physical system can be examined from many points of view e…

Diversity

Enforcing KL Regularization in General Tsallis Entropy Reinforcement Learning via Advantage Learning

2022-05-16 · Lingwei Zhu, Zheng Chen, Eiji Uchibe, Takamitsu Matsubara

Maximum Tsallis entropy (MTE) framework in reinforcement learning has gained popularity recently by virtue of its flexible modeling choices including the widely used Shannon entropy and sparse entropy. However, non-Shann…

reinforcement-learningReinforcement Learning (RL)

The Representation Jensen-Shannon Divergence

2023-05-25 · Jhoan K. Hoyos-Osorio, Luis G. Sanchez-Giraldo

Quantifying the difference between probability distributions is crucial in machine learning. However, estimating statistical divergences from empirical samples is challenging due to unknown underlying distributions. This…

Domain AdaptationTwo-sample testingUnsupervised Domain Adaptation

Generalizing Bayesian Optimization with Decision-theoretic Entropies

2022-10-04 · Willie Neiswanger, Lantao Yu, Shengjia Zhao, Chenlin Meng 외

Bayesian optimization (BO) is a popular method for efficiently inferring optima of an expensive black-box function via a sequence of queries. Existing information-theoretic BO procedures aim to make queries that most red…

Bayesian OptimizationDecision MakingSequential Decision Making