paper-with-me

홈 › Papers

JSCDS: A Core Data Selection Method with Jason-Shannon Divergence for Caries RGB Images-Efficient Learning

2024-06-29 · Peiliang Zhang, Yujia Tong, Chenghu Du, Chao Che, Yongjun Zhu

Deep learning-based RGB caries detection improves the efficiency of caries identification and is crucial for preventing oral diseases. The performance of deep learning models depends on high-quality data and requires substantial training resources, making efficient deployment challenging. Core data selection, by eliminating low-quality and confusing data, aims to enhance training efficiency without significantly compromising model performance. However, distance-based data selection methods struggle to distinguish dependencies among high-dimensional caries data. To address this issue, we propose a Core Data Selection Method with Jensen-Shannon Divergence (JSCDS) for efficient caries image learning and caries classification. We describe the core data selection criterion as the distribution of samples in different classes. JSCDS calculates the cluster centers by sample embedding representation in the caries classification network and utilizes Jensen-Shannon Divergence to compute the mutual information between data samples and cluster centers, capturing nonlinear dependencies among high-dimensional data. The average mutual information is calculated to fit the above distribution, serving as the criterion for constructing the core set for model training. Extensive experiments on RGB caries datasets show that JSCDS outperforms other data selection methods in prediction performance and time consumption. Notably, JSCDS exceeds the performance of the full dataset model with only 50% of the core data, with its performance advantage becoming more pronounced in the 70% of core data.

📄 PDF Abstract BibTeX arXiv:2407.00362

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

FSMJ: Feature Selection with Maximum Jensen-Shannon Divergence for Text Categorization

2016-06-20 · Bo Tang, Haibo He

In this paper, we present a new wrapper feature selection approach based on Jensen-Shannon (JS) divergence, termed feature selection with maximum JS-divergence (FSMJ), for text categorization. Unlike most existing featur…

feature selectionText Categorization

Generalizing Machine Learning Evaluation through the Integration of Shannon Entropy and Rough Set Theory

2024-04-18 · Olga Cherednichenko, Dmytro Chernyshov, Dmytro Sytnikov, Polina Sytnikova

This research paper delves into the innovative integration of Shannon entropy and rough set theory, presenting a novel approach to generalize the evaluation approach in machine learning. The conventional application of e…

Decision MakingModel SelectionUncertainty Quantification

Feature selection in machine learning: Rényi min-entropy vs Shannon entropy

2020-01-27 · Catuscia Palamidessi, Marco Romanelli

Feature selection, in the context of machine learning, is the process of separating the highly predictive feature from those that might be irrelevant or redundant. Information theory has been recognized as a useful conce…

BIG-bench Machine Learningfeature selection

GauSS-MI: Gaussian Splatting Shannon Mutual Information for Active 3D Reconstruction

2025-04-29 · Yuhan Xie, Yixi Cai, Yinqiang Zhang, Lei Yang 외

This research tackles the challenge of real-time active view selection and uncertainty quantification on visual quality for active 3D reconstruction. Visual quality is a critical aspect of 3D reconstruction. Recent advan…

3DGS3D ReconstructionActive 3D ReconstructionNeRF+1

Shannon entropy for intuitionistic fuzzy information

2018-07-02 · Vasile Patrascu

The paper presents an extension of Shannon fuzzy entropy for intuitionistic fuzzy one. Firstly, we presented a new formula for calculating the distance and similarity of intuitionistic fuzzy information. Then, we constru…