Quantifying Overfitting: Introducing the Overfitting Index
In the rapidly evolving domain of machine learning, ensuring model generalizability remains a quintessential challenge. Overfitting, where a model exhibits superior performance on training data but falters on unseen data, is a recurrent concern. This paper introduces the Overfitting Index (OI), a novel metric devised to quantitatively assess a model's tendency to overfit. Through extensive experiments on the Breast Ultrasound Images Dataset (BUS) and the MNIST dataset using architectures such as MobileNet, U-Net, ResNet, Darknet, and ViT-32, we illustrate the utility and discernment of the OI. Our results underscore the variable overfitting behaviors across architectures and highlight the mitigative impact of data augmentation, especially on smaller and more specialized datasets. The ViT-32's performance on MNIST further emphasizes the robustness of certain models and the dataset's comprehensive nature. By providing an objective lens to gauge overfitting, the OI offers a promising avenue to advance model optimization and ensure real-world efficacy.
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationModel OptimizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Friend or Foe? Harnessing Controllable Overfitting for Anomaly Detection
Overfitting has long been stigmatized as detrimental to model performance, especially in the context of anomaly detection. Our work challenges this conventional view by introducing a paradigm shift, recasting overfitting…
Anomaly DetectionMulti-class Anomaly DetectionDeep Reinforcement Learning for Cryptocurrency Trading: Practical Approach to Address Backtest Overfitting
Designing profitable and reliable trading strategies is challenging in the highly volatile cryptocurrency market. Existing works applied deep reinforcement learning methods and optimistically reported increased profits i…
Algorithmic TradingDeep Reinforcement Learningreinforcement-learningReinforcement Learning+1DroneSR: Rethinking Few-shot Thermal Image Super-Resolution from Drone-based Perspective
Although large scale models achieve significant improvements in performance, the overfitting challenge still frequently undermines their generalization ability. In super resolution tasks on images, diffusion models as re…
Representation LearningImage Super-ResolutionImage ReconstructionObjectness-Aware Few-Shot Semantic Segmentation
Few-shot semantic segmentation models aim to segment images after learning from only a few annotated examples. A key challenge for them is how to avoid overfitting because limited training data is available. While prior …
Few-Shot Semantic SegmentationSegmentationSemantic SegmentationCovariance-Driven Regression Trees: Reducing Overfitting in CART
Decision trees are powerful machine learning algorithms, widely used in fields such as economics and medicine for their simplicity and interpretability. However, decision trees such as CART are prone to overfitting, espe…