paper-with-me

홈 › Papers

Human not in the loop: objective sample difficulty measures for Curriculum Learning

2023-02-02 · Zhengbo Zhou, Jun Luo, Dooman Arefan, Gene Kitamura, Shandong Wu

Curriculum learning is a learning method that trains models in a meaningful order from easier to harder samples. A key here is to devise automatic and objective difficulty measures of samples. In the medical domain, previous work applied domain knowledge from human experts to qualitatively assess classification difficulty of medical images to guide curriculum learning, which requires extra annotation efforts, relies on subjective human experience, and may introduce bias. In this work, we propose a new automated curriculum learning technique using the variance of gradients (VoG) to compute an objective difficulty measure of samples and evaluated its effects on elbow fracture classification from X-ray images. Specifically, we used VoG as a metric to rank each sample in terms of the classification difficulty, where high VoG scores indicate more difficult cases for classification, to guide the curriculum training process We compared the proposed technique to a baseline (without curriculum learning), a previous method that used human annotations on classification difficulty, and anti-curriculum learning. Our experiment results showed comparable and higher performance for the binary and multi-class bone fracture classification tasks.

📄 PDF Abstract BibTeX arXiv:2302.01243

Code (0)

등록된 구현이 없습니다.

Tasks

Classification

Similar Papers 제목 키워드 기반

Iterative Closed-Loop Motion Synthesis for Scaling the Capabilities of Humanoid Control

2026-02-25 · Weisheng Xu, Qiwei Wu, Jiaxi Zhang, Tan Jing 외 arxiv

Physics-based humanoid control relies on training with motion datasets that have diverse data distributions. However, the fixed difficulty distribution of datasets limits the performance ceiling of the trained control po…

Motion Synthesis

Exploring the Learning Difficulty of Data Theory and Measure

2022-05-16 · Weiyao Zhu, Ou wu, Fengguang Su, Yingjun Deng

As learning difficulty is crucial for machine learning (e.g., difficulty-based weighting learning strategies), previous literature has proposed a number of learning difficulty measures. However, no comprehensive investig…

Image-Difficulty-Aware Evaluation of Super-Resolution Models

2025-09-30 · Atakan Topaloglu, Ahmet Bilican, Cansu Korkmaz, A. Murat Tekalp arxiv

Image super-resolution models are commonly evaluated by average scores (over some benchmark test sets), which fail to reflect the performance of these models on images of varying difficulty and that some models generate …

Image Super-Resolution

How hard are computer vision datasets? Calibrating dataset difficulty to viewing time

2023-09-26 · NeurIPS 2023 12

Humans outperform object recognizers despite the fact that models perform well on current datasets, including those explicitly designed to challenge machines with debiased images or distribution shift. This problem persi…

Object Recognition

Human Decision Makings on Curriculum Reinforcement Learning with Difficulty Adjustment

2022-08-04 · Yilei Zeng, Jiali Duan, Yang Li, Emilio Ferrara 외

Human-centered AI considers human experiences with AI performance. While abundant research has been helping AI achieve superhuman performance either by fully automatic or weak supervision learning, fewer endeavors are ex…

reinforcement-learningReinforcement LearningReinforcement Learning (RL)