paper-with-me

홈 › Papers

Learn like a Pathologist: Curriculum Learning by Annotator Agreement for Histopathology Image Classification

2020-09-29 · Jerry Wei, Arief Suriawinata, Bing Ren, Xiaoying Liu, Mikhail Lisovsky, Louis Vaickus, Charles Brown, Michael Baker, Mustafa Nasir-Moin, Naofumi Tomita, Lorenzo Torresani, Jason Wei, Saeed Hassanpour

Applying curriculum learning requires both a range of difficulty in data and a method for determining the difficulty of examples. In many tasks, however, satisfying these requirements can be a formidable challenge. In this paper, we contend that histopathology image classification is a compelling use case for curriculum learning. Based on the nature of histopathology images, a range of difficulty inherently exists among examples, and, since medical datasets are often labeled by multiple annotators, annotator agreement can be used as a natural proxy for the difficulty of a given example. Hence, we propose a simple curriculum learning method that trains on progressively-harder images as determined by annotator agreement. We evaluate our hypothesis on the challenging and clinically-important task of colorectal polyp classification. Whereas vanilla training achieves an AUC of 83.7% for this task, a model trained with our proposed curriculum learning approach achieves an AUC of 88.2%, an improvement of 4.5%. Our work aims to inspire researchers to think more creatively and rigorously when choosing contexts for applying curriculum learning.

📄 PDF Abstract BibTeX arXiv:2009.13698

Code (0)

등록된 구현이 없습니다.

Tasks

General Classificationimage-classificationImage Classification

Similar Papers 제목 키워드 기반

Improved statistical benchmarking of digital pathology models using pairwise frames evaluation

2023-06-07 · Ylaine Gerardin, John Shamshoian, Judy Shen, Nhat Le 외

Nested pairwise frames is a method for relative benchmarking of cell or tissue digital pathology models against manual pathologist annotations on a set of sampled patches. At a high level, the method compares agreement b…

BenchmarkingClassification

Leveraging whole slide difficulty in Multiple Instance Learning to improve prostate cancer grading

2026-03-10 · Marie Arrivat, Rémy Peyret, Elsa Angelini, Pietro Gori arxiv

Multiple Instance Learning (MIL) has been widely applied in histopathology to classify Whole Slide Images (WSIs) with slide-level diagnoses. While the ground truth is established by expert pathologists, the slides can be…

Multiple Instance Learning

CHUCKLE -- When Humans Teach AI To Learn Emotions The Easy Way

2025-10-10 · Ankush Pratap Singh, Houwei Cao, Yong Liu arxiv

Curriculum learning (CL) structures training from simple to complex samples, facilitating progressive learning. However, existing CL approaches for emotion recognition often rely on heuristic, data-driven, or model-based…

Emotion Recognition

Difficulty Translation in Histopathology Images

2020-04-27 · Jerry Wei, Arief Suriawinata, Xiaoying Liu, Bing Ren 외

The unique nature of histopathology images opens the door to domain-specific formulations of image translation models. We propose a difficulty translation model that modifies colorectal histopathology images to be more c…

BIG-bench Machine LearningTranslation

Everyone's Voice Matters: Quantifying Annotation Disagreement Using Demographic Information

2023-01-12 · Ruyuan Wan, Jaehyung Kim, Dongyeop Kang

In NLP annotation, it is common to have multiple annotators label the text and then obtain the ground truth labels based on the agreement of major annotators. However, annotators are individuals with different background…