paper-with-me

홈 › Papers

Calibrating Label Distribution for Class-Imbalanced Barely-Supervised Knee Segmentation

2022-05-07 · Yiqun Lin, Huifeng Yao, Zezhong Li, Guoyan Zheng, Xiaomeng Li

Segmentation of 3D knee MR images is important for the assessment of osteoarthritis. Like other medical data, the volume-wise labeling of knee MR images is expertise-demanded and time-consuming; hence semi-supervised learning (SSL), particularly barely-supervised learning, is highly desirable for training with insufficient labeled data. We observed that the class imbalance problem is severe in the knee MR images as the cartilages only occupy 6% of foreground volumes, and the situation becomes worse without sufficient labeled data. To address the above problem, we present a novel framework for barely-supervised knee segmentation with noisy and imbalanced labels. Our framework leverages label distribution to encourage the network to put more effort into learning cartilage parts. Specifically, we utilize 1.) label quantity distribution for modifying the objective loss function to a class-aware weighted form and 2.) label position distribution for constructing a cropping probability mask to crop more sub-volumes in cartilage areas from both labeled and unlabeled inputs. In addition, we design dual uncertainty-aware sampling supervision to enhance the supervision of low-confident categories for efficient unsupervised learning. Experiments show that our proposed framework brings significant improvements by incorporating the unlabeled data and alleviating the problem of class imbalance. More importantly, our method outperforms the state-of-the-art SSL methods, demonstrating the potential of our framework for the more challenging SSL setting.

📄 PDF Abstract BibTeX arXiv:2205.03644

Code (1)

xmed-lab/cld-semi 공식 구현 pytorch

Similar Papers 제목 키워드 기반

Class-Distribution-Aware Calibration for Long-Tailed Visual Recognition

2021-09-11 · Mobarakol Islam, Lalithkumar Seenivasan, Hongliang Ren, Ben Glocker

Despite impressive accuracy, deep neural networks are often miscalibrated and tend to overly confident predictions. Recent techniques like temperature scaling (TS) and label smoothing (LS) show effectiveness in obtaining…

Label-Aware Distribution Calibration for Long-tailed Classification

2021-11-09 · Chaozheng Wang, Shuzheng Gao, Cuiyun Gao, Pengyun Wang 외

Real-world data usually present long-tailed distributions. Training on imbalanced data tends to render neural networks perform well on head classes while much worse on tail classes. The severe sparseness of training inst…

Classification

Federated Skewed Label Learning with Logits Fusion

2023-11-14 · Yuwei Wang, Runhan Li, Hao Tan, Xuefeng Jiang 외

Federated learning (FL) aims to collaboratively train a shared model across multiple clients without transmitting their local data. Data heterogeneity is a critical challenge in realistic FL settings, as it causes signif…

Federated Learning

Distribution Aligning Refinery of Pseudo-label for Imbalanced Semi-supervised Learning

2020-07-17 · NeurIPS 2020 12 · Jaehyung Kim, Youngbum Hur, Sejun Park, Eunho Yang 외

While semi-supervised learning (SSL) has proven to be a promising way for leveraging unlabeled data when labeled data is scarce, the existing SSL algorithms typically assume that training class distributions are balanced…

Pseudo Label

Transfer Knowledge from Head to Tail: Uncertainty Calibration under Long-tailed Distribution

2023-04-13 · CVPR 2023 1 · Jiahao Chen, Bing Su

How to estimate the uncertainty of a given model is a crucial problem. Current calibration techniques treat different classes equally and thus implicitly assume that the distribution of training data is balanced, but ign…

Domain Adaptation