paper-with-me

홈 › Papers

Multi-Level Label Correction by Distilling Proximate Patterns for Semi-supervised Semantic Segmentation

2024-04-02 · Hui Xiao, Yuting Hong, Li Dong, Diqun Yan, Jiayan Zhuang, Junjie Xiong, Dongtai Liang, Chengbin Peng

Semi-supervised semantic segmentation relieves the reliance on large-scale labeled data by leveraging unlabeled data. Recent semi-supervised semantic segmentation approaches mainly resort to pseudo-labeling methods to exploit unlabeled data. However, unreliable pseudo-labeling can undermine the semi-supervision processes. In this paper, we propose an algorithm called Multi-Level Label Correction (MLLC), which aims to use graph neural networks to capture structural relationships in Semantic-Level Graphs (SLGs) and Class-Level Graphs (CLGs) to rectify erroneous pseudo-labels. Specifically, SLGs represent semantic affinities between pairs of pixel features, and CLGs describe classification consistencies between pairs of pixel labels. With the support of proximate pattern information from graphs, MLLC can rectify incorrectly predicted pseudo-labels and can facilitate discriminative feature representations. We design an end-to-end network to train and perform this effective label corrections mechanism. Experiments demonstrate that MLLC can significantly improve supervised baselines and outperforms state-of-the-art approaches in different scenarios on Cityscapes and PASCAL VOC 2012 datasets. Specifically, MLLC improves the supervised baseline by at least 5% and 2% with DeepLabV2 and DeepLabV3+ respectively under different partition protocols.

📄 PDF Abstract BibTeX arXiv:2404.02065

Code (0)

등록된 구현이 없습니다.

Tasks

Semantic SegmentationSemi-Supervised Semantic Segmentation

Methods 이 논문이 사용한 방법론

Spatial Pyramid Pooling Spatial Pyramid Pooling (SPP) is a pooling layer that removes the fixed-size constraint of the network, i.e. a CNN does not require a fixed-size input image. Specifically, we…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Dilated Convolution 설명 없음
ASPP Atrous Spatial Pyramid Pooling (ASPP) is a semantic segmentation module for resampling a given feature layer at multiple rates prior to…
CRF Conditional Random Fields or CRFs are a type of probabilistic graph model that take neighboring sample context into account for tasks like classification. Prediction is…
Feedforward Network A Feedforward Network, or a Multilayer Perceptron (MLP), is a neural network with solely densely connected layers. This is the classic neural network architecture of the…
DeepLabv2 DeepLabv2 is an architecture for semantic segmentation that build on DeepLab with an atrous [spatial pyramid…

Similar Papers 제목 키워드 기반

Does label smoothing mitigate label noise?

2020-03-05 · ICML 2020 1 · Michal Lukasik, Srinadh Bhojanapalli, Aditya Krishna Menon, Sanjiv Kumar

Label smoothing is commonly used in training deep learning models, wherein one-hot training labels are mixed with uniform label vectors. Empirically, smoothing has been shown to improve both predictive performance and mo…

Learning with noisy labels

Structure-Level Knowledge Distillation For Multilingual Sequence Labeling

2020-04-08 · ACL 2020 6 · Xinyu Wang, Yong Jiang, Nguyen Bach, Tao Wang 외

Multilingual sequence labeling is a task of predicting label sequences using a single unified model for multiple languages. Compared with relying on multiple monolingual models, using a multilingual model has the benefit…

Aspect ExtractionKnowledge Distillation

Confidence Scores Make Instance-dependent Label-noise Learning Possible

2020-01-11 · Antonin Berthon, Bo Han, Gang Niu, Tongliang Liu 외

In learning with noisy labels, for every instance, its label can randomly walk to other classes following a transition distribution which is named a noise model. Well-studied noise models are all instance-independent, na…

Learning with noisy labels

Efficient Bilevel Optimization for Meta Label Correction in Noisy Label Learning

2026-05-18 · Ba Hoang Anh Nguyen, Viet Cuong Ta arxiv

Training a deep neural network with noisy labels could reduce data annotation cost but may introduce noise into the learned model. In meta label correction approaches, an additional meta model besides the main model is t…

Bilevel Optimization

Distilling and Retrieving Generalizable Knowledge for Robot Manipulation via Language Corrections

2023-11-17 · Lihan Zha, Yuchen Cui, Li-Heng Lin, Minae Kwon 외

Today's robot policies exhibit subpar performance when faced with the challenge of generalizing to novel environments. Human corrective feedback is a crucial form of guidance to enable such generalization. However, adapt…

Language ModellingLarge Language ModelRobot Manipulation