paper-with-me

Papers

Perturbed Self-Distillation: Weakly Supervised Large-Scale Point Cloud Semantic Segmentation

2021-01-01 · ICCV 2021 10 · Yachao Zhang, Yanyun Qu, Yuan Xie, Zonghao Li, Shanshan Zheng, Cuihua Li

Large-scale point cloud semantic segmentation has wide applications. Current popular researches mainly focus on fully supervised learning which demands expensive and tedious manual point-wise annotation. Weakly supervised learning is an alternative way to avoid this exhausting annotation. However, for large-scale point clouds with few labeled points, the network is difficult to extract discriminative features for unlabeled points, as well as the regularization of topology between labeled and unlabeled points is usually ignored, resulting in incorrect segmentation results. To address this problem, we propose a perturbed self-distillation (PSD) framework. Specifically, inspired by self-supervised learning, we construct the perturbed branch and enforce the predictive consistency among the perturbed branch and original branch. In this way, the graph topology of the whole point cloud can be effectively established by the introduced auxiliary supervision, such that the information propagation between the labeled and unlabeled points will be realized. Besides point-level supervision, we present a well-integrated context-aware module to explicitly regularize the affinity correlation of labeled points. Therefore, the graph topology of the point cloud can be further refined. The experimental results evaluated on three large-scale datasets show the large gain (3.0% on average) against recent weakly supervised methods and comparable results to some fully supervised methods.

📄 PDF Abstract BibTeX

Code (3)

2023-MindSpore-1/ms-code-113 mindspore
dmcv-ecnu/MindSpore_ModelZoo/tree/main/PSD_Mindspore mindspore
yangyucheng000/PSD_Mindspore mindspore

Tasks

Self-Supervised LearningSemantic SegmentationWeakly-supervised Learning

Similar Papers 제목 키워드 기반

Large scale weakly and semi-supervised learning for low-resource video ASR

2020-05-16 · Kritika Singh, Vimal Manohar, Alex Xiao, Sergey Edunov 외

Many semi- and weakly-supervised approaches have been investigated for overcoming the labeling cost of building high quality speech recognition systems. On the challenging task of transcribing social media videos in low-…

Decoderspeech-recognitionSpeech Recognition

Modality-Aware Contrastive Instance Learning with Self-Distillation for Weakly-Supervised Audio-Visual Violence Detection

2022-07-12 · Jiashuo Yu, Jinyu Liu, Ying Cheng, Rui Feng 외

Weakly-supervised audio-visual violence detection aims to distinguish snippets containing multimodal violence events with video-level labels. Many prior works perform audio-visual integration and interaction in an early …

Anomaly Detection In Surveillance Videosaudio-visual learningMultiple Instance Learning

SimReg: Regression as a Simple Yet Effective Tool for Self-supervised Knowledge Distillation

2022-01-13 · K L Navaneet, Soroush Abbasi Koohpayegani, Ajinkya Tejankar, Hamed Pirsiavash

Feature regression is a simple way to distill large neural network models to smaller ones. We show that with simple changes to the network architecture, regression can outperform more complex state-of-the-art approaches …

Knowledge Distillationregression

Comprehensive Attention Self-Distillation for Weakly-Supervised Object Detection

2020-10-22 · NeurIPS 2020 12 · Zeyi Huang, Yang Zou, Vijayakumar Bhagavatula, Dong Huang

Weakly Supervised Object Detection (WSOD) has emerged as an effective tool to train object detectors using only the image-level category labels. However, without object-level labels, WSOD detectors are prone to detect bo…

Objectobject-detectionObject DetectionWeakly Supervised Object Detection

Spatial Likelihood Voting with Self-Knowledge Distillation for Weakly Supervised Object Detection

2022-04-14 · Ze Chen, Zhihang Fu, Jianqiang Huang, Mingyuan Tao 외

Weakly supervised object detection (WSOD), which is an effective way to train an object detection model using only image-level annotations, has attracted considerable attention from researchers. However, most of the exis…

Knowledge DistillationMultiple Instance Learningobject-detectionObject Detection+3