Learning from Mistakes: Self-Regularizing Hierarchical Representations in Point Cloud Semantic Segmentation
Recent advances in autonomous robotic technologies have highlighted the growing need for precise environmental analysis. LiDAR semantic segmentation has gained attention to accomplish fine-grained scene understanding by acting directly on raw content provided by sensors. Recent solutions showed how different learning techniques can be used to improve the performance of the model, without any architectural or dataset change. Following this trend, we present a coarse-to-fine setup that LEArns from classification mistaKes (LEAK) derived from a standard model. First, classes are clustered into macro groups according to mutual prediction errors; then, the learning process is regularized by: (1) aligning class-conditional prototypical feature representation for both fine and coarse classes, (2) weighting instances with a per-class fairness index. Our LEAK approach is very general and can be seamlessly applied on top of any segmentation architecture; indeed, experimental results showed that it enables state-of-the-art performances on different architectures, datasets and tasks, while ensuring more balanced class-wise results and faster convergence.
Code (0)
등록된 구현이 없습니다.
Tasks
FairnessLIDAR Semantic SegmentationPoint Cloud SegmentationScene UnderstandingSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
Bridging Domain Gap of Point Cloud Representations via Self-Supervised Geometric Augmentation
Recent progress of semantic point clouds analysis is largely driven by synthetic data (e.g., the ModelNet and the ShapeNet), which are typically complete, well-aligned and noisy free. Therefore, representations of those …
Domain AdaptationPoint Cloud ClassificationRepresentation LearningSelf-Supervised Learning+1Self-Directed Linear Classification
In online classification, a learner is presented with a sequence of examples and aims to predict their labels in an online fashion so as to minimize the total number of mistakes. In the self-directed variant, the learner…
ClassificationTowards Foundation Models for 3D Scene Understanding: Instance-Aware Self-Supervised Learning for Point Clouds
Recent advances in self-supervised learning (SSL) for point clouds have substantially improved 3D scene understanding without human annotations. Existing approaches emphasize semantic awareness by enforcing feature consi…
Self-Supervised LearningPanoptic SegmentationInstance SegmentationScene UnderstandingOn Partial Prototype Collapse in the DINO Family of Self-Supervised Methods
A prominent self-supervised learning paradigm is to model the representations as clusters, or more generally as a mixture model. Learning to map the data samples to compact representations and fitting the mixture model s…
Self-Supervised LearningAll Mistakes Are Not Equal: Comprehensive Hierarchy Aware Multi-label Predictions (CHAMP)
This paper considers the problem of Hierarchical Multi-Label Classification (HMC), where (i) several labels can be present for each example, and (ii) labels are related via a domain-specific hierarchy tree. Guided by the…
AllClassificationHierarchical Multi-label ClassificationMulti-Label Classification+1