paper-with-me

Papers

Hyperbolic Active Learning for Semantic Segmentation under Domain Shift

2023-06-19 · Luca Franco, Paolo Mandica, Konstantinos Kallidromitis, Devin Guillory, Yu-Teng Li, Trevor Darrell, Fabio Galasso

We introduce a hyperbolic neural network approach to pixel-level active learning for semantic segmentation. Analysis of the data statistics leads to a novel interpretation of the hyperbolic radius as an indicator of data scarcity. In HALO (Hyperbolic Active Learning Optimization), for the first time, we propose the use of epistemic uncertainty as a data acquisition strategy, following the intuition of selecting data points that are the least known. The hyperbolic radius, complemented by the widely-adopted prediction entropy, effectively approximates epistemic uncertainty. We perform extensive experimental analysis based on two established synthetic-to-real benchmarks, i.e. GTAV $\rightarrow$ Cityscapes and SYNTHIA $\rightarrow$ Cityscapes. Additionally, we test HALO on Cityscape $\rightarrow$ ACDC for domain adaptation under adverse weather conditions, and we benchmark both convolutional and attention-based backbones. HALO sets a new state-of-the-art in active learning for semantic segmentation under domain shift and it is the first active learning approach that surpasses the performance of supervised domain adaptation while using only a small portion of labels (i.e., 1%).

📄 PDF Abstract BibTeX arXiv:2306.11180

Code (1)

paolomandica/HALO 공식 구현 pytorch

Tasks

Domain AdaptationSemantic SegmentationSource-Free Domain Adaptation

Similar Papers 제목 키워드 기반

Flattening the Parent Bias: Hierarchical Semantic Segmentation in the Poincare Ball

2024-01-01 · CVPR 2024 1 · Simon Weber, Bar?? Zöngür, Nikita Araslanov, Daniel Cremers

Hierarchy is a natural representation of semantic taxonomies including the ones routinely used in image segmentation. Indeed recent work on semantic segmentation reports improved accuracy from supervised training lev…

Image SegmentationSegmentationSemantic Segmentation

Flattening the Parent Bias: Hierarchical Semantic Segmentation in the Poincaré Ball

2024-04-04 · Simon Weber, Barış Zöngür, Nikita Araslanov, Daniel Cremers

Hierarchy is a natural representation of semantic taxonomies, including the ones routinely used in image segmentation. Indeed, recent work on semantic segmentation reports improved accuracy from supervised training lever…

Image SegmentationSegmentationSemantic Segmentation

Semantic Alignment in Hyperbolic Space for Open-Vocabulary Semantic Segmentation

2026-05-09 · Hoang M. Truong, Hai Nguyen-Truong, Dang Huynh arxiv

Open-vocabulary semantic segmentation requires adapting image-level vision-language models such as CLIP to dense pixel-level prediction, which is challenging due to the mismatch between hierarchical structure and semanti…

Semantic Segmentation

When Cars meet Drones: Hyperbolic Federated Learning for Source-Free Domain Adaptation in Adverse Weather

2024-03-20 · Giulia Rizzoli, Matteo Caligiuri, Donald Shenaj, Francesco Barbato 외

In Federated Learning (FL), multiple clients collaboratively train a global model without sharing private data. In semantic segmentation, the Federated source Free Domain Adaptation (FFreeDA) setting is of particular int…

Autonomous VehiclesDomain AdaptationFederated LearningSegmentation+2

Understanding Fine-tuning CLIP for Open-vocabulary Semantic Segmentation in Hyperbolic Space

2025-01-01 · CVPR 2025 1 · Zelin Peng, Zhengqin Xu, Zhilin Zeng, Changsong Wen 외

CLIP, a foundational vision-language model, has emerged as a powerful tool for open-vocabulary semantic segmentation. While freezing the text encoder preserves its powerful embeddings, recent studies show that fine-t…

Open Vocabulary Semantic SegmentationOpen-Vocabulary Semantic SegmentationSegmentationSemantic Segmentation