Weakly-supervised Semantic Segmentation in Cityscape via Hyperspectral Image

2020-12-18 · Yuxing Huang, ShaoDi You, Ying Fu, Qiu Shen

High-resolution hyperspectral images (HSIs) contain the response of each pixel in different spectral bands, which can be used to effectively distinguish various objects in complex scenes. While HSI cameras have become low cost, algorithms based on it have not been well exploited. In this paper, we focus on a novel topic, weakly-supervised semantic segmentation in cityscape via HSIs. It is based on the idea that high-resolution HSIs in city scenes contain rich spectral information, which can be easily associated to semantics without manual labeling. Therefore, it enables low cost, highly reliable semantic segmentation in complex scenes. Specifically, in this paper, we theoretically analyze the HSIs and introduce a weakly-supervised HSI semantic segmentation framework, which utilizes spectral information to improve the coarse labels to a finer degree. The experimental results show that our method can obtain highly competitive labels and even have higher edge fineness than artificial fine labels in some classes. At the same time, the results also show that the refined labels can effectively improve the effect of semantic segmentation. The combination of HSIs and semantic segmentation proves that HSIs have great potential in high-level visual tasks.

📄 PDF Abstract BibTeX arXiv:2012.10122

Code (0)

등록된 구현이 없습니다.

Tasks

Segmentation Semantic Segmentation Semi-Supervised Semantic Segmentation Weakly supervised Semantic Segmentation Weakly-Supervised Semantic Segmentation

Weakly- and Semi-Supervised Panoptic Segmentation

2018-08-10 · ECCV 2018 9 · Qizhu Li, Anurag Arnab, Philip H. S. Torr

We present a weakly supervised model that jointly performs both semantic- and instance-segmentation -- a particularly relevant problem given the substantial cost of obtaining pixel-perfect annotation for these tasks. In …

Instance Segmentation Panoptic Segmentation Segmentation Semantic Segmentation+3

Adversarial Diffusion Model for Unsupervised Domain-Adaptive Semantic Segmentation

2024-12-22 · Jongmin Yu, Zhongtian Sun, Shan Luo

Semantic segmentation requires labour-intensive labelling tasks to obtain the supervision signals, and because of this issue, it is encouraged that using domain adaptation, which transfers information from the existing l…

Domain Adaptation Segmentation Semantic Segmentation Unsupervised Domain Adaptation

WeClick: Weakly-Supervised Video Semantic Segmentation with Click Annotations

2021-07-07 · Peidong Liu, Zibin He, Xiyu Yan, Yong Jiang 외

Compared with tedious per-pixel mask annotating, it is much easier to annotate data by clicks, which costs only several seconds for an image. However, applying clicks to learn video semantic segmentation model has not be…

Knowledge Distillation Model Compression Segmentation Semantic Segmentation+1

Weakly Supervised Semantic Segmentation for Driving Scenes

2023-12-21 · Dongseob Kim, Seungho Lee, Junsuk Choe, Hyunjung Shim

State-of-the-art techniques in weakly-supervised semantic segmentation (WSSS) using image-level labels exhibit severe performance degradation on driving scene datasets such as Cityscapes. To address this challenge, we de…

Semantic Segmentation Weakly supervised Semantic Segmentation Weakly-Supervised Semantic Segmentation

Exploring Limits of Diffusion-Synthetic Training with Weakly Supervised Semantic Segmentation

2023-09-04 · Ryota Yoshihashi, Yuya Otsuka, Kenji Doi, Tomohiro Tanaka 외

The advance of generative models for images has inspired various training techniques for image recognition utilizing synthetic images. In semantic segmentation, one promising approach is extracting pseudo-masks from atte…

Data Augmentation Image Generation Segmentation Semantic Segmentation+4