paper-with-me

홈 › Papers

Prompt What You Need: Enhancing Segmentation in Rainy Scenes with Anchor-based Prompting

2023-05-06 · XIAOYU GUO, Xiang Wei, Qi Su, Huiqin Zhao, Shunli Zhang

Semantic segmentation in rainy scenes is a challenging task due to the complex environment, class distribution imbalance, and limited annotated data. To address these challenges, we propose a novel framework that utilizes semi-supervised learning and pre-trained segmentation foundation model to achieve superior performance. Specifically, our framework leverages the semi-supervised model as the basis for generating raw semantic segmentation results, while also serving as a guiding force to prompt pre-trained foundation model to compensate for knowledge gaps with entropy-based anchors. In addition, to minimize the impact of irrelevant segmentation masks generated by the pre-trained foundation model, we also propose a mask filtering and fusion mechanism that optimizes raw semantic segmentation results based on the principle of minimum risk. The proposed framework achieves superior segmentation performance on the Rainy WCity dataset and is awarded the first prize in the sub-track of STRAIN in ICME 2023 Grand Challenges.

📄 PDF Abstract BibTeX arXiv:2305.03902

Code (0)

등록된 구현이 없습니다.

Tasks

SegmentationSemantic Segmentation

Similar Papers 제목 키워드 기반

RaidaR: A Rich Annotated Image Dataset of Rainy Street Scenes

2021-04-09 · Jiongchao Jin, Arezou Fatemi, Wallace Lira, Fenggen Yu 외

We introduce RaidaR, a rich annotated image dataset of rainy street scenes, to support autonomous driving research. The new dataset contains the largest number of rainy images (58,542) to date, 5,000 of which provide sem…

Autonomous DrivingData AugmentationImage-to-Image TranslationRain Removal+2

Rainy screens: Collecting rainy datasets, indoors

2020-03-10 · Horia Porav, Valentina-Nicoleta Musat, Tom Bruls, Paul Newman

Acquisition of data with adverse conditions in robotics is a cumbersome task due to the difficulty in guaranteeing proper ground truth and synchronising with desired weather conditions. In this paper, we present a simple…

DiversityImage ReconstructionSegmentationSemantic Segmentation

Beauty and Brains: Detecting Anomalous Pattern Co-Occurrences

2015-12-22 · Roel Bertens, Jilles Vreeken, Arno Siebes

Our world is filled with both beautiful and brainy people, but how often does a Nobel Prize winner also wins a beauty pageant? Let us assume that someone who is both very beautiful and very smart is more rare than what w…

SynDiff-AD: Improving Semantic Segmentation and End-to-End Autonomous Driving with Synthetic Data from Latent Diffusion Models

2024-11-25 · Harsh Goel, Sai Shankar Narasimhan, Oguzhan Akcin, Sandeep Chinchali

In recent years, significant progress has been made in collecting large-scale datasets to improve segmentation and autonomous driving models. These large-scale datasets are often dominated by common environmental conditi…

Autonomous DrivingData AugmentationSemantic Segmentation

AEPL: Automated and Editable Prompt Learning for Brain Tumor Segmentation

2024-10-21 · Yongheng Sun, Mingxia Liu, Chunfeng Lian

Brain tumor segmentation is crucial for accurate diagnosisand treatment planning, but the small size and irregular shapeof tumors pose significant challenges. Existing methods of-ten fail to effectively incorporate medic…

Brain Tumor SegmentationDecoderMulti-Task LearningPrompt Learning+2