paper-with-me

홈 › Papers

Unsupervised Instance Segmentation in Microscopy Images via Panoptic Domain Adaptation and Task Re-weighting

2020-05-05 · CVPR 2020 6 · Dongnan Liu, Donghao Zhang, Yang song, Fan Zhang, Lauren O'Donnell, Heng Huang, Mei Chen, Weidong Cai

Unsupervised domain adaptation (UDA) for nuclei instance segmentation is important for digital pathology, as it alleviates the burden of labor-intensive annotation and domain shift across datasets. In this work, we propose a Cycle Consistency Panoptic Domain Adaptive Mask R-CNN (CyC-PDAM) architecture for unsupervised nuclei segmentation in histopathology images, by learning from fluorescence microscopy images. More specifically, we first propose a nuclei inpainting mechanism to remove the auxiliary generated objects in the synthesized images. Secondly, a semantic branch with a domain discriminator is designed to achieve panoptic-level domain adaptation. Thirdly, in order to avoid the influence of the source-biased features, we propose a task re-weighting mechanism to dynamically add trade-off weights for the task-specific loss functions. Experimental results on three datasets indicate that our proposed method outperforms state-of-the-art UDA methods significantly, and demonstrates a similar performance as fully supervised methods.

📄 PDF Abstract BibTeX arXiv:2005.02066

Code (1)

dliu5812/PDAM 공식 구현 pytorch

Tasks

Domain AdaptationInstance SegmentationSegmentationSemantic SegmentationUnsupervised Domain AdaptationUnsupervised Instance Segmentation

Methods 이 논문이 사용한 방법론

RPN A Region Proposal Network, or RPN, is a fully convolutional network that simultaneously predicts object bounds and objectness scores at each position. The RPN is trained…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
RoIAlign Region of Interest Align, or RoIAlign, is an operation for extracting a small feature map from each RoI in detection and segmentation based tasks. It removes the harsh…
Mask R-CNN Mask R-CNN extends Faster R-CNN to solve instance segmentation tasks. It achieves this by adding a branch for predicting an…

Similar Papers 제목 키워드 기반

PDAM: A Panoptic-Level Feature Alignment Framework for Unsupervised Domain Adaptive Instance Segmentation in Microscopy Images

2020-09-11 · Dongnan Liu, Donghao Zhang, Yang song, Fan Zhang 외

In this work, we present an unsupervised domain adaptation (UDA) method, named Panoptic Domain Adaptive Mask R-CNN (PDAM), for unsupervised instance segmentation in microscopy images. Since there currently lack methods p…

Domain AdaptationInstance SegmentationSegmentationSemantic Segmentation+2

Scene-Centric Unsupervised Panoptic Segmentation

2025-04-02 · CVPR 2025 1 · Oliver Hahn, Christoph Reich, Nikita Araslanov, Daniel Cremers 외

Unsupervised panoptic segmentation aims to partition an image into semantically meaningful regions and distinct object instances without training on manually annotated data. In contrast to prior work on unsupervised pano…

Instance SegmentationPanoptic SegmentationPseudo LabelScene Understanding+5

Unsupervised Universal Image Segmentation

2023-12-28 · CVPR 2024 1 · Dantong Niu, Xudong Wang, Xinyang Han, Long Lian 외

Several unsupervised image segmentation approaches have been proposed which eliminate the need for dense manually-annotated segmentation masks; current models separately handle either semantic segmentation (e.g., STEGO) …

Image SegmentationInstance SegmentationPanoptic SegmentationSegmentation+8

Unsupervised Learning of Object-Centric Embeddings for Cell Instance Segmentation in Microscopy Images

2023-10-12 · ICCV 2023 1 · Steffen Wolf, Manan Lalit, Henry Westmacott, Katie McDole 외

Segmentation of objects in microscopy images is required for many biomedical applications. We introduce object-centric embeddings (OCEs), which embed image patches such that the spatial offsets between patches cropped fr…

Instance SegmentationSemantic Segmentation

Contextual Image Parsing via Panoptic Segment Sorting

2021-01-01 · Jyh-Jing Hwang, Tsung-Wei Ke, Stella Yu

Visual context is versatile and hard to describe or label precisely. We aim to leverage the densely labeled task, image parsing, a.k.a panoptic segmentation, to learn a model that encodes and discovers object-centric co…

Metric LearningPanoptic SegmentationSegmentation