Reinforced Coloring for End-to-End Instance Segmentation
Instance segmentation is one of the actively studied research topics in computer vision in which many objects of interest should be separated individually. While many feed-forward networks produce high-quality segmentation on different types of images, their results often suffer from topological errors (merging or splitting) for segmentation of many objects, requiring post-processing. Existing iterative methods, on the other hand, extract a single object at a time using discriminative knowledge-based properties (shapes, boundaries, etc.) without relying on post-processing, but they do not scale well. To exploit the advantages of conventional single-object-per-step segmentation methods without impairing the scalability, we propose a novel iterative deep reinforcement learning agent that learns how to differentiate multiple objects in parallel. Our reward function for the trainable agent is designed to favor grouping pixels belonging to the same object using a graph coloring algorithm. We demonstrate that the proposed method can efficiently perform instance segmentation of many objects without heavy post-processing.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep Reinforcement LearningInstance SegmentationObjectSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
ColorRL: Reinforced Coloring for End-to-End Instance Segmentation
Instance segmentation, the task of identifying and separating each individual object of interest in the image, is one of the actively studied research topics in computer vision. Although many feed-forward networks pr…
Deep Reinforcement LearningInstance SegmentationSegmentationSemantic SegmentationInstance Segmentation by Deep Coloring
We propose a new and, arguably, a very simple reduction of instance segmentation to semantic segmentation. This reduction allows to train feed-forward non-recurrent deep instance segmentation systems in an end-to-end fas…
Autonomous DrivingInstance SegmentationPlant PhenotypingSegmentation+1Disco: Densely-overlapping Cell Instance Segmentation via Adjacency-aware Collaborative Coloring
Accurate cell instance segmentation is foundational for digital pathology analysis. Existing methods based on contour detection and distance mapping still face significant challenges in processing complex and dense cellu…
Instance SegmentationDARC: Distribution-Aware Re-Coloring Model for Generalizable Nucleus Segmentation
Nucleus segmentation is usually the first step in pathological image analysis tasks. Generalizable nucleus segmentation refers to the problem of training a segmentation model that is robust to domain gaps between the sou…
SegmentationDense Point-to-Mask Optimization with Reinforced Point Selection for Crowd Instance Segmentation
Crowd instance segmentation is a crucial task with a wide range of applications, including surveillance and transportation. Currently, point labels are common in crowd datasets, while region labels (e.g., boxes) are rare…
Instance Segmentation