End-to-End Deep Convolutional Active Contours for Image Segmentation
The Active Contour Model (ACM) is a standard image analysis technique whose numerous variants have attracted an enormous amount of research attention across multiple fields. Incorrectly, however, the ACM's differential-equation-based formulation and prototypical dependence on user initialization have been regarded as being largely incompatible with the recently popular deep learning approaches to image segmentation. This paper introduces the first tight unification of these two paradigms. In particular, we devise Deep Convolutional Active Contours (DCAC), a truly end-to-end trainable image segmentation framework comprising a Convolutional Neural Network (CNN) and an ACM with learnable parameters. The ACM's Eulerian energy functional includes per-pixel parameter maps predicted by the backbone CNN, which also initializes the ACM. Importantly, both the CNN and ACM components are fully implemented in TensorFlow, and the entire DCAC architecture is end-to-end automatically differentiable and backpropagation trainable without user intervention. As a challenging test case, we tackle the problem of building instance segmentation in aerial images and evaluate DCAC on two publicly available datasets, Vaihingen and Bing Huts. Our reseults demonstrate that, for building segmentation, the DCAC establishes a new state-of-the-art performance by a wide margin.
Code (0)
등록된 구현이 없습니다.
Tasks
Image SegmentationInstance SegmentationSegmentationSemantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Combining CNN and Hybrid Active Contours for Head and Neck Tumor Segmentation in CT and PET images
Automatic segmentation of head and neck tumors plays an important role in radiomics analysis. In this short paper, we propose an automatic segmentation method for head and neck tumors from PET and CT images based on the …
SegmentationTumor SegmentationFree Form based active contours for image segmentation and free space perception
In this paper we present a novel approach for representing and evolving deformable active contours. The method combines piecewise regular B{\'e}zier models and curve evolution defined by local Free Form Deformation. The …
FormImage SegmentationSegmentationSemantic SegmentationActive contours driven by local and global intensity fitting energy with application to SAR image segmentation and its fast solvers
In this paper, we propose a novel variational active contour model based on Aubert-Aujol (AA) denoising model, which hybrides geodesic active contour (GAC) model with active contours without edges (ACWE) model and can be…
DenoisingImage SegmentationSegmentationSemantic SegmentationImage Segmentation and Restoration Using Parametric Contours With Free Endpoints
In this paper, we introduce a novel approach for active contours with free endpoints. A scheme is presented for image segmentation and restoration based on a discrete version of the Mumford-Shah functional where the cont…
DenoisingImage SegmentationSegmentationSemantic SegmentationDeep Active Contours Using Locally Controlled Distance Vector Flow
Active contours Model (ACM) has been extensively used in computer vision and image processing. In recent studies, Convolutional Neural Networks (CNNs) have been combined with active contours replacing the user in the pro…
Image SegmentationInstance SegmentationSegmentationSemantic Segmentation