End to End Trainable Active Contours via Differentiable Rendering
We present an image segmentation method that iteratively evolves a polygon. At each iteration, the vertices of the polygon are displaced based on the local value of a 2D shift map that is inferred from the input image via an encoder-decoder architecture. The main training loss that is used is the difference between the polygon shape and the ground truth segmentation mask. The network employs a neural renderer to create the polygon from its vertices, making the process fully differentiable. We demonstrate that our method outperforms the state of the art segmentation networks and deep active contour solutions in a variety of benchmarks, including medical imaging and aerial images. Our code is available at https://github.com/shirgur/ACDRNet.
Code (2)
Tasks
DecoderImage SegmentationSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
End-to-End Deep Convolutional Active Contours for Image Segmentation
The Active Contour Model (ACM) is a standard image analysis technique whose numerous variants have attracted an enormous amount of research attention across multiple fields. Incorrectly, however, the ACM's differential-e…
Image SegmentationInstance SegmentationSegmentationSemantic SegmentationEnd-to-End Trainable Deep Active Contour Models for Automated Image Segmentation: Delineating Buildings in Aerial Imagery
The automated segmentation of buildings in remote sensing imagery is a challenging task that requires the accurate delineation of multiple building instances over typically large image areas. Manual methods are often lab…
Image SegmentationSegmentationSemantic SegmentationInkDiffuser: High-Fidelity One-shot Chinese Calligraphy via Differentiable Morphological Optimization
Current Chinese calligraphy generation methods suffer from poor stroke rendering and unrealistic ink morphology, resulting in outputs with limited visual fidelity and artistic fluidity. To address this problem, we propos…
LED2-Net: Monocular 360 Layout Estimation via Differentiable Depth Rendering
Although significant progress has been made in room layout estimation, most methods aim to reduce the loss in the 2D pixel coordinate rather than exploiting the room structure in the 3D space. Towards reconstructing the …
3D Room Layouts From A Single RGB PanoramaDepth EstimationDepth PredictionRoom Layout EstimationLED2-Net: Monocular 360deg Layout Estimation via Differentiable Depth Rendering
Although significant progress has been made in room layout estimation, most methods aim to reduce the loss in the 2D pixel coordinate rather than exploiting the room structure in the 3D space. Towards reconstructing …
Depth EstimationDepth PredictionRoom Layout Estimation