Learning on the Edge: Explicit Boundary Handling in CNNs
Convolutional neural networks (CNNs) handle the case where filters extend beyond the image boundary using several heuristics, such as zero, repeat or mean padding. These schemes are applied in an ad-hoc fashion and, being weakly related to the image content and oblivious of the target task, result in low output quality at the boundary. In this paper, we propose a simple and effective improvement that learns the boundary handling itself. At training-time, the network is provided with a separate set of explicit boundary filters. At testing-time, we use these filters which have learned to extrapolate features at the boundary in an optimal way for the specific task. Our extensive evaluation, over a wide range of architectural changes (variations of layers, feature channels, or both), shows how the explicit filters result in improved boundary handling. Consequently, we demonstrate an improvement of 5% to 20% across the board of typical CNN applications (colorization, de-Bayering, optical flow, and disparity estimation).
Code (1)
Tasks
ColorizationDisparity EstimationOptical Flow EstimationSimilar Papers 제목 키워드 기반
Classification With an Edge: Improving Semantic Image Segmentation with Boundary Detection
We present an end-to-end trainable deep convolutional neural network (DCNN) for semantic segmentation with built-in awareness of semantically meaningful boundaries. Semantic segmentation is a fundamental remote sensing t…
Boundary DetectionDecoderEdge DetectionGeneral Classification+3Learning to predict crisp boundaries
Recent methods for boundary or edge detection built on Deep Convolutional Neural Networks (CNNs) typically suffer from the issue of predicted edges being thick and need post-processing to obtain crisp boundaries. Highly …
Boundary DetectionEdge DetectionRethinking Boundary Detection in Deep Learning-Based Medical Image Segmentation
Medical image segmentation is a pivotal task within the realms of medical image analysis and computer vision. While current methods have shown promise in accurately segmenting major regions of interest, the precise segme…
Boundary DetectionDecoderDeep LearningEdge Detection+5End-to-End Boundary Aware Networks for Medical Image Segmentation
Fully convolutional neural networks (CNNs) have proven to be effective at representing and classifying textural information, thus transforming image intensity into output class masks that achieve semantic image segmentat…
Brain Tumor SegmentationImage SegmentationMedical Image AnalysisMedical Image Segmentation+3Rethinking Boundary Detection in Deep Learning Models for Medical Image Segmentation
Medical image segmentation is a fundamental task in the community of medical image analysis. In this paper, a novel network architecture, referred to as Convolution, Transformer, and Operator (CTO), is proposed. CTO empl…
Boundary DetectionDecoderImage SegmentationMedical Image Analysis+3