Side Window Filtering
Local windows are routinely used in computer vision and almost without exception the center of the window is aligned with the pixels being processed. We show that this conventional wisdom is not universally applicable. When a pixel is on an edge, placing the center of the window on the pixel is one of the fundamental reasons that cause many filtering algorithms to blur the edges. Based on this insight, we propose a new Side Window Filtering (SWF) technique which aligns the window's side or corner with the pixel being processed. The SWF technique is surprisingly simple yet theoretically rooted and very effective in practice. We show that many traditional linear and nonlinear filters can be easily implemented under the SWF framework. Extensive analysis and experiments show that implementing the SWF principle can significantly improve their edge preserving capabilities and achieve state of the art performances in applications such as image smoothing, denoising, enhancement, structure-preserving texture-removing, mutual-structure extraction, and HDR tone mapping. In addition to image filtering, we further show that the SWF principle can be extended to other applications involving the use of a local window. Using colorization by optimization as an example, we demonstrate that implementing the SWF principle can effectively prevent artifacts such as color leakage associated with the conventional implementation. Given the ubiquity of window based operations in computer vision, the new SWF technique is likely to benefit many more applications.
Code (1)
Tasks
ColorizationDenoisingimage smoothingPoint-interactive Image ColorizationTone MappingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Accurate Frequency Domain Identification of ODEs with Arbitrary Signals
The difficulty in frequency domain identification is that frequency components of arbitrary inputs and outputs are not related by the system's transfer function if signals are windowed. When rectangular windows are used,…
Oriented Light-Field Windows for Scene Flow
2D spatial image windows are used for comparing pixel values in computer vision applications such as correspondence for optical flow and 3D reconstruction, bilateral filtering, and image segmentation. However, pixel wind…
3D ReconstructionImage SegmentationOptical Flow EstimationSemantic Segmentation+1Fully Connected Guided Image Filtering
This paper presents a linear time fully connected guided filter by introducing the minimum spanning tree (MST) to the guided filter (GF). Since the intensity based filtering kernel of GF is apt to overly smooth edges and…
Fast Implementation of Morphological Filtering Using ARM NEON Extension
In this paper we consider speedup potential of morphological image filtering on ARM processors. Morphological operations are widely used in image analysis and recognition and their speedup in some cases can significantly…
Spectral Leakage and Rethinking the Kernel Size in CNNs
Convolutional layers in CNNs implement linear filters which decompose the input into different frequency bands. However, most modern architectures neglect standard principles of filter design when optimizing their model …