Multi Kernel Estimation based Object Segmentation
This paper presents a novel approach for multi-kernel estimation by enhancing the KernelGAN algorithm, which traditionally estimates a single kernel for the entire image. We introduce Multi-KernelGAN, which extends KernelGAN's capabilities by estimating two distinct kernels based on object segmentation masks. Our approach is validated through three distinct methods: texture-based patch Fast Fourier Transform (FFT) calculation, detail-based segmentation, and deep learning-based object segmentation using YOLOv8 and the Segment Anything Model (SAM). Among these methods, the combination of YOLO and SAM yields the best results for kernel estimation. Experimental results demonstrate that our multi-kernel estimation technique outperforms conventional single-kernel methods in super-resolution tasks.
Code (1)
Tasks
ObjectSegmentationSemantic SegmentationSuper-ResolutionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Video Deblurring via Semantic Segmentation and Pixel-Wise Non-Linear Kernel
Video deblurring is a challenging problem as the blur is complex and usually caused by the combination of camera shakes, object motions, and depth variations. Optical flow can be used for kernel estimation since it predi…
DeblurringOptical Flow EstimationSemantic SegmentationVideo DeblurringDynamic Filtering with Large Sampling Field for ConvNets
We propose a dynamic filtering strategy with large sampling field for ConvNets (LS-DFN), where the position-specific kernels learn from not only the identical position but also multiple sampled neighbor regions. During s…
object-detectionObject DetectionPositionSemantic Segmentation+1ISDA: Position-Aware Instance Segmentation with Deformable Attention
Most instance segmentation models are not end-to-end trainable due to either the incorporation of proposal estimation (RPN) as a pre-processing or non-maximum suppression (NMS) as a post-processing. Here we propose a nov…
Instance SegmentationPositionSegmentationSemantic SegmentationOn Point Affiliation in Feature Upsampling
We introduce the notion of point affiliation into feature upsampling. By abstracting a feature map into non-overlapped semantic clusters formed by points of identical semantic meaning, feature upsampling can be viewed as…
DecoderDepth EstimationFeature UpsamplingImage Matting+6Spectrum-guided Multi-granularity Referring Video Object Segmentation
Current referring video object segmentation (R-VOS) techniques extract conditional kernels from encoded (low-resolution) vision-language features to segment the decoded high-resolution features. We discovered that this c…
ObjectReferring Expression SegmentationReferring Video Object SegmentationSegmentation+3