paper-with-me

홈 › Papers

MaskBlur: Spatial and Angular Data Augmentation for Light Field Image Super-Resolution

2024-10-09 · Wentao Chao, Fuqing Duan, Yulan Guo, Guanghui Wang

Data augmentation (DA) is an effective approach for enhancing model performance with limited data, such as light field (LF) image super-resolution (SR). LF images inherently possess rich spatial and angular information. Nonetheless, there is a scarcity of DA methodologies explicitly tailored for LF images, and existing works tend to concentrate solely on either the spatial or angular domain. This paper proposes a novel spatial and angular DA strategy named MaskBlur for LF image SR by concurrently addressing spatial and angular aspects. MaskBlur consists of spatial blur and angular dropout two components. Spatial blur is governed by a spatial mask, which controls where pixels are blurred, i.e., pasting pixels between the low-resolution and high-resolution domains. The angular mask is responsible for angular dropout, i.e., selecting which views to perform the spatial blur operation. By doing so, MaskBlur enables the model to treat pixels differently in the spatial and angular domains when super-resolving LF images rather than blindly treating all pixels equally. Extensive experiments demonstrate the efficacy of MaskBlur in significantly enhancing the performance of existing SR methods. We further extend MaskBlur to other LF image tasks such as denoising, deblurring, low-light enhancement, and real-world SR. Code is publicly available at \url{https://github.com/chaowentao/MaskBlur}.

📄 PDF Abstract BibTeX arXiv:2410.06478

Code (1)

chaowentao/maskblur 공식 구현 pytorch

Tasks

Data AugmentationDeblurringDenoisingImage Super-ResolutionSuper-Resolution

Methods 이 논문이 사용한 방법론

Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

Spatial and Angular Resolution Enhancement of Light Fields Using Convolutional Neural Networks

2017-07-04 · M. Shahzeb Khan Gul, Bahadir K. Gunturk

Light field imaging extends the traditional photography by capturing both spatial and angular distribution of light, which enables new capabilities, including post-capture refocusing, post-capture aperture control, and d…

Depth Estimation

SADN: Learned Light Field Image Compression with Spatial-Angular Decorrelation

2022-02-22 · Kedeng Tong, Xin Jin, Chen Wang, Fan Jiang

Light field image becomes one of the most promising media types for immersive video applications. In this paper, we propose a novel end-to-end spatial-angular-decorrelated network (SADN) for high-efficiency light field i…

Image Compression

Spatial-Angular Attention Network for Light Field Reconstruction

2020-07-05 · Gaochang Wu, Yingqian Wang, Yebin Liu, Lu Fang 외

Typical learning-based light field reconstruction methods demand in constructing a large receptive field by deepening the network to capture correspondences between input views. In this paper, we propose a spatial-angula…

Learning-based Spatial and Angular Information Separation for Light Field Compression

2023-04-13 · Jinglei Shi, Yihong Xu, Christine Guillemot

Light fields are a type of image data that capture both spatial and angular scene information by recording light rays emitted by a scene from different orientations. In this context, spatial information is defined as fea…

Tensor Decomposition

3DVSR: 3D EPI Volume-based Approach for Angular and Spatial Light field Image Super-resolution

2022-01-04 · Trung-Hieu Tran, Jan Berberich, Sven Simon

Light field (LF) imaging, which captures both spatial and angular information of a scene, is undoubtedly beneficial to numerous applications. Although various techniques have been proposed for LF acquisition, achieving b…

Image Super-ResolutionSuper-Resolution