paper-with-me

홈 › Papers

Lightweight Image Inpainting by Stripe Window Transformer with Joint Attention to CNN

2023-01-02 · Tsung-Jung Liu, Bo-Wei Chen, Kuan-Hsien Liu

Image inpainting is an important task in computer vision. As admirable methods are presented, the inpainted image is getting closer to reality. However, the result is still not good enough in the reconstructed texture and structure based on human vision. Although recent advances in computer hardware have enabled the development of larger and more complex models, there is still a need for lightweight models that can be used by individuals and small-sized institutions. Therefore, we propose a lightweight model that combines a specialized transformer with a traditional convolutional neural network (CNN). Furthermore, we have noticed most researchers only consider three primary colors (RGB) in inpainted images, but we think this is not enough. So we propose a new loss function to intensify color details. Extensive experiments on commonly seen datasets (Places2 and CelebA) validate the efficacy of our proposed model compared with other state-of-the-art methods. Index Terms: HSV color space, image inpainting, joint attention, stripe window, transformer

📄 PDF Abstract BibTeX arXiv:2301.00553

Code (1)

bobo0303/LIGHTWEIGHT-IMAGE-INPAINTING-BY-STRIPE-WINDOW-TRANSFORMER-WITH-JOINT-ATTENTION-TO-CNN 공식 구현 pytorch

Tasks

Image Inpainting

Methods 이 논문이 사용한 방법론

Inpainting Train a convolutional neural network to generate the contents of an arbitrary image region conditioned on its surroundings.

Similar Papers 제목 키워드 기반

Image Super-Resolution using Efficient Striped Window Transformer

2023-01-24 · Jinpeng Shi, Hui Li, Tianle Liu, Yulong Liu 외

Transformers have achieved remarkable results in single-image super-resolution (SR). However, the challenge of balancing model performance and complexity has hindered their application in lightweight SR (LSR). To tackle …

Image Super-Resolution

CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped Windows

2021-07-01 · CVPR 2022 1 · Xiaoyi Dong, Jianmin Bao, Dongdong Chen, Weiming Zhang 외

We present CSWin Transformer, an efficient and effective Transformer-based backbone for general-purpose vision tasks. A challenging issue in Transformer design is that global self-attention is very expensive to compute w…

Image ClassificationSemantic Segmentation

CATANet: Efficient Content-Aware Token Aggregation for Lightweight Image Super-Resolution

2025-03-10 · CVPR 2025 1 · Xin Liu, Jie Liu, Jie Tang, Gangshan Wu

Transformer-based methods have demonstrated impressive performance in low-level visual tasks such as Image Super-Resolution (SR). However, its computational complexity grows quadratically with the spatial resolution. A s…

Image Super-ResolutionSuper-Resolution

Region-wise matching for image inpainting based on adaptive weighted low-rank decomposition

2023-03-22 · Shenghai Liao, Xuya Liu, Ruyi Han, Shujun Fu 외

Digital image inpainting is an interpolation problem, inferring the content in the missing (unknown) region to agree with the known region data such that the interpolated result fulfills some prior knowledge. Low-rank an…

Image InpaintingMatrix Completion

Equivariant Imaging for Self-supervised Hyperspectral Image Inpainting

2024-04-19 · Shuo Li, Mike Davies, Mehrdad Yaghoobi

Hyperspectral imaging (HSI) is a key technology for earth observation, surveillance, medical imaging and diagnostics, astronomy and space exploration. The conventional technology for HSI in remote sensing applications is…

AstronomyEarth ObservationHyperspectral Image InpaintingImage Inpainting+1