paper-with-me

Papers

A Polarization-Aided Transformer for Image Deblurring via Motion Vector Decomposition

2025-01-01 · CVPR 2025 1 · Duosheng Chen, Shihao Zhou, Jinshan Pan, Jinglei Shi, Lishen Qu, Jufeng Yang

Effectively leveraging motion information is crucial for the image deblurring task. Existing methods typically build deep-learning models to restore a clean image by estimating blur patterns over the entire movement. This suggests that the blur caused by rotational motion components is processed together with the translational one. Exploring the movement without separation leads to limited performance for complex motion deblurring, especially rotational motion. In this paper, we propose Motion Decomposition Transformer (MDT), a transformer-based architecture augmented with polarized modules for deblurring via motion vector decomposition. MDT consists of a Motion Decomposition Module (MDM) for extracting hybrid rotation and translation features, and a Radial Stripe Attention Solver (RSAS) for sharp image reconstruction with enhanced rotational information. Specifically, the MDM uses a deformable Cartesian convolutional branch to capture translational motion, complemented by a polar-system branch to capture rotational motion. The RSAS employs radial stripe windows and angular relative positional encoding in the polar system to enhance rotational information. This design preserves translational details while keeping computational costs lower than dual-coordinate design. Experimental results on 6 image deblurring datasets show that MDT outperforms state-of-the-art methods, particularly in handling blur caused by complex motions with significant rotational components.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

DeblurringImage DeblurringImage Reconstruction

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Adam 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Position-Wise Feed-Forward Layer 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Multi-Head Attention 설명 없음

Similar Papers 제목 키워드 기반

Learning to Deblur Polarized Images

2024-02-28 · Chu Zhou, Minggui Teng, Xinyu Zhou, Chao Xu 외

A polarization camera can capture four linear polarized images with different polarizer angles in a single shot, which is useful in polarization-based vision applications since the degree of linear polarization (DoLP) an…

DeblurringImage DeblurringImage DehazingReflection Removal

Gyroscope-Assisted Motion Deblurring Network

2024-02-10 · Simin Luan, Cong Yang, Zeyd Boukhers, Xue Qin 외

Image research has shown substantial attention in deblurring networks in recent years. Yet, their practical usage in real-world deblurring, especially motion blur, remains limited due to the lack of pixel-aligned trainin…

DeblurringImage RestorationTriplet

Adaptive Window Pruning for Efficient Local Motion Deblurring

2023-06-25 · Haoying Li, Jixin Zhao, Shangchen Zhou, Huajun Feng 외

Local motion blur commonly occurs in real-world photography due to the mixing between moving objects and stationary backgrounds during exposure. Existing image deblurring methods predominantly focus on global deblurring,…

DeblurringImage Deblurring

Gyroscope-Aided Motion Deblurring with Deep Networks

2018-10-01 · Janne Mustaniemi, Juho Kannala, Simo Särkkä, Jiri Matas 외

We propose a deblurring method that incorporates gyroscope measurements into a convolutional neural network (CNN). With the help of such measurements, it can handle extremely strong and spatially-variant motion blur. At …

Deblurring

Spread Your Wings: A Radial Strip Transformer for Image Deblurring

2024-03-30 · Duosheng Chen, Shihao Zhou, Jinshan Pan, Jinglei Shi 외

Exploring motion information is important for the motion deblurring task. Recent the window-based transformer approaches have achieved decent performance in image deblurring. Note that the motion causing blurry results i…

DeblurringImage DeblurringTranslation