paper-with-me

Papers

Super-Resolving Blurry Images with Events

2024-05-11 · Chi Zhang, Mingyuan Lin, Xiang Zhang, Chenxu Jiang, Lei Yu

Super-resolution from motion-blurred images poses a significant challenge due to the combined effects of motion blur and low spatial resolution. To address this challenge, this paper introduces an Event-based Blurry Super Resolution Network (EBSR-Net), which leverages the high temporal resolution of events to mitigate motion blur and improve high-resolution image prediction. Specifically, we propose a multi-scale center-surround event representation to fully capture motion and texture information inherent in events. Additionally, we design a symmetric cross-modal attention module to fully exploit the complementarity between blurry images and events. Furthermore, we introduce an intermodal residual group composed of several residual dense Swin Transformer blocks, each incorporating multiple Swin Transformer layers and a residual connection, to extract global context and facilitate inter-block feature aggregation. Extensive experiments show that our method compares favorably against state-of-the-art approaches and achieves remarkable performance.

📄 PDF Abstract BibTeX arXiv:2405.06918

Code (0)

등록된 구현이 없습니다.

Tasks

Super-Resolution

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Position-Wise Feed-Forward Layer 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Residual Connection 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Stochastic Depth Stochastic Depth aims to shrink the depth of a network during training, while keeping it unchanged during testing. This is achieved by randomly dropping entire…

Similar Papers 제목 키워드 기반

CrossZoom: Simultaneously Motion Deblurring and Event Super-Resolving

2023-09-29 · Chi Zhang, Xiang Zhang, Mingyuan Lin, Cheng Li 외

Even though the collaboration between traditional and neuromorphic event cameras brings prosperity to frame-event based vision applications, the performance is still confined by the resolution gap crossing two modalities…

DeblurringEvent-based vision

Unifying Motion Deblurring and Frame Interpolation with Events

2022-03-23 · CVPR 2022 6 · Xiang Zhang, Lei Yu

Slow shutter speed and long exposure time of frame-based cameras often cause visual blur and loss of inter-frame information, degenerating the overall quality of captured videos. To this end, we present a unified framewo…

DeblurringSelf-Supervised LearningVideo Enhancement

EVDI++: Event-based Video Deblurring and Interpolation via Self-Supervised Learning

2025-09-10 · Chi Zhang, Xiang Zhang, Chenxu Jiang, Gui-Song Xia 외 arxiv

Frame-based cameras with extended exposure times often produce perceptible visual blurring and information loss between frames, significantly degrading video quality. To address this challenge, we introduce EVDI++, a uni…

Self-Supervised Learning

Bringing a Blurry Frame Alive at High Frame-Rate with an Event Camera

2018-11-26 · CVPR 2019 6 · Liyuan Pan, Cedric Scheerlinck, Xin Yu, Richard Hartley 외

Event-based cameras can measure intensity changes (called `{\it events}') with microsecond accuracy under high-speed motion and challenging lighting conditions. With the active pixel sensor (APS), the event camera allows…

Video Generation

Learning to Super-Resolve Blurry Images with Events

2023-02-27 · Lei Yu, Bishan Wang, Xiang Zhang, Haijian Zhang 외

Super-Resolution from a single motion Blurred image (SRB) is a severely ill-posed problem due to the joint degradation of motion blurs and low spatial resolution. In this paper, we employ events to alleviate the burden o…

Sparse LearningSuper-Resolution