paper-with-me

홈 › Papers

MambaCSR: Dual-Interleaved Scanning for Compressed Image Super-Resolution With SSMs

2024-08-21 · Yulin Ren, Xin Li, Mengxi Guo, Bingchen Li, Shijie Zhao, Zhibo Chen

We present MambaCSR, a simple but effective framework based on Mamba for the challenging compressed image super-resolution (CSR) task. Particularly, the scanning strategies of Mamba are crucial for effective contextual knowledge modeling in the restoration process despite it relying on selective state space modeling for all tokens. In this work, we propose an efficient dual-interleaved scanning paradigm (DIS) for CSR, which is composed of two scanning strategies: (i) hierarchical interleaved scanning is designed to comprehensively capture and utilize the most potential contextual information within an image by simultaneously taking advantage of the local window-based and sequential scanning methods; (ii) horizontal-to-vertical interleaved scanning is proposed to reduce the computational cost by leaving the redundancy between the scanning of different directions. To overcome the non-uniform compression artifacts, we also propose position-aligned cross-scale scanning to model multi-scale contextual information. Experimental results on multiple benchmarks have shown the great performance of our MambaCSR in the compressed image super-resolution task. The code will be soon available in~\textcolor{magenta}{\url{https://github.com/renyulin-f/MambaCSR}}.

📄 PDF Abstract BibTeX arXiv:2408.11758

Code (1)

renyulin-f/mambacsr 공식 구현 pytorch

Tasks

Compressed Image Super-resolutionImage Super-ResolutionMambaSuper-Resolution

Methods 이 논문이 사용한 방법론

Mamba Foundation models, now powering most of the exciting applications in deep learning, are almost universally based on the Transformer architecture and its core attention module.…

Similar Papers 제목 키워드 기반

Resampling detection of recompressed images via dual-stream convolutional neural network

2019-01-15 · Gang Cao, Antao Zhou, Xianglin Huang, Gege Song 외

Resampling detection plays an important role in identifying image tampering, such as image splicing. Currently, the resampling detection is still difficult in recompressed images, which are yielded by applying resampling…

parameter estimation

Learning to Scan: A Deep Reinforcement Learning Approach for Personalized Scanning in CT Imaging

2020-06-03 · Ziju Shen, YuFei Wang, Dufan Wu, Xu Yang 외

Computed Tomography (CT) takes X-ray measurements on the subjects to reconstruct tomographic images. As X-ray is radioactive, it is desirable to control the total amount of dose of X-ray for safety concerns. Therefore, w…

compressed sensingComputed Tomography (CT)CT ReconstructionDeep Reinforcement Learning+1

Improving spatial domain based image formation through compressed sensing

2020-10-01 · Gene Stoltz, André Leon Nel

In this paper, we improve image reconstruction in a single-pixel scanning system by selecting an detector optimal field of view. Image reconstruction is based on compressed sensing and image quality is compared to interp…

compressed sensingImage Reconstruction

Deep Learning Supersampled Scanning Transmission Electron Microscopy

2019-10-23 · Jeffrey M. Ede

Compressed sensing can increase resolution, and decrease electron dose and scan time of electron microscope point-scan systems with minimal information loss. Building on a history of successful deep learning applications…

compressed sensingDeep LearningGenerative Adversarial Network

Compressed Sensing Microscopy with Scanning Line Probes

2019-09-26 · Han-Wen Kuo, Anna E. Dorfi, Daniel V. Esposito, John N. Wright

In applications of scanning probe microscopy, images are acquired by raster scanning a point probe across a sample. Viewed from the perspective of compressed sensing (CS), this pointwise sampling scheme is inefficient, e…

compressed sensing