paper-with-me

홈 › Papers

SANDFORMER: CNN and Transformer under Gated Fusion for Sand Dust Image Restoration

2023-03-08 · Jun Shi, Bingcai Wei, Gang Zhou, Liye Zhang

Although Convolutional Neural Networks (CNN) have made good progress in image restoration, the intrinsic equivalence and locality of convolutions still constrain further improvements in image quality. Recent vision transformer and self-attention have achieved promising results on various computer vision tasks. However, directly utilizing Transformer for image restoration is a challenging task. In this paper, we introduce an effective hybrid architecture for sand image restoration tasks, which leverages local features from CNN and long-range dependencies captured by transformer to improve the results further. We propose an efficient hybrid structure for sand dust image restoration to solve the feature inconsistency issue between Transformer and CNN. The framework complements each representation by modulating features from the CNN-based and Transformer-based branches rather than simply adding or concatenating features. Experiments demonstrate that SandFormer achieves significant performance improvements in synthetic and real dust scenes compared to previous sand image restoration methods.

📄 PDF Abstract BibTeX arXiv:2303.04365

Code (0)

등록된 구현이 없습니다.

Tasks

Image RestorationSand

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Residual Connection 설명 없음
Multi-Head Attention 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Position-Wise Feed-Forward Layer 설명 없음

Similar Papers 제목 키워드 기반

S2DiT: Sandwich Diffusion Transformer for Mobile Streaming Video Generation

2026-01-19 · Lin Zhao, Yushu Wu, Aleksei Lebedev, Dishani Lahiri 외 arxiv

Diffusion Transformers (DiTs) have recently improved video generation quality. However, their heavy computational cost makes real-time or on-device generation infeasible. In this work, we introduce S2DiT, a Streaming San…

Video Generation

Multimodal Token Fusion for Vision Transformers

2022-04-19 · journal 2022 7 · Yikai Wang, Xinghao Chen, Lele Cao, Wenbing Huang 외

Many adaptations of transformers have emerged to address the single-modal vision tasks, where self-attention modules are stacked to handle input sources like images. Intuitively, feeding multiple modalities of data to vi…

3D Object DetectionImage-to-Image Translationobject-detectionObject Detection+1

GMF-Drive: Gated Mamba Fusion with Spatial-Aware BEV Representation for End-to-End Autonomous Driving

2025-08-08 · Jian Wang, Chaokang Jiang, Haitao Xu arxiv

Diffusion-based models are redefining the state-of-the-art in end-to-end autonomous driving, yet their performance is increasingly hampered by a reliance on transformer-based fusion. These architectures face fundamental …

Autonomous Driving

DiG: Scalable and Efficient Diffusion Models with Gated Linear Attention

2024-05-28 · CVPR 2025 1 · Lianghui Zhu, Zilong Huang, Bencheng Liao, Jun Hao Liew 외

Diffusion models with large-scale pre-training have achieved significant success in the field of visual content generation, particularly exemplified by Diffusion Transformers (DiT). However, DiT models have faced challen…

GPUMamba

LiT: Delving into a Simplified Linear Diffusion Transformer for Image Generation

2025-01-22 · Jiahao Wang, Ning Kang, Lewei Yao, Mengzhao Chen 외

In commonly used sub-quadratic complexity modules, linear attention benefits from simplicity and high parallelism, making it promising for image synthesis tasks. However, the architectural design and learning strategy fo…

Image GenerationKnowledge DistillationMambaText to Image Generation+1