paper-with-me

홈 › Papers

GridFormer: Residual Dense Transformer with Grid Structure for Image Restoration in Adverse Weather Conditions

2023-05-29 · Tao Wang, Kaihao Zhang, Ziqian Shao, Wenhan Luo, Bjorn Stenger, Tong Lu, Tae-Kyun Kim, Wei Liu, Hongdong Li

Image restoration in adverse weather conditions is a difficult task in computer vision. In this paper, we propose a novel transformer-based framework called GridFormer which serves as a backbone for image restoration under adverse weather conditions. GridFormer is designed in a grid structure using a residual dense transformer block, and it introduces two core designs. First, it uses an enhanced attention mechanism in the transformer layer. The mechanism includes stages of the sampler and compact self-attention to improve efficiency, and a local enhancement stage to strengthen local information. Second, we introduce a residual dense transformer block (RDTB) as the final GridFormer layer. This design further improves the network's ability to learn effective features from both preceding and current local features. The GridFormer framework achieves state-of-the-art results on five diverse image restoration tasks in adverse weather conditions, including image deraining, dehazing, deraining \& dehazing, desnowing, and multi-weather restoration. The source code and pre-trained models are available at https://github.com/TaoWangzj/GridFormer.

📄 PDF Abstract BibTeX arXiv:2305.17863

Code (1)

taowangzj/gridformer 공식 구현 pytorch

Tasks

Image RestorationRain Removal

Similar Papers 제목 키워드 기반

GridFormer: Point-Grid Transformer for Surface Reconstruction

2024-01-04 · Shengtao Li, Ge Gao, Yudong Liu, Yu-Shen Liu 외

Implicit neural networks have emerged as a crucial technology in 3D surface reconstruction. To reconstruct continuous surfaces from discrete point clouds, encoding the input points into regular grid features (plane or vo…

Computational EfficiencySurface Reconstruction

GridFormer: Towards Accurate Table Structure Recognition via Grid Prediction

2023-09-26 · Pengyuan Lyu, Weihong Ma, Hongyi Wang, Yuechen Yu 외

All tables can be represented as grids. Based on this observation, we propose GridFormer, a novel approach for interpreting unconstrained table structures by predicting the vertex and edge of a grid. First, we propose a …

Prediction

Phase Marginalization for Patch-Grid Instability in Vision Transformers

2026-06-06 · Oğuzhan Ercan arxiv

Vision Transformers operate on fixed patch grids, which can introduce phase-dependent instability for dense prediction: changing the patch partition can change the token evidence available to a pixel, especially near bou…

Less Tokens, Better Forecasts: Sparse Residual Routing for Efficient Weather Prediction

2026-07-02 · Janet Wang, Yunbei Zhang, Lin Zhao, Xi Xiao 외 arxiv

Existing ViT-based weather forecasting models apply uniform computation across all spatial tokens, even though nearby atmospheric grid points often contain similar values and large regions evolve smoothly over time. This…

Weather Forecasting

Fus3D: Decoding Consolidated 3D Geometry from Feed-forward Geometry Transformer Latents

2026-03-26 · Laura Fink, Linus Franke, George Kopanas, Marc Stamminger 외 arxiv

We propose a feed-forward method for dense Signed Distance Field (SDF) regression from unstructured image collections in less than three seconds, without camera calibration or post-hoc fusion. Our key insight is that the…