paper-with-me

홈 › Papers

Bidirectional Multi-Scale Implicit Neural Representations for Image Deraining

2024-04-02 · CVPR 2024 1 · Xiang Chen, Jinshan Pan, Jiangxin Dong

How to effectively explore multi-scale representations of rain streaks is important for image deraining. In contrast to existing Transformer-based methods that depend mostly on single-scale rain appearance, we develop an end-to-end multi-scale Transformer that leverages the potentially useful features in various scales to facilitate high-quality image reconstruction. To better explore the common degradation representations from spatially-varying rain streaks, we incorporate intra-scale implicit neural representations based on pixel coordinates with the degraded inputs in a closed-loop design, enabling the learned features to facilitate rain removal and improve the robustness of the model in complex scenarios. To ensure richer collaborative representation from different scales, we embed a simple yet effective inter-scale bidirectional feedback operation into our multi-scale Transformer by performing coarse-to-fine and fine-to-coarse information communication. Extensive experiments demonstrate that our approach, named as NeRD-Rain, performs favorably against the state-of-the-art ones on both synthetic and real-world benchmark datasets. The source code and trained models are available at https://github.com/cschenxiang/NeRD-Rain.

📄 PDF Abstract BibTeX arXiv:2404.01547

Code (1)

cschenxiang/nerd-rain 공식 구현 pytorch

Tasks

Image ReconstructionRain Removal

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Multi-Head Attention 설명 없음
Adam 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

Learning Implicit Entity-object Relations by Bidirectional Generative Alignment for Multimodal NER

2023-08-03 · Feng Chen, Jiajia Liu, Kaixiang Ji, Wang Ren 외

The challenge posed by multimodal named entity recognition (MNER) is mainly two-fold: (1) bridging the semantic gap between text and image and (2) matching the entity with its associated object in image. Existing methods…

named-entity-recognitionNamed Entity RecognitionNERObject

Multilingual Text-to-Image Person Retrieval via Bidirectional Relation Reasoning and Aligning

2025-10-20 · Min Cao, Xinyu Zhou, Ding Jiang, Bo Du 외 arxiv

Text-to-image person retrieval (TIPR) aims to identify the target person using textual descriptions, facing challenge in modality heterogeneity. Prior works have attempted to address it by developing cross-modal global o…

Person Retrieval

Exploring Explicit and Implicit Visual Relationships for Image Captioning

2021-05-06 · Zeliang Song, Xiaofei Zhou

Image captioning is one of the most challenging tasks in AI, which aims to automatically generate textual sentences for an image. Recent methods for image captioning follow encoder-decoder framework that transforms the s…

DecoderImage Captioning

Reg-NF: Efficient Registration of Implicit Surfaces within Neural Fields

2024-02-15 · Stephen Hausler, David Hall, Sutharsan Mahendren, Peyman Moghadam

Neural fields, coordinate-based neural networks, have recently gained popularity for implicitly representing a scene. In contrast to classical methods that are based on explicit representations such as point clouds, neur…

3D geometry

Domain Adaptation via Bidirectional Cross-Attention Transformer

2022-01-15 · Xiyu Wang, Pengxin Guo, Yu Zhang

Domain Adaptation (DA) aims to leverage the knowledge learned from a source domain with ample labeled data to a target domain with unlabeled data only. Most existing studies on DA contribute to learning domain-invariant …

Domain Adaptation