paper-with-me

Papers

MCGKT-Net: Multi-level Context Gating Knowledge Transfer Network for Single Image Deraining

2020-10-19 · Kohei Yamamichi, Xian-Hua Han

Rain streak removal in a single image is a very challenging task due to its ill-posed nature in essence. Recently, the end-to-end learning techniques with deep convolutional neural networks (DCNN) have made great progress in this task. However, the conventional DCNN-based deraining methods have struggled to exploit deeper and more complex network architectures for pursuing better performance. This study proposes a novel MCGKT-Net for boosting deraining performance, which is a naturally multi-scale learning framework being capable of exploring multi-scale attributes of rain streaks and different semantic structures of the clear images. In order to obtain high representative features inside MCGKT-Net, we explore internal knowledge transfer module using ConvLSTM unit for conducting interaction learning between different layers and investigate external knowledge transfer module for leveraging the knowledge already learned in other task domains. Furthermore, to dynamically select useful features in learning procedure, we propose a multi-scale context gating module in the MCGKT-Net using squeeze-and-excitation block. Experiments on three benchmark datasets: Rain100H, Rain100L, and Rain800, manifest impressive performance compared with state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:2010.09241

Code (0)

등록된 구현이 없습니다.

Tasks

Rain RemovalSingle Image DerainingTransfer Learning

Methods 이 논문이 사용한 방법론

Sigmoid Activation 설명 없음
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Tanh Activation 설명 없음
ConvLSTM ConvLSTM is a type of recurrent neural network for spatio-temporal prediction that has convolutional structures in both the input-to-state and state-to-state transitions. The…

Similar Papers 제목 키워드 기반

Translate to Disambiguate: Zero-shot Multilingual Word Sense Disambiguation with Pretrained Language Models

2023-04-26 · Haoqiang Kang, Terra Blevins, Luke Zettlemoyer

Pretrained Language Models (PLMs) learn rich cross-lingual knowledge and can be finetuned to perform well on diverse tasks such as translation and multilingual word sense disambiguation (WSD). However, they often struggl…

TranslationWord Sense Disambiguation

Improving End-to-End Contextual Speech Recognition with Fine-Grained Contextual Knowledge Selection

2022-01-30 · Minglun Han, Linhao Dong, Zhenlin Liang, Meng Cai 외

Nowadays, most methods in end-to-end contextual speech recognition bias the recognition process towards contextual knowledge. Since all-neural contextual biasing methods rely on phrase-level contextual modeling and atten…

speech-recognitionSpeech Recognition

ISNet: Integrate Image-Level and Semantic-Level Context for Semantic Segmentation

2021-08-27 · ICCV 2021 10 · Zhenchao Jin, Bin Liu, Qi Chu, Nenghai Yu

Co-occurrent visual pattern makes aggregating contextual information a common paradigm to enhance the pixel representation for semantic image segmentation. The existing approaches focus on modeling the context from the p…

Image SegmentationSemantic Segmentation

Knowledge Integration Networks for Action Recognition

2020-02-18 · Shiwen Zhang, Sheng Guo, Li-Min Wang, Weilin Huang 외

In this work, we propose Knowledge Integration Networks (referred as KINet) for video action recognition. KINet is capable of aggregating meaningful context features which are of great importance to identifying an action…

Action RecognitionHuman ParsingScene RecognitionTemporal Action Localization

HyperVLP: Enhancing Hierarchical Surgical Video-Language Pre-training in Hyperbolic Space

2026-06-30 · Yaojun Hu, Kun Yuan, Nassir Navab, Haochao Ying 외 arxiv

Surgical vision-language foundation models typically adopt educational materials, such as surgical lecture videos, to transfer surgical knowledge encoded in language into visual representations. These knowledge are multi…