paper-with-me

홈 › Papers

Transcending the Limit of Local Window: Advanced Super-Resolution Transformer with Adaptive Token Dictionary

2024-01-16 · CVPR 2024 1 · Leheng Zhang, Yawei Li, Xingyu Zhou, Xiaorui Zhao, Shuhang Gu

Single Image Super-Resolution is a classic computer vision problem that involves estimating high-resolution (HR) images from low-resolution (LR) ones. Although deep neural networks (DNNs), especially Transformers for super-resolution, have seen significant advancements in recent years, challenges still remain, particularly in limited receptive field caused by window-based self-attention. To address these issues, we introduce a group of auxiliary Adaptive Token Dictionary to SR Transformer and establish an ATD-SR method. The introduced token dictionary could learn prior information from training data and adapt the learned prior to specific testing image through an adaptive refinement step. The refinement strategy could not only provide global information to all input tokens but also group image tokens into categories. Based on category partitions, we further propose a category-based self-attention mechanism designed to leverage distant but similar tokens for enhancing input features. The experimental results show that our method achieves the best performance on various single image super-resolution benchmarks.

📄 PDF Abstract BibTeX arXiv:2401.08209

Code (1)

labshuhanggu/adaptive-token-dictionary 공식 구현 pytorch

Tasks

Image Super-ResolutionSuper-Resolution

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Residual Connection 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Similar Papers 제목 키워드 기반

Less is More: Toward Zero-Shot Local Scene Graph Generation via Foundation Models

2023-10-02 · Shu Zhao, Huijuan Xu

Humans inherently recognize objects via selective visual perception, transform specific regions from the visual field into structured symbolic knowledge, and reason their relationships among regions based on the allocati…

Graph GenerationScene Graph Generation

PromptSR: Cascade Prompting for Lightweight Image Super-Resolution

2025-07-05 · Wenyang Liu, Chen Cai, Jianjun Gao, Kejun Wu 외 arxiv

Although the lightweight Vision Transformer has significantly advanced image super-resolution (SR), it faces the inherent challenge of a limited receptive field due to the window-based self-attention modeling. The quadra…

Image Super-Resolution

Windowed SummaryMixing: An Efficient Fine-Tuning of Self-Supervised Learning Models for Low-resource Speech Recognition

2026-02-04 · Aditya Srinivas Menon, Kumud Tripathi, Raj Gohil, Pankaj Wasnik arxiv

Self-supervised learning (SSL) has advanced speech processing but suffers from quadratic complexity due to self-attention. To address this, SummaryMixing (SM) has been proposed as a linear-time alternative that summarize…

Self-Supervised LearningSpeech Recognition

Window-to-Window BEV Representation Learning for Limited FoV Cross-View Geo-localization

2024-07-09 · Lei Cheng, Teng Wang, Lingquan Meng, Changyin Sun

Cross-view geo-localization confronts significant challenges due to large perspective changes, especially when the ground-view query image has a limited field of view with unknown orientation. To bridge the cross-view do…

geo-localizationRepresentation Learning

DGCPath: Distribution-Aware Generative Contrastive Framework for Self-supervised Path Representation Learning -- Extended Version

2026-09-07 · Sean Bin Yang, Hao Miao, Zongyi Xu, Jilin Hu 외 arxiv

Due to the proliferation of vehicle trajectory data enabled by advanced sensing technologies, path representation learning has become a pivotal task in intelligent transportation systems. Although existing self-supervise…

Representation LearningContrastive Learning