paper-with-me

Papers

Recurrent Multi-scale Transformer for High-Resolution Salient Object Detection

2023-08-07 · Xinhao Deng, Pingping Zhang, Wei Liu, Huchuan Lu

Salient Object Detection (SOD) aims to identify and segment the most conspicuous objects in an image or video. As an important pre-processing step, it has many potential applications in multimedia and vision tasks. With the advance of imaging devices, SOD with high-resolution images is of great demand, recently. However, traditional SOD methods are largely limited to low-resolution images, making them difficult to adapt to the development of High-Resolution SOD (HRSOD). Although some HRSOD methods emerge, there are no large enough datasets for training and evaluating. Besides, current HRSOD methods generally produce incomplete object regions and irregular object boundaries. To address above issues, in this work, we first propose a new HRS10K dataset, which contains 10,500 high-quality annotated images at 2K-8K resolution. As far as we know, it is the largest dataset for the HRSOD task, which will significantly help future works in training and evaluating models. Furthermore, to improve the HRSOD performance, we propose a novel Recurrent Multi-scale Transformer (RMFormer), which recurrently utilizes shared Transformers and multi-scale refinement architectures. Thus, high-resolution saliency maps can be generated with the guidance of lower-resolution predictions. Extensive experiments on both high-resolution and low-resolution benchmarks show the effectiveness and superiority of the proposed framework. The source code and dataset are released at: https://github.com/DrowsyMon/RMFormer.

📄 PDF Abstract BibTeX arXiv:2308.03826

Code (1)

drowsymon/rmformer 공식 구현 pytorch

Tasks

2k8kobject-detectionObject DetectionSalient Object Detection

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Adam 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Residual Connection 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

Self-supervised pretraining for an iterative image size agnostic vision transformer

2026-04-22 · Nedyalko Prisadnikov, Danda Pani Paudel, Yuqian Fu, Luc Van Gool arxiv

Vision Transformers (ViTs) dominate self-supervised learning (SSL). While they have proven highly effective for large-scale pretraining, they are computationally inefficient and scale poorly with image size. Consequently…

Self-Supervised Learning

Memory-Efficient Optical Flow via Radius-Distribution Orthogonal Cost Volume

2023-12-06 · Gangwei Xu, Shujun Chen, Hao Jia, Miaojie Feng 외

The full 4D cost volume in Recurrent All-Pairs Field Transforms (RAFT) or global matching by Transformer achieves impressive performance for optical flow estimation. However, their memory consumption increases quadratica…

4kOptical Flow Estimation

Multiresolution Transformer Networks: Recurrence is Not Essential for Modeling Hierarchical Structure

2019-08-27 · Vikas K. Garg, Inderjit S. Dhillon, Hsiang-Fu Yu

The architecture of Transformer is based entirely on self-attention, and has been shown to outperform models that employ recurrence on sequence transduction tasks such as machine translation. The superior performance of …

Machine TranslationTranslation

Recurrent Homography Estimation Using Homography-Guided Image Warping and Focus Transformer

2023-01-01 · CVPR 2023 1 · Si-Yuan Cao, Runmin Zhang, Lun Luo, Beinan Yu 외

We propose the Recurrent homography estimation framework using Homography-guided image Warping and Focus transformer (FocusFormer), named RHWF. Both being appropriately absorbed into the recurrent framework, the homo…

Homography Estimation

VidFace: A Full-Transformer Solver for Video FaceHallucination with Unaligned Tiny Snapshots

2021-05-31 · Yuan Gan, Yawei Luo, Xin Yu, Bang Zhang 외

In this paper, we investigate the task of hallucinating an authentic high-resolution (HR) human face from multiple low-resolution (LR) video snapshots. We propose a pure transformer-based model, dubbed VidFace, to fully …

Face HallucinationHallucination