paper-with-me

Papers

SaRPFF: A Self-Attention with Register-based Pyramid Feature Fusion module for enhanced RLD detection

2024-02-26 · Yunusa Haruna, Shiyin Qin, Abdulrahman Hamman Adama Chukkol, Isah Bello, Adamu Lawan

Detecting objects across varying scales is still a challenge in computer vision, particularly in agricultural applications like Rice Leaf Disease (RLD) detection, where objects exhibit significant scale variations (SV). Conventional object detection (OD) like Faster R-CNN, SSD, and YOLO methods often fail to effectively address SV, leading to reduced accuracy and missed detections. To tackle this, we propose SaRPFF (Self-Attention with Register-based Pyramid Feature Fusion), a novel module designed to enhance multi-scale object detection. SaRPFF integrates 2D-Multi-Head Self-Attention (MHSA) with Register tokens, improving feature interpretability by mitigating artifacts within MHSA. Additionally, it integrates efficient attention atrous convolutions into the pyramid feature fusion and introduce a deconvolutional layer for refined up-sampling. We evaluate SaRPFF on YOLOv7 using the MRLD and COCO datasets. Our approach demonstrates a +2.61% improvement in Average Precision (AP) on the MRLD dataset compared to the baseline FPN method in YOLOv7. Furthermore, SaRPFF outperforms other FPN variants, including BiFPN, NAS-FPN, and PANET, showcasing its versatility and potential to advance OD techniques. This study highlights SaRPFF effectiveness in addressing SV challenges and its adaptability across FPN-based OD models.

📄 PDF Abstract BibTeX arXiv:2402.16291

Code (0)

등록된 구현이 없습니다.

Tasks

Objectobject-detectionObject Detection

Methods 이 논문이 사용한 방법론

RPN A Region Proposal Network, or RPN, is a fully convolutional network that simultaneously predicts object bounds and objectness scores at each position. The RPN is trained…
RoIPool 설명 없음
Non Maximum Suppression Non Maximum Suppression is a computer vision method that selects a single entity out of many overlapping entities (for example bounding boxes in object detection). The…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
SSD SSD is a single-stage object detection method that discretizes the output space of bounding boxes into a set of default boxes over different aspect ratios and scales per…
Faster R-CNN Faster R-CNN is an object detection model that improves on Fast R-CNN by utilising a region proposal network…
Pointwise Convolution Pointwise Convolution is a type of convolution that uses a 1x1 kernel: a kernel that iterates through every single point. This…
Depthwise Convolution Depthwise Convolution is a type of convolution where we apply a single convolutional filter for each input channel. In the regular 2D…

Similar Papers 제목 키워드 기반

Pyramid Attention Networks for Image Restoration

2020-04-28 · Yiqun Mei, Yuchen Fan, Yulun Zhang, Jiahui Yu 외

Self-similarity refers to the image prior widely used in image restoration algorithms that small but similar patterns tend to occur at different locations and scales. However, recent advanced deep convolutional neural ne…

DemosaickingDenoisingImage DenoisingImage Restoration+1

Interaction-aware Spatio-temporal Pyramid Attention Networks for Action Classification

2018-08-03 · ECCV 2018 9 · Yang Du, Chunfeng Yuan, Bing Li, Lili Zhao 외

Local features at neighboring spatial positions in feature maps have high correlation since their receptive fields are often overlapped. Self-attention usually uses the weighted sum (or other functions) with internal ele…

Action ClassificationClassificationGeneral Classification

Enhancing Unregistered Hyperspectral Image Super-Resolution via Unmixing-based Abundance Fusion Learning

2026-03-09 · Yingkai Zhang, Tao Zhang, Jing Nie, Ying Fu arxiv

Unregistered hyperspectral image (HSI) super-resolution (SR) typically aims to enhance a low-resolution HSI using an unregistered high-resolution reference image. In this paper, we propose an unmixing-based fusion framew…

Image Super-Resolution

Salient Object Detection Combining a Self-attention Module and a Feature Pyramid Network

2020-04-30 · Guangyu Ren, Tianhong Dai, Panagiotis Barmpoutis, Tania Stathaki

Salient object detection has achieved great improvement by using the Fully Convolution Network (FCN). However, the FCN-based U-shape architecture may cause the dilution problem in the high-level semantic information duri…

Objectobject-detectionObject DetectionObject Localization+3

Register and CLS tokens yield a decoupling of local and global features in large ViTs

2025-05-09 · Alexander Lappe, Martin A. Giese

Recent work has shown that the attention maps of the widely popular DINOv2 model exhibit artifacts, which hurt both model interpretability and performance on dense image tasks. These artifacts emerge due to the model rep…