paper-with-me

홈 › Papers

Action-Driven Object Detection with Top-Down Visual Attentions

2016-12-20 · Donggeun Yoo, Sunggyun Park, Kyunghyun Paeng, Joon-Young Lee, In So Kweon

A dominant paradigm for deep learning based object detection relies on a "bottom-up" approach using "passive" scoring of class agnostic proposals. These approaches are efficient but lack of holistic analysis of scene-level context. In this paper, we present an "action-driven" detection mechanism using our "top-down" visual attention model. We localize an object by taking sequential actions that the attention model provides. The attention model conditioned with an image region provides required actions to get closer toward a target object. An action at each time step is weak itself but an ensemble of the sequential actions makes a bounding-box accurately converge to a target object boundary. This attention model we call AttentionNet is composed of a convolutional neural network. During our whole detection procedure, we only utilize the actions from a single AttentionNet without any modules for object proposals nor post bounding-box regression. We evaluate our top-down detection mechanism over the PASCAL VOC series and ILSVRC CLS-LOC dataset, and achieve state-of-the-art performances compared to the major bottom-up detection methods. In particular, our detection mechanism shows a strong advantage in elaborate localization by outperforming Faster R-CNN with a margin of +7.1% over PASCAL VOC 2007 when we increase the IoU threshold for positive detection to 0.7.

📄 PDF Abstract BibTeX arXiv:1612.06704

Code (0)

등록된 구현이 없습니다.

Tasks

Objectobject-detectionObject Detection

Methods 이 논문이 사용한 방법론

RPN A Region Proposal Network, or RPN, is a fully convolutional network that simultaneously predicts object bounds and objectness scores at each position. The RPN is trained…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
RoIPool 설명 없음
Faster R-CNN Faster R-CNN is an object detection model that improves on Fast R-CNN by utilising a region proposal network…

Similar Papers 제목 키워드 기반

Top-Down Networks: A coarse-to-fine reimagination of CNNs

2020-04-16 · Ioannis Lelekas, Nergis Tomen, Silvia L. Pintea, Jan C. van Gemert

Biological vision adopts a coarse-to-fine information processing pathway, from initial visual detection and binding of salient features of a visual scene, to the enhanced and preferential processing given relevant stimul…

Decision Making

Fine-grained Visual-Text Prompt-Driven Self-Training for Open-Vocabulary Object Detection

2022-11-02 · Yanxin Long, Jianhua Han, Runhui Huang, Xu Hang 외

Inspired by the success of vision-language methods (VLMs) in zero-shot classification, recent works attempt to extend this line of work into object detection by leveraging the localization ability of pre-trained VLMs and…

Objectobject-detectionObject DetectionOpen-vocabulary object detection+6

Top-Down Saliency Detection Driven by Visual Classification

2017-09-15 · Francesca Murabito, Concetto Spampinato, Simone Palazzo, Konstantin Pogorelov 외

This paper presents an approach for top-down saliency detection guided by visual classification tasks. We first learn how to compute visual saliency when a specific visual task has to be accomplished, as opposed to most …

ClassificationGeneral ClassificationSaliency Detection

One-Shot Object Affordance Detection in the Wild

2021-08-08 · Wei Zhai, Hongchen Luo, Jing Zhang, Yang Cao 외

Affordance detection refers to identifying the potential action possibilities of objects in an image, which is a crucial ability for robot perception and manipulation. To empower robots with this ability in unseen scenar…

Action RecognitionAffordance DetectionObjectRobot Manipulation+1

Unsupervised image saliency detection with Gestalt-laws guided optimization and visual attention based refinement

2018-02-14 · Pattern Recognition 2018 2 · YijunYan, JinchangRen, GenyunSun, HuiminZhao 외

Visual attention is a kind of fundamental cognitive capability that allows human beings to focus on the region of interests (ROIs) under complex natural environments. What kind of ROIs that we pay attention to mainly dep…

object-detectionObject DetectionSaliency DetectionSalient Object Detection