paper-with-me

Papers

Zero-Shot Detection

2018-03-19 · Pengkai Zhu, Hanxiao Wang, Venkatesh Saligrama

As we move towards large-scale object detection, it is unrealistic to expect annotated training data, in the form of bounding box annotations around objects, for all object classes at sufficient scale, and so methods capable of unseen object detection are required. We propose a novel zero-shot method based on training an end-to-end model that fuses semantic attribute prediction with visual features to propose object bounding boxes for seen and unseen classes. While we utilize semantic features during training, our method is agnostic to semantic information for unseen classes at test-time. Our method retains the efficiency and effectiveness of YOLOv2 for objects seen during training, while improving its performance for novel and unseen objects. The ability of state-of-art detection methods to learn discriminative object features to reject background proposals also limits their performance for unseen objects. We posit that, to detect unseen objects, we must incorporate semantic information into the visual domain so that the learned visual features reflect this information and leads to improved recall rates for unseen objects. We test our method on PASCAL VOC and MS COCO dataset and observed significant improvements on the average precision of unseen classes.

📄 PDF Abstract BibTeX arXiv:1803.07113

Code (1)

howBiGaStorm/ZeroShot-YOLO pytorch

Tasks

AttributeObjectobject-detectionObject Detection

Methods 이 논문이 사용한 방법론

Average Pooling 설명 없음
Global Average Pooling Global Average Pooling is a pooling operation designed to replace fully connected layers in classical CNNs. The idea is to generate one feature map for each corresponding…
1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…
Batch Normalization 설명 없음
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Darknet-19 설명 없음

Similar Papers 제목 키워드 기반

FADE: Few-shot/zero-shot Anomaly Detection Engine using Large Vision-Language Model

2024-08-31 · Yuanwei Li, Elizaveta Ivanova, Martins Bruveris

Automatic image anomaly detection is important for quality inspection in the manufacturing industry. The usual unsupervised anomaly detection approach is to train a model for each object class using a dataset of normal s…

Anomaly DetectionAnomaly SegmentationLanguage ModelingLanguage Modelling+2

Adversarial Learning for Zero-Shot Stance Detection on Social Media

2021-05-14 · NAACL 2021 4 · Emily Allaway, Malavika Srikanth, Kathleen McKeown

Stance detection on social media can help to identify and understand slanted news or commentary in everyday life. In this work, we propose a new model for zero-shot stance detection on Twitter that uses adversarial learn…

Stance DetectionZero-Shot Stance Detection

Hypothesis Engineering for Zero-Shot Hate Speech Detection

2022-10-03 · TRAC (COLING) 2022 10 · Janis Goldzycher, Gerold Schneider

Standard approaches to hate speech detection rely on sufficient available hate speech annotations. Extending previous work that repurposes natural language inference (NLI) models for zero-shot text classification, we pro…

Hate Speech DetectionNatural Language InferenceText ClassificationZero-Shot Text Classification

Segment Any Change

2024-02-02 · Zhuo Zheng, Yanfei Zhong, Liangpei Zhang, Stefano Ermon

Visual foundation models have achieved remarkable results in zero-shot image classification and segmentation, but zero-shot change detection remains an open problem. In this paper, we propose the segment any change model…

Change Detectionimage-classificationImage ClassificationZero-Shot Image Classification

Zero-Shot Anomaly Detection via Batch Normalization

2023-02-15 · NeurIPS 2023 11 · Aodong Li, Chen Qiu, Marius Kloft, Padhraic Smyth 외

Anomaly detection (AD) plays a crucial role in many safety-critical application domains. The challenge of adapting an anomaly detector to drift in the normal data distribution, especially when no training data is availab…

Anomaly DetectionUnsupervised Anomaly Detectionzero-shot anomaly detectionZero-shot Generalization