Using Web Co-occurrence Statistics for Improving Image Categorization
Object recognition and localization are important tasks in computer vision. The focus of this work is the incorporation of contextual information in order to improve object recognition and localization. For instance, it is natural to expect not to see an elephant to appear in the middle of an ocean. We consider a simple approach to encapsulate such common sense knowledge using co-occurrence statistics from web documents. By merely counting the number of times nouns (such as elephants, sharks, oceans, etc.) co-occur in web documents, we obtain a good estimate of expected co-occurrences in visual data. We then cast the problem of combining textual co-occurrence statistics with the predictions of image-based classifiers as an optimization problem. The resulting optimization problem serves as a surrogate for our inference procedure. Albeit the simplicity of the resulting optimization problem, it is effective in improving both recognition and localization accuracy. Concretely, we observe significant improvements in recognition and localization rates for both ImageNet Detection 2012 and Sun 2012 datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Common Sense ReasoningImage CategorizationObject RecognitionSimilar Papers 제목 키워드 기반
Matching Pixels Using Co-Occurrence Statistics
We propose a new error measure for matching pixels that is based on co-occurrence statistics. The measure relies on a co-occurrence matrix that counts the number of times pairs of pixel values co-occur within a window. T…
Image RegistrationTemplate MatchingGrey Level Co-occurrence Matrix (GLCM) Based Second Order Statistics for Image Texture Analysis
Grey Level Co-occurrence Matrix and Grey Level Difference Vector are described and computed for twenty four 128 x 128 x 3 test images along horizontal, vertical and diagonal directions. Second order image statistics such…
Texture ClassificationCo-occurrence Based Texture Synthesis
As image generation techniques mature, there is a growing interest in explainable representations that are easy to understand and intuitive to manipulate. In this work, we turn to co-occurrence statistics, which have lon…
Generative Adversarial NetworkImage GenerationMORPHTexture Classification+1Contextual object categorization with energy-based model
Object categorization is a hot issue of an image mining. Contextual information between objects is one of the important semantic knowledge of an image. However, the previous researches for an object categorization have n…
modelObjectObject CategorizationCOSTA: Co-Occurrence Statistics for Zero-Shot Classification
In this paper we aim for zero-shot classification, that is visual recognition of an unseen class by using knowledge transfer from known classes. Our main contribution is COSTA, which exploits co-occurrences of visual con…
ClassificationFew-Shot LearningGeneral ClassificationTransfer Learning+2