Semantic Clustering for Robust Fine-Grained Scene Recognition
In domain generalization, the knowledge learnt from one or multiple source domains is transferred to an unseen target domain. In this work, we propose a novel domain generalization approach for fine-grained scene recognition. We first propose a semantic scene descriptor that jointly captures the subtle differences between fine-grained scenes, while being robust to varying object configurations across domains. We model the occurrence patterns of objects in scenes, capturing the informativeness and discriminability of each object for each scene. We then transform such occurrences into scene probabilities for each scene image. Second, we argue that scene images belong to hidden semantic topics that can be discovered by clustering our semantic descriptors. To evaluate the proposed method, we propose a new fine-grained scene dataset in cross-domain settings. Extensive experiments on the proposed dataset and three benchmark scene datasets show the effectiveness of the proposed approach for fine-grained scene transfer, where we outperform state-of-the-art scene recognition and domain generalization methods.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringDomain GeneralizationInformativenessScene RecognitionSimilar Papers 제목 키워드 기반
Knowledge Mining with Scene Text for Fine-Grained Recognition
Recently, the semantics of scene text has been proven to be essential in fine-grained image classification. However, the existing methods mainly exploit the literal meaning of scene text for fine-grained recognition, whi…
Activity RecognitionClassificationFine-Grained Image Classificationimage-classification+1An Active and Contrastive Learning Framework for Fine-Grained Off-Road Semantic Segmentation
Off-road semantic segmentation with fine-grained labels is necessary for autonomous vehicles to understand driving scenes, as the coarse-grained road detection can not satisfy off-road vehicles with various mechanical pr…
Autonomous VehiclesContrastive LearningSegmentationSemantic SegmentationRegion based Ensemble Learning Network for Fine-grained Classification
As an important research topic in computer vision, fine-grained classification which aims to recognition subordinate-level categories has attracted significant attention. We propose a novel region based ensemble learning…
ClassificationEnsemble LearningGeneral ClassificationScene RecognitionDeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition
We evaluate whether features extracted from the activation of a deep convolutional network trained in a fully supervised fashion on a large, fixed set of object recognition tasks can be re-purposed to novel generic tasks…
ClusteringDomain AdaptationObject RecognitionScene Recognition+1What's in a Name? Beyond Class Indices for Image Recognition
Existing machine learning models demonstrate excellent performance in image object recognition after training on a large-scale dataset under full supervision. However, these models only learn to map an image to a predefi…
ClusteringLanguage ModellingObject Recognition