Hyper-Class Augmented and Regularized Deep Learning for Fine-Grained Image Classification
Deep convolutional neural networks (CNN) have seen tremendous success in large-scale generic object recognition. In comparison with generic object recognition, fine-grained image classification (FGIC) is much more challenging because (i) fine-grained labeled data is much more expensive to acquire (usually requiring domain expertise); (ii) there exists large intra-class and small inter-class variance. Most recent work exploiting deep CNN for image recognition with small training data adopts a simple strategy: pre-train a deep CNN on a large-scale external dataset (e.g., ImageNet) and fine-tune on the small-scale target data to fit the specific classification task. In this paper, beyond the fine-tuning strategy, we propose a systematic framework of learning a deep CNN that addresses the challenges from two new perspectives: (i) identifying easily annotated hyper-classes inherent in the fine-grained data and acquiring a large number of hyper-class-labeled images from readily available external sources (e.g., image search engines), and formulating the problem into multi-task learning; (ii) a novel learning model by exploiting a regularization between the fine-grained recognition model and the hyper-class recognition model. We demonstrate the success of the proposed framework on two small-scale fine-grained datasets (Stanford Dogs and Stanford Cars) and on a large-scale car dataset that we collected.
Code (0)
등록된 구현이 없습니다.
Tasks
Fine-Grained Image ClassificationGeneral Classificationimage-classificationImage ClassificationImage RetrievalMulti-Task LearningObject RecognitionSimilar Papers 제목 키워드 기반
Cross-Granularity Hypergraph Retrieval-Augmented Generation for Multi-hop Question Answering
Multi-hop question answering (MHQA) requires integrating knowledge scattered across multiple passages to derive the correct answer. Traditional retrieval-augmented generation (RAG) methods primarily focus on coarse-grain…
Multi-hop Question AnsweringSemantic SimilarityAnswer GenerationKnowledge GraphsNavigating the Emotion Tree: Hierarchical Hyperbolic RAG for Multimodal Emotion Recognition
Multimodal emotion recognition aims to integrate text, audio, and video sources to understand human affective states. Although multimodal large language models excel at multimodal reasoning, they typically treat emotion …
Multimodal Emotion RecognitionEmotion ClassificationMultimodal ReasoningHyperImageNet: A Large-Scale High-Spatial Resolution Hyperspectral Imagery Classification Benchmark
We present HyperImageNet, a large-scale benchmark for fine-grained hyperspectral land-cover understanding. The dataset contains 26,084 airborne hyperspectral image patches with 224 spectral bands and 138 fine-grained lan…
Instance SegmentationHyperbolicRAG: Enhancing Retrieval-Augmented Generation with Hyperbolic Representations
Retrieval-augmented generation (RAG) enables large language models (LLMs) to access external knowledge, helping mitigate hallucinations and enhance domain-specific expertise. Graph-based RAG enhances structural reasoning…
Semantic SimilarityKnowledge GraphsGeneralizing Graph Foundation Models via Hyperbolic Retrieval-Augmented Generation
Graph foundation models (GFMs) emerged as a dominant paradigm in graph representation learning by leveraging large-scale pre-training for cross-domain inference. However, the parameterized knowledge encoded within these …
Graph Representation Learning