Channel Interaction Networks for Fine-Grained Image Categorization
Fine-grained image categorization is challenging due to the subtle inter-class differences.We posit that exploiting the rich relationships between channels can help capture such differences since different channels correspond to different semantics. In this paper, we propose a channel interaction network (CIN), which models the channel-wise interplay both within an image and across images. For a single image, a self-channel interaction (SCI) module is proposed to explore channel-wise correlation within the image. This allows the model to learn the complementary features from the correlated channels, yielding stronger fine-grained features. Furthermore, given an image pair, we introduce a contrastive channel interaction (CCI) module to model the cross-sample channel interaction with a metric learning framework, allowing the CIN to distinguish the subtle visual differences between images. Our model can be trained efficiently in an end-to-end fashion without the need of multi-stage training and testing. Finally, comprehensive experiments are conducted on three publicly available benchmarks, where the proposed method consistently outperforms the state-of-theart approaches, such as DFL-CNN (Wang, Morariu, and Davis 2018) and NTS (Yang et al. 2018).
Code (0)
등록된 구현이 없습니다.
Tasks
Image CategorizationMetric LearningSimilar Papers 제목 키워드 기반
Fine-grained Video Categorization with Redundancy Reduction Attention
For fine-grained categorization tasks, videos could serve as a better source than static images as videos have a higher chance of containing discriminative patterns. Nevertheless, a video sequence could also contain a lo…
Action RecognitionVideo ClassificationThe Devil is in the Channels: Mutual-Channel Loss for Fine-Grained Image Classification
Key for solving fine-grained image categorization is finding discriminate and local regions that correspond to subtle visual traits. Great strides have been made, with complex networks designed specifically to learn part…
DiversityFine-Grained Image ClassificationGeneral ClassificationImage Categorization+2Novel Class Discovery for Ultra-Fine-Grained Visual Categorization
Ultra-fine-grained visual categorization (Ultra-FGVC) aims at distinguishing highly similar sub-categories within fine-grained objects, such as different soybean cultivars. Compared to traditional fine-grained visual cat…
Contrastive LearningFine-Grained Visual CategorizationNovel Class DiscoveryRepresentation Learning+1Weakly Supervised Fine-Grained Image Categorization
In this paper, we categorize fine-grained images without using any object / part annotation neither in the training nor in the testing stage, a step towards making it suitable for deployments. Fine-grained image categori…
Fine-Grained Image ClassificationImage CategorizationObjectDual Cross-Attention Learning for Fine-Grained Visual Categorization and Object Re-Identification
Recently, self-attention mechanisms have shown impressive performance in various NLP and CV tasks, which can help capture sequential characteristics and derive global information. In this work, we explore how to extend s…
Fine-Grained Image ClassificationFine-Grained Visual Categorization