paper-with-me

Papers

High-Order-Interaction for weakly supervised Fine-Grained Visual Categorization

2021-11-13 · Neurocomputing 2021 11 · Nanyu Li, Junzhen Wang, Zhimin Luo, Zhun Zhong, Shaozi Li

Fine-Grained Visual Categorization (FGVC) is a challenging task due to the large intra-subcategory and small inter-subcategory variances. Recent studies tackle this task through a weakly supervised manner without using the part annotation from the experts. Of those, methods based on bilinear pooling are one of the main categories for computing the interaction between deep features and have shown high effectiveness. However, these methods mainly focus on the correlation within one specific layer but largely ignore the high interactions between multiple layers. In this study, we argue that considering the high interaction between the features from multiple layers can help to learn more distinguishing fine-grained features. To this end, we propose a High-Order-Interaction (HOI) method for FGVC. In our HOI, an efficient cross-layer trilinear pooling is introduced to calculate the third-order interaction between three different layers. Third-order interactions of different combinations are then fused to form the final representation. HOI can produce more discriminative representations and be readily integrated with the two popular techniques, attention mechanism and triplet loss, to obtain superposed improvement. Extensive experiments conducted on four FGVC datasets show the great superiority of our method over bilinear-based methods and demonstrate that the proposed method achieves the state of the art.

📄 PDF Abstract BibTeX

Code (1)

puallee/HOI-Net pytorch

Tasks

Fine-Grained Image ClassificationFine-Grained Image RecognitionFine-Grained Visual CategorizationTripletVocal Bursts Intensity Prediction

Similar Papers 제목 키워드 기반

Munsit at NADI 2025 Shared Task 2: Pushing the Boundaries of Multidialectal Arabic ASR with Weakly Supervised Pretraining and Continual Supervised Fine-tuning

2025-08-12 · Mahmoud Salhab, Shameed Sait, Mohammad Abusheikh, Hasan Abusheikh arxiv

Automatic speech recognition (ASR) plays a vital role in enabling natural human-machine interaction across applications such as virtual assistants, industrial automation, customer support, and real-time transcription. Ho…

Speech Recognition

Weakly-Supervised HOI Detection from Interaction Labels Only and Language/Vision-Language Priors

2023-03-09 · Mesut Erhan Unal, Adriana Kovashka

Human-object interaction (HOI) detection aims to extract interacting human-object pairs and their interaction categories from a given natural image. Even though the labeling effort required for building HOI detection dat…

Human-Object Interaction DetectionLanguage ModelingLanguage ModellingLarge Language Model+1

MotifClass: Weakly Supervised Text Classification with Higher-order Metadata Information

2021-11-07 · Yu Zhang, Shweta Garg, Yu Meng, Xiusi Chen 외

We study the problem of weakly supervised text classification, which aims to classify text documents into a set of pre-defined categories with category surface names only and without any annotated training document provi…

text-classificationText Classification

Weakly-Supervised Temporal Action Detection for Fine-Grained Videos with Hierarchical Atomic Actions

2022-07-24 · Zhi Li, Lu He, Huijuan Xu

Action understanding has evolved into the era of fine granularity, as most human behaviors in real life have only minor differences. To detect these fine-grained actions accurately in a label-efficient way, we tackle the…

Action DetectionAction UnderstandingFine-Grained Action DetectionWeakly Supervised Action Localization

Weakly Supervised Human-Object Interaction Detection in Video via Contrastive Spatiotemporal Regions

2021-10-07 · ICCV 2021 10 · Shuang Li, Yilun Du, Antonio Torralba, Josef Sivic 외

We introduce the task of weakly supervised learning for detecting human and object interactions in videos. Our task poses unique challenges as a system does not know what types of human-object interactions are present in…

Human-Object Interaction DetectionObjectSentenceWeakly-supervised Learning