Multi-Semantic Interactive Learning for Object Detection
Single-branch object detection methods use shared features for localization and classification, yet the shared features are not fit for the two different tasks simultaneously. Multi-branch object detection methods usually use different features for localization and classification separately, ignoring the relevance between different tasks. Therefore, we propose multi-semantic interactive learning (MSIL) to mine the semantic relevance between different branches and extract multi-semantic enhanced features of objects. MSIL first performs semantic alignment of regression and classification branches, then merges the features of different branches by semantic fusion, finally extracts relevant information by semantic separation and passes it back to the regression and classification branches respectively. More importantly, MSIL can be integrated into existing object detection nets as a plug-and-play component. Experiments on the MS COCO, and Pascal VOC datasets show that the integration of MSIL with existing algorithms can utilize the relevant information between semantics of different tasks and achieve better performance.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationObjectobject-detectionObject DetectionregressionSimilar Papers 제목 키워드 기반
RR-Net: Injecting Interactive Semantics in Human-Object Interaction Detection
Human-Object Interaction (HOI) detection devotes to learn how humans interact with surrounding objects. Latest end-to-end HOI detectors are short of relation reasoning, which leads to inability to learn HOI-specific inte…
Human-Object Interaction DetectionRelationA Graph-based Interactive Reasoning for Human-Object Interaction Detection
Human-Object Interaction (HOI) detection devotes to learn how humans interact with surrounding objects via inferring triplets of < human, verb, object >. However, recent HOI detection methods mostly rely on additional an…
Human-Object Interaction DetectionBLVD: Building A Large-scale 5D Semantics Benchmark for Autonomous Driving
In autonomous driving community, numerous benchmarks have been established to assist the tasks of 3D/2D object detection, stereo vision, semantic/instance segmentation. However, the more meaningful dynamic evolution of t…
2D Object DetectionAutonomous DrivingInstance Segmentationobject-detection+4Exploring Interactive Semantic Alignment for Efficient HOI Detection with Vision-language Model
Human-Object Interaction (HOI) detection aims to localize human-object pairs and comprehend their interactions. Recently, two-stage transformer-based methods have demonstrated competitive performance. However, these meth…
Human-Object Interaction DetectionLanguage ModelingLanguage ModellingObjectTowards Precise Weakly Supervised Object Detection via Interactive Contrastive Learning of Context Information
Weakly supervised object detection (WSOD) aims at learning precise object detectors with only image-level tags. In spite of intensive research on deep learning (DL) approaches over the past few years, there is still a si…
Contrastive LearningObjectobject-detectionObject Detection+2