paper-with-me

Papers

Multi-Semantic Interactive Learning for Object Detection

2023-03-18 · Shuxin Wang, Zhichao Zheng, Yanhui Gu, Junsheng Zhou, Yi Chen

Single-branch object detection methods use shared features for localization and classification, yet the shared features are not fit for the two different tasks simultaneously. Multi-branch object detection methods usually use different features for localization and classification separately, ignoring the relevance between different tasks. Therefore, we propose multi-semantic interactive learning (MSIL) to mine the semantic relevance between different branches and extract multi-semantic enhanced features of objects. MSIL first performs semantic alignment of regression and classification branches, then merges the features of different branches by semantic fusion, finally extracts relevant information by semantic separation and passes it back to the regression and classification branches respectively. More importantly, MSIL can be integrated into existing object detection nets as a plug-and-play component. Experiments on the MS COCO, and Pascal VOC datasets show that the integration of MSIL with existing algorithms can utilize the relevant information between semantics of different tasks and achieve better performance.

📄 PDF Abstract BibTeX arXiv:2303.10411

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationObjectobject-detectionObject Detectionregression

Similar Papers 제목 키워드 기반

RR-Net: Injecting Interactive Semantics in Human-Object Interaction Detection

2021-04-30 · Dongming Yang, Yuexian Zou, Can Zhang, Meng Cao 외

Human-Object Interaction (HOI) detection devotes to learn how humans interact with surrounding objects. Latest end-to-end HOI detectors are short of relation reasoning, which leads to inability to learn HOI-specific inte…

Human-Object Interaction DetectionRelation

A Graph-based Interactive Reasoning for Human-Object Interaction Detection

2020-07-14 · Dongming Yang, YueXian Zou

Human-Object Interaction (HOI) detection devotes to learn how humans interact with surrounding objects via inferring triplets of < human, verb, object >. However, recent HOI detection methods mostly rely on additional an…

Human-Object Interaction Detection

BLVD: Building A Large-scale 5D Semantics Benchmark for Autonomous Driving

2019-03-15 · Jianru Xue, Jianwu Fang, Tao Li, Bohua Zhang 외

In autonomous driving community, numerous benchmarks have been established to assist the tasks of 3D/2D object detection, stereo vision, semantic/instance segmentation. However, the more meaningful dynamic evolution of t…

2D Object DetectionAutonomous DrivingInstance Segmentationobject-detection+4

Exploring Interactive Semantic Alignment for Efficient HOI Detection with Vision-language Model

2024-04-19 · Jihao Dong, Renjie Pan, Hua Yang

Human-Object Interaction (HOI) detection aims to localize human-object pairs and comprehend their interactions. Recently, two-stage transformer-based methods have demonstrated competitive performance. However, these meth…

Human-Object Interaction DetectionLanguage ModelingLanguage ModellingObject

Towards Precise Weakly Supervised Object Detection via Interactive Contrastive Learning of Context Information

2023-04-27 · Qi Lai, ChiMan Vong

Weakly supervised object detection (WSOD) aims at learning precise object detectors with only image-level tags. In spite of intensive research on deep learning (DL) approaches over the past few years, there is still a si…

Contrastive LearningObjectobject-detectionObject Detection+2