paper-with-me

Papers

MCFNet: A Multimodal Collaborative Fusion Network for Fine-Grained Semantic Classification

2025-05-29 · Yang Qiao, Xiaoyu Zhong, Xiaofeng Gu, Zhiguo Yu

Multimodal information processing has become increasingly important for enhancing image classification performance. However, the intricate and implicit dependencies across different modalities often hinder conventional methods from effectively capturing fine-grained semantic interactions, thereby limiting their applicability in high-precision classification tasks. To address this issue, we propose a novel Multimodal Collaborative Fusion Network (MCFNet) designed for fine-grained classification. The proposed MCFNet architecture incorporates a regularized integrated fusion module that improves intra-modal feature representation through modality-specific regularization strategies, while facilitating precise semantic alignment via a hybrid attention mechanism. Additionally, we introduce a multimodal decision classification module, which jointly exploits inter-modal correlations and unimodal discriminative features by integrating multiple loss functions within a weighted voting paradigm. Extensive experiments and ablation studies on benchmark datasets demonstrate that the proposed MCFNet framework achieves consistent improvements in classification accuracy, confirming its effectiveness in modeling subtle cross-modal semantics.

📄 PDF Abstract BibTeX arXiv:2505.23365

Code (0)

등록된 구현이 없습니다.

Tasks

Classificationimage-classificationImage Classification

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

Beyond conventional vision: RGB-event fusion for robust object detection in dynamic traffic scenarios

2025-08-14 · Zhanwen Liu, Yujing Sun, Yang Wang, Nan Yang 외 arxiv

The dynamic range limitation of conventional RGB cameras reduces global contrast and causes loss of high-frequency details such as textures and edges in complex traffic environments (e.g., nighttime driving, tunnels), hi…

Robust Object Detection

MCFNet: Multi-scale Covariance Feature Fusion Network for Real-time Semantic Segmentation

2023-12-12 · Xiaojie Fang, Xingguo Song, Xiangyin Meng, Xu Fang 외

The low-level spatial detail information and high-level semantic abstract information are both essential to the semantic segmentation task. The features extracted by the deep network can obtain rich semantic information,…

Real-Time Semantic SegmentationSegmentationSemantic Segmentation

Multi-scale Cascaded Large-Model for Whole-body ROI Segmentation

2024-11-23 · Rui Hao, Dayu Tan, Yansen Su, ChunHou Zheng

Organs-at-risk segmentation is critical for ensuring the safety and precision of radiotherapy and surgical procedures. However, existing methods for organs-at-risk image segmentation often suffer from uncertainties and b…

Computational EfficiencyGPUImage SegmentationSegmentation+1

Latent Structure Mining with Contrastive Modality Fusion for Multimedia Recommendation

2021-11-01 · Jinghao Zhang, Yanqiao Zhu, Qiang Liu, Mengqi Zhang 외

Recent years have witnessed growing interests in multimedia recommendation, which aims to predict whether a user will interact with an item with multimodal contents. Previous studies focus on modeling user-item interacti…

Collaborative FilteringMultimedia recommendation

Multi-scale HSV Color Feature Embedding for High-fidelity NIR-to-RGB Spectrum Translation

2024-04-25 · Huiyu Zhai, Mo Chen, Xingxing Yang, Gusheng Kang

The NIR-to-RGB spectral domain translation is a formidable task due to the inherent spectral mapping ambiguities within NIR inputs and RGB outputs. Thus, existing methods fail to reconcile the tension between maintaining…

ColorizationImage ColorizationTranslation