paper-with-me

홈 › Papers

Masked Two-channel Decoupling Framework for Incomplete Multi-view Weak Multi-label Learning

2024-04-26 · NeurIPS 2023 11 · Chengliang Liu, Jie Wen, Yabo Liu, Chao Huang, Zhihao Wu, Xiaoling Luo, Yong Xu

Multi-view learning has become a popular research topic in recent years, but research on the cross-application of classic multi-label classification and multi-view learning is still in its early stages. In this paper, we focus on the complex yet highly realistic task of incomplete multi-view weak multi-label learning and propose a masked two-channel decoupling framework based on deep neural networks to solve this problem. The core innovation of our method lies in decoupling the single-channel view-level representation, which is common in deep multi-view learning methods, into a shared representation and a view-proprietary representation. We also design a cross-channel contrastive loss to enhance the semantic property of the two channels. Additionally, we exploit supervised information to design a label-guided graph regularization loss, helping the extracted embedding features preserve the geometric structure among samples. Inspired by the success of masking mechanisms in image and text analysis, we develop a random fragment masking strategy for vector features to improve the learning ability of encoders. Finally, it is important to emphasize that our model is fully adaptable to arbitrary view and label absences while also performing well on the ideal full data. We have conducted sufficient and convincing experiments to confirm the effectiveness and advancement of our model.

📄 PDF Abstract BibTeX arXiv:2404.17340

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-Label ClassificationMUlTI-LABEL-ClASSIFICATIONMulti-Label LearningMULTI-VIEW LEARNING

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Decoupling Feature Representations of Ego and Other Modalities for Incomplete Multi-modal Brain Tumor Segmentation

2024-08-16 · Kaixiang Yang, Wenqi Shan, Xudong Li, Xuan Wang 외

Multi-modal brain tumor segmentation typically involves four magnetic resonance imaging (MRI) modalities, while incomplete modalities significantly degrade performance. Existing solutions employ explicit or implicit moda…

Brain Tumor SegmentationTumor Segmentation

Dual Stream Independence Decoupling for True Emotion Recognition under Masked Expressions

2026-03-17 · Jinsheng Wei, Xiguang Zhang, Zheng Shi, Guanming Lu arxiv

Recongnizing true emotions from masked expressions is extremely challenging due to deliberate concealment. Existing paradigms recognize true emotions from masked-expression clips that contain onsetframes just starting to…

Emotion Recognition

Multi-Masked Querying Network for Robust Emotion Recognition from Incomplete Multi-Modal Physiological Signals

2025-07-28 · Geng-Xin Xu, Xiang Zuo, Ye Li arxiv

Emotion recognition from physiological data is crucial for mental health assessment, yet it faces two significant challenges: incomplete multi-modal signals and interference from body movements and artifacts. This paper …

Emotion Recognition

Incomplete Multi-view Multi-label Classification via a Dual-level Contrastive Learning Framework

2024-11-27 · Bingyan Nie, Wulin Xie, Jiang Long, Xiaohuan Lu

Recently, multi-view and multi-label classification have become significant domains for comprehensive data analysis and exploration. However, incompleteness both in views and labels is still a real-world scenario for mul…

ClassificationContrastive LearningLearning TheoryMulti-Label Classification+1

Gradient-Guided Modality Decoupling for Missing-Modality Robustness

2024-02-26 · Hao Wang, Shengda Luo, Guosheng Hu, JianGuo Zhang

Multimodal learning with incomplete input data (missing modality) is practical and challenging. In this work, we conduct an in-depth analysis of this challenge and find that modality dominance has a significant negative …

Sentiment Analysis