Modality-Aware Negative Sampling for Multi-modal Knowledge Graph Embedding
Negative sampling (NS) is widely used in knowledge graph embedding (KGE), which aims to generate negative triples to make a positive-negative contrast during training. However, existing NS methods are unsuitable when multi-modal information is considered in KGE models. They are also inefficient due to their complex design. In this paper, we propose Modality-Aware Negative Sampling (MANS) for multi-modal knowledge graph embedding (MMKGE) to address the mentioned problems. MANS could align structural and visual embeddings for entities in KGs and learn meaningful embeddings to perform better in multi-modal KGE while keeping lightweight and efficient. Empirical results on two benchmarks demonstrate that MANS outperforms existing NS methods. Meanwhile, we make further explorations about MANS to confirm its effectiveness.
Code (1)
Tasks
Graph EmbeddingKnowledge Graph EmbeddingMulti-modal Knowledge GraphMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
On Negative Sampling for Contrastive Audio-Text Retrieval
This paper investigates negative sampling for contrastive learning in the context of audio-text retrieval. The strategy for negative sampling refers to selecting negatives (either audio clips or textual descriptions) fro…
Audio to Text RetrievalContrastive LearningRetrievalText RetrievalRebalanced Multimodal Learning with Data-aware Unimodal Sampling
To address the modality learning degeneration caused by modality imbalance, existing multimodal learning~(MML) approaches primarily attempt to balance the optimization process of each modality from the perspective of mod…
Reinforcement Learning (RL)Complementarity-driven Representation Learning for Multi-modal Knowledge Graph Completion
Multi-modal Knowledge Graph Completion (MMKGC) aims to uncover hidden world knowledge in multimodal knowledge graphs by leveraging both multimodal and structural entity information. However, the inherent imbalance in mul…
Knowledge Graph CompletionRepresentation LearningKnowledge GraphsDebiasing Multimodal Large Language Models via Noise-Aware Preference Optimization
Multimodal Large Language Models excel in various tasks, yet often struggle with modality bias, where the model tends to rely heavily on a single modality and overlook critical information in other modalities, which lead…
Generating Negative Samples for Multi-Modal Recommendation
Multi-modal recommender systems (MMRS) have gained significant attention due to their ability to leverage information from various modalities to enhance recommendation quality. However, existing negative sampling techniq…
Multi-modal RecommendationRecommendation Systems