paper-with-me

홈 › Papers

Multimodal-Aware Weakly Supervised Metric Learning with Self-weighting Triplet Loss

2021-02-03 · Huiyuan Deng, Xiangzhu Meng, Lin Feng

In recent years, we have witnessed a surge of interests in learning a suitable distance metric from weakly supervised data. Most existing methods aim to pull all the similar samples closer while push the dissimilar ones as far as possible. However, when some classes of the dataset exhibit multimodal distribution, these goals conflict and thus can hardly be concurrently satisfied. Additionally, to ensure a valid metric, many methods require a repeated eigenvalue decomposition process, which is expensive and numerically unstable. Therefore, how to learn an appropriate distance metric from weakly supervised data remains an open but challenging problem. To address this issue, in this paper, we propose a novel weakly supervised metric learning algorithm, named MultimoDal Aware weakly supervised Metric Learning (MDaML). MDaML partitions the data space into several clusters and allocates the local cluster centers and weight for each sample. Then, combining it with the weighted triplet loss can further enhance the local separability, which encourages the local dissimilar samples to keep a large distance from the local similar samples. Meanwhile, MDaML casts the metric learning problem into an unconstrained optimization on the SPD manifold, which can be efficiently solved by Riemannian Conjugate Gradient Descent (RCGD). Extensive experiments conducted on 13 datasets validate the superiority of the proposed MDaML.

📄 PDF Abstract BibTeX arXiv:2102.02670

Code (0)

등록된 구현이 없습니다.

Tasks

Metric LearningTripletvalid

Methods 이 논문이 사용한 방법론

AWARE We propose to theoretically and empirically examine the effect of incorporating weighting schemes into walk-aggregating GNNs. To this end, we propose a simple, interpretable, and…
Triplet Loss The goal of Triplet loss, in the context of Siamese Networks, is to maximize the joint probability among all score-pairs i.e. the product of all probabilities. By using its…

Similar Papers 제목 키워드 기반

Modality-Aware Contrastive Instance Learning with Self-Distillation for Weakly-Supervised Audio-Visual Violence Detection

2022-07-12 · Jiashuo Yu, Jinyu Liu, Ying Cheng, Rui Feng 외

Weakly-supervised audio-visual violence detection aims to distinguish snippets containing multimodal violence events with video-level labels. Many prior works perform audio-visual integration and interaction in an early …

Anomaly Detection In Surveillance Videosaudio-visual learningMultiple Instance Learning

iReasoner: Trajectory-Aware Intrinsic Reasoning Supervision for Self-Evolving Large Multimodal Models

2026-01-09 · Meghana Sunil, Manikandarajan Venmathimaran, Muthu Subash Kavitha arxiv

Recent work shows that large multimodal models (LMMs) can self-improve from unlabeled data via self-play and intrinsic feedback. Yet existing self-evolving frameworks mainly reward final outcomes, leaving intermediate re…

Multimodal ReasoningDecision Making

MAF: Multimodal Alignment Framework for Weakly-Supervised Phrase Grounding

2020-10-12 · EMNLP 2020 11 · Qinxin Wang, Hao Tan, Sheng Shen, Michael W. Mahoney 외

Phrase localization is a task that studies the mapping from textual phrases to regions of an image. Given difficulties in annotating phrase-to-object datasets at scale, we develop a Multimodal Alignment Framework (MAF) t…

Phrase Grounding

Weakly supervised multimodal segmentation of acoustic borehole images with depth-aware cross-attention

2026-03-21 · Jose Luis Lima de Jesus Silva arxiv

Acoustic borehole images provide high-resolution borehole-wall structure, but large-scale interpretation remains difficult because dense expert annotations are rarely available and subsurface information is intrinsically…

Weakly and Self-Supervised Class-Agnostic Motion Prediction for Autonomous Driving

2025-09-16 · Ruibo Li, Hanyu Shi, Zhe Wang, Guosheng Lin arxiv

Understanding motion in dynamic environments is critical for autonomous driving, thereby motivating research on class-agnostic motion prediction. In this work, we investigate weakly and self-supervised class-agnostic mot…

Self-Supervised LearningAutonomous DrivingScene ParsingPoint Clouds