Weakly Supervised Multiple Instance Learning for Whale Call Detection and Temporal Localization in Long-Duration Passive Acoustic Monitoring
Marine ecosystem monitoring via Passive Acoustic Monitoring (PAM) generates vast data, but deep learning often requires precise annotations and short segments. We introduce DSMIL-LocNet, a Multiple Instance Learning framework for whale call detection and localization using only bag-level labels. Our dual-stream model processes 2-30 minute audio segments, leveraging spectral and temporal features with attention-based instance selection. Tests on Antarctic whale data show longer contexts improve classification (F1: 0.8-0.9) while medium instances ensure localization precision (0.65-0.70). This suggests MIL can enhance scalable marine monitoring. Code: https://github.com/Ragib-Amin-Nihal/DSMIL-Loc
Code (1)
Tasks
Multiple Instance LearningTemporal LocalizationSimilar Papers 제목 키워드 기반
Multiple Instance Detection Network with Online Instance Classifier Refinement
Of late, weakly supervised object detection is with great importance in object recognition. Based on deep learning, weakly supervised detectors have achieved many promising results. However, compared with fully supervise…
Multiple Instance LearningObjectobject-detectionObject Detection+2Weakly Supervised Scalable Audio Content Analysis
Audio Event Detection is an important task for content analysis of multimedia data. Most of the current works on detection of audio events is driven through supervised learning approaches. We propose a weakly supervised …
Event DetectionMultiple Instance LearningWeakly-supervised LearningWeakly Supervised Clustering by Exploiting Unique Class Count
A weakly supervised learning based clustering framework is proposed in this paper. As the core of this framework, we introduce a novel multiple instance learning task based on a bag level label called unique class count …
ClusteringMultiple Instance LearningSemantic SegmentationWeakly-supervised Learning+1Transformer based multiple instance learning for weakly supervised histopathology image segmentation
Hispathological image segmentation algorithms play a critical role in computer aided diagnosis technology. The development of weakly supervised segmentation algorithm alleviates the problem of medical image annotation th…
Image SegmentationMultiple Instance LearningSegmentationSemantic Segmentation+2Whale: Large-Scale multilingual ASR model with w2v-BERT and E-Branchformer with large speech data
This paper reports on the development of a large-scale speech recognition model, Whale. Similar to models such as Whisper and OWSM, Whale leverages both a large model size and a diverse, extensive dataset. Whale's archit…
Decoderspeech-recognitionSpeech Recognition