CLAP-S: Support Set Based Adaptation for Downstream Fiber-optic Acoustic Recognition
Contrastive Language-Audio Pretraining (CLAP) models have demonstrated unprecedented performance in various acoustic signal recognition tasks. Fiber-optic-based acoustic recognition is one of the most important downstream tasks and plays a significant role in environmental sensing. Adapting CLAP for fiber-optic acoustic recognition has become an active research area. As a non-conventional acoustic sensor, fiber-optic acoustic recognition presents a challenging, domain-specific, low-shot deployment environment with significant domain shifts due to unique frequency response and noise characteristics. To address these challenges, we propose a support-based adaptation method, CLAP-S, which linearly interpolates a CLAP Adapter with the Support Set, leveraging both implicit knowledge through fine-tuning and explicit knowledge retrieved from memory for cross-domain generalization. Experimental results show that our method delivers competitive performance on both laboratory-recorded fiber-optic ESC-50 datasets and a real-world fiber-optic gunshot-firework dataset. Our research also provides valuable insights for other downstream acoustic recognition tasks. The code and gunshot-firework dataset are available at https://github.com/Jingchensun/clap-s.
Code (1)
Tasks
Domain GeneralizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Transfer Learning for Neural Networks-based Equalizers in Coherent Optical Systems
In this work, we address the question of the adaptability of artificial neural networks (NNs) used for impairments mitigation in optical transmission systems. We demonstrate that by using well-developed techniques based …
Transfer LearningTheoretical Evaluation of the Capacity-Achieving Distribution for IM-DD Fiber-Optic Channels
The capacity and capacity-achieving distribution for intensity-modulation and direct-detection (IM-DD) fiber-optic channels is theoretically investigated. Different from coherent fiber-optic channels, we indicate that th…
Variational Autoencoder Domain Adaptation for Cross-System Generalization in ML-Based SOP Monitoring
Machine learning (ML) models trained to detect physical-layer threats on one optical fiber system often fail catastrophically when applied to a different system, due to variations in operating wavelength, fiber propertie…
Domain AdaptationClapperText: A Benchmark for Text Recognition in Low-Resource Archival Documents
This paper presents ClapperText, a benchmark dataset for handwritten and printed text recognition in visually degraded and low-resource settings. The dataset is derived from 127 World War II-era archival video segments c…
Few-Shot LearningTurbulence-Resistant All Optical Relaying Based on Few-Mode EDFA in Free-Space Optical Systems
We investigate the communication performance of a few-mode EDFA based all-optical relaying system for atmospheric channels in this paper. A dual-hop free space optical communication model based on the relay with two-mode…
All