U-Mamba-Net: A highly efficient Mamba-based U-net style network for noisy and reverberant speech separation
The topic of speech separation involves separating mixed speech with multiple overlapping speakers into several streams, with each stream containing speech from only one speaker. Many highly effective models have emerged and proliferated rapidly over time. However, the size and computational load of these models have also increased accordingly. This is a disaster for the community, as researchers need more time and computational resources to reproduce and compare existing models. In this paper, we propose U-mamba-net: a lightweight Mamba-based U-style model for speech separation in complex environments. Mamba is a state space sequence model that incorporates feature selection capabilities. U-style network is a fully convolutional neural network whose symmetric contracting and expansive paths are able to learn multi-resolution features. In our work, Mamba serves as a feature filter, alternating with U-Net. We test the proposed model on Libri2mix. The results show that U-Mamba-Net achieves improved performance with quite low computational cost.
Code (0)
등록된 구현이 없습니다.
Tasks
feature selectionMambaSpeech SeparationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
QMamba: On First Exploration of Vision Mamba for Image Quality Assessment
In this work, we take the first exploration of the recently popular foundation model, i.e., State Space Model/Mamba, in image quality assessment (IQA), aiming at observing and excavating the perception potential in visio…
Image Quality AssessmentMambaTransfer LearningMambaVoiceCloning: Efficient and Expressive Text-to-Speech via State-Space Modeling and Diffusion Control
MambaVoiceCloning (MVC) asks whether the conditioning path of diffusion-based TTS can be made fully SSM-only at inference, removing all attention and explicit RNN-style recurrence layers across text, rhythm, and prosody,…
SMCD: High Realism Motion Style Transfer via Mamba-based Diffusion
Motion style transfer is a significant research direction in multimedia applications. It enables the rapid switching of different styles of the same motion for virtual digital humans, thus vastly increasing the diversity…
MambaMotion Style TransferStyle TransferMamba-ST: State Space Model for Efficient Style Transfer
The goal of style transfer is, given a content image and a style source, generating a new image preserving the content but with the artistic representation of the style source. Most of the state-of-the-art architectures …
MambaStyle TransferGLADMamba: Unsupervised Graph-Level Anomaly Detection Powered by Selective State Space Model
Unsupervised graph-level anomaly detection (UGLAD) is a critical and challenging task across various domains, such as social network analysis, anti-cancer drug discovery, and toxic molecule identification. However, exist…
Anomaly DetectionDrug DiscoveryMambaState Space Models