Complex-Valued Time-Frequency Self-Attention for Speech Dereverberation
Several speech processing systems have demonstrated considerable performance improvements when deep complex neural networks (DCNN) are coupled with self-attention (SA) networks. However, the majority of DCNN-based studies on speech dereverberation that employ self-attention do not explicitly account for the inter-dependencies between real and imaginary features when computing attention. In this study, we propose a complex-valued T-F attention (TFA) module that models spectral and temporal dependencies by computing two-dimensional attention maps across time and frequency dimensions. We validate the effectiveness of our proposed complex-valued TFA module with the deep complex convolutional recurrent network (DCCRN) using the REVERB challenge corpus. Experimental findings indicate that integrating our complex-TFA module with DCCRN improves overall speech quality and performance of back-end speech applications, such as automatic speech recognition, compared to earlier approaches for self-attention.
Code (0)
등록된 구현이 없습니다.
Tasks
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Speech Dereverberationspeech-recognitionSpeech RecognitionSimilar Papers 제목 키워드 기반
Quantum Complex-Valued Self-Attention Model
Self-attention has revolutionized classical machine learning, yet existing quantum self-attention models underutilize quantum states' potential due to oversimplified or incomplete mechanisms. To address this limitation, …
modelMulti-class ClassificationQuantum Machine LearningMonaural Speech Enhancement with Complex Convolutional Block Attention Module and Joint Time Frequency Losses
Deep complex U-Net structure and convolutional recurrent network (CRN) structure achieve state-of-the-art performance for monaural speech enhancement. Both deep complex U-Net and CRN are encoder and decoder structures wi…
DecoderSpeech DenoisingSpeech EnhancementAdvanced Machine Learning Techniques for Self-Interference Cancellation in Full-Duplex Radios
In-band full-duplex systems allow for more efficient use of temporal and spectral resources by transmitting and receiving information at the same time and on the same frequency. However, this creates a strong self-interf…
BIG-bench Machine LearningComplex-Valued Frequency Selective Extrapolation for Fast Image and Video Signal Extrapolation
Signal extrapolation tasks arise in miscellaneous manners in the field of image and video signal processing. But, due to the widespread use of low-power and mobile devices, the computational complexity of an algorithm pl…
MiscellaneousRetrieving Signals in the Frequency Domain with Deep Complex Extractors
Recent advances have made it possible to create deep complex-valued neural networks. Despite this progress, the potential power of fully complex intermediate computations and representations has not yet been explored for…
Audio Source Separation