paper-with-me

홈 › Papers

Complex-Valued Time-Frequency Self-Attention for Speech Dereverberation

2022-11-22 · Vinay Kothapally, John H. L. Hansen

Several speech processing systems have demonstrated considerable performance improvements when deep complex neural networks (DCNN) are coupled with self-attention (SA) networks. However, the majority of DCNN-based studies on speech dereverberation that employ self-attention do not explicitly account for the inter-dependencies between real and imaginary features when computing attention. In this study, we propose a complex-valued T-F attention (TFA) module that models spectral and temporal dependencies by computing two-dimensional attention maps across time and frequency dimensions. We validate the effectiveness of our proposed complex-valued TFA module with the deep complex convolutional recurrent network (DCCRN) using the REVERB challenge corpus. Experimental findings indicate that integrating our complex-TFA module with DCCRN improves overall speech quality and performance of back-end speech applications, such as automatic speech recognition, compared to earlier approaches for self-attention.

📄 PDF Abstract BibTeX arXiv:2211.12632

Code (0)

등록된 구현이 없습니다.

Tasks

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Speech Dereverberationspeech-recognitionSpeech Recognition

Similar Papers 제목 키워드 기반

Quantum Complex-Valued Self-Attention Model

2025-03-24 · Fu Chen, Qinglin Zhao, Li Feng, Longfei Tang 외

Self-attention has revolutionized classical machine learning, yet existing quantum self-attention models underutilize quantum states' potential due to oversimplified or incomplete mechanisms. To address this limitation, …

modelMulti-class ClassificationQuantum Machine Learning

Monaural Speech Enhancement with Complex Convolutional Block Attention Module and Joint Time Frequency Losses

2021-02-03 · Shengkui Zhao, Trung Hieu Nguyen, Bin Ma

Deep complex U-Net structure and convolutional recurrent network (CRN) structure achieve state-of-the-art performance for monaural speech enhancement. Both deep complex U-Net and CRN are encoder and decoder structures wi…

DecoderSpeech DenoisingSpeech Enhancement

Advanced Machine Learning Techniques for Self-Interference Cancellation in Full-Duplex Radios

2019-12-14 · Andreas Toftegaard Kristensen, Andreas Burg, Alexios Balatsoukas-Stimming

In-band full-duplex systems allow for more efficient use of temporal and spectral resources by transmitting and receiving information at the same time and on the same frequency. However, this creates a strong self-interf…

BIG-bench Machine Learning

Complex-Valued Frequency Selective Extrapolation for Fast Image and Video Signal Extrapolation

2022-04-27 · Jürgen Seiler, André Kaup

Signal extrapolation tasks arise in miscellaneous manners in the field of image and video signal processing. But, due to the widespread use of low-power and mobile devices, the computational complexity of an algorithm pl…

Miscellaneous

Retrieving Signals in the Frequency Domain with Deep Complex Extractors

2019-09-25 · Chiheb Trabelsi, Olexa Bilaniuk, Ousmane Dia, Ying Zhang 외

Recent advances have made it possible to create deep complex-valued neural networks. Despite this progress, the potential power of fully complex intermediate computations and representations has not yet been explored for…

Audio Source Separation