paper-with-me

홈 › Papers

InterFormer: Interactive Local and Global Features Fusion for Automatic Speech Recognition

2023-05-24 · Zhi-Hao Lai, Tian-Hao Zhang, Qi Liu, Xinyuan Qian, Li-Fang Wei, Song-Lu Chen, Feng Chen, Xu-Cheng Yin

The local and global features are both essential for automatic speech recognition (ASR). Many recent methods have verified that simply combining local and global features can further promote ASR performance. However, these methods pay less attention to the interaction of local and global features, and their series architectures are rigid to reflect local and global relationships. To address these issues, this paper proposes InterFormer for interactive local and global features fusion to learn a better representation for ASR. Specifically, we combine the convolution block with the transformer block in a parallel design. Besides, we propose a bidirectional feature interaction module (BFIM) and a selective fusion module (SFM) to implement the interaction and fusion of local and global features, respectively. Extensive experiments on public ASR datasets demonstrate the effectiveness of our proposed InterFormer and its superior performance over the other Transformer and Conformer models.

📄 PDF Abstract BibTeX arXiv:2305.16342

Code (0)

등록된 구현이 없습니다.

Tasks

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

InterFormer: Real-time Interactive Image Segmentation

2023-04-06 · ICCV 2023 1 · You Huang, Hao Yang, Ke Sun, Shengchuan Zhang 외

Interactive image segmentation enables annotators to efficiently perform pixel-level annotation for segmentation tasks. However, the existing interactive segmentation pipeline suffers from inefficient computations of int…

Computational EfficiencyCPUImage SegmentationInteractive Segmentation+2

Interaction-aware Representation Modeling with Co-occurrence Consistency for Egocentric Hand-Object Parsing

2026-02-24 · Yuejiao Su, Yi Wang, Lei Yao, Yawen Cui 외 arxiv

A fine-grained understanding of egocentric human-environment interactions is crucial for developing next-generation embodied agents. One fundamental challenge in this area involves accurately parsing hands and active obj…

CIT-EmotionNet: CNN Interactive Transformer Network for EEG Emotion Recognition

2023-05-07 · Wei Lu, Hua Ma, Tien-Ping Tan

Emotion recognition using Electroencephalogram (EEG) signals has emerged as a significant research challenge in affective computing and intelligent interaction. However, effectively combining global and local features of…

EEGEEG Emotion RecognitionElectroencephalogram (EEG)Emotion Recognition

Pointerformer: Deep Reinforced Multi-Pointer Transformer for the Traveling Salesman Problem

2023-04-19 · Yan Jin, Yuandong Ding, Xuanhao Pan, Kun He 외

Traveling Salesman Problem (TSP), as a classic routing optimization problem originally arising in the domain of transportation and logistics, has become a critical task in broader domains, such as manufacturing and biolo…

DecoderDeep Reinforcement LearningTraveling Salesman Problem

DAAF:Degradation-Aware Adaptive Fusion Framework for Robust Infrared and Visible Images Fusion

2025-04-15 · Tianpei Zhang, Jufeng Zhao, Yiming Zhu, Guangmang Cui 외

Existing infrared and visible image fusion(IVIF) algorithms often prioritize high-quality images, neglecting image degradation such as low light and noise, which limits the practical potential. This paper propose Degrada…

Infrared And Visible Image Fusion