paper-with-me

Papers

DANCER: Entity Description Augmented Named Entity Corrector for Automatic Speech Recognition

2024-03-26 · Yi-Cheng Wang, Hsin-Wei Wang, Bi-Cheng Yan, Chi-Han Lin, Berlin Chen

End-to-end automatic speech recognition (E2E ASR) systems often suffer from mistranscription of domain-specific phrases, such as named entities, sometimes leading to catastrophic failures in downstream tasks. A family of fast and lightweight named entity correction (NEC) models for ASR have recently been proposed, which normally build on phonetic-level edit distance algorithms and have shown impressive NEC performance. However, as the named entity (NE) list grows, the problems of phonetic confusion in the NE list are exacerbated; for example, homophone ambiguities increase substantially. In view of this, we proposed a novel Description Augmented Named entity CorrEctoR (dubbed DANCER), which leverages entity descriptions to provide additional information to facilitate mitigation of phonetic confusion for NEC on ASR transcription. To this end, an efficient entity description augmented masked language model (EDA-MLM) comprised of a dense retrieval model is introduced, enabling MLM to adapt swiftly to domain-specific entities for the NEC task. A series of experiments conducted on the AISHELL-1 and Homophone datasets confirm the effectiveness of our modeling approach. DANCER outperforms a strong baseline, the phonetic edit-distance-based NEC model (PED-NEC), by a character error rate (CER) reduction of about 7% relatively on AISHELL-1 for named entities. More notably, when tested on Homophone that contain named entities of high phonetic confusion, DANCER offers a more pronounced CER reduction of 46% relatively over PED-NEC for named entities.

📄 PDF Abstract BibTeX arXiv:2403.17645

Code (0)

등록된 구현이 없습니다.

Tasks

Automatic Speech RecognitionLanguage Modellingspeech-recognitionSpeech Recognition

Similar Papers 제목 키워드 기반

FaceDancer: Pose- and Occlusion-Aware High Fidelity Face Swapping

2022-10-19 · Felix Rosberg, Eren Erdal Aksoy, Fernando Alonso-Fernandez, Cristofer Englund

In this work, we present a new single-stage method for subject agnostic face swapping and identity transfer, named FaceDancer. We have two major contributions: Adaptive Feature Fusion Attention (AFFA) and Interpreted Fea…

AttributeDecoderFace SwappingVocal Bursts Intensity Prediction

Large-Scale Label Interpretation Learning for Few-Shot Named Entity Recognition

2024-03-21 · Jonas Golde, Felix Hamborg, Alan Akbik

Few-shot named entity recognition (NER) detects named entities within text using only a few annotated examples. One promising line of research is to leverage natural language descriptions of each entity type: the common …

Entity Linkingfew-shot-nerFew-shot NERnamed-entity-recognition+3

Open Named Entity Modeling from Embedding Distribution

2019-08-31 · Ying Luo, Hai Zhao, Zhuosheng Zhang, Bingjie Tang

In this paper, we report our discovery on named entity distribution in a general word embedding space, which helps an open definition on multilingual named entity definition rather than previous closed and constraint def…

named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Word Embeddings

Knowledge Completes the Vision: A Multimodal Entity-aware Retrieval-Augmented Generation Framework for News Image Captioning

2025-11-26 · Xiaoxing You, Qiang Huang, Lingyu Li, Chi Zhang 외 arxiv

News image captioning aims to produce journalistically informative descriptions by combining visual content with contextual cues from associated articles. Despite recent advances, existing methods struggle with three key…

Image Captioning

Representation Learning Models for Entity Search

2016-10-28 · Shijia E, Yang Xiang, Mohan Zhang

We focus on the problem of learning distributed representations for entity search queries, named entities, and their short descriptions. With our representation learning models, the entity search query, named entity and …

Representation Learning