paper-with-me

홈 › Papers

A Glance is Enough: Extract Target Sentence By Looking at A keyword

2023-10-09 · Ying Shi, Dong Wang, Lantian Li, Jiqing Han

This paper investigates the possibility of extracting a target sentence from multi-talker speech using only a keyword as input. For example, in social security applications, the keyword might be "help", and the goal is to identify what the person who called for help is articulating while ignoring other speakers. To address this problem, we propose using the Transformer architecture to embed both the keyword and the speech utterance and then rely on the cross-attention mechanism to select the correct content from the concatenated or overlapping speech. Experimental results on Librispeech demonstrate that our proposed method can effectively extract target sentences from very noisy and mixed speech (SNR=-3dB), achieving a phone error rate (PER) of 26\%, compared to the baseline system's PER of 96%.

📄 PDF Abstract BibTeX arXiv:2310.05352

Code (0)

등록된 구현이 없습니다.

Tasks

Sentence

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Position-Wise Feed-Forward Layer 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Adam 설명 없음

Similar Papers 제목 키워드 기반

D3G: Exploring Gaussian Prior for Temporal Sentence Grounding with Glance Annotation

2023-08-08 · ICCV 2023 1 · Hanjun Li, Xiujun Shu, Sunan He, Ruizhi Qiao 외

Temporal sentence grounding (TSG) aims to locate a specific moment from an untrimmed video with a given natural language query. Recently, weakly supervised methods still have a large performance gap compared to fully sup…

Contrastive LearningSentenceTemporal Sentence Grounding

Extract and Attend: Improving Entity Translation in Neural Machine Translation

2023-06-04 · Zixin Zeng, Rui Wang, Yichong Leng, Junliang Guo 외

While Neural Machine Translation(NMT) has achieved great progress in recent years, it still suffers from inaccurate translation of entities (e.g., person/organization name, location), due to the lack of entity training i…

DecoderMachine TranslationNMTSentence+1

Using English as Pivot to Extract Persian-Italian Parallel Sentences from Non-Parallel Corpora

2017-01-29 · Ebrahim Ansari, M. H. Sadreddini, Mostafa Sheikhalishahi, Richard Wallace 외

The effectiveness of a statistical machine translation system (SMT) is very dependent upon the amount of parallel corpus used in the training phase. For low-resource language pairs there are not enough parallel corpora t…

Machine TranslationSentenceSentence SimilarityTranslation

Simple Unsupervised Summarization by Contextual Matching

2019-07-31 · ACL 2019 7 · Jiawei Zhou, Alexander M. Rush

We propose an unsupervised method for sentence summarization using only language modeling. The approach employs two language models, one that is generic (i.e. pretrained), and the other that is specific to the target dom…

Language ModelingLanguage ModellingSentenceSentence Summarization+2

Glance-Say: Multimodal Human-Robot Collaboration and Intent Recognition via Sticky Glance

2026-03-06 · Yuzhi Lai, Shenghai Yuan, Peizheng Li, Benjamin Kiefer 외 arxiv

Gaze and speech are promising interaction modalities for individuals with motor impairments, yet robust intent recognition in multi-object environments remains challenging due to micro-saccades, semantic ambiguity, and v…

Intent Recognition