paper-with-me

홈 › Papers

RWEN-TTS: Relation-aware Word Encoding Network for Natural Text-to-Speech Synthesis

2022-12-15 · Shinhyeok Oh, HyeongRae Noh, Yoonseok Hong, Insoo Oh

With the advent of deep learning, a huge number of text-to-speech (TTS) models which produce human-like speech have emerged. Recently, by introducing syntactic and semantic information w.r.t the input text, various approaches have been proposed to enrich the naturalness and expressiveness of TTS models. Although these strategies showed impressive results, they still have some limitations in utilizing language information. First, most approaches only use graph networks to utilize syntactic and semantic information without considering linguistic features. Second, most previous works do not explicitly consider adjacent words when encoding syntactic and semantic information, even though it is obvious that adjacent words are usually meaningful when encoding the current word. To address these issues, we propose Relation-aware Word Encoding Network (RWEN), which effectively allows syntactic and semantic information based on two modules (i.e., Semantic-level Relation Encoding and Adjacent Word Relation Encoding). Experimental results show substantial improvements compared to previous works.

📄 PDF Abstract BibTeX arXiv:2212.07939

Code (1)

shinhyeokoh/rwen 공식 구현 pytorch

Tasks

RelationSpeech Synthesistext-to-speechText to SpeechText-To-Speech Synthesis

Similar Papers 제목 키워드 기반

Phoneme-aware Encoding for Prefix-tree-based Contextual ASR

2023-12-15 · Hayato Futami, Emiru Tsunoo, Yosuke Kashiwagi, Hiroaki Ogawa 외

In speech recognition applications, it is important to recognize context-specific rare words, such as proper nouns. Tree-constrained Pointer Generator (TCPGen) has shown promise for this purpose, which efficiently biases…

speech-recognitionSpeech Recognition

Keyword-Aware Relative Spatio-Temporal Graph Networks for Video Question Answering

2023-07-25 · Yi Cheng, Hehe Fan, Dongyun Lin, Ying Sun 외

The main challenge in video question answering (VideoQA) is to capture and understand the complex spatial and temporal relations between objects based on given questions. Existing graph-based methods for VideoQA usually …

graph constructionQuestion AnsweringRelationVideo Question Answering

A 2D Semantic-Aware Position Encoding for Vision Transformers

2025-05-14 · Xi Chen, Shiyang Zhou, Muqi Huang, Jiaxu Feng 외

Vision transformers have demonstrated significant advantages in computer vision tasks due to their ability to capture long-range dependencies and contextual relationships through self-attention. However, existing positio…

PositionSemantic SimilaritySemantic Textual SimilarityTranslation

Relation Aware Semi-autoregressive Semantic Parsing for NL2SQL

2021-08-02 · Junyang Huang, Yongbo Wang, Yongliang Wang, Yang Dong 외

Natural language to SQL (NL2SQL) aims to parse a natural language with a given database into a SQL query, which widely appears in practical Internet applications. Jointly encode database schema and question utterance is …

RelationSemantic Parsing

Position-aware Self-attention with Relative Positional Encodings for Slot Filling

2018-07-09 · Ivan Bilan, Benjamin Roth

This paper describes how to apply self-attention with relative positional encodings to the task of relation extraction. We propose to use the self-attention encoder layer together with an additional position-aware attent…

PositionRelation ExtractionSentenceslot-filling+1