Papers Sign Language Production
“Sign Language Production” 태그가 달린 논문 40편 · 필터 해제
Changing the Representation: Examining Language Representation for Neural Sign Language Production
Neural Sign Language Production (SLP) aims to automatically translate from spoken language sentences to sign language videos. Historically the SLP task has been broken into two steps; Firstly, translating from a spoken l…
SentenceSign Language ProductionSign Language TranslationTranslationNeural Sign Reenactor: Deep Photorealistic Sign Language Retargeting
In this paper, we introduce a neural rendering pipeline for transferring the facial expressions, head pose, and body movements of one person in a source video to another in a target video. We apply our method to the chal…
Neural RenderingSign Language ProductionG2P-DDM: Generating Sign Pose Sequence from Gloss Sequence with Discrete Diffusion Model
The Sign Language Production (SLP) project aims to automatically translate spoken languages into sign sequences. Our approach focuses on the transformation of sign gloss sequences into their corresponding sign pose seque…
DenoisingQuantizationSign Language ProductionNon-Autoregressive Sign Language Production via Knowledge Distillation
Sign Language Production (SLP) aims to translate expressions in spoken language into corresponding ones in sign language, such as skeleton-based sign poses or videos. Existing SLP models are either AutoRegressive (AR) or…
Knowledge DistillationSign Language ProductionSign Language Production With Avatar Layering: A Critical Use Case over Rare Words
Sign language production (SLP) is the process of generating sign language videos from spoken language expressions. Since sign languages are highly under-resourced, existing vision-based SLP approaches suffer from out-of-…
DecoderLanguage ModelingLanguage ModellingSign Language Production+1KoSign Sign Language Translation Project: Introducing The NIASL2021 Dataset
We introduce a new sign language production (SLP) and sign language translation (SLT) dataset, NIASL2021, consisting of 201,026 Korean-KSL data pairs. KSL translations of Korean source texts are represented in three form…
PositionSign Language ProductionSign Language TranslationTranslationSigning at Scale: Learning to Co-Articulate Signs for Large-Scale Photo-Realistic Sign Language Production
Sign languages are visual languages, with vocabularies as rich as their spoken language counterparts. However, current deep-learning based Sign Language Production (SLP) models produce under-articulated skeleton pose seq…
Sign Language ProductionAll You Need In Sign Language Production
Sign Language is the dominant form of communication language used in the deaf and hearing-impaired community. To make an easy and mutual communication between the hearing-impaired and the hearing communities, building a …
AllCultural Vocal Bursts Intensity PredictionSign Language ProductionSign Language Recognition+1Skeletal Graph Self-Attention: Embedding a Skeleton Inductive Bias into Sign Language Production
Recent approaches to Sign Language Production (SLP) have adopted spoken language Neural Machine Translation (NMT) architectures, applied without sign-specific modifications. In addition, these works represent sign langua…
Inductive BiasMachine TranslationNMTSign Language Production+1Mixed SIGNals: Sign Language Production via a Mixture of Motion Primitives
It is common practice to represent spoken languages at their phonetic level. However, for sign languages, this implies breaking motion into its constituent motion primitives. Avatar based Sign Language Production (SLP) h…
Sign Language ProductionTranslationModel-Aware Gesture-to-Gesture Translation
Hand gesture-to-gesture translation is a significant and interesting problem, which serves as a key role in many applications, such as sign language production. This task involves fine-grained structure understanding…
Gesture-to-Gesture TranslationmodelSign Language ProductionTranslationSign Language Production: A Review
Sign Language is the dominant yet non-primary form of communication language used in the deaf and hearing-impaired community. To make an easy and mutual communication between the hearing-impaired and the hearing communit…
Sign Language ProductionSign Language RecognitionSurveyContinuous 3D Multi-Channel Sign Language Production via Progressive Transformers and Mixture Density Networks
Sign languages are multi-channel visual languages, where signers use a continuous 3D space to communicate.Sign Language Production (SLP), the automatic translation from spoken to sign languages, must embody both the cont…
Data AugmentationSign Language ProductionTranslationCan Everybody Sign Now? Exploring Sign Language Video Generation from 2D Poses
Recent work have addressed the generation of human poses represented by 2D/3D coordinates of human joints for sign language. We use the state of the art in Deep Learning for motion transfer and evaluate them on How2Sign,…
Sign Language ProductionVideo GenerationEverybody Sign Now: Translating Spoken Language to Photo Realistic Sign Language Video
To be truly understandable and accepted by Deaf communities, an automatic Sign Language Production (SLP) system must generate a photo-realistic signer. Prior approaches based on graphical avatars have proven unpopular, w…
Sign Language ProductionVideo GenerationAdversarial Training for Multi-Channel Sign Language Production
Sign Languages are rich multi-channel languages, requiring articulation of both manual (hands) and non-manual (face and body) features in a precise, intricate manner. Sign Language Production (SLP), the automatic transla…
Sign Language ProductionTranslationHow2Sign: A Large-scale Multimodal Dataset for Continuous American Sign Language
One of the factors that have hindered progress in the areas of sign language recognition, translation, and production is the absence of large annotated datasets. Towards this end, we introduce How2Sign, a multimodal and …
Sign Language ProductionSign Language TranslationTranslationProgressive Transformers for End-to-End Sign Language Production
The goal of automatic Sign Language Production (SLP) is to translate spoken language to a continuous stream of sign language video at a level comparable to a human translator. If this was achievable, then it would revolu…
Sign Language ProductionTranslationBosphorusSign22k Sign Language Recognition Dataset
Sign Language Recognition is a challenging research domain. It has recently seen several advancements with the increased availability of data. In this paper, we introduce the BosphorusSign22k, a publicly available large …
Sign Language ProductionSign Language RecognitionVideo RecognitionText2Sign: Towards Sign Language Production Using Neural Machine Translation and Generative Adversarial Networks
We present a novel approach to automatic Sign Language Production using recent developments in Neural Machine Translation (NMT), Generative Adversarial Networks, and motion generation. Our system is capable of producing …
Generative Adversarial NetworkMachine TranslationMotion GenerationNMT+4