Papers Sign Language Production
“Sign Language Production” 태그가 달린 논문 40편 · 필터 해제
Text-Driven Diffusion Model for Sign Language Production
We introduce the hfut-lmc team's solution to the SLRTP Sign Production Challenge. The challenge aims to generate semantically aligned sign language pose sequences from text inputs. To this end, we propose a Text-driven D…
Sign Language ProductionA Transformer-Based Framework for Greek Sign Language Production using Extended Skeletal Motion Representations
Sign Languages are the primary form of communication for Deaf communities across the world. To break the communication barriers between the Deaf and Hard-of-Hearing and the hearing communities, it is imperative to build …
SchedulingSign Language ProductionTranslationBeyond Words: AuralLLM and SignMST-C for Precise Sign Language Production and Bidirectional Accessibility
Although sign language recognition aids non-hearing-impaired understanding, many hearing-impaired individuals still rely on sign language alone due to limited literacy, underscoring the need for advanced sign language pr…
RAGSign Language ProductionSign Language RecognitionLinguistics-Vision Monotonic Consistent Network for Sign Language Production
Sign Language Production (SLP) aims to generate sign videos corresponding to spoken language sentences, where the conversion of sign Glosses to Poses (G2P) is the key step. Due to the cross-modal semantic gap and the lac…
Sign Language ProductionSign-IDD: Iconicity Disentangled Diffusion for Sign Language Production
Sign Language Production (SLP) aims to generate semantically consistent sign videos from textual statements, where the conversion from textual glosses to sign poses (G2P) is a crucial step. Existing G2P methods typically…
AttributeDisentanglementSign Language ProductionEmpowering Sign Language Communication: Integrating Sentiment and Semantics for Facial Expression Synthesis
Translating written sentences from oral languages to a sequence of manual and non-manual gestures plays a crucial role in building a more inclusive society for deaf and hard-of-hearing people. Facial expressions (non-man…
Facial expression generationSentenceSign Language ProductionMS2SL: Multimodal Spoken Data-Driven Continuous Sign Language Production
Sign language understanding has made significant strides; however, there is still no viable solution for generating sign sequences directly from entire spoken content, e.g., text or speech. In this paper, we propose a un…
Sign Language ProductionA Spatio-Temporal Representation Learning as an Alternative to Traditional Glosses in Sign Language Translation and Production
This work addresses the challenges associated with the use of glosses in both Sign Language Translation (SLT) and Sign Language Production (SLP). While glosses have long been used as a bridge between sign language and sp…
Gloss-free Sign Language TranslationRepresentation LearningSelf-Supervised LearningSign Language Production+3T2S-GPT: Dynamic Vector Quantization for Autoregressive Sign Language Production from Text
In this work, we propose a two-stage sign language production (SLP) paradigm that first encodes sign language sequences into discrete codes and then autoregressively generates sign language from text based on the learned…
QuantizationSign Language ProductionSignLLM: Sign Language Production Large Language Models
In this paper, we propose SignLLM, a multilingual Sign Language Production (SLP) large language model, which includes two novel multilingual SLP modes MLSF and Prompt2LangGloss that allow sign language gestures generatio…
Language ModelingLanguage ModellingLarge Language ModelSign Language ProductionDiversity-Aware Sign Language Production through a Pose Encoding Variational Autoencoder
This paper addresses the problem of diversity-aware sign language production, where we want to give an image (or sequence) of a signer and produce another image with the same pose but different attributes (\textit{e.g.} …
DecoderDiversityPose EstimationSign Language Production+1Sign Stitching: A Novel Approach to Sign Language Production
Sign Language Production (SLP) is a challenging task, given the limited resources available and the inherent diversity within sign data. As a result, previous works have suffered from the problem of regression to the mea…
DiversitySign Language ProductionA Data-Driven Representation for Sign Language Production
Phonetic representations are used when recording spoken languages, but no equivalent exists for recording signed languages. As a result, linguists have proposed several annotation systems that operate on the gloss or sub…
Sign Language ProductionTranslationSelect and Reorder: A Novel Approach for Neural Sign Language Production
Sign languages, often categorised as low-resource languages, face significant challenges in achieving accurate translation due to the scarcity of parallel annotated datasets. This paper introduces Select and Reorder (S&R…
DisentanglementSign Language ProductionTranslationSign Language Production with Latent Motion Transformer
Sign Language Production (SLP) is the tough task of turning sign language into sign videos. The main goal of SLP is to create these videos using a sign gloss. In this research, we've developed a new method to make high-q…
Sign Language ProductionNeural Sign Actors: A diffusion model for 3D sign language production from text
Sign Languages (SL) serve as the primary mode of communication for the Deaf and Hard of Hearing communities. Deep learning methods for SL recognition and translation have achieved promising results. However, Sign Languag…
Graph Neural NetworkSign Language ProductionSignAvatars: A Large-scale 3D Sign Language Holistic Motion Dataset and Benchmark
We present SignAvatars, the first large-scale, multi-prompt 3D sign language (SL) motion dataset designed to bridge the communication gap for Deaf and hard-of-hearing individuals. While there has been an exponentially gr…
Sign Language ProductionSign Language RecognitionAutoregressive Sign Language Production: A Gloss-Free Approach with Discrete Representations
Gloss-free Sign Language Production (SLP) offers a direct translation of spoken language sentences into sign language, bypassing the need for gloss intermediaries. This paper presents the Sign language Vector Quantizatio…
QuantizationSign Language ProductionTranslationSignDiff: Diffusion Model for American Sign Language Production
In this paper, we propose a dual-condition diffusion pre-training model named SignDiff that can generate human sign language speakers from a skeleton pose. SignDiff has a novel Frame Reinforcement Network called FR-Net, …
Pose EstimationSign Language ProductionSSIMSDW-ASL: A Dynamic System to Generate Large Scale Dataset for Continuous American Sign Language
Despite tremendous progress in natural language processing using deep learning techniques in recent years, sign language production and comprehension has advanced very little. One critical barrier is the lack of largesca…
Dataset GenerationDeep LearningSign Language Production