From Rule-Based Models to Deep Learning Transformers Architectures for Natural Language Processing and Sign Language Translation Systems: Survey, Taxonomy and Performance Evaluation
With the growing Deaf and Hard of Hearing population worldwide and the persistent shortage of certified sign language interpreters, there is a pressing need for an efficient, signs-driven, integrated end-to-end translation system, from sign to gloss to text and vice-versa. There has been a wealth of research on machine translations and related reviews. However, there are few works on sign language machine translation considering the particularity of the language being continuous and dynamic. This paper aims to address this void, providing a retrospective analysis of the temporal evolution of sign language machine translation algorithms and a taxonomy of the Transformers architectures, the most used approach in language translation. We also present the requirements of a real-time Quality-of-Service sign language ma-chine translation system underpinned by accurate deep learning algorithms. We propose future research directions for sign language translation systems.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine TranslationSign Language TranslationTranslationSimilar Papers 제목 키워드 기반
BERT got a Date: Introducing Transformers to Temporal Tagging
Temporal expressions in text play a significant role in language understanding, and correctly identifying them is fundamental to various retrieval and natural language processing systems. Previous works have slowly shift…
ClassificationDecoderLanguage ModelingLanguage Modelling+4BERT got a Date: Introducing Transformers to Temporal Tagging
Temporal expressions in text play a significant role in language understanding and correctly identifying them is fundamental to various retrieval and natural language processing systems. Previous works have slowly shifte…
ClassificationDecoderLanguage ModelingLanguage Modelling+4Transformers: State-of-the-Art Natural Language Processing
Recent progress in natural language processing has been driven by advances in both model architecture and model pretraining. Transformer architectures have facilitated building higher-capacity models and pretraining has …
Image ClassificationObject RecognitionSpeech RecognitionHuggingFace's Transformers: State-of-the-art Natural Language Processing
Recent progress in natural language processing has been driven by advances in both model architecture and model pretraining. Transformer architectures have facilitated building higher-capacity models and pretraining has …
Text GenerationTransfer LearningHyperMixer: An MLP-based Low Cost Alternative to Transformers
Transformer-based architectures are the model of choice for natural language understanding, but they come at a significant cost, as they have quadratic complexity in the input length, require a lot of training data, and …
Natural Language Understanding