paper-with-me

홈 › Papers

SignBank+: Preparing a Multilingual Sign Language Dataset for Machine Translation Using Large Language Models

2023-09-20 · Amit Moryossef, Zifan Jiang

We introduce SignBank+, a clean version of the SignBank dataset, optimized for machine translation between spoken language text and SignWriting, a phonetic sign language writing system. In addition to previous work that employs complex factorization techniques to enable translation between text and SignWriting, we show that a traditional text-to-text translation approach performs equally effectively on the cleaned SignBank+ dataset. Our evaluation results indicate that models trained on SignBank+ surpass those on the original dataset, establishing a new benchmark for SignWriting-based sign language translation and providing an open resource for future research.

📄 PDF Abstract BibTeX arXiv:2309.11566

Code (2)

sign-language-processing/signbank-plus 공식 구현
sign-language-processing/signwriting-evaluation

Tasks

Machine TranslationSign Language TranslationTranslation

Similar Papers 제목 키워드 기반

Measuring Lexical Similarity across Sign Languages in Global Signbank

2020-05-01 · LREC 2020 5 · Carl B{\"o}rstell, Onno Crasborn, Lori Whynot

Lexicostatistics is the main method used in previous work measuring linguistic distances between sign languages. As a method, it disregards any possible structural/grammatical similarity, instead focusing exclusively on …

Signbank: Software to Support Web Based Dictionaries of Sign Language

2018-05-01 · LREC 2018 5 · Steve Cassidy, Onno Crasborn, Henri Nieminen, Wessel Stoop 외

Machine Translation between Spoken Languages and Signed Languages Represented in SignWriting

2022-10-11 · Zifan Jiang, Amit Moryossef, Mathias Müller, Sarah Ebling

This paper presents work on novel machine translation (MT) systems between spoken and signed languages, where signed languages are represented in SignWriting, a sign language writing system. Our work seeks to address the…

Machine TranslationSign Language TranslationTranslation

The Corpus of Finnish Sign Language

2020-05-01 · LREC 2020 5 · Juhana Salonen, Antti Kronqvist, Tommi Jantunen

This paper presents the Corpus of Finnish Sign Language (Corpus FinSL), a structured and annotated collection of Finnish Sign Language (FinSL) videos published in May 2019 in FIN-CLARIN{'}s Language Bank of Finland. The …

Preparing the Vuk'uzenzele and ZA-gov-multilingual South African multilingual corpora

2023-03-07 · Richard Lastrucci, Isheanesu Dzingirai, Jenalea Rajab, Andani Madodonga 외

This paper introduces two multilingual government themed corpora in various South African languages. The corpora were collected by gathering the South African Government newspaper (Vuk'uzenzele), as well as South African…

Language ModelingLanguage ModellingMachine TranslationNMT+1