A Shared Task for Spoken CALL?
We argue that the field of spoken CALL needs a shared task in order to facilitate comparisons between different groups and methodologies, and describe a concrete example of such a task, based on data collected from a speech-enabled online tool which has been used to help young Swiss German teens practise skills in English conversation. Items are prompt-response pairs, where the prompt is a piece of German text and the response is a recorded English audio file. The task is to label pairs as {`}accept{''} or {`}reject{''}, accepting responses which are grammatically and linguistically correct to match a set of hidden gold standard answers as closely as possible. Initial resources are provided so that a scratch system can be constructed with a minimal investment of effort, and in particular without necessarily using a speech recogniser. Training data for the task will be released in June 2016, and test data in January 2017.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
A Report on the 2017 Native Language Identification Shared Task
Native Language Identification (NLI) is the task of automatically identifying the native language (L1) of an individual based on their language production in a learned language. It is typically framed as a classification…
Grammatical Error CorrectionLanguage AcquisitionLanguage IdentificationNative Language IdentificationFindings of the IWSLT 2024 Evaluation Campaign
This paper reports on the shared tasks organized by the 21st IWSLT Conference. The shared tasks address 7 scientific challenges in spoken language translation: simultaneous and offline translation, automatic subtitling a…
Speech-to-Speech TranslationTranslationFew-Shot Spoken Language Understanding via Joint Speech-Text Models
Recent work on speech representation models jointly pre-trained with text has demonstrated the potential of improving speech representations by encoding speech and text in a shared space. In this paper, we leverage such …
named-entity-recognitionNamed Entity RecognitionSentiment AnalysisSpoken Language UnderstandingASR-Generated Text for Language Model Pre-training Applied to Speech Tasks
We aim at improving spoken language modeling (LM) using very large amount of automatically transcribed speech. We leverage the INA (French National Audiovisual Institute) collection and obtain 19GB of text after applying…
Language ModelingLanguage ModellingSpoken Language UnderstandingMTL-SLT: Multi-Task Learning for Spoken Language Tasks
Language understanding in speech-based systems has attracted extensive interest from both academic and industrial communities in recent years with the growing demand for voice-based applications. Prior works focus on ind…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Language ModellingMulti-Task Learning+4