paper-with-me

SLUE

Spoken Language Understanding Evaluation

홈페이지 · 논문 22편

Spoken Language Understanding Evaluation (SLUE) is a suite of benchmark tasks for spoken language understanding evaluation. It consists of limited-size labeled training sets and corresponding evaluation sets. This resource would allow the research community to track progress, evaluate pre-trained representations for higher-level tasks, and study open questions such as the utility of pipeline versus end-to-end approaches. The first phase of the SLUE benchmark suite consists of named entity recognition (NER), sentiment analysis (SA), and ASR on the corresponding datasets. Corpus includes: - SLUE-VoxPopuli: consists of ASR and NER tasks - CC0 license - SLUE-VoxCeleb: consists of ASR and SA tasks - CCBY 4.0 license

Speech

벤치마크

Named Entity Recognition (NER) on SLUE 결과 13개
Sentiment Analysis on SLUE 결과 8개
Speech Recognition on SLUE 결과 8개