Mining Word Boundaries in Speech as Naturally Annotated Word Segmentation Data
Inspired by early research on exploring naturally annotated data for Chinese word segmentation (CWS), and also by recent research on integration of speech and text processing, this work for the first time proposes to mine word boundaries from parallel speech/text data. First we collect parallel speech/text data from two Internet sources that are related with CWS data used in our experiments. Then, we obtain character-level alignments and design simple heuristic rules for determining word boundaries according to pause duration between adjacent characters. Finally, we present an effective complete-then-train strategy that can better utilize extra naturally annotated data for model training. Experiments demonstrate our approach can significantly boost CWS performance in both cross-domain and low-resource scenarios.
Code (0)
등록된 구현이 없습니다.
Tasks
Chinese Word SegmentationSimilar Papers 제목 키워드 기반
Mining Word Boundaries from Speech-Text Parallel Data for Cross-domain Chinese Word Segmentation
Inspired by early research on exploring naturally annotated data for Chinese Word Segmentation (CWS), and also by recent research on integration of speech and text processing, this work for the first time proposes to exp…
Chinese Word SegmentationRecognizing Co-Speech Gestures in-the-Wild
While humans naturally gesture during speech, only a sparse subset of these movements are visually depictive and semantically linked to specific spoken words. Current multimodal models struggle to capture these semantic …
Gesture RecognitionSemi-automatically Alignment of Predicates between Speech and OntoNotes data
Speech data currently receives a growing attention and is an important source of information. We still lack suitable corpora of transcribed speech annotated with semantic roles that can be used for semantic role labeling…
Semantic Role LabelingSentenceShrinking Japanese Morphological Analyzers With Neural Networks and Semi-supervised Learning
For languages without natural word boundaries, like Japanese and Chinese, word segmentation is a prerequisite for downstream analysis. For Japanese, segmentation is often done jointly with part of speech tagging, and thi…
Chinese Word SegmentationMorphological AnalysisPart-Of-Speech TaggingSegmentationA Code-Switching Corpus of Turkish-German Conversations
We present a code-switching corpus of Turkish-German that is collected by recording conversations of bilinguals. The recordings are then transcribed in two layers following speech and orthography conventions, and annotat…
Automatic Speech Recognition (ASR)Language IdentificationLanguage ModellingPart-Of-Speech Tagging+3