A deep-learning based native-language classification by using a latent semantic analysis for the NLI Shared Task 2017
This paper proposes a deep-learning based native-language identification (NLI) using a latent semantic analysis (LSA) as a participant (ETRI-SLP) of the NLI Shared Task 2017 where the NLI Shared Task 2017 aims to detect the native language of an essay or speech response of a standardized assessment of English proficiency for academic purposes. To this end, we use the six unit forms of a text data such as character 4/5/6-grams and word 1/2/3-grams. For each unit form of text data, we convert it into a count-based vector, extract a 2000-rank LSA feature, and perform a linear discriminant analysis (LDA) based dimension reduction. From the count-based vector or the LSA-LDA feature, we also obtain the output prediction values of a support vector machine (SVM) based classifier, the output prediction values of a deep neural network (DNN) based classifier, and the bottleneck values of a DNN based classifier. In order to incorporate the various kinds of text-based features and a speech-based i-vector feature, we design two DNN based ensemble classifiers for late fusion and early fusion, respectively. From the NLI experiments, the F1 (macro) scores are obtained as 0.8601, 0.8664, and 0.9220 for the essay track, the speech track, and the fusion track, respectively. The proposed method has comparable performance to the top-ranked teams for the speech and fusion tracks, although it has slightly lower performance for the essay track.
Code (0)
등록된 구현이 없습니다.
Tasks
Automatic Speech Recognition (ASR)Dimensionality ReductionGeneral ClassificationLanguage IdentificationNative Language IdentificationSpeech RecognitionSimilar Papers 제목 키워드 기반
Novel Category Discovery with X-Agent Attention for Open-Vocabulary Semantic Segmentation
Open-vocabulary semantic segmentation (OVSS) conducts pixel-level classification via text-driven alignment, where the domain discrepancy between base category training and open-vocabulary inference poses challenges in di…
Semantic SegmentationLearning Discriminative Latent Attributes for Zero-Shot Classification
Zero-shot learning (ZSL) aims to transfer knowledge from observed classes to the unseen classes, based on the assumption that both the seen and unseen classes share a common semantic space, among which attributes enjoy a…
AttributeClassificationDictionary LearningGeneral Classification+2Masked Latent Semantic Modeling: an Efficient Pre-training Alternative to Masked Language Modeling
In this paper, we propose an alternative to the classic masked language modeling (MLM) pre-training paradigm, where the objective is altered from the reconstruction of the exact identity of randomly selected masked subwo…
Language ModelingLanguage ModellingMasked Language ModelingLatent Embedding Feedback and Discriminative Features for Zero-Shot Classification
Zero-shot learning strives to classify unseen categories for which no data is available during training. In the generalized variant, the test samples can further belong to seen or unseen categories. The state-of-the-art …
Action ClassificationClassificationDecoderGeneral Classification+3Noise Diffusion for Enhancing Semantic Faithfulness in Text-to-Image Synthesis
Diffusion models have achieved impressive success in generating photorealistic images, but challenges remain in ensuring precise semantic alignment with input prompts. Optimizing the initial noisy latent offers a more ef…
Image GenerationPrompt Engineering