Auxiliary Objectives for Neural Error Detection Models
We investigate the utility of different auxiliary objectives and training strategies within a neural sequence labeling approach to error detection in learner writing. Auxiliary costs provide the model with additional linguistic information, allowing it to learn general-purpose compositional features that can then be exploited for other objectives. Our experiments show that a joint learning approach trained with parallel labels on in-domain data improves performance over the previous best error detection system. While the resulting model has the same number of parameters, the additional objectives allow it to be optimised more efficiently and achieve better performance.
Code (0)
등록된 구현이 없습니다.
Tasks
Grammatical Error DetectionSimilar Papers 제목 키워드 기반
Factorized Latent Dynamics for Video JEPA: An Empirical Study of Auxiliary Objectives
Joint-Embedding Predictive Architectures (JEPA) are a promising framework for self-supervised video representation learning, yet the behavior of auxiliary objectives in small-scale Video-JEPA training is not well charact…
Representation LearningGrammatical error detection in transcriptions of spoken English
We describe the collection of transcription corrections and grammatical error annotations for the CrowdED Corpus of spoken English monologues on business topics. The corpus recordings were crowdsourced from native speake…
Grammatical Error CorrectionGrammatical Error DetectionAuxiliary Sequence Labeling Tasks for Disfluency Detection
Detecting disfluencies in spontaneous speech is an important preprocessing step in natural language processing and speech recognition applications. Existing works for disfluency detection have focused on designing a sing…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER+3AANG: Automating Auxiliary Learning
Auxiliary objectives, supplementary learning signals that are introduced to help aid learning on data-starved or highly complex end-tasks, are commonplace in machine learning. Whilst much work has been done to formulate …
Auxiliary LearningMitigate Domain Shift by Primary-Auxiliary Objectives Association for Generalizing Person ReID
While deep learning has significantly improved ReID model accuracy under the independent and identical distribution (IID) assumption, it has also become clear that such models degrade notably when applied to an unseen no…
Auxiliary LearningDomain GeneralizationSaliency DetectionUnsupervised Domain Adaptation