Happy Are Those Who Grade without Seeing: A Multi-Task Learning Approach to Grade Essays Using Gaze Behaviour
The gaze behaviour of a reader is helpful in solving several NLP tasks such as automatic essay grading. However, collecting gaze behaviour from readers is costly in terms of time and money. In this paper, we propose a way to improve automatic essay grading using gaze behaviour, which is learnt at run time using a multi-task learning framework. To demonstrate the efficacy of this multi-task learning based approach to automatic essay grading, we collect gaze behaviour for 48 essays across 4 essay sets, and learn gaze behaviour for the rest of the essays, numbering over 7000 essays. Using the learnt gaze behaviour, we can achieve a statistically significant improvement in performance over the state-of-the-art system for the essay sets where we have gaze data. We also achieve a statistically significant improvement for 4 other essay sets, numbering about 6000 essays, where we have no gaze behaviour data available. Our approach establishes that learning gaze behaviour improves automatic essay grading.
Code (1)
Tasks
Multi-Task LearningNamed Entity Recognition (NER)Sarcasm DetectionSimilar Papers 제목 키워드 기반
Happy Together: Learning and Understanding Appraisal From Natural Language
In this paper, we explore various approaches for learning two types of appraisal components from happy language. We focus on 'agency' of the author and the 'sociality' involved in happy moments based on the HappyDB datas…
Machine TranslationTranslationMHPL: Minimum Happy Points Learning for Active Source Free Domain Adaptation
Source free domain adaptation (SFDA) aims to transfer a trained source model to the unlabeled target domain without accessing the source data. However, the SFDA setting faces a performance bottleneck due to the absen…
Active LearningDomain AdaptationSource-Free Domain AdaptationBatMobility: Towards Flying Without Seeing for Autonomous Drones
Unmanned aerial vehicles (UAVs) rely on optical sensors such as cameras and lidar for autonomous operation. However, such optical sensors are error-prone in bad lighting, inclement weather conditions including fog and sm…
Collision AvoidanceOptical Flow EstimationA Review of Different Word Embeddings for Sentiment Classification using Deep Learning
The web is loaded with textual content, and Natural Language Processing is a standout amongst the most vital fields in Machine Learning. But when data is huge simple Machine Learning algorithms are not able to handle it …
BIG-bench Machine LearningGeneral ClassificationSentiment AnalysisSentiment Classification+1HappyDB: A Corpus of 100,000 Crowdsourced Happy Moments
The science of happiness is an area of positive psychology concerned with understanding what behaviors make people happy in a sustainable fashion. Recently, there has been interest in developing technologies that help in…
Art Analysis