Multiple Instance Learning for Content Feedback Localization without Annotation
Automated Essay Scoring (AES) can be used to automatically generate holistic scores with reliability comparable to human scoring. In addition, AES systems can provide formative feedback to learners, typically at the essay level. In contrast, we are interested in providing feedback specialized to the content of the essay, and specifically for the content areas required by the rubric. A key objective is that the feedback should be localized alongside the relevant essay text. An important step in this process is determining where in the essay the rubric designated points and topics are discussed. A natural approach to this task is to train a classifier using manually annotated data; however, collecting such data is extremely resource intensive. Instead, we propose a method to predict these annotation spans without requiring any labeled annotation data. Our approach is to consider AES as a Multiple Instance Learning (MIL) task. We show that such models can both predict content scores and localize content by leveraging their sentence-level score predictions. This capability arises despite never having access to annotation training data. Implications are discussed for improving formative feedback and explainable AES models.
Code (0)
등록된 구현이 없습니다.
Tasks
Automated Essay ScoringMultiple Instance LearningSentenceSimilar Papers 제목 키워드 기반
SLV: Spatial Likelihood Voting for Weakly Supervised Object Detection
Based on the framework of multiple instance learning (MIL), tremendous works have promoted the advances of weakly supervised object detection (WSOD). However, most MIL-based methods tend to localize instances to their di…
General ClassificationMultiple Instance LearningMulti-Task LearningObject+3Weakly Supervised Object Localization with Multi-fold Multiple Instance Learning
Object category localization is a challenging problem in computer vision. Standard supervised training requires bounding box annotations of object instances. This time-consuming annotation process is sidestepped in weakl…
Multiple Instance LearningObjectObject LocalizationWeakly-supervised Learning+1Breast Cancer Histopathology Image Classification and Localization using Multiple Instance Learning
Breast cancer has the highest mortality among cancers in women. Computer-aided pathology to analyze microscopic histopathology images for diagnosis with an increasing number of breast cancer patients can bring the cost a…
ClassificationGeneral Classificationimage-classificationImage Classification+1Temporal Action Localization in Untrimmed Videos via Multi-stage CNNs
We address temporal action localization in untrimmed long videos. This is important because videos in real applications are usually unconstrained and contain multiple action instances plus video content of background sce…
Action ClassificationAction LocalizationClassificationGeneral Classification+2A Multiclass Multiple Instance Learning Method with Exact Likelihood
We study a multiclass multiple instance learning (MIL) problem where the labels only suggest whether any instance of a class exists or does not exist in a training sample or example. No further information, e.g., the num…
General ClassificationMultiple Instance Learningobject-detectionObject Detection