Guided K-best Selection for Semantic Parsing Annotation
Collecting data for conversational semantic parsing is a time-consuming and demanding process. In this paper we consider, given an incomplete dataset with only a small amount of data, how to build an AI-powered human-in-the-loop process to enable efficient data collection. A guided K-best selection process is proposed, which (i) generates a set of possible valid candidates; (ii) allows users to quickly traverse the set and filter incorrect parses; and (iii) asks users to select the correct parse, with minimal modification when necessary. We investigate how to best support users in efficiently traversing the candidate set and locating the correct parse, in terms of speed and accuracy. In our user study, consisting of five annotators labeling 300 instances each, we find that combining keyword searching, where keywords can be used to query relevant candidates, and keyword suggestion, where representative keywords are automatically generated, enables fast and accurate annotation.
Code (0)
등록된 구현이 없습니다.
Tasks
Semantic ParsingvalidSimilar Papers 제목 키워드 기반
Accurate SHRG-Based Semantic Parsing
We demonstrate that an SHRG-based parser can produce semantic graphs much more accurately than previously shown, by relating synchronous production rules to the syntacto-semantic composition process. Our parser achieves …
Semantic CompositionSemantic ParsingHuman Co-Parsing Guided Alignment for Occluded Person Re-identification
Occluded person re-identification (ReID) is a challenging task due to more background noises and incomplete foreground information. Although existing human parsing-based ReID methods can tackle this problem with semantic…
Human ParsingOccluded Person Re-IdentificationPerson Re-IdentificationA High-Efficiency Framework for Constructing Large-Scale Face Parsing Benchmark
Face parsing, which is to assign a semantic label to each pixel in face images, has recently attracted increasing interest due to its huge application potentials. Although many face related fields (e.g., face recognition…
Face AlignmentFace DetectionFace ParsingFace Recognition+1Pose-Guided Human Parsing with Deep Learned Features
Parsing human body into semantic regions is crucial to human-centric analysis. In this paper, we propose a segment-based parsing pipeline that explores human pose information, i.e. the joint location of a human model, wh…
Human ParsingLarge-scale Semantic Parsing without Question-Answer Pairs
In this paper we introduce a novel semantic parsing approach to query Freebase in natural language without requiring manual annotations or question-answer pairs. Our key insight is to represent natural language via seman…
Graph MatchingSemantic Parsing