Balancing Appearance and Context in Sketch Interpretation
We describe a sketch interpretation system that detects and classifies clock numerals created by subjects taking the Clock Drawing Test, a clinical tool widely used to screen for cognitive impairments (e.g., dementia). We describe how it balances appearance and context, and document its performance on some 2,000 drawings (about 24K clock numerals) produced by a wide spectrum of patients. We calibrate the utility of different forms of context, describing experiments with Conditional Random Fields trained and tested using a variety of features. We identify context that contributes to interpreting otherwise ambiguous or incomprehensible strokes. We describe ST-slices, a novel representation that enables "unpeeling" the layers of ink that result when people overwrite, which often produces ink impossible to analyze if only the final drawing is examined. We characterize when ST-slices work, calibrate their impact on performance, and consider their breadth of applicability.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
SketchSense: Learning to Interpret Imperfect Sketch Guidance for Image Inpainting
Sketch-guided image inpainting provides intuitive structural control, yet real sketches often mix reliable global intent with locally crowded, displaced, incomplete, or deliberately unconventional strokes. Existing appro…
Image InpaintingLearning from Neighboring Strokes: Combining Appearance and Context for Multi-Domain Sketch Recognition
We propose a new sketch recognition framework that combines a rich representation of low level visual appearance with a graphical model for capturing high level relationships between symbols. This joint model of appearan…
Sketch RecognitionSketchingReality: From Freehand Scene Sketches To Photorealistic Images
Recent years have witnessed remarkable progress in generative AI, with natural language emerging as the most common conditioning input. As underlying models grow more powerful, researchers are exploring increasingly dive…
Sketch2Human: Deep Human Generation with Disentangled Geometry and Appearance Control
Geometry- and appearance-controlled full-body human image generation is an interesting but challenging task. Existing solutions are either unconditional or dependent on coarse conditions (e.g., pose, text), thus lacking …
Face GenerationImage GenerationImage Generation from Sketch Constraint Using Contextual GAN
In this paper we investigate image generation guided by hand sketch. When the input sketch is badly drawn, the output of common image-to-image translation follows the input edges due to the hard condition imposed by the …
Image GenerationImage-to-Image TranslationTranslation