Learning from Neighboring Strokes: Combining Appearance and Context for Multi-Domain Sketch Recognition
We propose a new sketch recognition framework that combines a rich representation of low level visual appearance with a graphical model for capturing high level relationships between symbols. This joint model of appearance and context allows our framework to be less sensitive to noise and drawing variations, improving accuracy and robustness. The result is a recognizer that is better able to handle the wide range of drawing styles found in messy freehand sketches. We evaluate our work on two real-world domains, molecular diagrams and electrical circuit diagrams, and show that our combined approach significantly improves recognition performance.
Code (0)
등록된 구현이 없습니다.
Tasks
Sketch RecognitionSimilar Papers 제목 키워드 기반
Neural 3D Strokes: Creating Stylized 3D Scenes with Vectorized 3D Strokes
We present Neural 3D Strokes, a novel technique to generate stylized images of a 3D scene at arbitrary novel views from multi-view 2D images. Different from existing methods which apply stylization to trained neural radi…
Deformation-Free Cross-Domain Image Registration via Position-Encoded Temporal Attention
We address the problem of cross-domain image registration, where paired images exhibit coupled geometric misalignment and domain-specific appearance shift. We formalize this as a factorization problem: decomposing each i…
Image RegistrationCoSE: Compositional Stroke Embeddings
We present a generative model for complex free-form structures such as stroke-based drawing tasks. While previous approaches rely on sequence-based models for drawings of basic objects or handwritten text, we propose a m…
Balancing Appearance and Context in Sketch Interpretation
We describe a sketch interpretation system that detects and classifies clock numerals created by subjects taking the Clock Drawing Test, a clinical tool widely used to screen for cognitive impairments (e.g., dementia). W…
SimAN: Exploring Self-Supervised Representation Learning of Scene Text via Similarity-Aware Normalization
Recently self-supervised representation learning has drawn considerable attention from the scene text recognition community. Different from previous studies using contrastive learning, we tackle the issue from an alterna…
Common Sense ReasoningContrastive LearningRepresentation LearningScene Text Recognition