Doodle Your Keypoints: Sketch-Based Few-Shot Keypoint Detection
Keypoint detection, integral to modern machine perception, faces challenges in few-shot learning, particularly when source data from the same distribution as the query is unavailable. This gap is addressed by leveraging sketches, a popular form of human expression, providing a source-free alternative. However, challenges arise in mastering cross-modal embeddings and handling user-specific sketch styles. Our proposed framework overcomes these hurdles with a prototypical setup, combined with a grid-based locator and prototypical domain adaptation. We also demonstrate success in few-shot convergence across novel keypoints and classes through extensive experiments.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationFew-Shot LearningKeypoint DetectionSimilar Papers 제목 키워드 기반
Doodle It Yourself: Class Incremental Learning by Drawing a Few Sketches
The human visual system is remarkable in learning new visual concepts from just a few examples. This is precisely the goal behind few-shot class incremental learning (FSCIL), where the emphasis is additionally placed on …
class-incremental learningClass Incremental LearningFew-Shot Class-Incremental LearningGraph Attention+2Creative Sketch Generation
Sketching or doodling is a popular creative activity that people engage in. However, most existing work in automatic sketch understanding or generation has focused on sketches that are quite mundane. In this work, we int…
Generative Adversarial NetworkDoodleFormer: Creative Sketch Drawing with Transformers
Creative sketching or doodling is an expressive activity, where imaginative and previously unseen depictions of everyday visual objects are drawn. Creative sketch image generation is a challenging vision problem, where t…
DecoderImage GenerationPSDoodle: Searching for App Screens via Interactive Sketching
Keyword-based mobile screen search does not account for screen content and fails to operate as a universal tool for all levels of users. Visual searching (e.g., image, sketch) is structured and easy to adopt. Current vis…
Doodle Your 3D: From Abstract Freehand Sketches to Precise 3D Shapes
In this paper, we democratise 3D content creation, enabling precise generation of 3D shapes from abstract sketches while overcoming limitations tied to drawing skills. We introduce a novel part-level modelling and alignm…
DecoderPosition