Fine-Grained VR Sketching: Dataset and Insights
We present the first fine-grained dataset of 1,497 3D VR sketch and 3D shape pairs of a chair category with large shapes diversity. Our dataset supports the recent trend in the sketch community on fine-grained data analysis, and extends it to an actively developing 3D domain. We argue for the most convenient sketching scenario where the sketch consists of sparse lines and does not require any sketching skills, prior training or time-consuming accurate drawing. We then, for the first time, study the scenario of fine-grained 3D VR sketch to 3D shape retrieval, as a novel VR sketching application and a proving ground to drive out generic insights to inform future research. By experimenting with carefully selected combinations of design factors on this new problem, we draw important conclusions to help follow-on work. We hope our dataset will enable other novel applications, especially those that require a fine-grained angle such as fine-grained 3D shape reconstruction. The dataset is available at tinyurl.com/VRSketch3DV21.
Code (1)
Tasks
3D Shape Reconstruction3D Shape RetrievalDiversityRetrievalSimilar Papers 제목 키워드 기반
RNN-based Generative Model for Fine-Grained Sketching
Deep generative models have shown great promise when it comes to synthesising novel images. While they can generate images that look convincing on a higher-level, generating fine-grained details is still a challenge. In …
Active Learning for Fine-Grained Sketch-Based Image Retrieval
The ability to retrieve a photo by mere free-hand sketching highlights the immense potential of Fine-grained sketch-based image retrieval (FG-SBIR). However, its rapid practical adoption, as well as scalability, is limit…
Active LearningImage RetrievalRetrievalSketch-Based Image RetrievalTowards Practicality of Sketch-Based Visual Understanding
Sketches have been used to conceptualise and depict visual objects from pre-historic times. Sketch research has flourished in the past decade, particularly with the proliferation of touchscreen devices. Much of the utili…
Image GenerationImage RetrievalRetrievalEffective sketching methods for value function approximation
High-dimensional representations, such as radial basis function networks or tile coding, are common choices for policy evaluation in reinforcement learning. Learning with such high-dimensional representations, however, c…
Reinforcement LearningReinforcement Learning (RL)FS-COCO: Towards Understanding of Freehand Sketches of Common Objects in Context
We advance sketch research to scenes with the first dataset of freehand scene sketches, FS-COCO. With practical applications in mind, we collect sketches that convey scene content well but can be sketched within a few mi…
DecoderImage CaptioningImage RetrievalMeta-Learning+1