paper-with-me

홈 › Papers

Scones: Towards Conversational Authoring of Sketches

2020-05-12 · Forrest Huang, Eldon Schoop, David Ha, John Canny

Iteratively refining and critiquing sketches are crucial steps to developing effective designs. We introduce Scones, a mixed-initiative, machine-learning-driven system that enables users to iteratively author sketches from text instructions. Scones is a novel deep-learning-based system that iteratively generates scenes of sketched objects composed with semantic specifications from natural language. Scones exceeds state-of-the-art performance on a text-based scene modification task, and introduces a mask-conditioned sketching model that can generate sketches with poses specified by high-level scene information. In an exploratory user evaluation of Scones, participants reported enjoying an iterative drawing task with Scones, and suggested additional features for further applications. We believe Scones is an early step towards automated, intelligent systems that support human-in-the-loop applications for communicating ideas through sketching in art and design.

📄 PDF Abstract BibTeX arXiv:2005.07781

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Sketch-based Creativity Support Tools using Deep Learning

2021-11-19 · Forrest Huang, Eldon Schoop, David Ha, Jeffrey Nichols 외

Sketching is a natural and effective visual communication medium commonly used in creative processes. Recent developments in deep-learning models drastically improved machines' ability in understanding and generating vis…

Deep LearningRetrieval

Jam or Cream First? Modeling Ambiguity in Neural Machine Translation with SCONES

2022-05-02 · NAACL 2022 7 · Felix Stahlberg, Shankar Kumar

The softmax layer in neural machine translation is designed to model the distribution over mutually exclusive tokens. Machine translation, however, is intrinsically uncertain: the same source sentence can have multiple s…

Machine TranslationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONNMT+2

Efficient network-guided multi-locus association mapping with graph cuts

2012-11-10 · Chloé-Agathe Azencott, Dominik Grimm, Mahito Sugiyama, Yoshinobu Kawahara 외

As an increasing number of genome-wide association studies reveal the limitations of attempting to explain phenotypic heritability by single genetic loci, there is growing interest for associating complex phenotypes with…

Exploring Multimodal Prompt for Visualization Authoring with Large Language Models

2025-04-18 · Zhen Wen, Luoxuan Weng, Yinghao Tang, Runjin Zhang 외

Recent advances in large language models (LLMs) have shown great potential in automating the process of visualization authoring through simple natural language utterances. However, instructing LLMs using natural language…

Agentic Authoring of Interactive Multiview Visualizations in Genomics

2026-05-29 · Astrid van den Brandt, Kiroong Choe, Sehi L'Yi, Devin Lange 외 arxiv

Diverse genomics data, scientific questions, and analysis tasks typically demand highly specialized visualizations. Therefore, users often must customize or author new ones tailored to their data. Existing tools are usua…