paper-with-me

홈 › Papers

Sketch2code: Generating a website from a paper mockup

2019-05-09 · Alex Robinson

An early stage of developing user-facing applications is creating a wireframe to layout the interface. Once a wireframe has been created it is given to a developer to implement in code. Developing boiler plate user interface code is time consuming work but still requires an experienced developer. In this dissertation we present two approaches which automates this process, one using classical computer vision techniques, and another using a novel application of deep semantic segmentation networks. We release a dataset of websites which can be used to train and evaluate these approaches. Further, we have designed a novel evaluation framework which allows empirical evaluation by creating synthetic sketches. Our evaluation illustrates that our deep learning approach outperforms our classical computer vision approach and we conclude that deep learning is the most promising direction for future research.

📄 PDF Abstract BibTeX arXiv:1905.13750

Code (0)

등록된 구현이 없습니다.

Tasks

Code GenerationDeep LearningSemantic Segmentation

Similar Papers 제목 키워드 기반

Evaluation of Sketch-Based and Semantic-Based Modalities for Mockup Generation

2023-03-22 · Tommaso Calò, Luigi De Russis

Design mockups are essential instruments for visualizing and testing design ideas. However, the process of generating mockups can be time-consuming and challenging for designers. In this article, we present and evaluate …

Sketch2FullStack: Generating Skeleton Code of Full Stack Website and Application from Sketch using Deep Learning and Computer Vision

2022-11-26 · Somoy Subandhu Barua, Imam Mohammad Zulkarnain, Abhishek Roy, Md. Golam Rabiul Alam 외

For a full-stack web or app development, it requires a software firm or more specifically a team of experienced developers to contribute a large portion of their time and resources to design the website and then convert …

WebMMU: A Benchmark for Multimodal Multilingual Website Understanding and Code Generation

2025-08-22 · Rabiul Awal, Mahsa Massoud, Aarash Feizi, Zichao Li 외 arxiv

We present WebMMU, a multilingual benchmark that evaluates three core web tasks: (1) website visual question answering, (2) code editing involving HTML/CSS/JavaScript, and (3) mockup-to-code generation. Unlike prior benc…

Visual Question AnsweringInformation ExtractionCode Generation

Automatic code generation from low fidelity graphical user interface sketches using deep learning

2022-11-28 · 2022 International Conference on Information and Communication Technology for Development for Africa (ICT4DA) 2022 11 · Biniam Behailu Adefris; Ayalew Belay Habtie; Yesuneh Getachew Taye

In software development, the user interface(UI) design process involves the part from an imagination that begins on a piece of paper where designers share thoughts to the final prototype that is ready to implement. UI de…

Code Generation

Order Matters: 3D Shape Generation from Sequential VR Sketches

2025-12-04 · Yizi Chen, Sidi Wu, Tianyi Xiao, Nina Wiedemann 외 arxiv

VR sketching lets users explore and iterate on ideas directly in 3D, offering a faster and more intuitive alternative to conventional CAD tools. However, existing sketch-to-shape models ignore the temporal ordering of st…