pix2code: Generating Code from a Graphical User Interface Screenshot
Transforming a graphical user interface screenshot created by a designer into computer code is a typical task conducted by a developer in order to build customized software, websites, and mobile applications. In this paper, we show that deep learning methods can be leveraged to train a model end-to-end to automatically generate code from a single input image with over 77% of accuracy for three different platforms (i.e. iOS, Android and web-based technologies).
Code (11)
Tasks
Class-level Code GenerationCode GenerationSimilar Papers 제목 키워드 기반
Automatically Generating Codes from Graphical Screenshots Based on Deep Autocoder
During software front-end development, the work to convert Graphical User Interface(GUI) image to the corresponding front-end code is an inevitable tedious work. There have been some attempts to make this work to be auto…
Benchpress: A Scalable and Versatile Workflow for Benchmarking Structure Learning Algorithms
Describing the relationship between the variables in a study domain and modelling the data generating mechanism is a fundamental problem in many empirical sciences. Probabilistic graphical models are one common approach …
BenchmarkingCoding with Eyes: Visual Feedback Unlocks Reliable GUI Code Generating and Debugging
Recent advances in Large Language Model (LLM)-based agents have shown remarkable progress in code generation. However, current agent methods mainly rely on text-output-based feedback (e.g. command-line outputs) for multi…
Code GenerationChampuru 2: Improved scoring of alignments and a user-friendly graphical interface
Champuru is a web software tool that helps determine the two sequences present in mixed Sanger chromatograms obtained by sequencing simultaneously two DNA templates of unequal lengths. A previous version (Champuru 1.0) w…
EEGLow-code LLM: Graphical User Interface over Large Language Models
Utilizing Large Language Models (LLMs) for complex tasks is challenging, often involving a time-consuming and uncontrollable prompt engineering process. This paper introduces a novel human-LLM interaction framework, Low-…
Prompt Engineering