paper-with-me

홈 › Papers

Frontend Diffusion: Exploring Intent-Based User Interfaces through Abstract-to-Detailed Task Transitions

2024-07-16 · Qinshi Zhang, Latisha Besariani Hendra, Mohan Chi, Zijian Ding

The emergence of Generative AI is catalyzing a paradigm shift in user interfaces from command-based to intent-based outcome specification. In this paper, we explore abstract-to-detailed task transitions in the context of frontend code generation as a step towards intent-based user interfaces, aiming to bridge the gap between abstract user intentions and concrete implementations. We introduce Frontend Diffusion, an end-to-end LLM-powered tool that generates high-quality websites from user sketches. The system employs a three-stage task transition process: sketching, writing, and coding. We demonstrate the potential of task transitions to reduce human intervention and communication costs in complex tasks. Our work also opens avenues for exploring similar approaches in other domains, potentially extending to more complex, interdependent tasks such as video production.

📄 PDF Abstract BibTeX arXiv:2408.00778

Code (0)

등록된 구현이 없습니다.

Tasks

Code Generation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

ASP-driven User-interaction with Clinguin

2025-02-13 · Alexander Beiser, Susana Hahn, Torsten Schaub

We present clinguin, a system for ASP-driven user interface design. Clinguin streamlines the development of user interfaces for ASP developers by letting them build interactive prototypes directly in ASP, eliminating the…

Low-code from frontend to backend: Connecting conversational user interfaces to backend services via a low-code IoT platform

2024-09-13 · Irene Weber

Current chatbot development platforms and frameworks facilitate setting up the language and dialog part of chatbots, while connecting it to backend services and business functions requires substantial manual coding effor…

Chatbot

OdoViz: A 3D Odometry Visualization and Processing Tool

2021-07-15 · Saravanabalagi Ramachandran, John McDonald

OdoViz is a reactive web-based tool for 3D visualization and processing of autonomous vehicle datasets designed to support common tasks in visual place recognition research. The system includes functionality for loading,…

ManagementVisual Place Recognition

LiteWebAgent: The Open-Source Suite for VLM-Based Web-Agent Applications

2025-03-04 · Danqing Zhang, Balaji Rama, Jingyi Ni, Shiying He 외

We introduce LiteWebAgent, an open-source suite for VLM-based web agent applications. Our framework addresses a critical gap in the web agent ecosystem with a production-ready solution that combines minimal serverless ba…

Action Generation

Korp --- the corpus infrastructure of Spr\aakbanken

2012-05-01 · LREC 2012 5 · Lars Borin, Markus Forsberg, Johan Roxendal

We present Korp, the corpus infrastructure of Spr{\aa}kbanken (the Swedish Language Bank). The infrastructure consists of three main components: the Korp corpus pipeline, the Korp backend, and the Korp frontend. The Korp…

Lemmatization