paper-with-me

Papers

Low-code LLM: Graphical User Interface over Large Language Models

2023-04-17 · Yuzhe Cai, Shaoguang Mao, Wenshan Wu, Zehua Wang, Yaobo Liang, Tao Ge, Chenfei Wu, Wang You, Ting Song, Yan Xia, Jonathan Tien, Nan Duan, Furu Wei

Utilizing Large Language Models (LLMs) for complex tasks is challenging, often involving a time-consuming and uncontrollable prompt engineering process. This paper introduces a novel human-LLM interaction framework, Low-code LLM. It incorporates six types of simple low-code visual programming interactions to achieve more controllable and stable responses. Through visual interaction with a graphical user interface, users can incorporate their ideas into the process without writing trivial prompts. The proposed Low-code LLM framework consists of a Planning LLM that designs a structured planning workflow for complex tasks, which can be correspondingly edited and confirmed by users through low-code visual programming operations, and an Executing LLM that generates responses following the user-confirmed workflow. We highlight three advantages of the low-code LLM: user-friendly interaction, controllable generation, and wide applicability. We demonstrate its benefits using four typical applications. By introducing this framework, we aim to bridge the gap between humans and LLMs, enabling more effective and efficient utilization of LLMs for complex tasks. The code, prompts, and experimental details are available at https://github.com/moymix/TaskMatrix/tree/main/LowCodeLLM. A system demonstration video can be found at https://www.youtube.com/watch?v=jb2C1vaeO3E.

📄 PDF Abstract BibTeX arXiv:2304.08103

Code (2)

microsoft/visual-chatgpt/tree/main/LowCodeLLM 공식 구현
moymix/taskmatrix 공식 구현

Tasks

Prompt Engineering

Similar Papers 제목 키워드 기반

pix2code: Generating Code from a Graphical User Interface Screenshot

2017-05-22 · Tony Beltramelli

Transforming a graphical user interface screenshot created by a designer into computer code is a typical task conducted by a developer in order to build customized software, websites, and mobile applications. In this pap…

Class-level Code GenerationCode Generation

The Command Line GUIde: Graphical Interfaces from Man Pages via AI

2025-10-01 · Saketh Ram Kasibatla, Kiran Medleri Hiremath, Raven Rothkopf, Sorin Lerner 외 arxiv

Although birthed in the era of teletypes, the command line shell survived the graphical interface revolution of the 1980's and lives on in modern desktop operating systems. The command line provides access to powerful fu…

Champuru 2: Improved scoring of alignments and a user-friendly graphical interface

2024-05-09 · Yann Spöri, Jean-François Flot

Champuru is a web software tool that helps determine the two sequences present in mixed Sanger chromatograms obtained by sequencing simultaneously two DNA templates of unequal lengths. A previous version (Champuru 1.0) w…

EEG

Voice CMS: updating the knowledge base of a digital assistant through conversation

2025-05-28 · Grzegorz Wolny, Michał Szczerbak

In this study, we propose a solution based on a multi-agent LLM architecture and a voice user interface (VUI) designed to update the knowledge base of a digital assistant. Its usability is evaluated in comparison to a mo…

Management

Scaling Computer-Use Grounding via User Interface Decomposition and Synthesis

2025-05-19 · Tianbao Xie, Jiaqi Deng, Xiaochuan Li, Junlin Yang 외

Graphical user interface (GUI) grounding, the ability to map natural language instructions to specific actions on graphical user interfaces, remains a critical bottleneck in computer use agent development. Current benchm…

Text Matching