paper-with-me

홈 › Papers

Responsible Task Automation: Empowering Large Language Models as Responsible Task Automators

2023-06-02 · Zhizheng Zhang, Xiaoyi Zhang, Wenxuan Xie, Yan Lu

The recent success of Large Language Models (LLMs) signifies an impressive stride towards artificial general intelligence. They have shown a promising prospect in automatically completing tasks upon user instructions, functioning as brain-like coordinators. The associated risks will be revealed as we delegate an increasing number of tasks to machines for automated completion. A big question emerges: how can we make machines behave responsibly when helping humans automate tasks as personal copilots? In this paper, we explore this question in depth from the perspectives of feasibility, completeness and security. In specific, we present Responsible Task Automation (ResponsibleTA) as a fundamental framework to facilitate responsible collaboration between LLM-based coordinators and executors for task automation with three empowered capabilities: 1) predicting the feasibility of the commands for executors; 2) verifying the completeness of executors; 3) enhancing the security (e.g., the protection of users' privacy). We further propose and compare two paradigms for implementing the first two capabilities. One is to leverage the generic knowledge of LLMs themselves via prompt engineering while the other is to adopt domain-specific learnable models. Moreover, we introduce a local memory mechanism for achieving the third capability. We evaluate our proposed ResponsibleTA on UI task automation and hope it could bring more attentions to ensuring LLMs more responsible in diverse scenarios.

📄 PDF Abstract BibTeX arXiv:2306.01242

Code (0)

등록된 구현이 없습니다.

Tasks

Prompt Engineering

Similar Papers 제목 키워드 기반

From Automation to Autonomy: A Survey on Large Language Models in Scientific Discovery

2025-05-19 · Tianshi Zheng, Zheye Deng, Hong Ting Tsang, Weiqi Wang 외

Large Language Models (LLMs) are catalyzing a paradigm shift in scientific discovery, evolving from task-specific automation tools into increasingly autonomous agents and fundamentally redefining research processes and h…

Navigatescientific discoverySurvey

Please Don't Kill My Vibe: Empowering Agents with Data Flow Control

2025-12-05 · Charlie Summers, Haneen Mohammed, Eugene Wu arxiv

The promise of Large Language Model (LLM) agents is to perform complex, stateful tasks. This promise is stunted by significant risks - policy violations, process corruption, and security flaws - that stem from the lack o…

TinyClick: Single-Turn Agent for Empowering GUI Automation

2024-10-09 · Pawel Pawlowski, Krystian Zawistowski, Wojciech Lapacz, Adam Wiacek 외

We present an UI agent for user interface (UI) interaction tasks, using Vision-Language Model Florence-2-Base. The agent's primary task is identifying the screen coordinates of the UI element corresponding to the user's …

Data AugmentationGPULanguage ModelingLanguage Modelling

DebugLM: Learning Traceable Training Data Provenance for LLMs

2026-03-18 · Wenjie Jacky Mo, Qin Liu, Xiaofei Wen, Wenxuan Zhou 외 arxiv

Large language models (LLMs) are trained through multi-stage pipelines over heterogeneous data sources, yet developers lack a principled way to pinpoint the specific data responsible for an observed behavior. This lack o…

Towards better healthcare: What could and should be automated?

2019-10-21 · Wolfgang Frühwirt, Paul Duckworth

While artificial intelligence (AI) and other automation technologies might lead to enormous progress in healthcare, they may also have undesired consequences for people working in the field. In this interdisciplinary stu…