paper-with-me

홈 › Papers

Prompt-to-OS (P2OS): Revolutionizing Operating Systems and Human-Computer Interaction with Integrated AI Generative Models

2023-10-07 · Gabriele Tolomei, Cesare Campagnano, Fabrizio Silvestri, Giovanni Trappolini

In this paper, we present a groundbreaking paradigm for human-computer interaction that revolutionizes the traditional notion of an operating system. Within this innovative framework, user requests issued to the machine are handled by an interconnected ecosystem of generative AI models that seamlessly integrate with or even replace traditional software applications. At the core of this paradigm shift are large generative models, such as language and diffusion models, which serve as the central interface between users and computers. This pioneering approach leverages the abilities of advanced language models, empowering users to engage in natural language conversations with their computing devices. Users can articulate their intentions, tasks, and inquiries directly to the system, eliminating the need for explicit commands or complex navigation. The language model comprehends and interprets the user's prompts, generating and displaying contextual and meaningful responses that facilitate seamless and intuitive interactions. This paradigm shift not only streamlines user interactions but also opens up new possibilities for personalized experiences. Generative models can adapt to individual preferences, learning from user input and continuously improving their understanding and response generation. Furthermore, it enables enhanced accessibility, as users can interact with the system using speech or text, accommodating diverse communication preferences. However, this visionary concept raises significant challenges, including privacy, security, trustability, and the ethical use of generative models. Robust safeguards must be in place to protect user data and prevent potential misuse or manipulation of the language model. While the full realization of this paradigm is still far from being achieved, this paper serves as a starting point for envisioning this transformative potential.

📄 PDF Abstract BibTeX arXiv:2310.04875

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModelingLanguage ModellingResponse Generation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Object Recognition in Human Computer Interaction:- A Comparative Analysis

2024-11-06 · Kaushik Ranade, Tanmay Khule, Riddhi More

Human-computer interaction (HCI) has been a widely researched area for many years, with continuous advancements in technology leading to the development of new techniques that change the way we interact with computers. W…

Gesture RecognitionObject Recognition

OmegaUse: Building a General-Purpose GUI Agent for Autonomous Task Execution

2026-01-28 · Le Zhang, Yixiong Xiao, Xinjiang Lu, Jingjia Cao 외 arxiv

Graphical User Interface (GUI) agents show great potential for enabling foundation models to complete real-world tasks, revolutionizing human-computer interaction and improving human productivity. In this report, we pres…

Computational Efficiency

Active Vision for Deep Visual Learning: A Unified Pooling Framework

2022-10-10 · journal 2022 10 · Nan Guo、 Ke Gu、Junfei Qiao、Hantao Liu

Convolutional neural networks (CNNs) can be generally regarded as learning-based visual systems for computer vision tasks. By imitating the operating mechanism of the human visual system (HVS), CNNs can even achieve bett…

LUMOS: A Semantic Operating-System Layer for Accessibility-Grounded AI Agents

2026-06-29 · Yogeswar Reddy Thota hf

Current operating systems expose interfaces optimized for human users but not for AI agents. Humans benefit from pixels, icons, windows, visual grouping, mouse movement, and keyboard shortcuts; AI agents instead need com…

Conversational Norms for Human-Robot Dialogues

2021-03-02 · Maitreyee Tewari, Thomas Hellström, Suna Bensch

This paper describes a recently initiated research project aiming at supporting development of computerised dialogue systems that handle breaches of conversational norms such as the Gricean maxims, which describe how dia…