paper-with-me

Papers

User-driven Intelligent Interface on the Basis of Multimodal Augmented Reality and Brain-Computer Interaction for People with Functional Disabilities

2017-04-12 · S. Stirenko, Yu. Gordienko, T. Shemsedinov, O. Alienin, Yu. Kochura, N. Gordienko, A. Rojbi, J. R. López Benito, E. Artetxe González

The analysis of the current integration attempts of some modes and use cases of user-machine interaction is presented. The new concept of the user-driven intelligent interface is proposed on the basis of multimodal augmented reality and brain-computer interaction for various applications: in disabilities studies, education, home care, health care, etc. The several use cases of multimodal augmentation are presented. The perspectives of the better human comprehension by the immediate feedback through neurophysical channels by means of brain-computer interaction are outlined. It is shown that brain-computer interface (BCI) technology provides new strategies to overcome limits of the currently available user interfaces, especially for people with functional disabilities. The results of the previous studies of the low end consumer and open-source BCI-devices allow us to conclude that combination of machine learning (ML), multimodal interactions (visual, sound, tactile) with BCI will profit from the immediate feedback from the actual neurophysical reactions classified by ML methods. In general, BCI in combination with other modes of AR interaction can deliver much more information than these types of interaction themselves. Even in the current state the combined AR-BCI interfaces could provide the highly adaptable and personal services, especially for people with functional disabilities.

📄 PDF Abstract BibTeX arXiv:1704.05915

Code (0)

등록된 구현이 없습니다.

Tasks

Brain Computer Interface

Similar Papers 제목 키워드 기반

MIRIAM: A Multimodal Chat-Based Interface for Autonomous Systems

2018-03-06 · Helen Hastie, Francisco J. Chiyah Garcia, David A. Robb, Pedro Patron 외

We present MIRIAM (Multimodal Intelligent inteRactIon for Autonomous systeMs), a multimodal interface to support situation awareness of autonomous vehicles through chat-based interaction. The user is able to chat about t…

Autonomous Vehicles

An Adaptive System Architecture for Multimodal Intelligent Transportation Systems

2024-02-13 · Muhammad Farooq, Nima Afraz, Fatemeh Golpayegani

Multimodal intelligent transportation systems (M-ITS) encompass a range of transportation services that utilise various modes of transport and incorporate intelligent technologies for enhanced efficiency and user experie…

Data IntegrationDecision Making

Generative AI in Multimodal User Interfaces: Trends, Challenges, and Cross-Platform Adaptability

2024-11-15 · J. Bieniek, M. Rahouti, D. C. Verma

As the boundaries of human computer interaction expand, Generative AI emerges as a key driver in reshaping user interfaces, introducing new possibilities for personalized, multimodal and cross-platform interactions. This…

multimodal interaction

Widget Captioning: Generating Natural Language Description for Mobile User Interface Elements

2020-10-08 · EMNLP 2020 11 · Yang Li, Gang Li, Luheng He, Jingjie Zheng 외

Natural language descriptions of user interface (UI) elements such as alternative text are crucial for accessibility and language-based interaction in general. Yet, these descriptions are constantly missing in mobile UIs…

How to Address Smart Homes with a Social Robot? A Multi-modal Corpus of User Interactions with an Intelligent Environment

2016-05-01 · LREC 2016 5 · Patrick Holthaus, Christian Leichsenring, Jasmin Bernotat, Viktor Richter 외

In order to explore intuitive verbal and non-verbal interfaces in smart environments we recorded user interactions with an intelligent apartment. Besides offering various interactive capabilities itself, the apartment is…