paper-with-me

홈 › Papers

Adaptive User-Centered Multimodal Interaction towards Reliable and Trusted Automotive Interfaces

2022-11-07 · Amr Gomaa

With the recently increasing capabilities of modern vehicles, novel approaches for interaction emerged that go beyond traditional touch-based and voice command approaches. Therefore, hand gestures, head pose, eye gaze, and speech have been extensively investigated in automotive applications for object selection and referencing. Despite these significant advances, existing approaches mostly employ a one-model-fits-all approach unsuitable for varying user behavior and individual differences. Moreover, current referencing approaches either consider these modalities separately or focus on a stationary situation, whereas the situation in a moving vehicle is highly dynamic and subject to safety-critical constraints. In this paper, I propose a research plan for a user-centered adaptive multimodal fusion approach for referencing external objects from a moving vehicle. The proposed plan aims to provide an open-source framework for user-centered adaptation and personalization using user observations and heuristics, multimodal fusion, clustering, transfer-of-learning for model adaptation, and continuous learning, moving towards trusted human-centered artificial intelligence.

📄 PDF Abstract BibTeX arXiv:2211.03539

Code (0)

등록된 구현이 없습니다.

Tasks

multimodal interaction

Similar Papers 제목 키워드 기반

Avenir-Web: Human-Experience-Imitating Multimodal Web Agents with Mixture of Grounding Experts

2026-02-02 · Aiden Yiliu Li, Xinyue Hao, Shilong Liu, Mengdi Wang arxiv

Despite advances in multimodal large language models, autonomous web agents still struggle to reliably execute long-horizon tasks on complex and dynamic web interfaces. Existing agents often suffer from inaccurate elemen…

LifeEval: A Multimodal Benchmark for Assistive AI in Egocentric Daily Life Tasks

2026-02-28 · Hengjian Gao, Kaiwei Zhang, Shibo Wang, Mingjie Chen 외 arxiv

The rapid progress of Multimodal Large Language Models (MLLMs) marks a significant step toward artificial general intelligence, offering great potential for augmenting human capabilities. However, their ability to provid…

PISHYAR: A Socially Intelligent Smart Cane for Indoor Social Navigation and Multimodal Human-Robot Interaction for Visually Impaired People

2026-02-13 · Mahdi Haghighat Joo, Maryam Karimi Jafari, Alireza Taheri arxiv

This paper presents PISHYAR, a socially intelligent smart cane designed by our group to combine socially aware navigation with multimodal human-AI interaction to support both physical mobility and interactive assistance.…

Group Activity RecognitionObject LocalizationSpeech RecognitionObject Detection

Dynamic Fusion Strategies for Federated Multimodal Recommendations

2024-10-11 · Zhiwei Li, Guodong Long, Jing Jiang, Chengqi Zhang

Delivering deeply personalized recommendations necessitates understanding user interactions with diverse multimedia features, but achieving this within the constraints of Federated Recommendation Systems (FedRec) is seve…

Multimodal RecommendationPrivacy PreservingRecommendation Systems

HoverAI: An Embodied Aerial Agent for Natural Human-Drone Interaction

2026-01-20 · Yuhua Jin, Nikita Kuzmin, Georgii Demianchuk, Mariya Lezina 외 arxiv

Drones operating in human-occupied spaces suffer from insufficient communication mechanisms that create uncertainty about their intentions. We present HoverAI, an embodied aerial agent that integrates drone mobility, inf…

Intent Classification