paper-with-me

Papers

Conversational Intent Understanding for Passengers in Autonomous Vehicles

2018-12-14 · Okur Eda, Kumar Shachi H, Sahay Saurav, Esme Asli Arslan, Nachman Lama

Understanding passenger intents and extracting relevant slots are important building blocks towards developing a contextual dialogue system responsible for handling certain vehicle-passenger interactions in autonomous vehicles (AV). When the passengers give instructions to AMIE (Automated-vehicle Multimodal In-cabin Experience), the agent should parse such commands properly and trigger the appropriate functionality of the AV system. In our AMIE scenarios, we describe usages and support various natural commands for interacting with the vehicle. We collected a multimodal in-cabin data-set with multi-turn dialogues between the passengers and AMIE using a Wizard-of-Oz scheme. We explored various recent Recurrent Neural Networks (RNN) based techniques and built our own hierarchical models to recognize passenger intents along with relevant slots associated with the action to be performed in AV scenarios. Our experimental results achieved F1-score of 0.91 on utterance-level intent recognition and 0.96 on slot extraction models.

📄 PDF Abstract BibTeX arXiv:1901.04899

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous VehiclesIntent Recognition

Similar Papers 제목 키워드 기반

Natural Language Interactions in Autonomous Vehicles: Intent Detection and Slot Filling from Passenger Utterances

2019-04-23 · Eda Okur, Shachi H. Kumar, Saurav Sahay, Asli Arslan Esme 외

Understanding passenger intents and extracting relevant slots are important building blocks towards developing contextual dialogue systems for natural interactions in autonomous vehicles (AV). In this work, we explored A…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Autonomous VehiclesIntent Detection+5

Towards Multimodal Understanding of Passenger-Vehicle Interactions in Autonomous Vehicles: Intent/Slot Recognition Utilizing Audio-Visual Data

2019-09-20 · Eda Okur, Shachi H. Kumar, Saurav Sahay, Lama Nachman

Understanding passenger intents from spoken interactions and car's vision (both inside and outside the vehicle) are important building blocks towards developing contextual dialog systems for natural interactions in auton…

Autonomous VehiclesIntent Detectionslot-fillingSlot Filling

Drive as You Speak: Enabling Human-Like Interaction with Large Language Models in Autonomous Vehicles

2023-09-19 · Can Cui, Yunsheng Ma, Xu Cao, Wenqian Ye 외

The future of autonomous vehicles lies in the convergence of human-centric design and advanced AI capabilities. Autonomous vehicles of the future will not only transport passengers but also interact and adapt to their de…

Autonomous DrivingAutonomous VehiclesDecision Making

What Do People Want to Know About Artificial Intelligence (AI)? The Importance of Answering End-User Questions to Explain Autonomous Vehicle (AV) Decisions

2025-05-09 · Somayeh Molaei, Lionel P. Robert, Nikola Banovic

Improving end-users' understanding of decisions made by autonomous vehicles (AVs) driven by artificial intelligence (AI) can improve utilization and acceptance of AVs. However, current explanation mechanisms primarily he…

Autonomous DrivingAutonomous Vehicles

Receive, Reason, and React: Drive as You Say with Large Language Models in Autonomous Vehicles

2023-10-12 · Can Cui, Yunsheng Ma, Xu Cao, Wenqian Ye 외

The fusion of human-centric design and artificial intelligence (AI) capabilities has opened up new possibilities for next-generation autonomous vehicles that go beyond transportation. These vehicles can dynamically inter…

Autonomous DrivingAutonomous VehiclesDecision Making