A Baseline for the Commands For Autonomous Vehicles Challenge
The Commands For Autonomous Vehicles (C4AV) challenge requires participants to solve an object referral task in a real-world setting. More specifically, we consider a scenario where a passenger can pass free-form natural language commands to a self-driving car. This problem is particularly challenging, as the language is much less constrained compared to existing benchmarks, and object references are often implicit. The challenge is based on the recent \texttt{Talk2Car} dataset. This document provides a technical overview of a model that we released to help participants get started in the competition. The code can be found at https://github.com/talk2car/Talk2Car.
Code (1)
Tasks
Autonomous VehiclesObjectSimilar Papers 제목 키워드 기반
Commands 4 Autonomous Vehicles (C4AV) Workshop Summary
The task of visual grounding requires locating the most relevant region or object in an image, given a natural language query. So far, progress on this task was mostly measured on curated datasets, which are not always r…
Autonomous VehiclesReferring Expression ComprehensionVisual GroundingLongitudinal Control for Autonomous Racing with Combustion Engine Vehicles
Usually, a controller for path- or trajectory tracking is employed in autonomous driving. Typically, these controllers generate high-level commands like longitudinal acceleration or force. However, vehicles with combusti…
Autonomous DrivingAutonomous RacingAutonomous Circular Drift Control for 4WD-4WS Vehicles Without Precomputed Drifting Equilibrium
Under extreme conditions, autonomous drifting enables vehicles to follow predefined paths at large slip angles, significantly enhancing the control system's capability to handle hazardous scenarios. Four-wheel-drive and …
Grounding Linguistic Commands to Navigable Regions
Humans have a natural ability to effortlessly comprehend linguistic commands such as "park next to the yellow sedan" and instinctively know which region of the road the vehicle should navigate. Extending this ability to …
Autonomous VehiclesImage SegmentationNavigateSemantic SegmentationConversational Intent Understanding for Passengers in Autonomous Vehicles
Understanding passenger intents and extracting relevant slots are important building blocks towards developing a contextual dialogue system responsible for handling certain vehicle-passenger interactions in autonomous ve…
Autonomous VehiclesIntent Recognition