Multiagent Multitraversal Multimodal Self-Driving: Open MARS Dataset
Large-scale datasets have fueled recent advancements in AI-based autonomous vehicle research. However, these datasets are usually collected from a single vehicle's one-time pass of a certain location, lacking multiagent interactions or repeated traversals of the same place. Such information could lead to transformative enhancements in autonomous vehicles' perception, prediction, and planning capabilities. To bridge this gap, in collaboration with the self-driving company May Mobility, we present the MARS dataset which unifies scenarios that enable MultiAgent, multitraveRSal, and multimodal autonomous vehicle research. More specifically, MARS is collected with a fleet of autonomous vehicles driving within a certain geographical area. Each vehicle has its own route and different vehicles may appear at nearby locations. Each vehicle is equipped with a LiDAR and surround-view RGB cameras. We curate two subsets in MARS: one facilitates collaborative driving with multiple vehicles simultaneously present at the same location, and the other enables memory retrospection through asynchronous traversals of the same location by multiple vehicles. We conduct experiments in place recognition and neural reconstruction. More importantly, MARS introduces new research opportunities and challenges such as multitraversal 3D reconstruction, multiagent perception, and unsupervised object discovery. Our data and codes can be found at https://ai4ce.github.io/MARS/.
Code (0)
등록된 구현이 없습니다.
Tasks
3D ReconstructionAutonomous VehiclesObject DiscoverySimilar Papers 제목 키워드 기반
Scalable Multiagent Driving Policies For Reducing Traffic Congestion
Traffic congestion is a major challenge in modern urban settings. The industry-wide development of autonomous and automated vehicles (AVs) motivates the question of how can AVs contribute to congestion reduction. Past re…
Transfer LearningTransfer Reinforcement LearningR-MADDPG for Partially Observable Environments and Limited Communication
There are several real-world tasks that would benefit from applying multiagent reinforcement learning (MARL) algorithms, including the coordination among self-driving cars. The real world has challenging conditions for m…
reinforcement-learningReinforcement LearningReinforcement Learning (RL)Self-Driving CarsHolonic Multiagent Simulation of Complex Adaptive Systems
We propose a holonic multiagent simulator that can simulate any complex urban environment. We focus on traffic simulation within any geographic area on earth, subject to any weather conditions. We adopt an agent-based ap…
Diverse Auto-Curriculum is Critical for Successful Real-World Multiagent Learning Systems
Multiagent reinforcement learning (MARL) has achieved a remarkable amount of success in solving various types of video games. A cornerstone of this success is the auto-curriculum framework, which shapes the learning proc…
Autonomous DrivingDiversityActive Legibility in Multiagent Reinforcement Learning
A multiagent sequential decision problem has been seen in many critical applications including urban transportation, autonomous driving cars, military operations, etc. Its widely known solution, namely multiagent reinfor…
Autonomous Drivingreinforcement-learningReinforcement Learning