A Robust Real-Time Computing-based Environment Sensing System for Intelligent Vehicle
For intelligent vehicles, sensing the 3D environment is the first but crucial step. In this paper, we build a real-time advanced driver assistance system based on a low-power mobile platform. The system is a real-time multi-scheme integrated innovation system, which combines stereo matching algorithm with machine learning based obstacle detection approach and takes advantage of the distributed computing technology of a mobile platform with GPU and CPUs. First of all, a multi-scale fast MPV (Multi-Path-Viterbi) stereo matching algorithm is proposed, which can generate robust and accurate disparity map. Then a machine learning, which is based on fusion technology of monocular and binocular, is applied to detect the obstacles. We also advance an automatic fast calibration mechanism based on Zhang's calibration method. Finally, the distributed computing and reasonable data flow programming are applied to ensure the operational efficiency of the system. The experimental results show that the system can achieve robust and accurate real-time environment perception for intelligent vehicles, which can be directly used in the commercial real-time intelligent driving applications.
Code (0)
등록된 구현이 없습니다.
Tasks
BIG-bench Machine LearningDistributed ComputingGPUStereo MatchingSimilar Papers 제목 키워드 기반
Intelligent Sensing-to-Action for Robust Autonomy at the Edge: Opportunities and Challenges
Autonomous edge computing in robotics, smart cities, and autonomous vehicles relies on the seamless integration of sensing, processing, and actuation for real-time decision-making in dynamic environments. At its core is …
Autonomous VehiclesEdge-computingIoV-Oriented Integrated Sensing, Computation, and Communication: System Design and Resource Allocation
—In future mobile communication systems, the deep integration of communication, sensing, and computation has become a new trend. This article paper designs an integrated sensing, computation, and communication (ISCC) sy…
Deep Reinforcement LearningEdge-computingIntegrated sensing and communicationISACIntegrating Communication, Sensing and Computing in Satellite Internet of Things: Challenges and Opportunities
Satellite Internet of Things (IoT) is to use satellites as the access points for IoT devices to achieve the global coverage of future IoT systems, and is expected to support burgeoning IoT applications, including communi…
In-Air Imaging Sonar Sensor Network with Real-Time Processing Using GPUs
For autonomous navigation and robotic applications, sensing the environment correctly is crucial. Many sensing modalities for this purpose exist. In recent years, one such modality that is being used is in-air imaging so…
Autonomous NavigationSAWEC: Sensing-Assisted Wireless Edge Computing
Emerging mobile virtual reality (VR) systems will require to continuously perform complex computer vision tasks on ultra-high-resolution video frames through the execution of deep neural networks (DNNs)-based algorithms.…
BenchmarkingEdge-computingInstance Segmentationobject-detection+2