OCTraN: 3D Occupancy Convolutional Transformer Network in Unstructured Traffic Scenarios
Modern approaches for vision-centric environment perception for autonomous navigation make extensive use of self-supervised monocular depth estimation algorithms that output disparity maps. However, when this disparity map is projected onto 3D space, the errors in disparity are magnified, resulting in a depth estimation error that increases quadratically as the distance from the camera increases. Though Light Detection and Ranging (LiDAR) can solve this issue, it is expensive and not feasible for many applications. To address the challenge of accurate ranging with low-cost sensors, we propose, OCTraN, a transformer architecture that uses iterative-attention to convert 2D image features into 3D occupancy features and makes use of convolution and transpose convolution to efficiently operate on spatial information. We also develop a self-supervised training pipeline to generalize the model to any scene by eliminating the need for LiDAR ground truth by substituting it with pseudo-ground truth labels obtained from boosted monocular depth estimation.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous NavigationDepth EstimationMonocular Depth EstimationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
SOccDPT: Semi-Supervised 3D Semantic Occupancy from Dense Prediction Transformers trained under memory constraints
We present SOccDPT, a memory-efficient approach for 3D semantic occupancy prediction from monocular image input using dense prediction transformers. To address the limitations of existing methods trained on structured tr…
3D Semantic Occupancy PredictionDisparity Estimationgraph constructionSemantic SegmentationSTrajNet: Multi-modal Hierarchical Transformer for Occupancy Flow Field Prediction in Autonomous Driving
Forecasting the future states of surrounding traffic participants is a crucial capability for autonomous vehicles. The recently proposed occupancy flow field prediction introduces a scalable and effective representation …
Autonomous DrivingAutonomous VehiclesCUNI Systems in WMT21: Revisiting Backtranslation Techniques for English-Czech NMT
We describe our two NMT systems submitted to the WMT2021 shared task in English-Czech news translation: CUNI-DocTransformer (document-level CUBBITT) and CUNI-Marian-Baselines. We improve the former with a better sentence…
NMTSegmentationSentenceSentence segmentation+1Advanced Language Model-based Translator for English-Vietnamese Translation
We introduce a transformative approach to English-Vietnamese translation, leveraging the cutting edge capabilities of the Gemma-7B-IT (Gemma Team et al. 2024) model. Enhanced by the Advanced Language Model-based Translat…
Language ModelingLanguage ModellingMachine TranslationTranslationUnsOcc: 3D Semantic Occupancy Prediction in Unstructured Scene via Rendering Fusion
Unstructured scenes present unique challenges for autonomous driving, as irregular obstacles and sparse scene layouts undermine the effectiveness of traditional perception methods such as 3D object detection. 3D semantic…
2D Semantic Segmentation3D Object DetectionAutonomous Driving