paper-with-me

홈 › Papers

OCTraN: 3D Occupancy Convolutional Transformer Network in Unstructured Traffic Scenarios

2023-07-20 · Aditya Nalgunda Ganesh, Dhruval Pobbathi Badrinath, Harshith Mohan Kumar, Priya SS, Surabhi Narayan

Modern approaches for vision-centric environment perception for autonomous navigation make extensive use of self-supervised monocular depth estimation algorithms that output disparity maps. However, when this disparity map is projected onto 3D space, the errors in disparity are magnified, resulting in a depth estimation error that increases quadratically as the distance from the camera increases. Though Light Detection and Ranging (LiDAR) can solve this issue, it is expensive and not feasible for many applications. To address the challenge of accurate ranging with low-cost sensors, we propose, OCTraN, a transformer architecture that uses iterative-attention to convert 2D image features into 3D occupancy features and makes use of convolution and transpose convolution to efficiently operate on spatial information. We also develop a self-supervised training pipeline to generalize the model to any scene by eliminating the need for LiDAR ground truth by substituting it with pseudo-ground truth labels obtained from boosted monocular depth estimation.

📄 PDF Abstract BibTeX arXiv:2307.10934

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous NavigationDepth EstimationMonocular Depth Estimation

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

SOccDPT: Semi-Supervised 3D Semantic Occupancy from Dense Prediction Transformers trained under memory constraints

2023-11-19 · Aditya Nalgunda Ganesh

We present SOccDPT, a memory-efficient approach for 3D semantic occupancy prediction from monocular image input using dense prediction transformers. To address the limitations of existing methods trained on structured tr…

3D Semantic Occupancy PredictionDisparity Estimationgraph constructionSemantic Segmentation

STrajNet: Multi-modal Hierarchical Transformer for Occupancy Flow Field Prediction in Autonomous Driving

2022-07-31 · Haochen Liu, Zhiyu Huang, Chen Lv

Forecasting the future states of surrounding traffic participants is a crucial capability for autonomous vehicles. The recently proposed occupancy flow field prediction introduces a scalable and effective representation …

Autonomous DrivingAutonomous Vehicles

CUNI Systems in WMT21: Revisiting Backtranslation Techniques for English-Czech NMT

2021-11-01 · WMT (EMNLP) 2021 11 · Petr Gebauer, Ondřej Bojar, Vojtěch Švandelík, Martin Popel

We describe our two NMT systems submitted to the WMT2021 shared task in English-Czech news translation: CUNI-DocTransformer (document-level CUBBITT) and CUNI-Marian-Baselines. We improve the former with a better sentence…

NMTSegmentationSentenceSentence segmentation+1

Advanced Language Model-based Translator for English-Vietnamese Translation

2024-05-27 · 2024 2024 5 · Hoai Nam Nguyen, Thanh Trong Nguyen, Quoc Bao Nguyen, Vu Anh Tran

We introduce a transformative approach to English-Vietnamese translation, leveraging the cutting edge capabilities of the Gemma-7B-IT (Gemma Team et al. 2024) model. Enhanced by the Advanced Language Model-based Translat…

Language ModelingLanguage ModellingMachine TranslationTranslation

UnsOcc: 3D Semantic Occupancy Prediction in Unstructured Scene via Rendering Fusion

2026-06-02 · Ye Wu, Ruiqi Song, Baiyong Ding, Nanxin Zeng 외 arxiv

Unstructured scenes present unique challenges for autonomous driving, as irregular obstacles and sparse scene layouts undermine the effectiveness of traditional perception methods such as 3D object detection. 3D semantic…

2D Semantic Segmentation3D Object DetectionAutonomous Driving