OffRoadTranSeg: Semi-Supervised Segmentation using Transformers on OffRoad environments
We present OffRoadTranSeg, the first end-to-end framework for semi-supervised segmentation in unstructured outdoor environment using transformers and automatic data selection for labelling. The offroad segmentation is a scene understanding approach that is widely used in autonomous driving. The popular offroad segmentation method is to use fully connected convolution layers and large labelled data, however, due to class imbalance, there will be several mismatches and also some classes may not be detected. Our approach is to do the task of offroad segmentation in a semi-supervised manner. The aim is to provide a model where self supervised vision transformer is used to fine-tune offroad datasets with self-supervised data collection for labelling using depth estimation. The proposed method is validated on RELLIS-3D and RUGD offroad datasets. The experiments show that OffRoadTranSeg outperformed other state of the art models, and also solves the RELLIS-3D class imbalance problem.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingDepth EstimationScene UnderstandingSegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Excavating in the Wild: The GOOSE-Ex Dataset for Semantic Segmentation
The successful deployment of deep learning-based techniques for autonomous systems is highly dependent on the data availability for the respective system in its deployment environment. Especially for unstructured outdoor…
Semantic SegmentationZJU ReLER Submission for EPIC-KITCHEN Challenge 2023: Semi-Supervised Video Object Segmentation
The Associating Objects with Transformers (AOT) framework has exhibited exceptional performance in a wide range of complex scenarios for video object segmentation. In this study, we introduce MSDeAOT, a variant of the AO…
ObjectPositionSegmentationSemantic Segmentation+3Exploring Token-Level Augmentation in Vision Transformer for Semi-Supervised Semantic Segmentation
Semi-supervised semantic segmentation has witnessed remarkable advancements in recent years. However, existing algorithms are based on convolutional neural networks and directly applying them to Vision Transformers poses…
Data AugmentationDiversityImage AugmentationSemantic Segmentation+1Visual Prompt Based Reasoning for Offroad Mapping using Multimodal LLMs
Traditional approaches to off-road autonomy rely on separate models for terrain classification, height estimation, and quantifying slip or slope conditions. Utilizing several models requires training each component separ…
Semi-Supervised Medical Image Segmentation via Cross Teaching between CNN and Transformer
Recently, deep learning with Convolutional Neural Networks (CNNs) and Transformers has shown encouraging results in fully supervised medical image segmentation. However, it is still challenging for them to achieve good p…
Image SegmentationMedical Image SegmentationPseudo LabelSegmentation+2