AuxNet: Auxiliary tasks enhanced Semantic Segmentation for Automated Driving
Decision making in automated driving is highly specific to the environment and thus semantic segmentation plays a key role in recognizing the objects in the environment around the car. Pixel level classification once considered a challenging task which is now becoming mature to be productized in a car. However, semantic annotation is time consuming and quite expensive. Synthetic datasets with domain adaptation techniques have been used to alleviate the lack of large annotated datasets. In this work, we explore an alternate approach of leveraging the annotations of other tasks to improve semantic segmentation. Recently, multi-task learning became a popular paradigm in automated driving which demonstrates joint learning of multiple tasks improves overall performance of each tasks. Motivated by this, we use auxiliary tasks like depth estimation to improve the performance of semantic segmentation task. We propose adaptive task loss weighting techniques to address scale issues in multi-task loss functions which become more crucial in auxiliary tasks. We experimented on automotive datasets including SYNTHIA and KITTI and obtained 3% and 5% improvement in accuracy respectively.
Code (0)
등록된 구현이 없습니다.
Tasks
Decision MakingDepth EstimationDomain AdaptationMulti-Task LearningSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
AuxAdapt: Stable and Efficient Test-Time Adaptation for Temporally Consistent Video Semantic Segmentation
In video segmentation, generating temporally consistent results across frames is as important as achieving frame-wise accuracy. Existing methods rely either on optical flow regularization or fine-tuning with test data to…
Optical Flow EstimationSegmentationSemantic SegmentationTest-time Adaptation+2Layer-Parallel Training of Residual Networks with Auxiliary-Variable Networks
Gradient-based methods for the distributed training of residual networks (ResNets) typically require a forward pass of the input data, followed by back-propagating the error gradient to update model parameters, which bec…
Data AugmentationGeoAuxNet: Towards Universal 3D Representation Learning for Multi-sensor Point Clouds
Point clouds captured by different sensors such as RGB-D cameras and LiDAR possess non-negligible domain gaps. Most existing methods design different network architectures and train separately on point clouds from variou…
Auxiliary LearningRepresentation LearningAuxiliary Tasks Enhanced Dual-affinity Learning for Weakly Supervised Semantic Segmentation
Most existing weakly supervised semantic segmentation (WSSS) methods rely on Class Activation Mapping (CAM) to extract coarse class-specific localization maps using image-level labels. Prior works have commonly used an o…
Auxiliary Learningimage-classificationImage ClassificationMulti-Label Image Classification+6SDCT-AuxNet$^θ$: DCT Augmented Stain Deconvolutional CNN with Auxiliary Classifier for Cancer Diagnosis
Acute lymphoblastic leukemia (ALL) is a pervasive pediatric white blood cell cancer across the globe. With the popularity of convolutional neural networks (CNNs), computer-aided diagnosis of cancer has attracted consider…
Decision MakingDiagnostic