paper-with-me

Papers

Domain Adaptive Knowledge Distillation for Driving Scene Semantic Segmentation

2020-11-03 · Divya Kothandaraman, Athira Nambiar, Anurag Mittal

Practical autonomous driving systems face two crucial challenges: memory constraints and domain gap issues. In this paper, we present a novel approach to learn domain adaptive knowledge in models with limited memory, thus bestowing the model with the ability to deal with these issues in a comprehensive manner. We term this as "Domain Adaptive Knowledge Distillation" and address the same in the context of unsupervised domain-adaptive semantic segmentation by proposing a multi-level distillation strategy to effectively distil knowledge at different levels. Further, we introduce a novel cross entropy loss that leverages pseudo labels from the teacher. These pseudo teacher labels play a multifaceted role towards: (i) knowledge distillation from the teacher network to the student network & (ii) serving as a proxy for the ground truth for target domain images, where the problem is completely unsupervised. We introduce four paradigms for distilling domain adaptive knowledge and carry out extensive experiments and ablation studies on real-to-real as well as synthetic-to-real scenarios. Our experiments demonstrate the profound success of our proposed method.

📄 PDF Abstract BibTeX arXiv:2011.08007

Code (1)

divyakraman/Domain-Adaptive-Knowledge-Distillation-for-Driving-Scene-Semantic-Segmentation pytorch

Tasks

Autonomous DrivingKnowledge DistillationSemantic Segmentation

Methods 이 논문이 사용한 방법론

Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…

Similar Papers 제목 키워드 기반

Effectiveness of Function Matching in Driving Scene Recognition

2022-08-20 · Shingo Yashima

Knowledge distillation is an effective approach for training compact recognizers required in autonomous driving. Recent studies on image classification have shown that matching student and teacher on a wide range of data…

Autonomous Drivingimage-classificationImage ClassificationKnowledge Distillation+2

Spirit Distillation: Precise Real-time Semantic Segmentation of Road Scenes with Insufficient Data

2021-03-25 · Zhiyuan Wu, Yu Jiang, Chupeng Cui, Zongmin Yang 외

Semantic segmentation of road scenes is one of the key technologies for realizing autonomous driving scene perception, and the effectiveness of deep Convolutional Neural Networks(CNNs) for this task has been demonstrated…

Autonomous DrivingFew-Shot LearningKnowledge DistillationReal-Time Semantic Segmentation+3

CD-FKD: Cross-Domain Feature Knowledge Distillation for Robust Single-Domain Generalization in Object Detection

2026-03-17 · Junseok Lee, Sungho Shin, Seongju Lee, Kyoobin Lee arxiv

Single-domain generalization is essential for object detection, particularly when training models on a single source domain and evaluating them on unseen target domains. Domain shifts, such as changes in weather, lightin…

Robust Object DetectionKnowledge DistillationDomain GeneralizationAutonomous Driving

Unsupervised Self-Driving Attention Prediction via Uncertainty Mining and Knowledge Embedding

2023-03-17 · ICCV 2023 1 · Pengfei Zhu, Mengshi Qi, Xia Li, Weijian Li 외

Predicting attention regions of interest is an important yet challenging task for self-driving systems. Existing methodologies rely on large-scale labeled traffic datasets that are labor-intensive to obtain. Besides, the…

TaPD: Temporal-adaptive Progressive Distillation for Observation-Adaptive Trajectory Forecasting in Autonomous Driving

2026-03-06 · Mingyu Fan, Yi Liu, Hao Zhou, Deheng Qian 외 arxiv

Trajectory prediction is essential for autonomous driving, enabling vehicles to anticipate the motion of surrounding agents to support safe planning. However, most existing predictors assume fixed-length histories and su…

Trajectory ForecastingKnowledge DistillationTrajectory PredictionAutonomous Driving