ViT-DD: Multi-Task Vision Transformer for Semi-Supervised Driver Distraction Detection
Ensuring traffic safety and mitigating accidents in modern driving is of paramount importance, and computer vision technologies have the potential to significantly contribute to this goal. This paper presents a multi-modal Vision Transformer for Driver Distraction Detection (termed ViT-DD), which incorporates inductive information from training signals related to both distraction detection and driver emotion recognition. Additionally, a self-learning algorithm is developed, allowing for the seamless integration of driver data without emotion labels into the multi-task training process of ViT-DD. Experimental results reveal that the proposed ViT-DD surpasses existing state-of-the-art methods for driver distraction detection by 6.5% and 0.9% on the SFDDD and AUCDD datasets, respectively.
Code (1)
Tasks
Self-LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Semi-Supervised Vision Transformers
We study the training of Vision Transformers for semi-supervised image classification. Transformers have recently demonstrated impressive performance on a multitude of supervised learning tasks. Surprisingly, we show Vis…
image-classificationImage ClassificationInductive BiasSemi-Supervised Image ClassificationSemi-supervised Vision Transformers at Scale
We study semi-supervised learning (SSL) for vision transformers (ViT), an under-explored topic despite the wide adoption of the ViT architectures to different tasks. To tackle this problem, we propose a new SSL pipeline,…
Inductive BiasSemi-Supervised Image ClassificationAdvMIM: Adversarial Masked Image Modeling for Semi-Supervised Medical Image Segmentation
Vision Transformer has recently gained tremendous popularity in medical image segmentation task due to its superior capability in capturing long-range dependencies. However, transformer requires a large amount of labeled…
Image SegmentationMedical Image SegmentationSegmentationSemantic Segmentation+1On the Surprising Effectiveness of Transformers in Low-Labeled Video Recognition
Recently vision transformers have been shown to be competitive with convolution-based methods (CNNs) broadly across multiple vision tasks. The less restrictive inductive bias of transformers endows greater representation…
image-classificationImage ClassificationInductive BiasVideo Classification+1Semi-MAE: Masked Autoencoders for Semi-supervised Vision Transformers
Vision Transformer (ViT) suffers from data scarcity in semi-supervised learning (SSL). To alleviate this issue, inspired by masked autoencoder (MAE), which is a data-efficient self-supervised learner, we propose Semi-MAE…
Decoderimage-classificationImage ClassificationRepresentation Learning+1