Robust Two-Stream Multi-Feature Network for Driver Drowsiness Detection
Drowsiness driving is a major cause of traffic accidents and thus numerous previous researches have focused on driver drowsiness detection. Many drive relevant factors have been taken into consideration for fatigue detection and can lead to high precision, but there are still several serious constraints, such as most existing models are environmentally susceptible. In this paper, fatigue detection is considered as temporal action detection problem instead of image classification. The proposed detection system can be divided into four parts: (1) Localize the key patches of the detected driver picture which are critical for fatigue detection and calculate the corresponding optical flow. (2) Contrast Limited Adaptive Histogram Equalization (CLAHE) is used in our system to reduce the impact of different light conditions. (3) Three individual two-stream networks combined with attention mechanism are designed for each feature to extract temporal information. (4) The outputs of the three sub-networks will be concatenated and sent to the fully-connected network, which judges the status of the driver. The drowsiness detection system is trained and evaluated on the famous Nation Tsing Hua University Driver Drowsiness Detection (NTHU-DDD) dataset and we obtain an accuracy of 94.46%, which outperforms most existing fatigue detection models.
Code (0)
등록된 구현이 없습니다.
Tasks
Action Detectionimage-classificationImage ClassificationOptical Flow EstimationVocal Bursts Valence PredictionSimilar Papers 제목 키워드 기반
Drivers Drowsiness Detection using Condition-Adaptive Representation Learning Framework
We propose a condition-adaptive representation learning framework for the driver drowsiness detection based on 3D-deep convolutional neural network. The proposed framework consists of four models: spatio-temporal represe…
Representation LearningDriver Drowsiness Classification Based on Eye Blink and Head Movement Features Using the k-NN Algorithm
Modern advanced driver-assistance systems analyze the driving performance to gather information about the driver's state. Such systems are able, for example, to detect signs of drowsiness by evaluating the steering or la…
feature selectionReal-Time Drivers' Drowsiness Detection and Analysis through Deep Learning
A long road trip is fun for drivers. However, a long drive for days can be tedious for a driver to accommodate stringent deadlines to reach distant destinations. Such a scenario forces drivers to drive extra miles, utili…
An EEG Channel Selection Framework for Driver Drowsiness Detection via Interpretability Guidance
Drowsy driving has a crucial influence on driving safety, creating an urgent demand for driver drowsiness detection. Electroencephalogram (EEG) signal can accurately reflect the mental fatigue state and thus has been wid…
channel selectionEEGElectroencephalogram (EEG)Towards a new system for drowsiness detection based on eye blinking and head posture estimation
Driver drowsiness problem is considered as one of the most important reasons that increases road accidents number. We propose in this paper a new approach for realtime driver drowsiness in order to prevent road accidents…