Addressing Out-of-Label Hazard Detection in Dashcam Videos: Insights from the COOOL Challenge
This paper presents a novel approach for hazard analysis in dashcam footage, addressing the detection of driver reactions to hazards, the identification of hazardous objects, and the generation of descriptive captions. We first introduce a method for detecting driver reactions through speed and sound anomaly detection, leveraging unsupervised learning techniques. For hazard detection, we employ a set of heuristic rules as weak classifiers, which are combined using an ensemble method. This ensemble approach is further refined with differential privacy to mitigate overconfidence, ensuring robustness despite the lack of labeled data. Lastly, we use state-of-the-art vision-language models for hazard captioning, generating descriptive labels for the detected hazards. Our method achieved the highest scores in the Challenge on Out-of-Label in Autonomous Driving, demonstrating its effectiveness across all three tasks. Source codes are publicly available at https://github.com/ffyyytt/COOOL_2025.
Code (1)
Tasks
Anomaly DetectionAutonomous DrivingDescriptiveMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
COOOL: Challenge Of Out-Of-Label A Novel Benchmark for Autonomous Driving
As the Computer Vision community rapidly develops and advances algorithms for autonomous driving systems, the goal of safer and more efficient autonomous transportation is becoming increasingly achievable. However, it is…
Anomaly DetectionAutonomous DrivingDomain AdaptationOpen Set Learning+1DashCop: Automated E-ticket Generation for Two-Wheeler Traffic Violations Using Dashcam Videos
Motorized two-wheelers are a prevalent and economical means of transportation, particularly in the Asia-Pacific region. However, hazardous driving practices such as triple riding and non-compliance with helmet regulation…
Towards Anomaly Detection in Dashcam Videos
Inexpensive sensing and computation, as well as insurance innovations, have made smart dashboard cameras ubiquitous. Increasingly, simple model-driven computer vision algorithms focused on lane departures or safe followi…
Anomaly DetectionOne-Class ClassificationExploring the Potential of Multi-Modal AI for Driving Hazard Prediction
This paper addresses the problem of predicting hazards that drivers may encounter while driving a car. We formulate it as a task of anticipating impending accidents using a single input image captured by car dashcams. Un…
Anomaly DetectionVisual Abductive ReasoningHierarchical Reasoning with Vision-Language Models for Incident Reports from Dashcam Videos
Recent advances in end-to-end (E2E) autonomous driving have been enabled by training on diverse large-scale driving datasets, yet autonomous driving models still struggle in out-of-distribution (OOD) scenarios. The COOOL…
Autonomous Driving