paper-with-me

홈 › Papers

Addressing Out-of-Label Hazard Detection in Dashcam Videos: Insights from the COOOL Challenge

2025-01-27 · Anh-Kiet Duong, Petra Gomez-Krämer

This paper presents a novel approach for hazard analysis in dashcam footage, addressing the detection of driver reactions to hazards, the identification of hazardous objects, and the generation of descriptive captions. We first introduce a method for detecting driver reactions through speed and sound anomaly detection, leveraging unsupervised learning techniques. For hazard detection, we employ a set of heuristic rules as weak classifiers, which are combined using an ensemble method. This ensemble approach is further refined with differential privacy to mitigate overconfidence, ensuring robustness despite the lack of labeled data. Lastly, we use state-of-the-art vision-language models for hazard captioning, generating descriptive labels for the detected hazards. Our method achieved the highest scores in the Challenge on Out-of-Label in Autonomous Driving, demonstrating its effectiveness across all three tasks. Source codes are publicly available at https://github.com/ffyyytt/COOOL_2025.

📄 PDF Abstract BibTeX arXiv:2501.16037

Code (1)

ffyyytt/coool_2025 공식 구현

Tasks

Anomaly DetectionAutonomous DrivingDescriptive

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…
SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

COOOL: Challenge Of Out-Of-Label A Novel Benchmark for Autonomous Driving

2024-12-06 · Ali K. AlShami, Ananya Kalita, Ryan Rabinowitz, Khang Lam 외

As the Computer Vision community rapidly develops and advances algorithms for autonomous driving systems, the goal of safer and more efficient autonomous transportation is becoming increasingly achievable. However, it is…

Anomaly DetectionAutonomous DrivingDomain AdaptationOpen Set Learning+1

DashCop: Automated E-ticket Generation for Two-Wheeler Traffic Violations Using Dashcam Videos

2025-03-01 · Deepti Rawat, Keshav Gupta, Aryamaan Basu Roy, Ravi Kiran Sarvadevabhatla

Motorized two-wheelers are a prevalent and economical means of transportation, particularly in the Asia-Pacific region. However, hazardous driving practices such as triple riding and non-compliance with helmet regulation…

Towards Anomaly Detection in Dashcam Videos

2020-04-11 · Sanjay Haresh, Sateesh Kumar, M. Zeeshan Zia, Quoc-Huy Tran

Inexpensive sensing and computation, as well as insurance innovations, have made smart dashboard cameras ubiquitous. Increasingly, simple model-driven computer vision algorithms focused on lane departures or safe followi…

Anomaly DetectionOne-Class Classification

Exploring the Potential of Multi-Modal AI for Driving Hazard Prediction

2023-10-07 · Korawat Charoenpitaks, Van-Quang Nguyen, Masanori Suganuma, Masahiro Takahashi 외

This paper addresses the problem of predicting hazards that drivers may encounter while driving a car. We formulate it as a task of anticipating impending accidents using a single input image captured by car dashcams. Un…

Anomaly DetectionVisual Abductive Reasoning

Hierarchical Reasoning with Vision-Language Models for Incident Reports from Dashcam Videos

2025-10-14 · Shingo Yokoi, Kento Sasaki, Yu Yamaguchi arxiv

Recent advances in end-to-end (E2E) autonomous driving have been enabled by training on diverse large-scale driving datasets, yet autonomous driving models still struggle in out-of-distribution (OOD) scenarios. The COOOL…

Autonomous Driving