paper-with-me

홈 › Papers

Zero-Label Driving Scenario Complexity Detection via Joint Embedding Predictive Architecture

2026-06-21 · Santosh Jaiswal arxiv

Identifying complex and safety-critical driving scenarios in large unlabelled datasets is an important but expensive problem. Existing approaches rely on human annotators, supervised classifiers, or carefully engineered rule sets, all of which require substantial prior knowledge about what constitutes a difficult scenario. We ask whether a model can discover scenario complexity on its own, with no labels at any stage. We train a minimal Joint Embedding Predictive Architecture (JEPA) on structured agent state data from the nuPlan mini dataset and use the temporal prediction error as a zero-shot complexity score. Without access to any ground-truth labels during training or evaluation setup, the model assigns significantly higher scores to scenarios involving unprotected turns, crosswalk interactions, and pedestrian proximity, and significantly lower scores to lane-following and stationary-traffic scenarios. We validate this finding through four ablation experiments that isolate the source of the signal, and through a downstream anomaly detection evaluation that achieves Average Precision of 0.512 against a 0.436 chance baseline. The results show that temporal prediction error in a self-supervised latent world model is a practical proxy for driving scenario complexity.

📄 PDF Abstract BibTeX arXiv:2606.28383

Code (0)

등록된 구현이 없습니다.

Tasks

Anomaly Detection

Similar Papers 제목 키워드 기반

Geographic Diversity Beats Data Volume for Cross-Domain Generalization in Zero-Label JEPA Driving World Models

2026-07-05 · Santosh Jaiswal arxiv

Self-supervised latent world models can assign a surprise score to driving scenarios without any human labels. A natural follow-up question is whether such a model, trained on driving data from one geographic region, can…

Domain Generalization

ZOPP: A Framework of Zero-shot Offboard Panoptic Perception for Autonomous Driving

2024-11-08 · Tao Ma, Hongbin Zhou, Qiusheng Huang, Xuemeng Yang 외

Offboard perception aims to automatically generate high-quality 3D labels for autonomous driving (AD) scenes. Existing offboard methods focus on 3D object detection with closed-set taxonomy and fail to match human-level …

3D Object DetectionAutonomous Drivingobject-detectionObject Detection+1

A Large-Scale Car Parts (LSCP) Dataset for Lightweight Fine-Grained Detection

2023-11-20 · Wang Jie, Zhong Yilin, CAO Qianqian

Automotive related datasets have previously been used for training autonomous driving systems or vehicle classification tasks. However, there is a lack of datasets in the field of automotive AI for car parts detection, a…

Autonomous Driving

Test-time Correction with Human Feedback: An Online 3D Detection System via Visual Prompting

2024-12-10 · Zetong Yang, Hanxue Zhang, Yanan sun, Li Chen 외

This paper introduces Test-time Correction (TTC) system, a novel online 3D detection system designated for online correction of test-time errors via human feedback, to guarantee the safety of deployed autonomous driving …

Autonomous DrivingVisual Prompting

LORD: Large Models based Opposite Reward Design for Autonomous Driving

2024-03-27 · Xin Ye, Feng Tao, Abhirup Mallik, Burhaneddin Yaman 외

Reinforcement learning (RL) based autonomous driving has emerged as a promising alternative to data-driven imitation learning approaches. However, crafting effective reward functions for RL poses challenges due to the co…

Autonomous DrivingImitation LearningReinforcement Learning (RL)