paper-with-me

홈 › Papers

Data Leakage in Automotive Perception: Practitioners' Insights

2026-04-08 · Md Abu Ahammed Babu, Sushant Kumar Pandey, Darko Durisic, Andras Balint, Miroslaw Staron arxiv

Data leakage is the inadvertent transfer of information between training and evaluation datasets that poses a subtle, yet critical, risk to the reliability of machine learning (ML) models in safety-critical systems such as automotive perception. While leakage is widely recognized in research, little is known about how industrial practitioners actually perceive and manage it in practice. This study investigates practitioners' knowledge, experiences, and mitigation strategies around data leakage through ten semi-structured interviews with system design, development, and verification engineers working on automotive perception functions development. Using reflexive thematic analysis, we identify that knowledge of data leakage is widespread and fragmented along role boundaries: ML engineers conceptualize it as a data-splitting or validation issue, whereas design and verification roles interpret it in terms of representativeness and scenario coverage. Detection commonly arises through generic considerations and observed performance anomalies rather than implying specific tools. However, data leakage prevention is more commonly practiced, which depends mostly on experience and knowledge sharing. These findings suggest that leakage control is a socio-technical coordination problem distributed across roles and workflows. We discuss implications for ML reliability engineering, highlighting the need for shared definitions, traceable data practices, and continuous cross-role communication to institutionalize data leakage awareness within automotive ML development.

📄 PDF Abstract BibTeX arXiv:2604.06899

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Improving Image Data Leakage Detection in Automotive Software

2024-10-29 · Md Abu Ahammed Babu, Sushant Kumar Pandey, Darko Durisic, Ashok Chaitanya Koppisetty 외

Data leakage is a very common problem that is often overlooked during splitting data into train and test sets before training any ML/DL model. The model performance gets artificially inflated with the presence of data le…

object-detectionObject Detection

Surround-view Fisheye Camera Perception for Automated Driving: Overview, Survey and Challenges

2022-05-26 · Varun Ravi Kumar, Ciaran Eising, Christian Witt, Senthil Yogamani

Surround-view fisheye cameras are commonly used for near-field sensing in automated driving. Four fisheye cameras on four sides of the vehicle are sufficient to cover 360{\deg} around the vehicle capturing the entire nea…

object-detectionObject Detection

Machine Learning Security in Industry: A Quantitative Survey

2022-07-11 · Kathrin Grosse, Lukas Bieringer, Tarek Richard Besold, Battista Biggio 외

Despite the large body of academic work on machine learning security, little is known about the occurrence of attacks on machine learning systems in the wild. In this paper, we report on a quantitative study with 139 ind…

BIG-bench Machine LearningDecision MakingSurvey

Automotive Perception Software Development: An Empirical Investigation into Data, Annotation, and Ecosystem Challenges

2023-03-10 · Hans-Martin Heyn, Khan Mohammad Habibullah, Eric Knauss, Jennifer Horkoff 외

Software that contains machine learning algorithms is an integral part of automotive perception, for example, in driving automation systems. The development of such software, specifically the training and validation of t…

A Method for the Runtime Validation of AI-based Environment Perception in Automated Driving System

2024-12-21 · Iqra Aslam, Abhishek Buragohain, Daniel Bamal, Adina Aniculaesei 외

Environment perception is a fundamental part of the dynamic driving task executed by Autonomous Driving Systems (ADS). Artificial Intelligence (AI)-based approaches have prevailed over classical techniques for realizing …

Autonomous Driving