paper-with-me

홈 › Papers

EMPERROR: A Flexible Generative Perception Error Model for Probing Self-Driving Planners

2024-11-12 · Niklas Hanselmann, Simon Doll, Marius Cordts, Hendrik P. A. Lensch, Andreas Geiger

To handle the complexities of real-world traffic, learning planners for self-driving from data is a promising direction. While recent approaches have shown great progress, they typically assume a setting in which the ground-truth world state is available as input. However, when deployed, planning needs to be robust to the long-tail of errors incurred by a noisy perception system, which is often neglected in evaluation. To address this, previous work has proposed drawing adversarial samples from a perception error model (PEM) mimicking the noise characteristics of a target object detector. However, these methods use simple PEMs that fail to accurately capture all failure modes of detection. In this paper, we present EMPERROR, a novel transformer-based generative PEM, apply it to stress-test an imitation learning (IL)-based planner and show that it imitates modern detectors more faithfully than previous work. Furthermore, it is able to produce realistic noisy inputs that increase the planner's collision rate by up to 85%, demonstrating its utility as a valuable tool for a more complete evaluation of self-driving planners.

📄 PDF Abstract BibTeX arXiv:2411.07719

Code (0)

등록된 구현이 없습니다.

Tasks

Imitation Learning

Similar Papers 제목 키워드 기반

Biologically Inspired Dynamic Textures for Probing Motion Perception

2015-11-09 · NeurIPS 2015 12 · Jonathan Vacher, Andrew Meso, Laurent U. Perrinet, Gabriel Peyré

Perception is often described as a predictive process based on an optimal inference with respect to a generative model. We study here the principled construction of a generative model specifically crafted to probe motion…

Bayesian Inference

Probing and Bridging Geometry-Interaction Cues for Affordance Reasoning in Vision Foundation Models

2026-02-24 · Qing Zhang, Xuesong Li, Jing Zhang arxiv

What does it mean for a visual system to truly understand affordance? We argue that this understanding hinges on two complementary capacities: geometric perception, which identifies the structural parts of objects that e…

HPP: Hierarchical Programmatic Probing for Long Video Understanding by Decoupling Perception and Reasoning

2026-06-19 · Awais Rauf, Ahmed Hasssan, Greg Slabaugh arxiv

Understanding long videos requires fine-grained perception and multi-step, higher-order reasoning over complex, long-range spatio-temporal dynamics. Vision-language models (VLMs) encode video frames into visual tokens an…

Relational ReasoningSemantic Retrieval

Taking the neural sampling code very seriously: A data-driven approach for evaluating generative models of the visual system

2023-09-21 · NeurIPS 2023 11

Prevailing theories of perception hypothesize that the brain implements perception via Bayesian inference in a generative model of the world. One prominent theory, the Neural Sampling Code (NSC), posits that neuronal res…

Robo3D: Towards Robust and Reliable 3D Perception against Corruptions

2023-03-30 · ICCV 2023 1 · Lingdong Kong, Youquan Liu, Xin Li, Runnan Chen 외

The robustness of 3D perception systems under natural corruptions from environments and sensors is pivotal for safety-critical applications. Existing large-scale 3D perception datasets often contain data that are meticul…

3D Object Detection3D Semantic SegmentationRobust 3D Object DetectionRobust 3D Semantic Segmentation