paper-with-me

Papers

Hyperdimensional Uncertainty Quantification for Multimodal Uncertainty Fusion in Autonomous Vehicles Perception

2025-03-25 · CVPR 2025 1 · Luke Chen, Junyao Wang, Trier Mortlock, Pramod Khargonekar, Mohammad Abdullah Al Faruque

Uncertainty Quantification (UQ) is crucial for ensuring the reliability of machine learning models deployed in real-world autonomous systems. However, existing approaches typically quantify task-level output prediction uncertainty without considering epistemic uncertainty at the multimodal feature fusion level, leading to sub-optimal outcomes. Additionally, popular uncertainty quantification methods, e.g., Bayesian approximations, remain challenging to deploy in practice due to high computational costs in training and inference. In this paper, we propose HyperDUM, a novel deterministic uncertainty method (DUM) that efficiently quantifies feature-level epistemic uncertainty by leveraging hyperdimensional computing. Our method captures the channel and spatial uncertainties through channel and patch -wise projection and bundling techniques respectively. Multimodal sensor features are then adaptively weighted to mitigate uncertainty propagation and improve feature fusion. Our evaluations show that HyperDUM on average outperforms the state-of-the-art (SOTA) algorithms by up to 2.01%/1.27% in 3D Object Detection and up to 1.29% improvement over baselines in semantic segmentation tasks under various types of uncertainties. Notably, HyperDUM requires 2.36x less Floating Point Operations and up to 38.30x less parameters than SOTA methods, providing an efficient solution for real-world autonomous systems.

📄 PDF Abstract BibTeX arXiv:2503.20011

Code (0)

등록된 구현이 없습니다.

Tasks

3D Object DetectionAutonomous Vehiclesobject-detectionObject DetectionSemantic SegmentationUncertainty Quantification

Similar Papers 제목 키워드 기반

Uncertainty-Aware Hardware Trojan Detection Using Multimodal Deep Learning

2024-01-15 · Rahul Vishwakarma, Amin Rezaei

The risk of hardware Trojans being inserted at various stages of chip production has increased in a zero-trust fabless era. To counter this, various machine learning solutions have been developed for the detection of har…

Decision MakingDeep LearningMultimodal Deep LearningUncertainty Quantification

Mutual Information-calibrated Conformal Feature Fusion for Uncertainty-Aware Multimodal 3D Object Detection at the Edge

2023-09-18 · Alex C. Stutts, Danilo Erricolo, Sathya Ravi, Theja Tulabandhula 외

In the expanding landscape of AI-enabled robotics, robust quantification of predictive uncertainties is of great importance. Three-dimensional (3D) object detection, a critical robotics operation, has seen significant ad…

3D Object Detectionobject-detectionObject DetectionUncertainty Quantification

MUSE: Multimodal Uncertainty Quantification of State Estimation

2026-05-17 · Minkyung Kim, Henry Che, Bhargav Chandaka, Bhumsitt Pramuanpornsatid 외 arxiv

Accurate visual state estimation has been a central topic in robotics with a wide range of applications in robot navigation, autonomous driving, and autonomous flight. Recent advances in robot perception have led to sign…

Autonomous DrivingRobot Navigation

Multimodal Learning with Uncertainty Quantification based on Discounted Belief Fusion

2024-12-23 · Grigor Bezirganyan, Sana Sellami, Laure Berti-ÉQuille, Sébastien Fournier

Multimodal AI models are increasingly used in fields like healthcare, finance, and autonomous driving, where information is drawn from multiple sources or modalities such as images, texts, audios, videos. However, effect…

Decision MakingMulti-modal ClassificationUncertainty Quantification

CoVAE: correlated multimodal generative modeling

2026-03-02 · Federico Caretti, Guido Sanguinetti arxiv

Multimodal Variational Autoencoders have emerged as a popular tool to extract effective representations from rich multimodal data. However, such models rely on fusion strategies in latent space that destroy the joint sta…