paper-with-me

홈 › Papers

CARMA: Context-Aware Runtime Reconfiguration for Energy-Efficient Sensor Fusion

2023-06-27 · Yifan Zhang, Arnav Vaibhav Malawade, Xiaofang Zhang, Yuhui Li, DongHwan Seong, Mohammad Abdullah Al Faruque, Sitao Huang

Autonomous systems (AS) are systems that can adapt and change their behavior in response to unanticipated events and include systems such as aerial drones, autonomous vehicles, and ground/aquatic robots. AS require a wide array of sensors, deep-learning models, and powerful hardware platforms to perceive and safely operate in real-time. However, in many contexts, some sensing modalities negatively impact perception while increasing the system's overall energy consumption. Since AS are often energy-constrained edge devices, energy-efficient sensor fusion methods have been proposed. However, existing methods either fail to adapt to changing scenario conditions or to optimize energy efficiency system-wide. We propose CARMA: a context-aware sensor fusion approach that uses context to dynamically reconfigure the computation flow on a Field-Programmable Gate Array (FPGA) at runtime. By clock-gating unused sensors and model sub-components, CARMA significantly reduces the energy used by a multi-sensory object detector without compromising performance. We use a Deep-learning Processor Unit (DPU) based reconfiguration approach to minimize the latency of model reconfiguration. We evaluate multiple context-identification strategies, propose a novel system-wide energy-performance joint optimization, and evaluate scenario-specific perception performance. Across challenging real-world sensing contexts, CARMA outperforms state-of-the-art methods with up to 1.3x speedup and 73% lower energy consumption.

📄 PDF Abstract BibTeX arXiv:2306.15748

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous VehiclesSensor Fusion

Methods 이 논문이 사용한 방법론

fail 설명 없음

Similar Papers 제목 키워드 기반

CARMA: Collocation-Aware Resource Manager

2025-08-26 · Ehsan Yousefzadeh-Asl-Miandoab, Florina M. Ciorba, Pınar Tözün arxiv

GPUs running deep learning (DL) workloads are frequently underutilized. Collocating multiple DL training tasks on the same GPU can improve utilization but introduces two key risks: (1) out-of-memory (OOM) crashes for new…

Context-Aware Regularization with Markovian Integration for Attention-Based Nucleotide Analysis

2025-07-12 · Mohammadsaleh Refahi, Mahdi Abavisani, Bahrad A. Sokhansanj, James R. Brown 외 arxiv

Transformers have revolutionized nucleotide sequence analysis, yet capturing long-range dependencies remains challenging. Recent studies show that autoregressive transformers often exhibit Markovian behavior by relying o…

CARMA: Context-Aware Situational Grounding of Human-Robot Group Interactions by Combining Vision-Language Models with Object and Action Recognition

2025-06-25 · Joerg Deigmoeller, Stephan Hasler, Nakul Agarwal, Daniel Tanneberg 외

We introduce CARMA, a system for situational grounding in human-robot group interactions. Effective collaboration in such group settings requires situational awareness based on a consistent representation of present pers…

Action RecognitionDecision Making

TRINE: A Token-Aware, Runtime-Adaptive FPGA Inference Engine for Multimodal AI

2026-03-24 · Hyunwoo Oh, Hanning Chen, Sanggeon Yun, Yang Ni 외 arxiv

Multimodal stacks that mix ViTs, CNNs, GNNs, and transformer NLP strain embedded platforms because their compute/memory patterns diverge and hard real-time targets leave little slack. TRINE is a single-bitstream FPGA acc…

Reconfigurable Cyber-Physical System for Lifestyle Video-Monitoring via Deep Learning

2020-10-07 · Daniel Deniz, Francisco Barranco, Juan Isern, Eduardo Ros

Indoor monitoring of people at their homes has become a popular application in Smart Health. With the advances in Machine Learning and hardware for embedded devices, new distributed approaches for Cyber-Physical Systems …

Action RecognitionDeep LearningManagementTemporal Action Localization