RGB-W: When Vision Meets Wireless
Inspired by the recent success of RGB-D cameras, we propose the enrichment of RGB data with an additional "quasi-free" modality, namely, the wireless signal (e.g., wifi or Bluetooth) emitted by individuals' cell phones, referred to as RGB-W. The received signal strength acts as a rough proxy for depth and a reliable cue on their identity. Although the measured signals are highly noisy (more than 2m average localization error), we demonstrate that the combination of visual and wireless data significantly improves the localization accuracy. We introduce a novel image-driven representation of wireless data which embeds all received signals onto a single image. We then indicate the ability of this additional data to (i) locate persons within a sparsity-driven framework and to (ii) track individuals with a new confidence measure on the data association problem. Our solution outperforms existing localization methods by a significant margin. It can be applied to the millions of currently installed RGB cameras to better analyze human behavior and offer the next generation of high-accuracy location-based services.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
QoS Provision for Controlling Energy Consumption in Ad-Hoc Wireless Sensor Networks
In this paper, a new quality of service (QoS) approach is proposed to control the consumed energy in ad-hoc wireless sensor network (WSN). The main reason is to reduce the node's energy through discovering the best optim…
When Wireless Security Meets Machine Learning: Motivation, Challenges, and Research Directions
Wireless systems are vulnerable to various attacks such as jamming and eavesdropping due to the shared and broadcast nature of wireless medium. To support both attack and defense strategies, machine learning (ML) provide…
BIG-bench Machine LearningIRIS: Wireless Ring for Vision-based Smart Home Interaction
Integrating cameras into wireless smart rings has been challenging due to size and power constraints. We introduce IRIS, the first wireless vision-enabled smart ring system for smart home interactions. Equipped with a ca…
Vision Meets Wireless Positioning: Effective Person Re-identification with Recurrent Context Propagation
Existing person re-identification methods rely on the visual sensor to capture the pedestrians. The image or video data from visual sensor inevitably suffers the occlusion and dramatic variations of pedestrian postures, …
Person Re-IdentificationGenerative AI Meets Wireless Sensing: Towards Wireless Foundation Model
Generative Artificial Intelligence (GenAI) has made significant advancements in fields such as computer vision (CV) and natural language processing (NLP), demonstrating its capability to synthesize high-fidelity data and…
Human Activity RecognitionData AugmentationDomain Adaptation