Propagate And Calibrate: Real-time Passive Non-line-of-sight Tracking
Non-line-of-sight (NLOS) tracking has drawn increasing attention in recent years, due to its ability to detect object motion out of sight. Most previous works on NLOS tracking rely on active illumination, e.g., laser, and suffer from high cost and elaborate experimental conditions. Besides, these techniques are still far from practical application due to oversimplified settings. In contrast, we propose a purely passive method to track a person walking in an invisible room by only observing a relay wall, which is more in line with real application scenarios, e.g., security. To excavate imperceptible changes in videos of the relay wall, we introduce difference frames as an essential carrier of temporal-local motion messages. In addition, we propose PAC-Net, which consists of alternating propagation and calibration, making it capable of leveraging both dynamic and static messages on a frame-level granularity. To evaluate the proposed method, we build and publish the first dynamic passive NLOS tracking dataset, NLOS-Track, which fills the vacuum of realistic NLOS datasets. NLOS-Track contains thousands of NLOS video clips and corresponding trajectories. Both real-shot and synthetic data are included. Our codes and dataset are available at https://againstentropy.github.io/NLOS-Track/.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Portfolio Optimisation via the Heston Model Calibrated to Real Asset Data
The debate between active and passive investment strategies has been ongoing for many years and is far from being over. In this paper, we show that the choice of an optimal portfolio management strategy depends on an inv…
ManagementSustainable Edge Vision via Empirically Calibrated DVFS: Eliminating Thermal Throttling on Passively Cooled Hardware
Passive cooling eliminates the energy overhead and mechanical failure modes of fans, making it attractive for edge deployment, yet sustained Deep Neural Network (DNN) inference on passively cooled edge Systems-on-Chip (S…
A cloud-IoT platform for passive radio sensing: challenges and application case studies
We propose a platform for the integration of passive radio sensing and vision technologies into a cloud-IoT framework that performs real-time channel quality information (CQI) time series processing and analytics. Radio …
Time SeriesTime Series AnalysisUncertainty Estimation and Propagation in Accelerated MRI Reconstruction
MRI reconstruction techniques based on deep learning have led to unprecedented reconstruction quality especially in highly accelerated settings. However, deep learning techniques are also known to fail unexpectedly and h…
MRI ReconstructionSegmentationUncertainty QuantificationTrilateration-Based Device-Free Sensing: Two Base Stations and One Passive IRS Are Sufficient
The classic trilateration technique can localize each target based on its distances to three anchors with known coordinates. Usually, this technique requires all the anchors and targets, e.g., the satellites and the mobi…
Integrated sensing and communicationISAC