WiFi-based Multi-task Sensing
WiFi-based sensing has aroused immense attention over recent years. The rationale is that the signal fluctuations caused by humans carry the information of human behavior which can be extracted from the channel state information of WiFi. Still, the prior studies mainly focus on single-task sensing (STS), e.g., gesture recognition, indoor localization, user identification. Since the fluctuations caused by gestures are highly coupling with body features and the user's location, we propose a WiFi-based multi-task sensing model (Wimuse) to perform gesture recognition, indoor localization, and user identification tasks simultaneously. However, these tasks have different difficulty levels (i.e., imbalance issue) and need task-specific information (i.e., discrepancy issue). To address these issues, the knowledge distillation technique and task-specific residual adaptor are adopted in Wimuse. We first train the STS model for each task. Then, for solving the imbalance issue, the extracted common feature in Wimuse is encouraged to get close to the counterpart features of the STS models. Further, for each task, a task-specific residual adaptor is applied to extract the task-specific compensation feature which is fused with the common feature to address the discrepancy issue. We conduct comprehensive experiments on three public datasets and evaluation suggests that Wimuse achieves state-of-the-art performance with the average accuracy of 85.20%, 98.39%, and 98.725% on the joint task of gesture recognition, indoor localization, and user identification, respectively.
Code (1)
Tasks
Gesture RecognitionIndoor LocalizationKnowledge DistillationSTSUser IdentificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
WiMANS: A Benchmark Dataset for WiFi-based Multi-user Activity Sensing
WiFi-based human sensing has exhibited remarkable potential to analyze user behaviors in a non-intrusive and device-free manner, benefiting applications as diverse as smart homes and healthcare. However, most previous wo…
Activity RecognitionEfficientFi: Towards Large-Scale Lightweight WiFi Sensing via CSI Compression
WiFi technology has been applied to various places due to the increasing requirement of high-speed Internet access. Recently, besides network services, WiFi sensing is appealing in smart homes since it is device-free, co…
Activity RecognitionCloud ComputingEdge-computingHuman Activity Recognition+1SenseFi: A Library and Benchmark on Deep-Learning-Empowered WiFi Human Sensing
WiFi sensing has been evolving rapidly in recent years. Empowered by propagation models and deep learning methods, many challenging applications are realized such as WiFi-based human activity recognition and gesture reco…
Activity RecognitionDeep LearningGesture RecognitionHuman Activity RecognitionCSI-Bench: A Large-Scale In-the-Wild Dataset for Multi-task WiFi Sensing
WiFi sensing has emerged as a compelling contactless modality for human activity monitoring by capturing fine-grained variations in Channel State Information (CSI). Its ability to operate continuously and non-intrusively…
Multi-Task LearningPrivacy PreservingAutoFi: Towards Automatic WiFi Human Sensing via Geometric Self-Supervised Learning
WiFi sensing technology has shown superiority in smart homes among various sensors for its cost-effective and privacy-preserving merits. It is empowered by Channel State Information (CSI) extracted from WiFi signals and …
Activity RecognitionDomain AdaptationGait RecognitionGesture Recognition+2