Uncertainty-aware Bridge based Mobile-Former Network for Event-based Pattern Recognition
The mainstream human activity recognition (HAR) algorithms are developed based on RGB cameras, which are easily influenced by low-quality images (e.g., low illumination, motion blur). Meanwhile, the privacy protection issue caused by ultra-high definition (HD) RGB cameras aroused more and more people's attention. Inspired by the success of event cameras which perform better on high dynamic range, no motion blur, and low energy consumption, we propose to recognize human actions based on the event stream. We propose a lightweight uncertainty-aware information propagation based Mobile-Former network for efficient pattern recognition, which aggregates the MobileNet and Transformer network effectively. Specifically, we first embed the event images using a stem network into feature representations, then, feed them into uncertainty-aware Mobile-Former blocks for local and global feature learning and fusion. Finally, the features from MobileNet and Transformer branches are concatenated for pattern recognition. Extensive experiments on multiple event-based recognition datasets fully validated the effectiveness of our model. The source code of this work will be released at https://github.com/Event-AHU/Uncertainty_aware_MobileFormer.
Code (1)
Tasks
Activity RecognitionHuman Activity RecognitionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Mobile-Former: Bridging MobileNet and Transformer
We present Mobile-Former, a parallel design of MobileNet and transformer with a two-way bridge in between. This structure leverages the advantages of MobileNet at local processing and transformer at global interaction. A…
Decoderobject-detectionObject DetectionSemi-UFormer: Semi-supervised Uncertainty-aware Transformer for Image Dehazing
Image dehazing is fundamental yet not well-solved in computer vision. Most cutting-edge models are trained in synthetic data, leading to the poor performance on real-world hazy scenarios. Besides, they commonly give dete…
Image DehazingKnowledge DistillationUR2M: Uncertainty and Resource-Aware Event Detection on Microcontrollers
Traditional machine learning techniques are prone to generating inaccurate predictions when confronted with shifts in the distribution of data between the training and testing phases. This vulnerability can lead to sever…
Event DetectionUncertainty QuantificationReNiL: Event-Driven Pedestrian Bayesian Localization Using IMU for Real-World Applications
Pedestrian inertial localization is key for mobile and IoT services because it provides infrastructure-free positioning. Yet most learning-based methods depend on fixed sliding-window integration, struggle to adapt to di…
Bayesian InferenceUncertainty quantification in neural network-based glucose prediction for diabetes
In this work, we investigate uncertainty-aware neural network models for blood glucose prediction and adverse glycemic event identification in Type 1 diabetes. We consider three families of sequence models based on LSTM,…