Temporal Binary Representation for Event-Based Action Recognition
In this paper we present an event aggregation strategy to convert the output of an event camera into frames processable by traditional Computer Vision algorithms. The proposed method first generates sequences of intermediate binary representations, which are then losslessly transformed into a compact format by simply applying a binary-to-decimal conversion. This strategy allows us to encode temporal information directly into pixel values, which are then interpreted by deep learning models. We apply our strategy, called Temporal Binary Representation, to the task of Gesture Recognition, obtaining state of the art results on the popular DVS128 Gesture Dataset. To underline the effectiveness of the proposed method compared to existing ones, we also collect an extension of the dataset under more challenging conditions on which to perform experiments.
Code (1)
Tasks
Action RecognitionGesture RecognitionSimilar Papers 제목 키워드 기반
SMV-EAR: Bring Spatiotemporal Multi-View Representation Learning into Efficient Event-Based Action Recognition
Event cameras action recognition (EAR) offers compelling privacy-protecting and efficiency advantages, where temporal motion dynamics is of great importance. Existing spatiotemporal multi-view representation learning (SM…
Representation LearningAction RecognitionObject RecognitionAction Genome: Actions as Composition of Spatio-temporal Scene Graphs
Action recognition has typically treated actions and activities as monolithic events that occur in videos. However, there is evidence from Cognitive Science and Neuroscience that people actively encode activities into co…
Action RecognitionFew-Shot action recognitionFew Shot Action RecognitionSpatio-temporal Scene GraphsAction Genome: Actions As Compositions of Spatio-Temporal Scene Graphs
Action recognition has typically treated actions and activities as monolithic events that occur in videos. However, there is evidence from Cognitive Science and Neuroscience that people actively encode activities into co…
Action RecognitionFew-Shot action recognitionFew Shot Action RecognitionSpatio-temporal Scene GraphsRecognition of Acoustic Events Using Masked Conditional Neural Networks
Automatic feature extraction using neural networks has accomplished remarkable success for images, but for sound recognition, these models are usually modified to fit the nature of the multi-dimensional temporal represen…
ExACT: Language-guided Conceptual Reasoning and Uncertainty Estimation for Event-based Action Recognition and More
Event cameras have recently been shown beneficial for practical vision tasks, such as action recognition, thanks to their high temporal resolution, power efficiency, and reduced privacy concerns. However, current researc…
Action Recognition