Event-based Action Recognition Using Timestamp Image Encoding Network
Event camera is an asynchronous, high frequency vision sensor with low power consumption, which is suitable for human action recognition task. It is vital to encode the spatial-temporal information of event data properly and use standard computer vision tool to learn from the data. In this work, we propose a timestamp image encoding 2D network, which takes the encoded spatial-temporal images of the event data as input and output the action label. Experiment results show that our method can achieve the same level of performance as those RGB-based benchmarks on real world action recognition, and also achieve the SOTA result on gesture recognition.
Code (0)
등록된 구현이 없습니다.
Tasks
Action RecognitionGesture RecognitionTemporal Action LocalizationSimilar Papers 제목 키워드 기반
Event-based Timestamp Image Encoding Network for Human Action Recognition and Anticipation
Event camera is an asynchronous, high frequency vision sensor with low power consumption, which is suitable for human action understanding task. It is vital to encode the spatial-temporal information of event data proper…
Action RecognitionAction UnderstandingGesture RecognitionTemporal Action LocalizationHuman Activity Recognition: A Spatio-temporal Image Encoding of 3D Skeleton Data for Online Action Detection
Human activity recognition (HAR) based on skeleton data that can be extracted from videos (Kinect for example) , or provided by a depth camera is a time series classification problem, where handling both spatial and temp…
Action DetectionActivity RecognitionHuman Activity RecognitionOnline Action Detection+2Lossy Event Compression based on Image-derived Quad Trees and Poisson Disk Sampling
With several advantages over conventional RGB cameras, event cameras have provided new opportunities for tackling visual tasks under challenging scenarios with fast motion, high dynamic range, and/or power constraint. Ye…
Event-based visionImage ReconstructionVideo CompressionLess is More: Surgical Phase Recognition from Timestamp Supervision
Surgical phase recognition is a fundamental task in computer-assisted surgery systems. Most existing works are under the supervision of expensive and time-consuming full annotations, which require the surgeons to repeat …
Surgical phase recognitionAction Recognition from Single Timestamp Supervision in Untrimmed Videos
Recognising actions in videos relies on labelled supervision during training, typically the start and end times of each action instance. This supervision is not only subjective, but also expensive to acquire. Weak video-…
Action RecognitionTemporal Action Localization