Multi-Label Activity Recognition using Activity-specific Features and Activity Correlations
Multi-label activity recognition is designed for recognizing multiple activities that are performed simultaneously or sequentially in each video. Most recent activity recognition networks focus on single-activities, that assume only one activity in each video. These networks extract shared features for all the activities, which are not designed for multi-label activities. We introduce an approach to multi-label activity recognition that extracts independent feature descriptors for each activity and learns activity correlations. This structure can be trained end-to-end and plugged into any existing network structures for video classification. Our method outperformed state-of-the-art approaches on four multi-label activity recognition datasets. To better understand the activity-specific features that the system generated, we visualized these activity-specific features in the Charades dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
Activity RecognitionVideo ClassificationSimilar Papers 제목 키워드 기반
Sequential Weakly Labeled Multi-Activity Localization and Recognition on Wearable Sensors using Recurrent Attention Networks
With the popularity and development of the wearable devices such as smartphones, human activity recognition (HAR) based on sensors has become as a key research area in human computer interaction and ubiquitous computing.…
Activity RecognitionHuman Activity RecognitionATARS: An Aerial Traffic Atomic Activity Recognition and Temporal Segmentation Dataset
Traffic Atomic Activity which describes traffic patterns for topological intersection dynamics is a crucial topic for the advancement of intelligent driving systems. However, existing atomic activity datasets are collect…
Activity RecognitionTemporal LocalizationContrastive Learning for Multimodal Human Activity Recognition with Limited Labeled Data
Human activity recognition serves as the foundation for various emerging applications. In recent years, researchers have used collaborative sensing of multi-source sensors to capture complex and dynamic human activities.…
Human Activity RecognitionContrastive LearningOn Multi-resident Activity Recognition in Ambient Smart-Homes
Increasing attention to the research on activity monitoring in smart homes has motivated the employment of ambient intelligence to reduce the deployment cost and solve the privacy issue. Several approaches have been prop…
Activity RecognitionGenerative Resident Separation and Multi-label Classification for Multi-person Activity Recognition
This paper presents two models to address the problem of multi-person activity recognition using ambient sensors in a home. The first model, Seq2Res, uses a sequence generation approach to separate sensor events from dif…
Activity RecognitionMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATION