An Evaluation of Action Recognition Models on EPIC-Kitchens
We benchmark contemporary action recognition models (TSN, TRN, and TSM) on the recently introduced EPIC-Kitchens dataset and release pretrained models on GitHub (https://github.com/epic-kitchens/action-models) for others to build upon. In contrast to popular action recognition datasets like Kinetics, Something-Something, UCF101, and HMDB51, EPIC-Kitchens is shot from an egocentric perspective and captures daily actions in-situ. In this report, we aim to understand how well these models can tackle the challenges present in this dataset, such as its long tail class distribution, unseen environment test set, and multiple tasks (verb, noun and, action classification). We discuss the models' shortcomings and avenues for future research.
Code (2)
Tasks
Action ClassificationAction RecognitionSimilar Papers 제목 키워드 기반
Rescaling Egocentric Vision
This paper introduces the pipeline to extend the largest dataset in egocentric vision, EPIC-KITCHENS. The effort culminates in EPIC-KITCHENS-100, a collection of 100 hours, 20M frames, 90K actions in 700 variable-length …
Action AnticipationAction DetectionAction RecognitionCross-Modal Retrieval+3Towards Training Stronger Video Vision Transformers for EPIC-KITCHENS-100 Action Recognition
With the recent surge in the research of vision transformers, they have demonstrated remarkable potential for various challenging computer vision applications, such as image recognition, point cloud classification as wel…
Action RecognitionPoint Cloud ClassificationPredictionVideo UnderstandingLLaVAction: evaluating and training multi-modal large language models for action recognition
Understanding human behavior requires measuring behavioral actions. Due to its complexity, behavior is best mapped onto a rich, semantic structure such as language. The recent development of multi-modal large language mo…
Action RecognitionAction UnderstandingEgoSchemaMVBench+1FBK-HUPBA Submission to the EPIC-Kitchens 2019 Action Recognition Challenge
In this report we describe the technical details of our submission to the EPIC-Kitchens 2019 action recognition challenge. To participate in the challenge we have developed a number of CNN-LSTA [3] and HF-TSN [2] variant…
Action RecognitionObject-based (yet Class-agnostic) Video Domain Adaptation
Existing video-based action recognition systems typically require dense annotation and struggle in environments when there is significant distribution shift relative to the training data. Current methods for video domain…
Action RecognitionDomain AdaptationObject