paper-with-me

Papers

Human Action Recognition in Egocentric Perspective Using 2D Object and Hands Pose

2023-06-08 · Wiktor Mucha, Martin Kampel

Egocentric action recognition is essential for healthcare and assistive technology that relies on egocentric cameras because it allows for the automatic and continuous monitoring of activities of daily living (ADLs) without requiring any conscious effort from the user. This study explores the feasibility of using 2D hand and object pose information for egocentric action recognition. While current literature focuses on 3D hand pose information, our work shows that using 2D skeleton data is a promising approach for hand-based action classification, might offer privacy enhancement, and could be less computationally demanding. The study uses a state-of-the-art transformer-based method to classify sequences and achieves validation results of 94%, outperforming other existing solutions. The accuracy of the test subset drops to 76%, indicating the need for further generalization improvement. This research highlights the potential of 2D hand and object pose information for action recognition tasks and offers a promising alternative to 3D-based methods.

📄 PDF Abstract BibTeX arXiv:2306.05147

Code (0)

등록된 구현이 없습니다.

Tasks

Action ClassificationAction RecognitionTemporal Action Localization

Methods 이 논문이 사용한 방법론

Test 설명 없음

Similar Papers 제목 키워드 기반

The MECCANO Dataset: Understanding Human-Object Interactions from Egocentric Videos in an Industrial-like Domain

2020-10-12 · Francesco Ragusa, Antonino Furnari, Salvatore Livatino, Giovanni Maria Farinella

Wearable cameras allow to collect images and videos of humans interacting with the world. While human-object interactions have been thoroughly investigated in third person vision, the problem has been understudied in ego…

Action RecognitionActive Object DetectionHuman-Object Interaction DetectionObject+3

Egocentric Hand Track and Object-based Human Action Recognition

2019-05-02 · Georgios Kapidis, Ronald Poppe, Elsbeth van Dam, Lucas P. J. J. Noldus 외

Egocentric vision is an emerging field of computer vision that is characterized by the acquisition of images and video from the first person perspective. In this paper we address the challenge of egocentric human action …

Action RecognitionObjectobject-detectionObject Detection+1

MECCANO: A Multimodal Egocentric Dataset for Humans Behavior Understanding in the Industrial-like Domain

2022-09-19 · Francesco Ragusa, Antonino Furnari, Giovanni Maria Farinella

Wearable cameras allow to acquire images and videos from the user's perspective. These data can be processed to understand humans behavior. Despite human behavior analysis has been thoroughly investigated in third person…

Action AnticipationAction RecognitionHuman-Object Interaction Detection

Head and eye egocentric gesture recognition for human-robot interaction using eyewear cameras

2022-01-27 · Javier Marina-Miranda, V. Javier Traver

Non-verbal communication plays a particularly important role in a wide range of scenarios in Human-Robot Interaction (HRI). Accordingly, this work addresses the problem of human gesture recognition. In particular, we foc…

Action RecognitionGesture Recognition

In My Perspective, In My Hands: Accurate Egocentric 2D Hand Pose and Action Recognition

2024-04-14 · Wiktor Mucha, Martin Kampel

Action recognition is essential for egocentric video understanding, allowing automatic and continuous monitoring of Activities of Daily Living (ADLs) without user effort. Existing literature focuses on 3D hand pose input…

Action RecognitionHand Pose EstimationSkeleton Based Action RecognitionVideo Understanding