paper-with-me

Papers

Object Aware Egocentric Online Action Detection

2024-06-03 · Joungbin An, Yunsu Park, Hyolim Kang, Seon Joo Kim

Advancements in egocentric video datasets like Ego4D, EPIC-Kitchens, and Ego-Exo4D have enriched the study of first-person human interactions, which is crucial for applications in augmented reality and assisted living. Despite these advancements, current Online Action Detection methods, which efficiently detect actions in streaming videos, are predominantly designed for exocentric views and thus fail to capitalize on the unique perspectives inherent to egocentric videos. To address this gap, we introduce an Object-Aware Module that integrates egocentric-specific priors into existing OAD frameworks, enhancing first-person footage interpretation. Utilizing object-specific details and temporal dynamics, our module improves scene understanding in detecting actions. Validated extensively on the Epic-Kitchens 100 dataset, our work can be seamlessly integrated into existing models with minimal overhead and bring consistent performance enhancements, marking an important step forward in adapting action detection systems to egocentric video analysis.

📄 PDF Abstract BibTeX arXiv:2406.01079

Code (0)

등록된 구현이 없습니다.

Tasks

Action DetectionObjectOnline Action DetectionScene Understanding

Similar Papers 제목 키워드 기반

EgoGenesis: Egocentric World-Action Modeling with Online Anchored Projective Memory and Action-3D RoPE

2026-07-30 · Zexuan Yan, Yuzhou Wu, Yue Ma, Zonghang He 외 arxiv

Egocentric video offers rich manipulation experience for embodied AI, yet collecting diverse egocentric data across scenes, objects, motions, and embodiments remains costly. We present \method, an egocentric world-action…

Video Generation

EgoAction: Egocentric Action Composition with Reliability-Aware Temporal Fusion for the EPIC-KITCHENS Action Detection Challenge at CVPR 2026

2026-05-23 · Zhiheng Fu, Zixu Li, Zhiwei Chen, Fangxu Liu 외 arxiv

The EPIC-KITCHENS-100 Action Detection challenge evaluates whether a model can localize the start and end of each action in long untrimmed egocentric videos and assign the corresponding verb--noun action label. In this r…

Action Detection

PREGO: online mistake detection in PRocedural EGOcentric videos

2024-04-02 · CVPR 2024 1 · Alessandro Flaborea, Guido Maria D'Amely di Melendugno, Leonardo Plini, Luca Scofano 외

Promptly identifying procedural errors from egocentric videos in an online setting is highly challenging and valuable for detecting mistakes as soon as they happen. This capability has a wide range of applications across…

Action RecognitionBenchmarkingMistake DetectionOne-Class Classification+1

Symbiotic Attention with Privileged Information for Egocentric Action Recognition

2020-02-08 · Xiaohan Wang, Yu Wu, Linchao Zhu, Yi Yang

Egocentric video recognition is a natural testbed for diverse interaction reasoning. Due to the large action vocabulary in egocentric video datasets, recent studies usually utilize a two-branch structure for action recog…

Action RecognitionEgocentric Activity RecognitionGeneral Classificationobject-detection+3

The MECCANO Dataset: Understanding Human-Object Interactions from Egocentric Videos in an Industrial-like Domain

2020-10-12 · Francesco Ragusa, Antonino Furnari, Salvatore Livatino, Giovanni Maria Farinella

Wearable cameras allow to collect images and videos of humans interacting with the world. While human-object interactions have been thoroughly investigated in third person vision, the problem has been understudied in ego…

Action RecognitionActive Object DetectionHuman-Object Interaction DetectionObject+3