paper-with-me

홈 › Papers

Ego-Surfing: Person Localization in First-Person Videos Using Ego-Motion Signatures

2016-06-15 · Ryo Yonetani, Kris M. Kitani, Yoichi Sato

We envision a future time when wearable cameras are worn by the masses and recording first-person point-of-view videos of everyday life. While these cameras can enable new assistive technologies and novel research challenges, they also raise serious privacy concerns. For example, first-person videos passively recorded by wearable cameras will necessarily include anyone who comes into the view of a camera -- with or without consent. Motivated by these benefits and risks, we developed a self-search technique tailored to first-person videos. The key observation of our work is that the egocentric head motion of a target person (ie, the self) is observed both in the point-of-view video of the target and observer. The motion correlation between the target person's video and the observer's video can then be used to identify instances of the self uniquely. We incorporate this feature into the proposed approach that computes the motion correlation over densely-sampled trajectories to search for a target individual in observer videos. Our approach significantly improves self-search performance over several well-known face detectors and recognizers. Furthermore, we show how our approach can enable several practical applications such as privacy filtering, target video retrieval, and social group clustering.

📄 PDF Abstract BibTeX arXiv:1606.04637

Code (0)

등록된 구현이 없습니다.

Tasks

ClusteringRetrievalVideo Retrieval

Similar Papers 제목 키워드 기반

Ego-Surfing First-Person Videos

2015-06-01 · CVPR 2015 6 · Ryo Yonetani, Kris M. Kitani, Yoichi Sato

We envision a future time when wearable cameras (e.g., small cameras in glasses or pinned on a shirt collar) are worn by the masses and record first-person point-of-view (POV) videos of everyday life. While these cameras…

Future Person Localization in First-Person Videos

2017-11-30 · CVPR 2018 6 · Takuma Yagi, Karttikeya Mangalam, Ryo Yonetani, Yoichi Sato

We present a new task that predicts future locations of people observed in first-person videos. Consider a first-person video stream continuously recorded by a wearable camera. Given a short clip of a person that is extr…

Egocentric Field-of-View Localization Using First-Person Point-of-View Devices

2015-10-07 · Vinay Bettadapura, Irfan Essa, Caroline Pantofaru

We present a technique that uses images, videos and sensor data taken from first-person point-of-view devices to perform egocentric field-of-view (FOV) localization. We define egocentric FOV localization as capturing the…

Using Panoramic Videos for Multi-person Localization and Tracking in a 3D Panoramic Coordinate

2019-11-24 · Fan Yang, Feiran Li, Yang Wu, Sakriani Sakti 외

3D panoramic multi-person localization and tracking are prominent in many applications, however, conventional methods using LiDAR equipment could be economically expensive and also computationally inefficient due to the …

Multi-Object Tracking

OWL (Observe, Watch, Listen): Audiovisual Temporal Context for Localizing Actions in Egocentric Videos

2022-02-10 · Merey Ramazanova, Victor Escorcia, Fabian Caba Heilbron, Chen Zhao 외

Egocentric videos capture sequences of human activities from a first-person perspective and can provide rich multimodal signals. However, most current localization methods use third-person videos and only incorporate vis…

Action LocalizationTemporal Action LocalizationTemporal Localization