paper-with-me

Papers

A Semi-Automated Method for Object Segmentation in Infant's Egocentric Videos to Study Object Perception

2016-02-08 · Qazaleh Mirsharif, Sidharth Sadani, Shishir Shah, Hanako Yoshida, Joseph Burling

Object segmentation in infant's egocentric videos is a fundamental step in studying how children perceive objects in early stages of development. From the computer vision perspective, object segmentation in such videos pose quite a few challenges because the child's view is unfocused, often with large head movements, effecting in sudden changes in the child's point of view which leads to frequent change in object properties such as size, shape and illumination. In this paper, we develop a semi-automated, domain specific, method to address these concerns and facilitate the object annotation process for cognitive scientists allowing them to select and monitor the object under segmentation. The method starts with an annotation from the user of the desired object and employs graph cut segmentation and optical flow computation to predict the object mask for subsequent video frames automatically. To maintain accuracy, we use domain specific heuristic rules to re-initialize the program with new user input whenever object properties change dramatically. The evaluations demonstrate the high speed and accuracy of the presented method for object segmentation in voluminous egocentric videos. We apply the proposed method to investigate potential patterns in object distribution in child's view at progressive ages.

📄 PDF Abstract BibTeX arXiv:1602.02522

Code (0)

등록된 구현이 없습니다.

Tasks

ObjectOptical Flow EstimationSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

Reverse-engineer the Distributional Structure of Infant Egocentric Views for Training Generalizable Image Classifiers

2021-06-12 · Satoshi Tsutsui, David Crandall, Chen Yu

We analyze egocentric views of attended objects from infants. This paper shows 1) empirical evidence that children's egocentric views have more diverse distributions compared to adults' views, 2) we can computationally s…

A Computational Model of Early Word Learning from the Infant's Point of View

2020-06-04 · Satoshi Tsutsui, Arjun Chandrasekaran, Md. Alimoor Reza, David Crandall 외

Human infants have the remarkable ability to learn the associations between object names and visual objects from inherently ambiguous experiences. Researchers in cognitive science and developmental psychology have built …

Enhanced Self-Perception in Mixed Reality: Egocentric Arm Segmentation and Database with Automatic Labelling

2020-03-27 · Ester Gonzalez-Sosa, Pablo Perez, Ruben Tolosana, Redouane Kachach 외

In this study, we focus on the egocentric segmentation of arms to improve self-perception in Augmented Virtuality (AV). The main contributions of this work are: i) a comprehensive survey of segmentation algorithms for AV…

Mixed RealitySegmentation

SiamParseNet: Joint Body Parsing and Label Propagation in Infant Movement Videos

2020-07-16 · Haomiao Ni, Yuan Xue, Qian Zhang, Xiaolei Huang

General movement assessment (GMA) of infant movement videos (IMVs) is an effective method for the early detection of cerebral palsy (CP) in infants. Automated body parsing is a crucial step towards computer-aided GMA, in…

Egocentric Human Segmentation for Mixed Reality

2020-05-25 · Andrija Gajic, Ester Gonzalez-Sosa, Diego Gonzalez-Morin, Marcos Escudero-Viñolo 외

The objective of this work is to segment human body parts from egocentric video using semantic segmentation networks. Our contribution is two-fold: i) we create a semi-synthetic dataset composed of more than 15, 000 real…

Mixed RealitySegmentationSemantic Segmentation