paper-with-me

홈 › Papers

Curriculum Learning With Infant Egocentric Videos

2023-09-21 · NeurIPS 2023 11

Infants possess a remarkable ability to rapidly learn and process visual inputs. As an infant's mobility increases, so does the variety and dynamics of their visual inputs. Is this change in the properties of the visual inputs beneficial or even critical for the proper development of the visual system? To address this question, we used video recordings from infants wearing head-mounted cameras to train a variety of self-supervised learning models. Critically, we separated the infant data by age group and evaluated the importance of training with a curriculum aligned with developmental order. We found that initiating learning with the data from the youngest age group provided the strongest learning signal and led to the best learning outcomes in terms of downstream task performance. We then showed that the benefits of the data from the youngest age group are due to the slowness and simplicity of the visual experience. The results provide strong empirical evidence for the importance of the properties of the early infant experience and developmental progression in training. More broadly, our approach and findings take a noteworthy step towards reverse engineering the learning mechanisms in newborn brains using image-computable models from artificial intelligence.

📄 PDF Abstract BibTeX

Code (1)

ssheybani/baby-vision-curriculum 공식 구현 pytorch

Similar Papers 제목 키워드 기반

Reverse-engineer the Distributional Structure of Infant Egocentric Views for Training Generalizable Image Classifiers

2021-06-12 · Satoshi Tsutsui, David Crandall, Chen Yu

We analyze egocentric views of attended objects from infants. This paper shows 1) empirical evidence that children's egocentric views have more diverse distributions compared to adults' views, 2) we can computationally s…

A Semi-Automated Method for Object Segmentation in Infant's Egocentric Videos to Study Object Perception

2016-02-08 · Qazaleh Mirsharif, Sidharth Sadani, Shishir Shah, Hanako Yoshida 외

Object segmentation in infant's egocentric videos is a fundamental step in studying how children perceive objects in early stages of development. From the computer vision perspective, object segmentation in such videos p…

ObjectOptical Flow EstimationSegmentationSemantic Segmentation

EgoBabyVLM: Benchmarking Cross-Modal Learning from Naturalistic Egocentric Video Data

2026-05-18 · Dongyan Lin, Phillip Rust, Angel Villar Corrales, Alvin W. M. Tan 외 arxiv

Children acquire language grounding with remarkable robustness from limited visuo-linguistic input in ways that surpass today's best large multimodal models. Recent research suggests current vision-language models (VLMs)…

A Computational Model of Early Word Learning from the Infant's Point of View

2020-06-04 · Satoshi Tsutsui, Arjun Chandrasekaran, Md. Alimoor Reza, David Crandall 외

Human infants have the remarkable ability to learn the associations between object names and visual objects from inherently ambiguous experiences. Researchers in cognitive science and developmental psychology have built …

Assessing the alignment between infants' visual and linguistic experience using multimodal language models

2025-11-24 · Alvin Wei Ming Tan, Jane Yang, Tarun Sepuri, Khai Loong Aw 외 arxiv

Figuring out which objects or concepts words refer to is a central language learning challenge for young children. Most models of this process posit that children learn early object labels from co-occurrences of words an…