paper-with-me

Papers

Developing hierarchical anticipations via neural network-based event segmentation

2022-06-04 · Christian Gumbsch, Maurits Adam, Birgit Elsner, Georg Martius, Martin V. Butz

Humans can make predictions on various time scales and hierarchical levels. Thereby, the learning of event encodings seems to play a crucial role. In this work we model the development of hierarchical predictions via autonomously learned latent event codes. We present a hierarchical recurrent neural network architecture, whose inductive learning biases foster the development of sparsely changing latent state that compress sensorimotor sequences. A higher level network learns to predict the situations in which the latent states tend to change. Using a simulated robotic manipulator, we demonstrate that the system (i) learns latent states that accurately reflect the event structure of the data, (ii) develops meaningful temporal abstract predictions on the higher level, and (iii) generates goal-anticipatory behavior similar to gaze behavior found in eye-tracking studies with infants. The architecture offers a step towards the autonomous learning of compressed hierarchical encodings of gathered experiences and the exploitation of these encodings to generate adaptive behavior.

📄 PDF Abstract BibTeX arXiv:2206.02042

Code (1)

cognitivemodeling/hierarchicalgatel0rd 공식 구현 pytorch

Tasks

Event SegmentationInductive Learning

Similar Papers 제목 키워드 기반

A Review of Mechanistic Models of Event Comprehension

2024-09-17 · Tan T. Nguyen

This review examines theoretical assumptions and computational models of event comprehension, tracing the evolution from discourse comprehension theories to contemporary event cognition frameworks. The review covers key …

Event SegmentationRepresentation Learning

Simultaneous Machine Translation with Tailored Reference

2023-10-20 · Shoutao Guo, Shaolei Zhang, Yang Feng

Simultaneous machine translation (SiMT) generates translation while reading the whole source sentence. However, existing SiMT models are typically trained using the same reference disregarding the varying amounts of avai…

Machine TranslationSentenceTranslation

Hierarchical Multi-label Classification for Fine-level Event Extraction from Aviation Accident Reports

2024-03-26 · Xinyu Zhao, Hao Yan, Yongming Liu

A large volume of accident reports is recorded in the aviation domain, which greatly values improving aviation safety. To better use those reports, we need to understand the most important events or impact factors accord…

Event ExtractionHierarchical Multi-label ClassificationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATION

Event-Aware Instructed Assistant for Referring Video Segmentation

2026-06-25 · Jinyu Liu, Henghui Ding, Shuting He, Yu-Gang Jiang arxiv

Existing referring video segmentation methods often treat a video as a single event consisting of multiple images, overlooking the fact that a video typically contains multiple distinct events. Under such a mechanism, th…

Video Segmentation

MouseSIS: A Frames-and-Events Dataset for Space-Time Instance Segmentation of Mice

2024-09-05 · Friedhelm Hamann, Hanxiong Li, Paul Mieske, Lars Lewejohann 외

Enabled by large annotated datasets, tracking and segmentation of objects in videos has made remarkable progress in recent years. Despite these advancements, algorithms still struggle under degraded conditions and during…

Instance SegmentationSegmentationSemantic SegmentationVideo Instance Segmentation