paper-with-me

Papers

Predicting Event Memorability from Contextual Visual Semantics

2021-12-01 · NeurIPS 2021 12 · Qianli Xu, Fen Fang, Ana Molino, Vigneshwaran Subbaraju, Joo-Hwee Lim

Episodic event memory is a key component of human cognition. Predicting event memorability,i.e., to what extent an event is recalled, is a tough challenge in memory research and has profound implications for artificial intelligence. In this study, we investigate factors that affect event memorability according to a cued recall process. Specifically, we explore whether event memorability is contingent on the event context, as well as the intrinsic visual attributes of image cues. We design a novel experiment protocol and conduct a large-scale experiment with 47 elder subjects over 3 months. Subjects’ memory of life events is tested in a cued recall process. Using advanced visual analytics methods, we build a first-of-its-kind event memorability dataset (called R3) with rich information about event context and visual semantic features. Furthermore, we propose a contextual event memory network (CEMNet) that tackles multi-modal input to predict item-wise event memorability, which outperforms competitive benchmarks. The findings inform deeper understanding of episodic event memory, and open up a new avenue for prediction of human episodic memory. Source code is available at https://github.com/ffzzy840304/Predicting-Event-Memorability.

📄 PDF Abstract BibTeX

Code (1)

ffzzy840304/predicting-event-memorability 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

Memory Network 설명 없음

Similar Papers 제목 키워드 기반

Multimodal Memorability: Modeling Effects of Semantics and Decay on Video Memorability

2020-09-05 · ECCV 2020 8 · Anelise Newman, Camilo Fosco, Vincent Casser, Allen Lee 외

A key capability of an intelligent system is deciding when events from past experience must be remembered and when they can be forgotten. Towards this goal, we develop a predictive model of human visual event memory and …

Predicting Media Memorability: Comparing Visual, Textual and Auditory Features

2021-12-15 · Lorin Sweeney, Graham Healy, Alan F. Smeaton

This paper describes our approach to the Predicting Media Memorability task in MediaEval 2021, which aims to address the question of media memorability by setting the task of automatically predicting video memorability. …

Diffusing Surrogate Dreams of Video Scenes to Predict Video Memorability

2022-12-19 · Lorin Sweeney, Graham Healy, Alan F. Smeaton

As part of the MediaEval 2022 Predicting Video Memorability task we explore the relationship between visual memorability, the visual representation that characterises it, and the underlying concept portrayed by that visu…

Leveraging Audio Gestalt to Predict Media Memorability

2020-12-31 · Lorin Sweeney, Graham Healy, Alan F. Smeaton

Memorability determines what evanesces into emptiness, and what worms its way into the deepest furrows of our minds. It is the key to curating more meaningful media content as we wade through daily digital torrents. The …

Multimodal Deep Learning

Feature representations useful for predicting image memorability

2023-03-14 · Takumi Harada, Hiroyuki Sakai

Prediction of image memorability has attracted interest in various fields. Consequently, the prediction accuracy of convolutional neural network (CNN) models has been approaching the empirical upper bound estimated based…

Object RecognitionOpen-Ended Question AnsweringPrediction