paper-with-me

Papers

Memorability: An image-computable measure of information utility

2021-04-01 · Zoya Bylinskii, Lore Goetschalckx, Anelise Newman, Aude Oliva

The pixels in an image, and the objects, scenes, and actions that they compose, determine whether an image will be memorable or forgettable. While memorability varies by image, it is largely independent of an individual observer. Observer independence is what makes memorability an image-computable measure of information, and eligible for automatic prediction. In this chapter, we zoom into memorability with a computational lens, detailing the state-of-the-art algorithms that accurately predict image memorability relative to human behavioral data, using image features at different scales from raw pixels to semantic labels. We discuss the design of algorithms and visualizations for face, object, and scene memorability, as well as algorithms that generalize beyond static scenes to actions and videos. We cover the state-of-the-art deep learning approaches that are the current front runners in the memorability prediction space. Beyond prediction, we show how recent A.I. approaches can be used to create and modify visual memorability. Finally, we preview the computational applications that memorability can power, from filtering visual streams to enhancing augmented reality interfaces.

📄 PDF Abstract BibTeX arXiv:2104.00805

Code (0)

등록된 구현이 없습니다.

Tasks

Prediction

Similar Papers 제목 키워드 기반

Understanding and Predicting Image Memorability at a Large Scale

2015-12-01 · ICCV 2015 12 · Aditya Khosla, Akhil S. Raju, Antonio Torralba, Aude Oliva

Progress in estimating visual memorability has been limited by the small scale and lack of variety of benchmark data. Here, we introduce a novel experimental procedure to objectively measure human memory, building the la…

VideoMem: Constructing, Analyzing, Predicting Short-term and Long-term Video Memorability

2018-12-05 · ICCV 2019 10 · Romain Cohendet, Claire-Hélène Demarty, Ngoc Q. K. Duong, Martin Engilberge

Humans share a strong tendency to memorize/forget some of the visual information they encounter. This paper focuses on providing computational models for the prediction of the intrinsic memorability of visual content. To…

MemorizationPrediction

Generating Memorable Images Based on Human Visual Memory Schemas

2020-05-06 · Cameron Kyle-Davidson, Adrian G. Bors, Karla K. Evans

This research study proposes using Generative Adversarial Networks (GAN) that incorporate a two-dimensional measure of human memorability to generate memorable or non-memorable images of scenes. The memorability of the g…

MediaEval 2018: Predicting Media Memorability Task

2018-07-03 · Romain Cohendet, Claire-Hélène Demarty, Ngoc Duong, Mats Sjöberg 외

In this paper, we present the Predicting Media Memorability task, which is proposed as part of the MediaEval 2018 Benchmarking Initiative for Multimedia Evaluation. Participants are expected to design systems that automa…

BenchmarkingMemorization

Understanding and Predicting the Memorability of Outdoor Natural Scenes

2018-10-09 · Jiaxin Lu, Mai Xu, Ren Yang, Zulin Wang

Memorability measures how easily an image is to be memorized after glancing, which may contribute to designing magazine covers, tourism publicity materials, and so forth. Recent works have shed light on the visual featur…