paper-with-me

홈 › Papers

SRVP: Strong Recollection Video Prediction Model Using Attention-Based Spatiotemporal Correlation Fusion

2025-04-10 · Yuseon Kim, Kyongseok Park

Video prediction (VP) generates future frames by leveraging spatial representations and temporal context from past frames. Traditional recurrent neural network (RNN)-based models enhance memory cell structures to capture spatiotemporal states over extended durations but suffer from gradual loss of object appearance details. To address this issue, we propose the strong recollection VP (SRVP) model, which integrates standard attention (SA) and reinforced feature attention (RFA) modules. Both modules employ scaled dot-product attention to extract temporal context and spatial correlations, which are then fused to enhance spatiotemporal representations. Experiments on three benchmark datasets demonstrate that SRVP mitigates image quality degradation in RNN-based models while achieving predictive performance comparable to RNN-free architectures.

📄 PDF Abstract BibTeX arXiv:2504.08012

Code (1)

yuseonk/srvp 공식 구현 pytorch

Tasks

Video Prediction

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

Synthetic Human Memories: AI-Edited Images and Videos Can Implant False Memories and Distort Recollection

2024-09-13 · Pat Pataranutaporn, Chayapatr Archiwaranguprok, Samantha W. T. Chan, Elizabeth Loftus 외

AI is increasingly used to enhance images and videos, both intentionally and unintentionally. As AI editing tools become more integrated into smartphones, users can modify or animate photos into realistic videos. This st…

Rethinking Memorization Measures and their Implications in Large Language Models

2025-07-20 · Bishwamittra Ghosh, Soumi Das, Qinyuan Wu, Mohammad Aflah Khan 외 arxiv

Concerned with privacy threats, memorization in LLMs is often seen as undesirable, specifically for learning. In this paper, we study whether memorization can be avoided when optimally learning a language, and whether th…

Two is better than one: distinct roles for familiarity and recollection in retrieving palimpsest memories

2011-12-01 · NeurIPS 2011 12 · Cristina Savin, Peter Dayan, Máté Lengyel

Storing a new pattern in a palimpsest memory system comes at the cost of interfering with the memory traces of previously stored items. Knowing the age of a pattern thus becomes critical for recalling it faithfully. This…

Generation and Consolidation of Recollections for Efficient Deep Lifelong Learning

2018-01-01 · ICLR 2018 1 · Matt Riemer, Michele Franceschini, and Tim Klinger

Deep lifelong learning systems need to efficiently manage resources to scale to large numbers of experiences and non-stationary goals. In this paper, we explore the relationship between lossy compression and the resource…

Knowledge DistillationLifelong learning

Efficient-SAM2: Accelerating SAM2 with Object-Aware Visual Encoding and Memory Retrieval

2026-02-09 · Jing Zhang, Zhikai Li, Xuewen Liu, Qingyi Gu arxiv

Segment Anything Model 2 (SAM2) shows excellent performance in video object segmentation tasks; however, the heavy computational burden hinders its application in real-time video processing. Although there have been effo…

Video Object Segmentation