paper-with-me

홈 › Papers

MixANT: Observation-dependent Memory Propagation for Stochastic Dense Action Anticipation

2025-09-14 · Syed Talal Wasim, Hamid Suleman, Olga Zatsarynna, Muzammal Naseer, Juergen Gall arxiv

We present MixANT, a novel architecture for stochastic long-term dense anticipation of human activities. While recent State Space Models (SSMs) like Mamba have shown promise through input-dependent selectivity on three key parameters, the critical forget-gate ($\textbf{A}$ matrix) controlling temporal memory remains static. We address this limitation by introducing a mixture of experts approach that dynamically selects contextually relevant $\textbf{A}$ matrices based on input features, enhancing representational capacity without sacrificing computational efficiency. Extensive experiments on the 50Salads, Breakfast, and Assembly101 datasets demonstrate that MixANT consistently outperforms state-of-the-art methods across all evaluation settings. Our results highlight the importance of input-dependent forget-gate mechanisms for reliable prediction of human behavior in diverse real-world scenarios.

📄 PDF Abstract BibTeX arXiv:2509.11394

Code (0)

등록된 구현이 없습니다.

Tasks

Computational EfficiencyAction Anticipation

Similar Papers 제목 키워드 기반

Stochastic Backpropagation: A Memory Efficient Strategy for Training Video Models

2022-03-31 · CVPR 2022 1 · Feng Cheng, Mingze Xu, Yuanjun Xiong, Hao Chen 외

We propose a memory efficient method, named Stochastic Backpropagation (SBP), for training deep neural networks on videos. It is based on the finding that gradients from incomplete execution for backpropagation can still…

Action DetectionAction RecognitionGPU

Stochastic Variational Propagation: Local, Scalable and Efficient Alternative to Backpropagation

2025-05-08 · Bojian Yin, Federico Corradi

Backpropagation (BP) is the cornerstone of deep learning, but its reliance on global gradient synchronization limits scalability and imposes significant memory overhead. We propose Stochastic Variational Propagation (SVP…

DiversityRepresentation LearningVariational Inference

Memory-dependent abstractions of stochastic systems through the lens of transfer operators

2025-02-06 · Adrien Banse, Giannis Delimpaltadakis, Luca Laurenti, Manuel Mazo Jr. 외

With the increasing ubiquity of safety-critical autonomous systems operating in uncertain environments, there is a need for mathematical methods for formal verification of stochastic models. Towards formally verifying pr…

An In-depth Study of Stochastic Backpropagation

2022-09-30 · Jun Fang, Mingze Xu, Hao Chen, Bing Shuai 외

In this paper, we provide an in-depth study of Stochastic Backpropagation (SBP) when training deep neural networks for standard image classification and object detection tasks. During backward propagation, SBP calculates…

GPUimage-classificationImage Classificationobject-detection+1

Memory-based control with recurrent neural networks

2015-12-14 · Nicolas Heess, Jonathan J. Hunt, Timothy P. Lillicrap, David Silver

Partially observed control problems are a challenging aspect of reinforcement learning. We extend two related, model-free algorithms for continuous control -- deterministic policy gradient and stochastic value gradient -…

continuous-controlContinuous ControlReinforcement Learning