paper-with-me

홈 › Papers

Efficiently Scanning and Resampling Spatio-Temporal Tasks with Irregular Observations

2024-10-11 · Bryce Ferenczi, Michael Burke, Tom Drummond

Various works have aimed at combining the inference efficiency of recurrent models and training parallelism of multi-head attention for sequence modeling. However, most of these works focus on tasks with fixed-dimension observation spaces, such as individual tokens in language modeling or pixels in image completion. To handle an observation space of varying size, we propose a novel algorithm that alternates between cross-attention between a 2D latent state and observation, and a discounted cumulative sum over the sequence dimension to efficiently accumulate historical information. We find this resampling cycle is critical for performance. To evaluate efficient sequence modeling in this domain, we introduce two multi-agent intention tasks: simulated agents chasing bouncing particles and micromanagement analysis in professional StarCraft II games. Our algorithm achieves comparable accuracy with a lower parameter count, faster training and inference compared to existing methods.

📄 PDF Abstract BibTeX arXiv:2410.08681

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModelingLanguage ModellingStarcraftStarcraft II

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Multi-Head Attention 설명 없음
Focus 설명 없음

Similar Papers 제목 키워드 기반

mlr3spatiotempcv: Spatiotemporal resampling methods for machine learning in R

2021-10-25 · Patrick Schratz, Marc Becker, Michel Lang, Alexander Brenning

Spatial and spatiotemporal machine-learning models require a suitable framework for their model assessment, model selection, and hyperparameter tuning, in order to avoid error estimation bias and over-fitting. This contr…

BIG-bench Machine LearningModel Selection

Continuous Space-Time Video Resampling with Invertible Motion Steganography

2025-01-01 · CVPR 2025 1 · Yuantong Zhang, Zhenzhong Chen

Space-time video resampling aims to conduct both spatial-temporal downsampling and upsampling processes to achieve high-quality video reconstruction.Although there has been much progress, some major challenges still …

TRUST: Efficient Abdominal Trauma Recognition via Image-to-Ultrasound-Video Transfer Learning

2026-06-26 · Enguang Wang, Hao Zhou, Shuo Gao, Tuo Liu 외 arxiv

Abdominal ultrasound is indispensable for rapid, noninvasive trauma triage. However, interpreting the subtle dynamic cues embedded in continuous scanning is time-intensive and operator-dependent. Parameter-Efficient Imag…

Computational EfficiencyTransfer Learning

UST-SSM: Unified Spatio-Temporal State Space Models for Point Cloud Video Modeling

2025-08-20 · Peiming Li, Ziyi Wang, Yulin Yuan, Hong Liu 외 arxiv

Point cloud videos capture dynamic 3D motion while reducing the effects of lighting and viewpoint variations, making them highly effective for recognizing subtle and continuous human actions. Although Selective State Spa…

DM3D: Deformable Mamba via Offset-Guided Differentiable Scanning for Point Cloud Understanding

2025-12-03 · Bin Liu, Chunyang Wang, Xuelian Liu, Ge Zhang arxiv

State Space Models (SSMs) show significant potential for long-sequence modeling, but their reliance on input order conflicts with the irregular nature of point clouds. Existing approaches often rely on predefined seriali…

Few-Shot LearningPoint Clouds