paper-with-me

Papers

Temporally Precise Action Spotting in Soccer Videos Using Dense Detection Anchors

2022-05-20 · João V. B. Soares, Avijit Shah, Topojoy Biswas

We present a model for temporally precise action spotting in videos, which uses a dense set of detection anchors, predicting a detection confidence and corresponding fine-grained temporal displacement for each anchor. We experiment with two trunk architectures, both of which are able to incorporate large temporal contexts while preserving the smaller-scale features required for precise localization: a one-dimensional version of a u-net, and a Transformer encoder (TE). We also suggest best practices for training models of this kind, by applying Sharpness-Aware Minimization (SAM) and mixup data augmentation. We achieve a new state-of-the-art on SoccerNet-v2, the largest soccer video dataset of its kind, with marked improvements in temporal localization. Additionally, our ablations show: the importance of predicting the temporal displacements; the trade-offs between the u-net and TE trunks; and the benefits of training with SAM and mixup.

📄 PDF Abstract BibTeX arXiv:2205.10450

Code (1)

yahoo/spivak 공식 구현 tf

Tasks

Action SpottingData AugmentationTemporal Localization

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…

Similar Papers 제목 키워드 기반

A Context-Aware Loss Function for Action Spotting in Soccer Videos

2019-12-03 · CVPR 2020 6 · Anthony Cioppa, Adrien Deliège, Silvio Giancola, Bernard Ghanem 외

In video understanding, action spotting consists in temporally localizing human-induced events annotated with single timestamps. In this paper, we propose a novel loss function that specifically considers the temporal co…

Action SpottingVideo Understanding

ASTRA: An Action Spotting TRAnsformer for Soccer Videos

2024-04-02 · Artur Xarles, Sergio Escalera, Thomas B. Moeslund, Albert Clapés

In this paper, we introduce ASTRA, a Transformer-based model designed for the task of Action Spotting in soccer matches. ASTRA addresses several challenges inherent in the task and dataset, including the requirement for …

Action LocalizationAction SpottingDecoder

SoccerNet: A Scalable Dataset for Action Spotting in Soccer Videos

2018-04-12 · Silvio Giancola, Mohieddine Amine, Tarek Dghaily, Bernard Ghanem

In this paper, we introduce SoccerNet, a benchmark for action spotting in soccer videos. The dataset is composed of 500 complete soccer games from six main European leagues, covering three seasons from 2014 to 2017 and a…

Action ClassificationAction DetectionAction RecognitionAction Spotting

Improved Soccer Action Spotting using both Audio and Video Streams

2020-11-09 · Bastien Vanderplaetse, Stéphane Dupont

In this paper, we propose a study on multi-modal (audio and video) action spotting and classification in soccer videos. Action spotting and classification are the tasks that consist in finding the temporal anchors of eve…

Action ClassificationAction SpottingClassificationGeneral Classification

Feature Combination Meets Attention: Baidu Soccer Embeddings and Transformer based Temporal Detection

2021-06-28 · Xin Zhou, Le Kang, Zhiyu Cheng, Bo He 외

With rapidly evolving internet technologies and emerging tools, sports related videos generated online are increasing at an unprecedentedly fast pace. To automate sports video editing/highlight generation process, a key …

Action RecognitionAction SpottingReplay GroundingVideo Editing+1