paper-with-me

홈 › Papers

Anticipative Feature Fusion Transformer for Multi-Modal Action Anticipation

2022-10-23 · Zeyun Zhong, David Schneider, Michael Voit, Rainer Stiefelhagen, Jürgen Beyerer

Although human action anticipation is a task which is inherently multi-modal, state-of-the-art methods on well known action anticipation datasets leverage this data by applying ensemble methods and averaging scores of unimodal anticipation networks. In this work we introduce transformer based modality fusion techniques, which unify multi-modal data at an early stage. Our Anticipative Feature Fusion Transformer (AFFT) proves to be superior to popular score fusion approaches and presents state-of-the-art results outperforming previous methods on EpicKitchens-100 and EGTEA Gaze+. Our model is easily extensible and allows for adding new modalities without architectural changes. Consequently, we extracted audio features on EpicKitchens-100 which we add to the set of commonly used features in the community.

📄 PDF Abstract BibTeX arXiv:2210.12649

Code (1)

zeyun-zhong/afft 공식 구현 pytorch

Tasks

Action Anticipation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Position-Wise Feed-Forward Layer 설명 없음
Adam 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

Solar Irradiance Anticipative Transformer

2023-05-29 · Thomas M. Mercier, Tasmiat Rahman, Amin Sabet

This paper proposes an anticipative transformer-based model for short-term solar irradiance forecasting. Given a sequence of sky images, our proposed vision transformer encodes features of consecutive images, feeding int…

DecoderSolar Irradiance Forecasting

On the Efficacy of Text-Based Input Modalities for Action Anticipation

2024-01-23 · Apoorva Beedu, Harish Haresamudram, Karan Samel, Irfan Essa

Anticipating future actions is a highly challenging task due to the diversity and scale of potential future actions; yet, information from different modalities help narrow down plausible action choices. Each modality can…

Action Anticipation

Anticipative Video Transformer

2021-06-03 · ICCV 2021 10 · Rohit Girdhar, Kristen Grauman

We propose Anticipative Video Transformer (AVT), an end-to-end attention-based video modeling architecture that attends to the previously observed video in order to anticipate future actions. We train the model jointly t…

Action Anticipation

About the decomposition of pricing formulas under stochastic volatility models

2015-03-27

We obtain a decomposition of the call option price for a very general stochastic volatility diffusion model extending the decomposition obtained by E. Al\`os in [2] for the Heston model. We realize that a new term arises…

Text-Derived Knowledge Helps Vision: A Simple Cross-modal Distillation for Video-based Action Anticipation

2022-10-12 · Sayontan Ghosh, Tanvi Aggarwal, Minh Hoai, Niranjan Balasubramanian

Anticipating future actions in a video is useful for many autonomous and assistive technologies. Most prior action anticipation work treat this as a vision modality problem, where the models learn the task information pr…

Action AnticipationTransfer Learning