paper-with-me

홈 › Papers

On Diverse Asynchronous Activity Anticipation

2020-08-01 · ECCV 2020 8 · He Zhao, Richard P. Wildes

We investigate the joint anticipation of long-term activity labels and their corresponding times with the aim of improving both the naturalness and diversity of predictions. We address these matters using Conditional Adversarial Generative Networks for Discrete Sequences. Central to our approach is a reexamination of the unavoidable sample quality vs. diversity tradeoff of the recently emerged Gumbel-Softmax relaxation based GAN on discrete data. In particular, we ameliorate this trade-off with a simple but effective sample distance regularizer. Moreover, we provide a unified approach to inference of activity labels and their times so that a single integrated optimization succeeds for both. With this novel approach in hand, we demonstrate the effectiveness of the resulting discrete sequential GAN on multimodal activity anticipation. We evaluate the approach on three standard datasets and show that it outperforms previous approaches in terms of both accuracy and diversity, thereby yielding a new state-of-the-art in activity anticipation.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Diversity

Similar Papers 제목 키워드 기반

A Hybrid Egocentric Activity Anticipation Framework via Memory-Augmented Recurrent and One-Shot Representation Forecasting

2022-01-01 · CVPR 2022 1 · Tianshan Liu, Kin-Man Lam

Egocentric activity anticipation involves identifying the interacted objects and target action patterns in the near future. A standard activity anticipation paradigm is recurrently forecasting future representations …

Contrastive Learning

Uncertainty-boosted Robust Video Activity Anticipation

2024-04-29 · Zhaobo Qi, Shuhui Wang, Weigang Zhang, Qingming Huang

Video activity anticipation aims to predict what will happen in the future, embracing a broad application prospect ranging from robot vision and autonomous driving. Despite the recent progress, the data uncertainty issue…

Autonomous Driving

Group Activity Prediction with Sequential Relational Anticipation Model

2020-08-06 · ECCV 2020 8 · Junwen Chen, Wentao Bao, Yu Kong

In this paper, we propose a novel approach to predict group activities given the beginning frames with incomplete activity executions. Existing action prediction approaches learn to enhance the representation power of th…

Activity PredictionmodelPrediction

Zero-Shot Anticipation for Instructional Activities

2018-12-06 · ICCV 2019 10 · Fadime Sener, Angela Yao

How can we teach a robot to predict what will happen next for an activity it has never seen before? We address this problem of zero-shot anticipation by presenting a hierarchical model that generalizes instructional know…

Zero-Shot Learning

Self-Regulated Learning for Egocentric Video Activity Anticipation

2021-11-23 · Zhaobo Qi, Shuhui Wang, Chi Su, Li Su 외

Future activity anticipation is a challenging problem in egocentric vision. As a standard future activity anticipation paradigm, recursive sequence prediction suffers from the accumulation of errors. To address this prob…

Multi-Task Learning