홈 › Papers

Relational Action Forecasting

2019-04-08 · CVPR 2019 6 · Chen Sun, Abhinav Shrivastava, Carl Vondrick, Rahul Sukthankar, Kevin Murphy, Cordelia Schmid

This paper focuses on multi-person action forecasting in videos. More precisely, given a history of H previous frames, the goal is to detect actors and to predict their future actions for the next T frames. Our approach jointly models temporal and spatial interactions among different actors by constructing a recurrent graph, using actor proposals obtained with Faster R-CNN as nodes. Our method learns to select a subset of discriminative relations without requiring explicit supervision, thus enabling us to tackle challenging visual data. We refer to our model as Discriminative Relational Recurrent Network (DRRN). Evaluation of action prediction on AVA demonstrates the effectiveness of our proposed method compared to simpler baselines. Furthermore, we significantly improve performance on the task of early action classification on J-HMDB, from the previous SOTA of 48% to 60%.

📄 PDF Abstract BibTeX arXiv:1904.04231

Code (0)

등록된 구현이 없습니다.

Tasks

Action Classification Action Recognition General Classification

Methods 이 논문이 사용한 방법론

RPN A Region Proposal Network, or RPN, is a fully convolutional network that simultaneously predicts object bounds and objectness scores at each position. The RPN is trained…

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

RoIPool 설명 없음

Faster R-CNN Faster R-CNN is an object detection model that improves on Fast R-CNN by utilising a region proposal network…

Dynamic Neural Relational Inference

2020-06-01 · CVPR 2020 6 · Colin Graber, Alexander G. Schwing

Understanding interactions between entities, e.g., joints of the human body, team sports players, etc., is crucial for tasks like forecasting. However, interactions between entities are commonly not observed and often ha…

Trajectory Forecasting

Deep Representation Learning for Forecasting Recursive and Multi-Relational Events in Temporal Networks

2024-04-27 · Tony Gracious, Ambedkar Dukkipati

Understanding relations arising out of interactions among entities can be very difficult, and predicting them is even more challenging. This problem has many applications in various fields, such as financial networks and…

Decoder Graph Representation Learning Link Prediction Representation Learning

Memory-Augmented Dynamic Neural Relational Inference

2021-01-01 · ICCV 2021 10 · Dong Gong, Frederic Z. Zhang, Javen Qinfeng Shi, Anton Van Den Hengel

Dynamic interacting systems are prevalent in vision tasks. These interactions are usually difficult to observe and measure directly, and yet understanding latent interactions is essential for performing inference tas…

Trajectory Prediction

Graph Deep Factors for Forecasting

2020-10-14 · Hongjie Chen, Ryan A. Rossi, Kanak Mahadik, Sungchul Kim 외

Deep probabilistic forecasting techniques have recently been proposed for modeling large collections of time-series. However, these techniques explicitly assume either complete independence (local model) or complete depe…

Computational Efficiency Time Series Time Series Analysis

Spatially-Aware Graph Neural Networks for Relational Behavior Forecasting from Sensor Data

2019-10-18 · Sergio Casas, Cole Gulino, Renjie Liao, Raquel Urtasun

In this paper, we tackle the problem of relational behavior forecasting from sensor data. Towards this goal, we propose a novel spatially-aware graph neural network (SpAGNN) that models the interactions between agents in…

Graph Neural Network Motion Planning Trajectory Forecasting