paper-with-me

홈 › Papers

MixTConv: Mixed Temporal Convolutional Kernels for Efficient Action Recogntion

2020-01-19 · Kaiyu Shan, Yongtao Wang, Zhuoying Wang, TingTing Liang, Zhi Tang, Ying Chen, Yangyan Li

To efficiently extract spatiotemporal features of video for action recognition, most state-of-the-art methods integrate 1D temporal convolution into a conventional 2D CNN backbone. However, they all exploit 1D temporal convolution of fixed kernel size (i.e., 3) in the network building block, thus have suboptimal temporal modeling capability to handle both long-term and short-term actions. To address this problem, we first investigate the impacts of different kernel sizes for the 1D temporal convolutional filters. Then, we propose a simple yet efficient operation called Mixed Temporal Convolution (MixTConv), which consists of multiple depthwise 1D convolutional filters with different kernel sizes. By plugging MixTConv into the conventional 2D CNN backbone ResNet-50, we further propose an efficient and effective network architecture named MSTNet for action recognition, and achieve state-of-the-art results on multiple benchmarks.

📄 PDF Abstract BibTeX arXiv:2001.06769

Code (0)

등록된 구현이 없습니다.

Tasks

Action Recognition

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Human Action Recognition using Factorized Spatio-Temporal Convolutional Networks

2015-10-02 · ICCV 2015 12 · Lin Sun, Kui Jia, Dit-yan Yeung, Bertram E. Shi

Human actions in video sequences are three-dimensional (3D) spatio-temporal signals characterizing both the visual appearance and motion dynamics of the involved humans and objects. Inspired by the success of convolution…

Action Recognitionimage-classificationImage ClassificationTemporal Action Localization

Generalization Bounds on Multi-Kernel Learning with Mixed Datasets

2022-05-15 · Lan V. Truong

This paper presents novel generalization bounds for the multi-kernel learning problem. Motivated by applications in sensor networks and spatial-temporal models, we assume that the dataset is mixed where each sample is ta…

Generalization Bounds

DD-GCN: Directed Diffusion Graph Convolutional Network for Skeleton-based Human Action Recognition

2023-08-24 · Chang Li, Qian Huang, Yingchi Mao

Graph Convolutional Networks (GCNs) have been widely used in skeleton-based human action recognition. In GCN-based methods, the spatio-temporal graph is fundamental for capturing motion patterns. However, existing approa…

Action RecognitionTemporal Action Localization

MiCT: Mixed 3D/2D Convolutional Tube for Human Action Recognition

2018-06-01 · CVPR 2018 6 · Yizhou Zhou, Xiaoyan Sun, Zheng-Jun Zha, Wen-Jun Zeng

Human actions in videos are three-dimensional (3D) signals. Recent attempts use 3D convolutional neural networks (CNNs) to explore spatio-temporal information for human action recognition. Though promising, 3D CNNs have …

Action RecognitionTemporal Action Localization

TricorNet: A Hybrid Temporal Convolutional and Recurrent Network for Video Action Segmentation

2017-05-22 · Li Ding, Chenliang Xu

Action segmentation as a milestone towards building automatic systems to understand untrimmed videos has received considerable attention in the recent years. It is typically being modeled as a sequence labeling problem b…

Action SegmentationDecoderSegmentation