AR-Net: Adaptive Frame Resolution for Efficient Action Recognition
Action recognition is an open and challenging problem in computer vision. While current state-of-the-art models offer excellent recognition results, their computational expense limits their impact for many real-world applications. In this paper, we propose a novel approach, called AR-Net (Adaptive Resolution Network), that selects on-the-fly the optimal resolution for each frame conditioned on the input for efficient action recognition in long untrimmed videos. Specifically, given a video frame, a policy network is used to decide what input resolution should be used for processing by the action recognition model, with the goal of improving both accuracy and efficiency. We efficiently train the policy network jointly with the recognition model using standard back-propagation. Extensive experiments on several challenging action recognition benchmark datasets well demonstrate the efficacy of our proposed approach over state-of-the-art methods. The project page can be found at https://mengyuest.github.io/AR-Net
Code (1)
Tasks
Action RecognitionSimilar Papers 제목 키워드 기반
Adaptive Deep Iris Feature Extractor at Arbitrary Resolutions
This paper proposes a deep feature extractor for iris recognition at arbitrary resolutions. Resolution degradation reduces the recognition performance of deep learning models trained by high-resolution images. Using vari…
Iris RecognitionKnowledge DistillationMulti-View Region Adaptive Multi-temporal DMM and RGB Action Recognition
Human action recognition remains an important yet challenging task. This work proposes a novel action recognition system. It uses a novel Multiple View Region Adaptive Multi-resolution in time Depth Motion Map (MV-RAMDMM…
Action RecognitionHuman-Object Interaction DetectionTemporal Action LocalizationEfficient Human Vision Inspired Action Recognition using Adaptive Spatiotemporal Sampling
Adaptive sampling that exploits the spatiotemporal redundancy in videos is critical for always-on action recognition on wearable devices with limited computing and battery resources. The commonly used fixed sampling stra…
Action RecognitionSelf-supervised Motion Representation via Scattering Local Motion Cues
Motion representation is key to many computer vision problems but has never been well studied in the literature. Existing works usually rely on the optical flow estimation to assist other tasks such as action recognition…
Action RecognitionOptical Flow EstimationVideo SegmentationVideo Semantic Segmentation+1DPFlow: Adaptive Optical Flow Estimation with a Dual-Pyramid Framework
Optical flow estimation is essential for video processing tasks, such as restoration and action recognition. The quality of videos is constantly increasing, with current standards reaching 8K resolution. However, optical…
8kAction RecognitionOptical Flow Estimation