Recognizing Dynamic Scenes with Deep Dual Descriptor based on Key Frames and Key Segments
Recognizing dynamic scenes is one of the fundamental problems in scene
understanding, which categorizes moving scenes such as a forest fire,
landslide, or avalanche. While existing methods focus on reliable capturing of
static and dynamic information, few works have explored frame selection from a
dynamic scene sequence. In this paper, we propose dynamic scene recognition
using a deep dual descriptor based on key frames' and key segments.' Key
frames that reflect the feature distribution of the sequence with a small
number are used for capturing salient static appearances. Key segments, which
are captured from the area around each key frame, provide an additional
discriminative power by dynamic patterns within short time intervals. To this
end, two types of transferred convolutional neural network features are used in
our approach. A fully connected layer is used to select the key frames and key
segments, while the convolutional layer is used to describe them. We conducted
experiments using public datasets as well as a new dataset comprised of 23
dynamic scene classes with 10 videos per class. The evaluation results
demonstrated the state-of-the-art performance of the proposed method.
Code (0)
등록된 구현이 없습니다.
Tasks
Scene RecognitionScene UnderstandingSimilar Papers 제목 키워드 기반
Object Sorting Using a Global Texture-Shape 3D Feature Descriptor
Object recognition and grasping plays a key role in robotic systems, especially for the autonomous robots to implement object sorting tasks in a warehouse. In this paper, we present a global texture-shape 3D feature desc…
ObjectObject DetectionObject RecognitionPerson Re-identification by analyzing Dynamic Variations in Gait Sequences
Gait recognition is a biometric technology that identifies individuals in a video sequence by analysing their style of walking or limb movement. However, this identification is generally sensitive to appearance changes a…
Gait RecognitionPerson Re-IdentificationSA-CNN: Dynamic Scene Classification using Convolutional Neural Networks
The task of classifying videos of natural dynamic scenes into appropriate classes has gained lot of attention in recent years. The problem especially becomes challenging when the camera used to capture the video is dynam…
ClassificationGeneral ClassificationScene ClassificationDynamicWAM: Dual-Path Motion Conditioning for World-Action Models in Dynamic Manipulation
Dynamic manipulation requires robots to infer target motion and respond promptly, yet existing World-Action Models (WAMs) typically condition only on the current frame and execute large backbones synchronously, limiting …
SUDS: Scalable Urban Dynamic Scenes
We extend neural radiance fields (NeRFs) to dynamic large-scale urban scenes. Prior work tends to reconstruct single video clips of short durations (up to 10 seconds). Two reasons are that such methods (a) tend to scale …
3D Instance SegmentationInstance SegmentationNeRFNovel View Synthesis+2