Papers Video Recognition
“Video Recognition” 태그가 달린 논문 307편 · 필터 해제
DVFL-Net: A Lightweight Distilled Video Focal Modulation Network for Spatio-Temporal Action Recognition
The landscape of video recognition has evolved significantly, shifting from traditional Convolutional Neural Networks (CNNs) to Transformer-based architectures for improved accuracy. While 3D CNNs have been effective at …
BenchmarkingKnowledge DistillationSpatio-temporal Action RecognitionTemporal Action Localization+2VCRBench: Exploring Long-form Causal Reasoning Capabilities of Large Video Language Models
Despite recent advances in video understanding, the capabilities of Large Video Language Models (LVLMs) to perform video-based causal reasoning remains underexplored, largely due to the absence of relevant and dedicated …
FormMultiple-choiceVideo RecognitionVideo UnderstandingGameplay Highlights Generation
In this work, we enable gamers to share their gaming experience on social media by automatically generating eye-catching highlight reels from their gameplay session Our automation will save time for gamers while increasi…
Event DetectionHighlight DetectionOptical Character Recognition (OCR)Prompt Engineering+3Fast Adversarial Training with Weak-to-Strong Spatial-Temporal Consistency in the Frequency Domain on Videos
Adversarial Training (AT) has been shown to significantly enhance adversarial robustness via a min-max optimization approach. However, its effectiveness in video recognition tasks is hampered by two main challenges. Firs…
Adversarial RobustnessVideo RecognitionCA^2ST: Cross-Attention in Audio, Space, and Time for Holistic Video Recognition
We propose Cross-Attention in Audio, Space, and Time (CA^2ST), a transformer-based method for holistic video recognition. Recognizing actions in videos requires both spatial and temporal understanding, yet most existing …
Action ClassificationAction RecognitionAudio ClassificationVideo Recognition+1Leveraging LLMs with Iterative Loop Structure for Enhanced Social Intelligence in Video Question Answering
Social intelligence, the ability to interpret emotions, intentions, and behaviors, is essential for effective communication and adaptive responses. As robots and AI systems become more prevalent in caregiving, healthcare…
Emotion RecognitionQuestion AnsweringVideo Question AnsweringVideo RecognitionBASKET: A Large-Scale Video Dataset for Fine-Grained Skill Estimation
We present BASKET, a large-scale basketball video dataset for fine-grained skill estimation. BASKET contains 4,477 hours of video capturing 32,232 basketball players from all over the world. Compared to prior skill estim…
Video RecognitionPAVE: Patching and Adapting Video Large Language Models
Pre-trained video large language models (Video LLMs) exhibit remarkable reasoning capabilities, yet adapting these models to new tasks involving additional modalities or data types (e.g., audio or 3D information) remains…
Audio-visual Question AnsweringMulti-Task LearningQuestion AnsweringVideo Recognition+2VTD-CLIP: Video-to-Text Discretization via Prompting CLIP
Vision-language models bridge visual and linguistic understanding and have proven to be powerful for video recognition tasks. Existing approaches primarily rely on parameter-efficient fine-tuning of image-text pre-traine…
parameter-efficient fine-tuningVideo RecognitionTowards Scalable Modeling of Compressed Videos for Efficient Action Recognition
Training robust deep video representations has proven to be computationally challenging due to substantial decoding overheads, the enormous size of raw video streams, and their inherent high temporal redundancy. Differen…
Action RecognitionVideo RecognitionVideo UnderstandingA Simple and Efficient Baseline for Video Action Recognition
There has been huge progress on video action recognition in recent years. However, many works focus on tweaking existing 2D backbones due to the reliance of ImageNet pretraining, which restrains the models from achieving…
Action RecognitionFine-grained Action RecognitionTemporal Action LocalizationVideo RecognitionVideoPure: Diffusion-based Adversarial Purification for Video Recognition
Recent work indicates that video recognition models are vulnerable to adversarial examples, posing a serious security risk to downstream applications. However, current research has primarily focused on adversarial attack…
Adversarial DefenseAdversarial PurificationAdversarial RobustnessDenoising+1Action Detail Matters: Refining Video Recognition with Local Action Queries
Video action recognition involves interpreting both global context and specific details to accurately identify actions. While previous models are effective at capturing spatiotemporal features, they often lack a focu…
Action RecognitionTemporal Action LocalizationVideo RecognitionDAVE: Diverse Atomic Visual Elements Dataset with High Representation of Vulnerable Road Users in Complex and Unpredictable Environments
Most existing traffic video datasets including Waymo are structured, focusing predominantly on Western traffic, which hinders global applicability. Specifically, most Asian scenarios are far more complex, involving numer…
Action LocalizationAction RecognitionMoment RetrievalTemporal Action Localization+1Uni-AdaFocus: Spatial-temporal Dynamic Computation for Video Recognition
This paper presents a comprehensive exploration of the phenomenon of data redundancy in video understanding, with the aim to improve computational efficiency. Our investigation commences with an examination of spatial re…
Computational EfficiencyVideo RecognitionVideo UnderstandingStandardization Trends on Safety and Trustworthiness Technology for Advanced AI
Artificial Intelligence (AI) has rapidly evolved over the past decade and has advanced in areas such as language comprehension, image and video recognition, programming, and scientific reasoning. Recent AI technologies b…
Video RecognitionMoTE: Reconciling Generalization with Specialization for Visual-Language to Video Knowledge Transfer
Transferring visual-language knowledge from large-scale foundation models for video recognition has proved to be effective. To bridge the domain gap, additional parametric modules are added to capture the temporal inform…
Transfer LearningVideo RecognitionZero-shot GeneralizationScaling Up Your Kernels: Large Kernel Design in ConvNets towards Universal Representations
This paper proposes the paradigm of large convolutional kernels in designing modern Convolutional Neural Networks (ConvNets). We establish that employing a few large kernels, instead of stacking multiple smaller ones, ca…
Time Series ForecastingVideo RecognitionA Novel Audio-Visual Information Fusion System for Mental Disorders Detection
Mental disorders are among the foremost contributors to the global healthcare challenge. Research indicates that timely diagnosis and intervention are vital in treating various mental disorders. However, the early somati…
EEGVideo RecognitionGenRec: Unifying Video Generation and Recognition with Diffusion Models
Video diffusion models are able to generate high-quality videos by learning strong spatial-temporal priors on large-scale datasets. In this paper, we aim to investigate whether such priors derived from a generative proce…
Image to Video GenerationVideo GenerationVideo Recognition