Action Quality Assessment using Transformers
Action quality assessment (AQA) is an active research problem in video-based applications that is a challenging task due to the score variance per frame. Existing methods address this problem via convolutional-based approaches but suffer from its limitation of effectively capturing long-range dependencies. With the recent advancements in Transformers, we show that they are a suitable alternative to the conventional convolutional-based architectures. Specifically, can transformer-based models solve the task of AQA by effectively capturing long-range dependencies, parallelizing computation, and providing a wider receptive field for diving videos? To demonstrate the effectiveness of our proposed architectures, we conducted comprehensive experiments and achieved a competitive Spearman correlation score of 0.9317. Additionally, we explore the hyperparameters effect on the model's performance and pave a new path for exploiting Transformers in AQA.
Code (0)
등록된 구현이 없습니다.
Tasks
Action Quality AssessmentSimilar Papers 제목 키워드 기반
Multi-Scale Features and Parallel Transformers Based Image Quality Assessment
With the increase in multimedia content, the type of distortions associated with multimedia is also increasing. This problem of image quality assessment is expanded well in the PIPAL dataset, which is still an open probl…
Image Quality AssessmentDCVQE: A Hierarchical Transformer for Video Quality Assessment
The explosion of user-generated videos stimulates a great demand for no-reference video quality assessment (NR-VQA). Inspired by our observation on the actions of human annotation, we put forward a Divide and Conquer Vid…
Video Quality AssessmentVisual Question Answering (VQA)DisCoVQA: Temporal Distortion-Content Transformers for Video Quality Assessment
The temporal relationships between frames and their influences on video quality assessment (VQA) are still under-studied in existing works. These relationships lead to two important types of effects for video quality. Fi…
Time Series AnalysisVideo Quality AssessmentVisual Question Answering (VQA)VTAMIQ: Transformers for Attention Modulated Image Quality Assessment
Following the major successes of self-attention and Transformers for image analysis, we investigate the use of such attention mechanisms in the context of Image Quality Assessment (IQA) and propose a novel full-reference…
Image Quality AssessmentReLaX-VQA: Residual Fragment and Layer Stack Extraction for Enhancing Video Quality Assessment
With the rapid growth of User-Generated Content (UGC) exchanged between users and sharing platforms, the need for video quality assessment in the wild is increasingly evident. UGC is typically acquired using consumer dev…
Optical Flow EstimationVideo CompressionVideo Quality AssessmentVisual Question Answering (VQA)