Patch-Wise Spatial-Temporal Quality Enhancement for HEVC Compressed Video
Recently, many deep learning based researches are conducted to explore the potential quality improvement of compressed videos. These methods mostly utilize either the spatial or temporal information to perform frame-level video enhancement. However, they fail in combining different spatial-temporal information to adaptively utilize adjacent patches to enhance the current patch and achieve limited enhancement performance especially on scene-changing and strong-motion videos. To overcome these limitations, we propose a patch-wise spatial-temporal quality enhancement network which firstly extracts spatial and temporal features, then recalibrates and fuses the obtained spatial and temporal features. Specifically, we design a temporal and spatial-wise attention-based feature distillation structure to adaptively utilize the adjacent patches for distilling patch-wise temporal features. For adaptively enhancing different patch with spatial and temporal information, a channel and spatial-wise attention fusion block is proposed to achieve patch-wise recalibration and fusion of spatial and temporal features. Experimental results demonstrate our network achieves peak signal-to-noise ratio improvement, 0.55 – 0.69 dB compared with the compressed videos at different quantization parameters, outperforming state- of-the-art approaches.
Code (1)
Tasks
QuantizationVideo EnhancementSimilar Papers 제목 키워드 기반
Decoding Human Attentive States from Spatial-temporal EEG Patches Using Transformers
Learning the spatial topology of electroencephalogram (EEG) channels and their temporal dynamics is crucial for decoding attention states. This paper introduces EEG-PatchFormer, a transformer-based deep learning framewor…
Brain Computer InterfaceEEGElectroencephalogram (EEG)SEER: Transformer-based Robust Time Series Forecasting via Automated Patch Enhancement and Replacement
Time series forecasting is important in many fields that require accurate predictions for decision-making. Patching techniques, commonly used and effective in time series modeling, help capture temporal dependencies by d…
Time Series ForecastingSTQE: Spatial-Temporal Attribute Quality Enhancement for G-PCC Compressed Dynamic Point Clouds
Very few studies have addressed quality enhancement for compressed dynamic point clouds. In particular, the effective exploitation of spatial-temporal correlations between point cloud frames remains largely unexplored. A…
Point CloudsSuper-Resolution Generative Adversarial Networks based Video Enhancement
This study introduces an enhanced approach to video super-resolution by extending ordinary Single-Image Super-Resolution (SISR) Super-Resolution Generative Adversarial Network (SRGAN) structure to handle spatio-temporal …
Generative Adversarial NetworkImage EnhancementImage Super-ResolutionSuper-Resolution+2PNeRV: A Polynomial Neural Representation for Videos
Extracting Implicit Neural Representations (INRs) on video data poses unique challenges due to the additional temporal dimension. In the context of videos, INRs have predominantly relied on a frame-only parameterization,…
Polynomial Neural Networks