Exploiting Change Blindness for Video Coding: Perspectives from a Less Promising User Study
What the human visual system can perceive is strongly limited by the capacity of our working memory and attention. Such limitations result in the human observer's inability to perceive large-scale changes in a stimulus, a phenomenon known as change blindness. In this paper, we started with the premise that this phenomenon can be exploited in video coding, especially HDR-video compression where the bitrate is high. We designed an HDR-video encoding approach that relies on spatially and temporally varying quantization parameters within the framework of HEVC video encoding. In the absence of a reliable change blindness prediction model, to extract compression candidate regions (CCR) we used an existing saliency prediction algorithm. We explored different configurations and carried out a subjective study to test our hypothesis. While our methodology did not lead to significantly superior performance in terms of the ratio between perceived quality and bitrate, we were able to determine potential flaws in our methodology, such as the employed saliency model for CCR prediction (chosen for computational efficiency, but eventually not sufficiently accurate), as well as a very strong subjective bias due to observers priming themselves early on in the experiment about the type of artifacts they should look for, thus creating a scenario with little ecological validity.
Code (0)
등록된 구현이 없습니다.
Tasks
Computational EfficiencyQuantizationSaliency PredictionVideo CompressionSimilar Papers 제목 키워드 기반
A Three-Feature Model to Predict Colour Change Blindness
Change blindness is a striking shortcoming of our visual system which is exploited in the popular "Spot the difference" game. It makes us unable to notice large visual changes happening right before our eyes and illustra…
regressionChange Blindness in 3D Virtual Reality
In the present change blindness study subjects explored stereoscopic three dimensional (3D) environments through a virtual reality (VR) headset. A novel method that tracked the subjects' head movements was used for induc…
Change DetectionLights out: training RL agents robust to temporary blindness
Agents trained with DQN rely on an observation at each timestep to decide what action to take next. However, in real world applications observations can change or be missing entirely. Examples of this could be a light bu…
Towards Accurate Human Pose Estimation in Videos of Crowded Scenes
Video-based human pose estimation in crowded scenes is a challenging problem due to occlusion, motion blur, scale variation and viewpoint change, etc. Prior approaches always fail to deal with this problem because of (1)…
DiversityOptical Flow EstimationPose EstimationLaVieID: Local Autoregressive Diffusion Transformers for Identity-Preserving Video Creation
In this paper, we present LaVieID, a novel \underline{l}ocal \underline{a}utoregressive \underline{vi}d\underline{e}o diffusion framework designed to tackle the challenging \underline{id}entity-preserving text-to-video t…