Can Super Resolution be used to improve Human Pose Estimation in Low Resolution Scenarios?
The results obtained from state of the art human pose estimation (HPE) models degrade rapidly when evaluating people of a low resolution, but can super resolution (SR) be used to help mitigate this effect? By using various SR approaches we enhanced two low resolution datasets and evaluated the change in performance of both an object and keypoint detector as well as end-to-end HPE results. We remark the following observations. First we find that for people who were originally depicted at a low resolution (segmentation area in pixels), their keypoint detection performance would improve once SR was applied. Second, the keypoint detection performance gained is dependent on that persons pixel count in the original image prior to any application of SR; keypoint detection performance was improved when SR was applied to people with a small initial segmentation area, but degrades as this becomes larger. To address this we introduced a novel Mask-RCNN approach, utilising a segmentation area threshold to decide when to use SR during the keypoint detection step. This approach achieved the best results on our low resolution datasets for each HPE performance metrics.
Code (0)
등록된 구현이 없습니다.
Tasks
Keypoint DetectionPose EstimationSegmentationSuper-ResolutionSimilar Papers 제목 키워드 기반
Tarsier: Evolving Noise Injection in Super-Resolution GANs
Super-resolution aims at increasing the resolution and level of detail within an image. The current state of the art in general single-image super-resolution is held by NESRGAN+, which injects a Gaussian noise after each…
Image Super-ResolutionSuper-ResolutionA New Super-Resolution Measurement of Perceptual Quality and Fidelity
Super-resolution results are usually measured by full-reference image quality metrics or human rating scores. However, these evaluation methods are general image quality measurement, and do not account for the nature of …
Super-ResolutionHRINet: Alternative Supervision Network for High-resolution CT image Interpolation
Image interpolation in medical area is of high importance as most 3D biomedical volume images are sampled where the distance between consecutive slices significantly greater than the in-plane pixel size due to radiation …
3D ReconstructionVocal Bursts Intensity PredictionLearning Super-resolution 3D Segmentation of Plant Root MRI Images from Few Examples
Analyzing plant roots is crucial to understand plant performance in different soil environments. While magnetic resonance imaging (MRI) can be used to obtain 3D images of plant roots, extracting the root structural model…
Super-ResolutionAn Emergency Disposal Decision-making Method with Human--Machine Collaboration
Rapid developments in artificial intelligence technology have led to unmanned systems replacing human beings in many fields requiring high-precision predictions and decisions. In modern operational environments, all job …
Decision MakingScheduling