Transfer Learning for Keypoint Detection in Low-Resolution Thermal TUG Test Images
This study presents a novel approach to human keypoint detection in low-resolution thermal images using transfer learning techniques. We introduce the first application of the Timed Up and Go (TUG) test in thermal image computer vision, establishing a new paradigm for mobility assessment. Our method leverages a MobileNetV3-Small encoder and a ViTPose decoder, trained using a composite loss function that balances latent representation alignment and heatmap accuracy. The model was evaluated using the Object Keypoint Similarity (OKS) metric from the COCO Keypoint Detection Challenge. The proposed model achieves better performance with AP, AP50, and AP75 scores of 0.861, 0.942, and 0.887 respectively, outperforming traditional supervised learning approaches like Mask R-CNN and ViTPose-Base. Moreover, our model demonstrates superior computational efficiency in terms of parameter count and FLOPS. This research lays a solid foundation for future clinical applications of thermal imaging in mobility assessment and rehabilitation monitoring.
Code (0)
등록된 구현이 없습니다.
Tasks
Computational EfficiencyDecoderKeypoint DetectionTransfer LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A computer vision-based model for occupancy detection using low-resolution thermal images
Occupancy plays an essential role in influencing the energy consumption and operation of heating, ventilation, and air conditioning (HVAC) systems. Traditional HVAC typically operate on fixed schedules without considerin…
Transfer LearningSimultaneous prediction of hand gestures, handedness, and hand keypoints using thermal images
Hand gesture detection is a well-explored area in computer vision with applications in various forms of Human-Computer Interactions. In this work, we propose a technique for simultaneous hand gesture classification, hand…
Multi-Task LearningCan Super Resolution be used to improve Human Pose Estimation in Low Resolution Scenarios?
The results obtained from state of the art human pose estimation (HPE) models degrade rapidly when evaluating people of a low resolution, but can super resolution (SR) be used to help mitigate this effect? By using vario…
Keypoint DetectionPose EstimationSegmentationSuper-ResolutionViTPose++: Vision Transformer for Generic Body Pose Estimation
In this paper, we show the surprisingly good properties of plain vision transformers for body pose estimation from various aspects, namely simplicity in model structure, scalability in model size, flexibility in training…
2D Human Pose EstimationAnimal Pose EstimationKeypoint DetectionPose EstimationNondestructive thermographic detection of internal defects using pixel-pattern based laser excitation and photothermal super resolution reconstruction
In this work, we present a novel approach to photothermal super resolution based thermographic resolution of internal defects using two-dimensional pixel pattern-based active photothermal laser heating in conjunction wit…
Super-Resolution