paper-with-me

Papers

Transfer Learning for Keypoint Detection in Low-Resolution Thermal TUG Test Images

2025-01-30 · Wei-Lun Chen, Chia-Yeh Hsieh, Yu-Hsiang Kao, Kai-Chun Liu, Sheng-Yu Peng, Yu Tsao

This study presents a novel approach to human keypoint detection in low-resolution thermal images using transfer learning techniques. We introduce the first application of the Timed Up and Go (TUG) test in thermal image computer vision, establishing a new paradigm for mobility assessment. Our method leverages a MobileNetV3-Small encoder and a ViTPose decoder, trained using a composite loss function that balances latent representation alignment and heatmap accuracy. The model was evaluated using the Object Keypoint Similarity (OKS) metric from the COCO Keypoint Detection Challenge. The proposed model achieves better performance with AP, AP50, and AP75 scores of 0.861, 0.942, and 0.887 respectively, outperforming traditional supervised learning approaches like Mask R-CNN and ViTPose-Base. Moreover, our model demonstrates superior computational efficiency in terms of parameter count and FLOPS. This research lays a solid foundation for future clinical applications of thermal imaging in mobility assessment and rehabilitation monitoring.

📄 PDF Abstract BibTeX arXiv:2501.18453

Code (0)

등록된 구현이 없습니다.

Tasks

Computational EfficiencyDecoderKeypoint DetectionTransfer Learning

Methods 이 논문이 사용한 방법론

RPN A Region Proposal Network, or RPN, is a fully convolutional network that simultaneously predicts object bounds and objectness scores at each position. The RPN is trained…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
RoIAlign Region of Interest Align, or RoIAlign, is an operation for extracting a small feature map from each RoI in detection and segmentation based tasks. It removes the harsh…
Heatmap 설명 없음
Mask R-CNN Mask R-CNN extends Faster R-CNN to solve instance segmentation tasks. It achieves this by adding a branch for predicting an…

Similar Papers 제목 키워드 기반

A computer vision-based model for occupancy detection using low-resolution thermal images

2025-05-13 · Xue Cui, Vincent Gbouna Zakka, Minhyun Lee

Occupancy plays an essential role in influencing the energy consumption and operation of heating, ventilation, and air conditioning (HVAC) systems. Traditional HVAC typically operate on fixed schedules without considerin…

Transfer Learning

Simultaneous prediction of hand gestures, handedness, and hand keypoints using thermal images

2023-03-02 · Sichao Li, Sean Banerjee, Natasha Kholgade Banerjee, Soumyabrata Dey

Hand gesture detection is a well-explored area in computer vision with applications in various forms of Human-Computer Interactions. In this work, we propose a technique for simultaneous hand gesture classification, hand…

Multi-Task Learning

Can Super Resolution be used to improve Human Pose Estimation in Low Resolution Scenarios?

2021-07-05 · Peter Hardy, Srinandan Dasmahapatra, Hansung Kim

The results obtained from state of the art human pose estimation (HPE) models degrade rapidly when evaluating people of a low resolution, but can super resolution (SR) be used to help mitigate this effect? By using vario…

Keypoint DetectionPose EstimationSegmentationSuper-Resolution

ViTPose++: Vision Transformer for Generic Body Pose Estimation

2022-12-07 · Yufei Xu, Jing Zhang, Qiming Zhang, DaCheng Tao

In this paper, we show the surprisingly good properties of plain vision transformers for body pose estimation from various aspects, namely simplicity in model structure, scalability in model size, flexibility in training…

2D Human Pose EstimationAnimal Pose EstimationKeypoint DetectionPose Estimation

Nondestructive thermographic detection of internal defects using pixel-pattern based laser excitation and photothermal super resolution reconstruction

2022-11-08 · Julien Lecompagnon, Philipp Daniel Hirsch, Christian Rupprecht, Mathias Ziegler

In this work, we present a novel approach to photothermal super resolution based thermographic resolution of internal defects using two-dimensional pixel pattern-based active photothermal laser heating in conjunction wit…

Super-Resolution