Real-time, low-cost multi-person 3D pose estimation
The process of tracking human anatomy in computer vision is referred to pose estimation, and it is used in fields ranging from gaming to surveillance. Three-dimensional pose estimation traditionally requires advanced equipment, such as multiple linked intensity cameras or high-resolution time-of-flight cameras to produce depth images. However, there are applications, e.g.~consumer electronics, where significant constraints are placed on the size, power consumption, weight and cost of the usable technology. Here, we demonstrate that computational imaging methods can achieve accurate pose estimation and overcome the apparent limitations of time-of-flight sensors designed for much simpler tasks. The sensor we use is already widely integrated in consumer-grade mobile devices, and despite its low spatial resolution, only 4$\times$4 pixels, our proposed Pixels2Pose system transforms its data into accurate depth maps and 3D pose data of multiple people up to a distance of 3 m from the sensor. We are able to generate depth maps at a resolution of 32$\times$32 and 3D localization of a body parts with an error of only $\approx$10 cm at a frame rate of 7 fps. This work opens up promising real-life applications in scenarios that were previously restricted by the advanced hardware requirements and cost of time-of-flight technology.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Human Pose Estimation3D Multi-Person Pose Estimation3D Pose EstimationAnatomyGesture RecognitionObject DetectionPose EstimationSuper-ResolutionSimilar Papers 제목 키워드 기반
TME-PSR: Time-aware, Multi-interest, and Explanation Personalization for Sequential Recommendation
In this paper, we propose a sequential recommendation model that integrates Time-aware personalization, Multi-interest personalization, and Explanation personalization for Personalized Sequential Recommendation (TME-PSR)…
Sequential RecommendationFaster VoxelPose: Real-time 3D Human Pose Estimation by Orthographic Projection
While the voxel-based methods have achieved promising results for multi-person 3D pose estimation from multi-cameras, they suffer from heavy computation burdens, especially for large scenes. We present Faster VoxelPose t…
3D Human Pose Estimation3D Multi-Person Pose Estimation3D Pose EstimationPose EstimationKnowledge Graph Tuning: Real-time Large Language Model Personalization based on Human Feedback
Large language models (LLMs) have demonstrated remarkable proficiency in a range of natural language processing tasks. Once deployed, LLMs encounter users with personalized factual knowledge, and such personalized knowle…
GPUKnowledge GraphsLanguage ModelingLanguage Modelling+1EfficientHRNet: Efficient Scaling for Lightweight High-Resolution Multi-Person Pose Estimation
There is an increasing demand for lightweight multi-person pose estimation for many emerging smart IoT applications. However, the existing algorithms tend to have large model sizes and intense computational requirements,…
2D Human Pose EstimationMulti-Person Pose EstimationPose EstimationVocal Bursts Intensity PredictionHiMe: Real-Time Self-Hosted Personal Agent Platform for Health Insights with Wearable Devices
Traditional approaches to wearable health signal analysis, such as smartwatches, are constrained by rigid analytical frameworks and limited personalisation. The emergence of LLM agents creates a new opportunity for Perso…