Deep Learning-based Lightweight RGB Object Tracking for Augmented Reality Devices
Augmented Reality (AR) applications often require robust real-time tracking of objects in the user's environment to correctly overlay virtual content. Recent advances in computer vision have produced highly accurate deep learning-based object trackers, but these models are typically too heavy in computation and memory for wearable AR devices. In this paper, we present a lightweight RGB object tracking algorithm designed specifically for resource-constrained AR platforms. The proposed tracker employs a compact Siamese neural network architecture and incorporates optimization techniques such as model pruning, quantization, and knowledge distillation to drastically reduce model size and inference cost while maintaining high tracking accuracy. We train the tracker offline on large video datasets using deep convolutional neural networks and then deploy it on-device for real-time tracking. Experimental results on standard tracking benchmarks show that our approach achieves comparable accuracy to state-of-the-art trackers, yet runs in real-time on a mobile AR headset at around 30 FPS -- more than an order of magnitude faster than prior high-performance trackers on the same hardware. This work enables practical, robust object tracking for AR use-cases, opening the door to more interactive and dynamic AR experiences on lightweight devices.
Code (0)
등록된 구현이 없습니다.
Tasks
Knowledge DistillationObject TrackingSimilar Papers 제목 키워드 기반
Instant 3D Object Tracking with Applications in Augmented Reality
Tracking object poses in 3D is a crucial building block for Augmented Reality applications. We propose an instant motion tracking system that tracks an object's pose in space (represented by its 3D bounding box) in real-…
3D Object TrackingCPUGPUObject TrackingInstant Motion Tracking and Its Applications to Augmented Reality
Augmented Reality (AR) brings immersive experiences to users. With recent advances in computer vision and mobile computing, AR has scaled across platforms, and has increased adoption in major products. One of the key cha…
eCAR: edge-assisted Collaborative Augmented Reality Framework
We propose a novel edge-assisted multi-user collaborative augmented reality framework in a large indoor environment. In Collaborative Augmented Reality, data communication that synchronizes virtual objects has large netw…
Edge-computingObjectGBOT: Graph-Based 3D Object Tracking for Augmented Reality-Assisted Assembly Guidance
Guidance for assemblable parts is a promising field for augmented reality. Augmented reality assembly guidance requires 6D object poses of target objects in real time. Especially in time-critical medical or industrial se…
3D Object Tracking6D Pose EstimationMulti-Object TrackingObject+2RGB-D-E: Event Camera Calibration for Fast 6-DOF Object Tracking
Augmented reality devices require multiple sensors to perform various tasks such as localization and tracking. Currently, popular cameras are mostly frame-based (e.g. RGB and Depth) which impose a high data bandwidth and…
3D Object TrackingCamera CalibrationObjectObject Tracking