Multi-animal pose estimation, identification and tracking with DeepLabCut
Estimating the pose of multiple animals is a challenging computer vision problem: frequent interactions cause occlusions and complicate the association of detected keypoints to the correct individuals, as well as having highly similar looking animals that interact more closely than in typical multi-human scenarios. To take up this challenge, we build on DeepLabCut, an open-source pose estimation toolbox, and provide high-performance animal assembly and tracking—features required for multi-animal scenarios. Furthermore, we integrate the ability to predict an animal’s identity to assist tracking (in case of occlusions). We illustrate the power of this framework with four datasets varying in complexity, which we release to serve as a benchmark for future algorithm development.
Code (2)
Tasks
Animal Pose EstimationPose EstimationSimilar Papers 제목 키워드 기반
APT-36K: A Large-scale Benchmark for Animal Pose Estimation and Tracking
Animal pose estimation and tracking (APT) is a fundamental task for detecting and tracking animal keypoints from a sequence of video frames. Previous animal-related datasets focus either on animal tracking or single-fram…
Animal Pose EstimationDomain GeneralizationPose EstimationTransfer LearningBuckTales : A multi-UAV dataset for multi-object tracking and re-identification of wild antelopes
Understanding animal behaviour is central to predicting, understanding, and mitigating impacts of natural and anthropogenic changes on animal populations and ecosystems. However, the challenges of acquiring and processin…
BenchmarkingMulti-Object TrackingObject TrackingAPTv2: Benchmarking Animal Pose Estimation and Tracking with a Large-scale Dataset and Beyond
Animal Pose Estimation and Tracking (APT) is a critical task in detecting and monitoring the keypoints of animals across a series of video frames, which is essential for understanding animal behavior. Past works relating…
Animal Pose EstimationBenchmarkingDomain GeneralizationPose Estimation+2PuTR-CouT: Counting-by-Tracking in Camera-Trap Image Sequences
Species identification in camera trap images has been widely studied, but key ecological modeling tasks such as species abundance or density estimation also require counting individual animals. However, the lack of count…
Density EstimationAn HMM-based framework for identity-aware long-term multi-object tracking from sparse and uncertain identification: use case on long-term tracking in livestock
The need for long-term multi-object tracking (MOT) is growing due to the demand for analyzing individual behaviors in videos that span several minutes. Unfortunately, due to identity switches between objects, the trackin…
Multi-Object Tracking