idtracker.ai: Tracking all individuals in large collectives of unmarked animals
Our understanding of collective animal behavior is limited by our ability to track each of the individuals. We describe an algorithm and software, idtracker.ai, that extracts from video all trajectories with correct identities at a high accuracy for collectives of up to 100 individuals. It uses two deep networks, one detecting when animals touch or cross and another one for animal identification, trained adaptively to conditions and difficulty of the video.
Code (1)
Tasks
AllMulti-Animal Tracking with identificationSimilar Papers 제목 키워드 기반
Robust Tracking and Behavioral Modeling of Movements of Biological Collectives from Ordinary Video Recordings
We propose a novel computational method to extract information about interactions among individuals with different behavioral states in a biological collective from ordinary video recordings. Assuming that individuals ar…
Pixel personality for dense object tracking in a 2D honeybee hive
Tracking large numbers of densely-arranged, interacting objects is challenging due to occlusions and the resulting complexity of possible trajectory combinations, as well as the sparsity of relevant, labeled datasets. He…
AttributeMulti-Object TrackingObjectobject-detection+3Hybrid Tracker with Pixel and Instance for Video Panoptic Segmentation
Video Panoptic Segmentation (VPS) aims to generate coherent panoptic segmentation and track the identities of all pixels across video frames. Existing methods predominantly utilize the trained instance embedding to keep …
Optical Flow EstimationPanoptic SegmentationSegmentationVideo Panoptic SegmentationAlgorithmic Collective Action with Two Collectives
Given that data-dependent algorithmic systems have become impactful in more domains of life, the need for individuals to promote their own interests and hold algorithms accountable has grown. To have meaningful influence…
Recommendation SystemsThe Computational Foundations of Collective Intelligence
Why do collectives outperform individuals when solving some problems? Fundamentally, collectives have greater computational resources with more sensory information, more memory, more processing capacity, and more ways to…