paper-with-me

Papers

Annolid: Annotate, Segment, and Track Anything You Need

2024-03-27 · Chen Yang, Thomas A. Cleland

Annolid is a deep learning-based software package designed for the segmentation, labeling, and tracking of research targets within video files, focusing primarily on animal behavior analysis. Based on state-of-the-art instance segmentation methods, Annolid now harnesses the Cutie video object segmentation model to achieve resilient, markerless tracking of multiple animals from single annotated frames, even in environments in which they may be partially or entirely concealed by environmental features or by one another. Our integration of Segment Anything and Grounding-DINO strategies additionally enables the automatic masking and segmentation of recognizable animals and objects by text command, removing the need for manual annotation. Annolid's comprehensive approach to object segmentation flexibly accommodates a broad spectrum of behavior analysis applications, enabling the classification of diverse behavioral states such as freezing, digging, pup huddling, and social interactions in addition to the tracking of animals and their body parts.

📄 PDF Abstract BibTeX arXiv:2403.18690

Code (1)

cplab/annolid pytorch

Tasks

Instance SegmentationSegmentationSemantic SegmentationVideo Object SegmentationVideo Semantic Segmentation

Similar Papers 제목 키워드 기반

Tracking Anything with Decoupled Video Segmentation

2023-09-07 · ICCV 2023 1 · Ho Kei Cheng, Seoung Wug Oh, Brian Price, Alexander Schwing 외

Training data for video segmentation are expensive to annotate. This impedes extensions of end-to-end algorithms to new video segmentation tasks, especially in large-vocabulary settings. To 'track anything' without train…

Open-Vocabulary Video SegmentationOpen-World Video SegmentationPanoptic SegmentationReferring Expression Segmentation+9

Automated Behavioral Analysis Using Instance Segmentation

2023-12-12 · Chen Yang, Jeremy Forest, Matthew Einhorn, Thomas A. Cleland

Animal behavior analysis plays a crucial role in various fields, such as life science and biomedical research. However, the scarcity of available data and the high cost associated with obtaining a large number of labeled…

Instance SegmentationSegmentationSemantic SegmentationTransfer Learning

Track Anything Annotate: Video annotation and dataset generation of computer vision models

2025-05-23 · Nikita Ivanov, Mark Klimov, Dmitry Glukhikh, Tatiana Chernysheva 외

Modern machine learning methods require significant amounts of labelled data, making the preparation process time-consuming and resource-intensive. In this paper, we propose to consider the process of prototyping a tool …

Dataset Generation

Matching Anything by Segmenting Anything

2024-06-06 · CVPR 2024 1 · Siyuan Li, Lei Ke, Martin Danelljan, Luigi Piccinelli 외

The robust association of the same objects across video frames in complex scenes is crucial for many applications, especially Multiple Object Tracking (MOT). Current methods predominantly rely on labeled domain-specific …

Domain GeneralizationMultiple Object TrackingObjectObject Tracking+1

Track Anything: Segment Anything Meets Videos

2023-04-24 · Jinyu Yang, Mingqi Gao, Zhe Li, Shang Gao 외

Recently, the Segment Anything Model (SAM) gains lots of attention rapidly due to its impressive segmentation performance on images. Regarding its strong ability on image segmentation and high interactivity with differen…

Image SegmentationObject TrackingSegmentationSemantic Segmentation+1