paper-with-me

Papers

Automated Behavioral Analysis Using Instance Segmentation

2023-12-12 · Chen Yang, Jeremy Forest, Matthew Einhorn, Thomas A. Cleland

Animal behavior analysis plays a crucial role in various fields, such as life science and biomedical research. However, the scarcity of available data and the high cost associated with obtaining a large number of labeled datasets pose significant challenges. In this research, we propose a novel approach that leverages instance segmentation-based transfer learning to address these issues. By capitalizing on fine-tuning the classification head of the instance segmentation network, we enable the tracking of multiple animals and facilitate behavior analysis in laboratory-recorded videos. To demonstrate the effectiveness of our method, we conducted a series of experiments, revealing that our approach achieves exceptional performance levels, comparable to human capabilities, across a diverse range of animal behavior analysis tasks. Moreover, we emphasize the practicality of our solution, as it requires only a small number of labeled images for training. To facilitate the adoption and further development of our method, we have developed an open-source implementation named Annolid (An annotation and instance segmentation-based multiple animal tracking and behavior analysis package). The codebase is publicly available on GitHub at https://github.com/cplab/annolid. This resource serves as a valuable asset for researchers and practitioners interested in advancing animal behavior analysis through state-of-the-art techniques.

📄 PDF Abstract BibTeX arXiv:2312.07723

Code (1)

cplab/annolid 공식 구현 pytorch

Tasks

Instance SegmentationSegmentationSemantic SegmentationTransfer Learning

Similar Papers 제목 키워드 기반

Automated Sperm Morphology Analysis Based on Instance-Aware Part Segmentation

2024-07-31 · Wenyuan Chen, Haocong Song, Changsheng Dai, Aojun Jiang 외

Traditional sperm morphology analysis is based on tedious manual annotation. Automated morphology analysis of a high number of sperm requires accurate segmentation of each sperm part and quantitative morphology evaluatio…

Segmentation

BehaveNet: nonlinear embedding and Bayesian neural decoding of behavioral videos

2019-12-01 · NeurIPS 2019 12 · Eleanor Batty, Matthew Whiteway, Shreya Saxena, Dan Biderman 외

A fundamental goal of systems neuroscience is to understand the relationship between neural activity and behavior. Behavior has traditionally been characterized by low-dimensional, task-related variables such as movement…

Automatic Drywall Analysis for Progress Tracking and Quality Control in Construction

2025-03-05 · Mariusz Trzeciakiewicz, Aleixo Cambeiro Barreiro, Niklas Gard, Anna Hilsmann 외

Digitalization in the construction industry has become essential, enabling centralized, easy access to all relevant information of a building. Automated systems can facilitate the timely and resource-efficient documentat…

Data AugmentationInstance SegmentationSegmentationSemantic Segmentation

Foundation Models for Amodal Video Instance Segmentation in Automated Driving

2024-09-21 · Jasmin Breitenstein, Franz Jünger, Andreas Bär, Tim Fingscheidt

In this work, we study amodal video instance segmentation for automated driving. Previous works perform amodal video instance segmentation relying on methods trained on entirely labeled video data with techniques borrowe…

Amodal Instance SegmentationInstance SegmentationPoint TrackingSegmentation+2

HoVer-Net: Simultaneous Segmentation and Classification of Nuclei in Multi-Tissue Histology Images

2018-12-16 · Simon Graham, Quoc Dang Vu, Shan E Ahmed Raza, Ayesha Azam 외

Nuclear segmentation and classification within Haematoxylin & Eosin stained histology images is a fundamental prerequisite in the digital pathology work-flow. The development of automated methods for nuclear segmentation…

ClassificationGeneral ClassificationMulti-tissue Nucleus SegmentationNuclear Segmentation+1