paper-with-me

홈 › Papers

A benchmark for computational analysis of animal behavior, using animal-borne tags

2023-05-18 · Benjamin Hoffman, Maddie Cusimano, Vittorio Baglione, Daniela Canestrari, Damien Chevallier, Dominic L. DeSantis, Lorène Jeantet, Monique A. Ladds, Takuya Maekawa, Vicente Mata-Silva, Víctor Moreno-González, Anthony Pagano, Eva Trapote, Outi Vainio, Antti Vehkaoja, Ken Yoda, Katherine Zacarian, Ari Friedlaender

Animal-borne sensors (`bio-loggers') can record a suite of kinematic and environmental data, which are used to elucidate animal ecophysiology and improve conservation efforts. Machine learning techniques are used for interpreting the large amounts of data recorded by bio-loggers, but there exists no common framework for comparing the different machine learning techniques in this domain. This makes it difficult to, for example, identify patterns in what works well for machine learning-based analysis of bio-logger data. It also makes it difficult to evaluate the effectiveness of novel methods developed by the machine learning community. To address this, we present the Bio-logger Ethogram Benchmark (BEBE), a collection of datasets with behavioral annotations, as well as a modeling task and evaluation metrics. BEBE is to date the largest, most taxonomically diverse, publicly available benchmark of this type. Using BEBE, we compare the performance of deep and classical machine learning methods for identifying animal behaviors based on bio-logger data. As an example usage of BEBE, we test an approach based on self-supervised learning. To apply this approach to animal behavior classification, we adapt a deep neural network pre-trained with 700,000 hours of data collected from human wrist-worn accelerometers. We find that deep neural networks out-perform the classical machine learning methods we tested across all nine datasets in BEBE. We additionally find that the approach based on self-supervised learning out-performs the alternatives we tested, especially in settings when there is a low amount of training data available. In light of this, we are able to make concrete suggestions for designing studies that rely on machine learning to infer behavior from bio-logger data. Datasets and code are available at https://github.com/earthspecies/BEBE.

📄 PDF Abstract BibTeX arXiv:2305.10740

Code (2)

earthspecies/bebe 공식 구현 jax
earthspecies/bebe-datasets 공식 구현

Tasks

Self-Supervised Learning

Similar Papers 제목 키워드 기반

AnimalTrack: A Benchmark for Multi-Animal Tracking in the Wild

2022-04-30 · Libo Zhang, Junyuan Gao, Zhen Xiao, Heng Fan

Multi-animal tracking (MAT), a multi-object tracking (MOT) problem, is crucial for animal motion and behavior analysis and has many crucial applications such as biology, ecology and animal conservation. Despite its impor…

Multi-Object TrackingObject Tracking

PyMiceTracking: An Open-Source Toolbox for Real-Time Behavioral Neuroscience Experiments

2022-01-01 · CVPR 2022 1 · Richardson Menezes, Aron de Miranda, Helton Maia

The development of computational tools allows the advancement of research in behavioral neuroscience and elevates the limits of experiment design. Many behavioral experiments need to determine the animal's position f…

Contour DetectionDecision MakingPosition

MammalNet: A Large-scale Video Benchmark for Mammal Recognition and Behavior Understanding

2023-06-01 · CVPR 2023 1 · Jun Chen, Ming Hu, Darren J. Coker, Michael L. Berumen 외

Monitoring animal behavior can facilitate conservation efforts by providing key insights into wildlife health, population status, and ecosystem function. Automatic recognition of animals and their behaviors is critical f…

AnimalMotionCLIP: Embedding motion in CLIP for Animal Behavior Analysis

2025-04-30 · Enmin Zhong, Carlos R. del-Blanco, Daniel Berjón, Fernando Jaureguizar 외

Recently, there has been a surge of interest in applying deep learning techniques to animal behavior recognition, particularly leveraging pre-trained visual language models, such as CLIP, due to their remarkable generali…

Optical Flow Estimation

Animal Kingdom: A Large and Diverse Dataset for Animal Behavior Understanding

2022-04-18 · CVPR 2022 1 · Xun Long Ng, Kian Eng Ong, Qichen Zheng, Yun Ni 외

Understanding animals' behaviors is significant for a wide range of applications. However, existing animal behavior datasets have limitations in multiple aspects, including limited numbers of animal classes, data samples…

Action RecognitionAnimal Action RecognitionAnimal Pose EstimationVideo Grounding