paper-with-me

홈 › Papers

Multimodal sensor data fusion for in-situ classification of animal behavior using accelerometry and GNSS data

2022-06-24 · Reza Arablouei, Ziwei Wang, Greg J. Bishop-Hurley, Jiajun Liu

In this paper, we examine the use of data from multiple sensing modes, i.e., accelerometry and global navigation satellite system (GNSS), for classifying animal behavior. We extract three new features from the GNSS data, namely, distance from water point, median speed, and median estimated horizontal position error. We combine the information available from the accelerometry and GNSS data via two approaches. The first approach is based on concatenating the features extracted from both sensor data and feeding the concatenated feature vector into a multi-layer perceptron (MLP) classifier. The second approach is based on fusing the posterior probabilities predicted by two MLP classifiers. The input to each classifier is the features extracted from the data of one sensing mode. We evaluate the performance of the developed multimodal animal behavior classification algorithms using two real-world datasets collected via smart cattle collar tags and ear tags. The leave-one-animal-out cross-validation results show that both approaches improve the classification performance appreciably compared with using data of only one sensing mode. This is more notable for the infrequent but important behaviors of walking and drinking. The algorithms developed based on both approaches require little computational and memory resources hence are suitable for implementation on embedded systems of our collar tags and ear tags. However, the multimodal animal behavior classification algorithm based on posterior probability fusion is preferable to the one based on feature concatenation as it delivers better classification accuracy, has less computational and memory complexity, is more robust to sensor data failure, and enjoys better modularity.

📄 PDF Abstract BibTeX arXiv:2206.12078

Code (1)

reza219/animal_behavior_classification_acc_gnss 공식 구현

Tasks

Classification

Similar Papers 제목 키워드 기반

Multimodal sensor fusion for real-time location-dependent defect detection in laser-directed energy deposition

2023-05-23 · Lequn Chen, Xiling Yao, Wenhe Feng, Youxiang Chew 외

Real-time defect detection is crucial in laser-directed energy deposition (L-DED) additive manufacturing (AM). Traditional in-situ monitoring approach utilizes a single sensor (i.e., acoustic, visual, or thermal sensor) …

Defect DetectionSensor Fusion

Multimodal sensor fusion in the latent representation space

2022-08-03 · Robert J. Piechocki, Xiaoyang Wang, Mohammud J. Bocus

A new method for multimodal sensor fusion is introduced. The technique relies on a two-stage process. In the first stage, a multimodal generative model is constructed from unlabelled training data. In the second stage, t…

compressed sensingDenoisingSensor Fusion

Using LLMs for Late Multimodal Sensor Fusion for Activity Recognition

2025-09-12 · Ilker Demirel, Karan Thakkar, Benjamin Elizalde, Miquel Espi Marques 외 arxiv

Sensor data streams provide valuable information around activities and context for downstream applications, though integrating complementary information can be challenging. We show that large language models (LLMs) can b…

Activity Recognition

EmbraceNet: A robust deep learning architecture for multimodal classification

2019-04-19 · Jun-Ho Choi, Jong-Seok Lee

Classification using multimodal data arises in many machine learning applications. It is crucial not only to model cross-modal relationship effectively but also to ensure robustness against loss of part of data or modali…

ClassificationDeep LearningGeneral Classification

In-situ surface porosity prediction in DED (directed energy deposition) printed SS316L parts using multimodal sensor fusion

2023-04-17 · Adithyaa Karthikeyan, Himanshu Balhara, Abhishek Hanchate, Andreas K Lianos 외

This study aims to relate the time-frequency patterns of acoustic emission (AE) and other multi-modal sensor data collected in a hybrid directed energy deposition (DED) process to the pore formations at high spatial (0.5…

Sensor Fusion