DomusFM: A Foundation Model for Event-Based Behavioral Monitoring in Smart-Homes
Smart-home sensor-based behavioral monitoring holds significant potential for healthcare, independent living, and early detection of functional or cognitive changes. In this setting, tasks like activity recognition, prediction, and pattern discovery provide complementary views of daily life, supporting the modeling of personal routines and habits, and their long-term changes. Existing approaches, however, face critical limitations. Supervised approaches require impractical amounts of labeled activity data to capture the variability of daily behavior across residents and environments. Foundation models represent a promising direction for learning transferable representations of latent behavioral patterns from sensor data. Still, current efforts are mostly designed for continuous inertial or physiological sensor data and do not address the sparse, discrete, and semantically rich event streams produced by smart homes. In this paper, we introduce DomusFM, a domain-specific foundation model for sensor-based behavioral monitoring in smart homes based on semantic event streams. DomusFM employs a self-supervised dual contrastive learning paradigm to capture both event-level semantic attributes and sequence-level temporal dependencies. By integrating semantic embeddings from a lightweight language model and specialized encoders for temporal patterns and binary states, DomusFM learns transferable representations that can be adapted across heterogeneous smart-home environments and tasks related to activity and event analysis. Through a leave-one-dataset-out evaluation across seven public smart-home datasets, we demonstrate that DomusFM consistently outperforms baselines on three downstream tasks: ADL recognition, next-k event prediction, and unsupervised clustering. DomusFM has a small footprint and can be deployed on edge devices.
Code (0)
등록된 구현이 없습니다.
Tasks
Contrastive LearningActivity RecognitionSimilar Papers 제목 키워드 기반
Late fusion of machine learning models using passively captured interpersonal social interactions and motion from smartphones predicts decompensation in heart failure
Objective: Worldwide, heart failure (HF) is a major cause of morbidity and mortality and one of the leading causes of hospitalization. Early detection of HF symptoms and pro-active management may reduce adverse events. A…
DecompensationManagementMonitoring Horses in Stalls: From Object to Event Detection
Monitoring the behavior of stalled horses is essential for early detection of health and welfare issues but remains labor-intensive and time-consuming. In this study, we present a prototype vision-based monitoring system…
Multi-Object TrackingObject DetectionCalBehav: A Machine Learning based Personalized Calendar Behavioral Model using Time-Series Smartphone Data
The electronic calendar is a valuable resource nowadays for managing our daily life appointments or schedules, also known as events, ranging from professional to highly personal. Researchers have studied various types of…
BIG-bench Machine LearningTime SeriesTime Series AnalysisEarCough: Enabling Continuous Subject Cough Event Detection on Hearables
Cough monitoring can enable new individual pulmonary health applications. Subject cough event detection is the foundation for continuous cough monitoring. Recently, the rapid growth in smart hearables has opened new oppo…
Edge-computingEvent DetectionDetecting the Unexpected: AI-Driven Anomaly Detection in Smart Bridge Monitoring
Bridges are critical components of national infrastructure and smart cities. Therefore, smart bridge monitoring is essential for ensuring public safety and preventing catastrophic failures or accidents. Traditional bridg…
Anomaly Detection