Cross-user activity recognition via temporal relation optimal transport
Current research on human activity recognition (HAR) mainly assumes that training and testing data are drawn from the same distribution to achieve a generalised model, which means all the data are considered to be independent and identically distributed $\displaystyle (i.i.d.) $. In many real-world applications, this assumption does not hold, and collected training and target testing datasets have non-uniform distribution, such as in the case of cross-user HAR. Domain adaptation is a promising approach for cross-user HAR tasks. Existing domain adaptation works based on the assumption that samples in each domain are $\displaystyle i.i.d. $ and do not consider the knowledge of temporal relation hidden in time series data for aligning data distribution. This strong assumption of $\displaystyle i.i.d. $ may not be suitable for time series-related domain adaptation methods because the samples formed by time series segmentation and feature extraction techniques are only coarse approximations to $\displaystyle i.i.d. $ assumption in each domain. In this paper, we propose the temporal relation optimal transport (TROT) method to utilise temporal relation and relax the $\displaystyle i.i.d. $ assumption for the samples in each domain for accurate and efficient knowledge transfer. We obtain the temporal relation representation and implement temporal relation alignment of activities via the Hidden Markov model (HMM) and optimal transport (OT) techniques. Besides, a new regularisation term that preserves temporal relation order information for an improved optimal transport mapping is proposed to enhance the domain adaptation performance. Comprehensive experiments are conducted on three public activity recognition datasets (i.e. OPPT, PAMAP2 and DSADS), demonstrating that TROT outperforms other state-of-the-art methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Activity RecognitionDomain AdaptationHuman Activity RecognitionRelationTime SeriesTransfer LearningSimilar Papers 제목 키워드 기반
Deep Generative Domain Adaptation with Temporal Relation Knowledge for Cross-User Activity Recognition
In human activity recognition (HAR), the assumption that training and testing data are independent and identically distributed (i.i.d.) often fails, particularly in cross-user scenarios where data distributions vary sign…
Activity RecognitionDomain AdaptationHuman Activity RecognitionRelation+1Cross-user activity recognition using deep domain adaptation with temporal relation information
Human Activity Recognition (HAR) is a cornerstone of ubiquitous computing, with promising applications in diverse fields such as health monitoring and ambient assisted living. Despite significant advancements, sensor-bas…
Activity RecognitionDomain AdaptationHuman Activity RecognitionRelationDeep Generative Domain Adaptation with Temporal Attention for Cross-User Activity Recognition
In Human Activity Recognition (HAR), a predominant assumption is that the data utilized for training and evaluation purposes are drawn from the same distribution. It is also assumed that all data samples are independent …
Activity RecognitionDomain AdaptationHuman Activity RecognitionRelation+1Temporal Reasoning Graph for Activity Recognition
Despite great success has been achieved in activity analysis, it still has many challenges. Most existing work in activity recognition pay more attention to design efficient architecture or video sampling strategy. Howev…
Action RecognitionActivity RecognitionRelationRelation Extraction+1Reinforcement Learning Driven Generalizable Feature Representation for Cross-User Activity Recognition
Human Activity Recognition (HAR) using wearable sensors is crucial for healthcare, fitness tracking, and smart environments, yet cross-user variability -- stemming from diverse motion patterns, sensor placements, and phy…
Human Activity RecognitionReinforcement LearningDomain Generalization