paper-with-me

Papers

Weakly Supervised Multi-Task Representation Learning for Human Activity Analysis Using Wearables

2023-08-06 · Taoran Sheng, Manfred Huber

Sensor data streams from wearable devices and smart environments are widely studied in areas like human activity recognition (HAR), person identification, or health monitoring. However, most of the previous works in activity and sensor stream analysis have been focusing on one aspect of the data, e.g. only recognizing the type of the activity or only identifying the person who performed the activity. We instead propose an approach that uses a weakly supervised multi-output siamese network that learns to map the data into multiple representation spaces, where each representation space focuses on one aspect of the data. The representation vectors of the data samples are positioned in the space such that the data with the same semantic meaning in that aspect are closely located to each other. Therefore, as demonstrated with a set of experiments, the trained model can provide metrics for clustering data based on multiple aspects, allowing it to address multiple tasks simultaneously and even to outperform single task supervised methods in many situations. In addition, further experiments are presented that in more detail analyze the effect of the architecture and of using multiple tasks within this framework, that investigate the scalability of the model to include additional tasks, and that demonstrate the ability of the framework to combine data for which only partial relationship information with respect to the target tasks is available.

📄 PDF Abstract BibTeX arXiv:2308.03805

Code (0)

등록된 구현이 없습니다.

Tasks

Activity RecognitionHuman Activity RecognitionPerson IdentificationRepresentation Learning

Methods 이 논문이 사용한 방법론

Siamese Network 설명 없음

Similar Papers 제목 키워드 기반

Weakly-Supervised 3D Human Pose Learning via Multi-view Images in the Wild

2020-03-17 · CVPR 2020 6 · Umar Iqbal, Pavlo Molchanov, Jan Kautz

One major challenge for monocular 3D human pose estimation in-the-wild is the acquisition of training data that contains unconstrained images annotated with accurate 3D poses. In this paper, we address this challenge by …

3D Human Pose EstimationMonocular 3D Human Pose EstimationPose EstimationWeakly-superavised 3D Human Pose Estimation+1

Improving Event Representation via Simultaneous Weakly Supervised Contrastive Learning and Clustering

2022-03-15 · ACL 2022 5 · Jun Gao, Wei Wang, Changlong Yu, Huan Zhao 외

Representations of events described in text are important for various tasks. In this work, we present SWCC: a Simultaneous Weakly supervised Contrastive learning and Clustering framework for event representation learning…

ClusteringContrastive LearningRepresentation LearningSentence+1

Self-Supervised 3D Human Pose Estimation via Part Guided Novel Image Synthesis

2020-04-09 · CVPR 2020 6 · Jogendra Nath Kundu, Siddharth Seth, Varun Jampani, Mugalodi Rakesh 외

Camera captured human pose is an outcome of several sources of variation. Performance of supervised 3D pose estimation approaches comes at the cost of dispensing with variations, such as shape and appearance, that may be…

3D Human Pose Estimation3D Pose EstimationDisentanglementImage Generation+4

Weakly Supervised Human-Object Interaction Detection in Video via Contrastive Spatiotemporal Regions

2021-10-07 · ICCV 2021 10 · Shuang Li, Yilun Du, Antonio Torralba, Josef Sivic 외

We introduce the task of weakly supervised learning for detecting human and object interactions in videos. Our task poses unique challenges as a system does not know what types of human-object interactions are present in…

Human-Object Interaction DetectionObjectSentenceWeakly-supervised Learning

MAF: Multimodal Alignment Framework for Weakly-Supervised Phrase Grounding

2020-10-12 · EMNLP 2020 11 · Qinxin Wang, Hao Tan, Sheng Shen, Michael W. Mahoney 외

Phrase localization is a task that studies the mapping from textual phrases to regions of an image. Given difficulties in annotating phrase-to-object datasets at scale, we develop a Multimodal Alignment Framework (MAF) t…

Phrase Grounding