paper-with-me

홈 › Papers

A Masked Semi-Supervised Learning Approach for Otago Micro Labels Recognition

2024-05-21 · Meng Shang, Lenore Dedeyne, Jolan Dupont, Laura Vercauteren, Nadjia Amini, Laurence Lapauw, Evelien Gielen, Sabine Verschueren, Carolina Varon, Walter De Raedt, Bart Vanrumste

The Otago Exercise Program (OEP) serves as a vital rehabilitation initiative for older adults, aiming to enhance their strength and balance, and consequently prevent falls. While Human Activity Recognition (HAR) systems have been widely employed in recognizing the activities of individuals, existing systems focus on the duration of macro activities (i.e. a sequence of repetitions of the same exercise), neglecting the ability to discern micro activities (i.e. the individual repetitions of the exercises), in the case of OEP. This study presents a novel semi-supervised machine learning approach aimed at bridging this gap in recognizing the micro activities of OEP. To manage the limited dataset size, our model utilizes a Transformer encoder for feature extraction, subsequently classified by a Temporal Convolutional Network (TCN). Simultaneously, the Transformer encoder is employed for masked unsupervised learning to reconstruct input signals. Results indicate that the masked unsupervised learning task enhances the performance of the supervised learning (classification task), as evidenced by f1-scores surpassing the clinically applicable threshold of 0.8. From the micro activities, two clinically relevant outcomes emerge: counting the number of repetitions of each exercise and calculating the velocity during chair rising. These outcomes enable the automatic monitoring of exercise intensity and difficulty in the daily lives of older adults.

📄 PDF Abstract BibTeX arXiv:2405.12711

Code (0)

등록된 구현이 없습니다.

Tasks

Activity RecognitionHuman Activity Recognition

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Position-Wise Feed-Forward Layer 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Residual Connection 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Similar Papers 제목 키워드 기반

Semi-MAE: Masked Autoencoders for Semi-supervised Vision Transformers

2023-01-04 · Haojie Yu, Kang Zhao, Xiaoming Xu

Vision Transformer (ViT) suffers from data scarcity in semi-supervised learning (SSL). To alleviate this issue, inspired by masked autoencoder (MAE), which is a data-efficient self-supervised learner, we propose Semi-MAE…

Decoderimage-classificationImage ClassificationRepresentation Learning+1

AdvMIM: Adversarial Masked Image Modeling for Semi-Supervised Medical Image Segmentation

2025-06-25 · Lei Zhu, Jun Zhou, Rick Siow Mong Goh, Yong liu

Vision Transformer has recently gained tremendous popularity in medical image segmentation task due to its superior capability in capturing long-range dependencies. However, transformer requires a large amount of labeled…

Image SegmentationMedical Image SegmentationSegmentationSemantic Segmentation+1

Semi-Supervised Masked Autoencoders: Unlocking Vision Transformer Potential with Limited Data

2026-01-27 · Atik Faysal, Mohammad Rostami, Reihaneh Gh. Roshan, Nikhil Muralidhar 외 arxiv

We address the challenge of training Vision Transformers (ViTs) when labeled data is scarce but unlabeled data is abundant. We propose Semi-Supervised Masked Autoencoder (SSMAE), a framework that jointly optimizes masked…

Image Reconstruction

Seamless Iterative Semi-Supervised Correction of Imperfect Labels in Microscopy Images

2022-08-05 · Marawan Elbatel, Christina Bornberg, Manasi Kattel, Enrique Almar 외

In-vitro tests are an alternative to animal testing for the toxicity of medical devices. Detecting cells as a first step, a cell expert evaluates the growth of cells according to cytotoxicity grade under the microscope. …

Image GenerationObject DetectionSemantic Segmentation

A comparative study of semi- and self-supervised semantic segmentation of biomedical microscopy data

2020-11-11 · Nastassya Horlava, Alisa Mironenko, Sebastian Niehaus, Sebastian Wagner 외

In recent years, Convolutional Neural Networks (CNNs) have become the state-of-the-art method for biomedical image analysis. However, these networks are usually trained in a supervised manner, requiring large amounts of …

image-classificationImage ClassificationImage SegmentationSegmentation+2