Loading...
BAMS: Binary Sequence-Augmented Spectrogram with Self-Attention Deep Learning for Human Activity Recognition
Author(s)
Date Issued
January 1, 2024
Type
Conference Paper
Abstract
Human Activity Recognition (HAR) has rapidly gained interest over the years due to its wide range of applications in AI-based systems, particularly healthcare monitoring. HAR methods typically involve extracting relevant features from data provided by wearable sensors, smartphone sensors, cameras, or their combinations to classify different activities. Nevertheless, a major challenge lies in achieving high classification accuracy with limited data samples, particularly when distinguishing between activities with similar signal attributes. To address this challenge, we propose a novel HAR method called BinAry sequence-augmented spectrograM with Self-attention deep learning (BAMS). Our proposed method leverages only basic wearable sensor data. It utilizes short-time Fourier transform spectrograms to extract spatio-temporal sensor information. The spectrogram is integrated with a binary sequence that captures movement direction. We integrate a scaled dot-product self-attention mechanism into the model to prioritize data from wearable sensors, thereby enhancing the model's performance. The proposed method is evaluated on a public dataset using leave-one-subject-out cross-validation for efficacy and robustness. The method is found to achieve significant improvement over other state-of-the-art methods with the classification accuracy percentage and weighted F-1 scores of 88.06±5.11 and 87.36±5.96, respectively, for a twelve-activity classification.
Citation
2024 IEEE 20th International Conference on Body Sensor Networks Bsn 2024 Proceedings, 2024