Using a Semi-supervised Learning Model for Recognition of Human Daily Activities from Wearable Sensor Data

(1) * Tien Manh Nguyen Mail (Shibaura Institute of Technology Graduate School, 307 Fukasaku, Minumaku, Saitama city, Saitama, Japan)
(2) Takagi Motoki Mail (Shibaura Institute of Technology Graduate School, 307 Fukasaku, Minumaku, Saitama-city, Saitama, Japan)
*corresponding author

Abstract


The application of Machine Learning (ML) and Artificial Intelligence (AI) is growing, and also becoming more important as the aging population increases. Smart support systems for distinguish Activities of Daily Living (ADL) can help the elders live more independently and safely. Many machine learning methods have been proposed for Human Activity Recognition (HAR), including complex networks containing convolutional, recurrent, and attentional layers. This study explores the application of ML techniques in ADL classification, leveraging wearable devices' time-series data capturing various parameters such as acceleration. The acceleration data obtained from sensors is so huge that it is difficult and expensive to accurately label every sample collected, so this study applies the Semi-supervised Learning model to unlabeled samples. Long Short-Term Memory (LSTM) has always been used for time series data such as acceleration, and recently, the Transformer model has emerged in many applications such as Natural Language Processing (NLP) or creating ChatGPT. In this study we proposed ADL classification method using the Self-Attention Transformer block and the Recurrent LSTM block and evaluated their results. After comparison, the model built with LSTM block gives better results than the model built with Transformer block.


Keywords


Elderly, Human Activity Recognition, Machine Learning, Accelerometer

   

DOI

https://doi.org/10.29099/ijair.v8i1.1146
      

Article metrics

10.29099/ijair.v8i1.1146 Abstract views : 363 | PDF views : 150

   

Cite

   

Full Text

Download

References


WHO, “Age and Health”, 1 October 2022, (last revised 20 Mar, 2024), https://www.who.int/news-room/fact-sheets/detail/ageing-and-health.

Iris Paho, “The Role of Digital Technologies in Aging and Health”, Pan American Health Organization and International Telecommunication Union, 14 April 2023, (last revised 20 Mar, 2024), https://iris.paho.org/handle/10665.2/57344.

Haben Yhdego, Christopher Paolini and Michel Audette, “Toward Real-Time, Robust Wearable Sensor Fall Detection Using Deep Learning Methods: A Feasibility Study”, MSPI, 16 March 2023, https://doi.org/10.3390/app13084988.

Haben Yhdego, Christopher Paolini, Jiang Li and Michel Audette, “Wearable Sensor Gait Analysis of Fall Detection using Attention Network”, IEEE, 14 January 2022, DOI: 10.1109/BIBM52615.2021.9669795.

Olga Andreeva, Wei Ding, Suzanne G. Leveille, Yurun Cai and Ping Chen, “Fall risk assessment through a synergistic multi-source DNN learning model”, Elsevier, 8 March 2022, https://doi.org/10.1016/j.artmed.2022.102280.

Gabriela Augustinov, Muhammad Adeel Nisar, Frédéric Li, Amir Tabatabaei, Marcin Grzegorzek, Keywan Sohrabi and Sebastian Fudickar, “Transformer-Based Recognition of Activities of Daily Living from Wearable Sensor Data”, 20 September 2023, https://doi.org/10.1145/3558884.3558895.

Ahmed Nait Aicha, Gwenn Englebienne, Kimberley S. van Schooten, Mirjam Pijnappels and Ben Kröse, “Deep Learning to Predict Falls in Older Adults Based on Daily-Life Trunk Accelerometry”, 22 May 2018, https://doi.org/10.3390/s18051654.

Jun Xu1, Zunwen He, and Yan Zhang, “CNN-LSTM Combined Network for IoT Enabled Fall Detection Applications”, 2019, DOI 10.1088/1742-6596/1267/1/012044.

Leyuan Liu, Yibin Hou, Jian He 1, Jonathan Lungu and Ruihai Dong, “An Energy-Efficient Fall Detection Method Based on FD-DNN for Elderly People”, 28 July 2020, https://doi.org/10.3390/s20154192.

Jincheng Lu and Wen-Bin Ye, “Design of a Multistage Radar-Based Human Fall Detection System”, IEEE, 1 July 2022, DOI: 10.1109/JSEN.2022.3177173

Astrid Ustad, Aleksej Logacjov, Stine Øverengen Trollebø, Pernille Thingstad, Beatrix Vereijken, Kerstin Bach and Nina Skjæret Maroni, “Validation of an Activity Type Recognition Model Classifying Daily Physical Behavior in Older Adults: The HAR70+ Model”, MDPI, 21 March 2023, https://doi.org/10.3390/s23052368

Aleksej Logacjov and Astrid Ustad, “HAR70+”, 22 February 2023, (last revised 20 Mar, 2024), https://archive.ics.uci.edu/dataset/780/har70.

Liang Xi, Zichao Yun, Han Liu, Ruidong Wang, Xunhua Huang, Haoyi Fan, “Semi-supervised Time Series Classification Model with Self-supervised Learning”, Engineering Applications of Artificial Intelligence, Volume 116, November 2022, https://doi.org/10.1016/j.engappai.2022.105331

Emadeldeen Eldele, Mohamed Ragab, Zhenghua Chen, Min Wu, Chee-Keong Kwoh, Xiaoli Li and Cuntai Guan, “Self-Supervised Contrastive Representation Learning for Semi-Supervised Time-Series Classification”, Volume: 45, Issue: 12, December 2023, DOI: 10.1109/TPAMI.2023.3308189

Andrea Masciadri, Sara Comai, and Fabio Salice, “SMARE: Semi-supervised Method for Activities of daily living REcognition”, 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC), Bari, Italy. October 6-9, 2019 , DOI: 10.1109/SMC.2019.8914279

Dongxin Liu and Tarek Abdelzaher, “Semi-Supervised Contrastive Learning for Human Activity Recognition”, 2021 17th International Conference on Distributed Computing in Sensor Systems (DCOSS),17 November 2021 , DOI: 10.1109/DCOSS52077.2021.00019

Hazar Zilelioglu, Ghazaleh Khodabandelou, Abdelghani Chibani and Yacine Amirat, “Semisupervised Generative Adversarial Networks With Temporal Convolutions for Human Activity Recognition IEEE Sensors Journal, Volume: 23, Issue: 11, 01 June 2023 , DOI: 10.1109/JSEN.2023.3267243




Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

________________________________________________________

The International Journal of Artificial Intelligence Research

Organized by: Departemen Teknik Informatika
Published by: STMIK Dharma Wacana
Jl. Kenanga No.03 Mulyojati 16C Metro Barat Kota Metro Lampung

Email: jurnal.ijair@gmail.com

View IJAIR Statcounter

Creative Commons License
This work is licensed under  Creative Commons Attribution-ShareAlike 4.0 International License.