Sea Horse Optimization–Deep Neural Network: A Medication Adherence Monitoring System Based on Hand Gesture Recognition
Abstract
:1. Introduction
1.1. Problem Statement
1.2. Research Contribution
- Use sensor-based devices for sensing and monitoring hand gestures to identify medication intake.
- Developing a novel SHO-DNN model for medication adherence monitoring based on hand gesture recognition.
- Update the hyperparameters of the DNN model using the SHO algorithm.
- Evaluate the performance of the SHO-DNN model using real-world sensor data.
- Measure the performance of the research model in terms of accuracy, sensitivity, F1-score, and precision.
- Compare and validate the performance of the SHO-DNN model with that of other current models.
1.3. Related Works
1.4. Research Gap
2. Materials and Methods
2.1. Data Collection
2.2. Data Preprocessing
2.3. Sea Horse Optimization
2.3.1. Initialization
2.3.2. The Behavior of Sea Horse Movement
2.3.3. Sea Horse Predation Behavior
2.3.4. Sea Horse Breeding Behavior
2.4. Deep Neural Network
2.5. Tuning DNN Hyperparameters Using SHO
Algorithm 1. Pseudocode of SHO-DNN |
Initialize parameters of DNN weights (W) and biases (B) using random values Evaluate the fitness of each set of weights and biases Assign the best set of weights and biases as W_best and B_best Set the current iteration count t = 0 Set the maximum number of iterations T While (t < T) If r1 = randn > 0 Then Set v and u = 0.05 Rotation angle Rand (−2π, 2π) Generate Levy coefficients Update biases and weights of the DNN using SHO with W_best and B_best Else Set P = 0.05 Update weights and biases of the DNN using SHO End if Evaluate the fitness of each set of weights and biases using the training dataset Select the best-performing sets of weights and biases as potential parents Generate offspring by combining and mutating the selected parents Evaluate the fitness of each offspring Select the next iteration population from both parents and offspring Update W_best and B_best if a better solution is found Increment the iteration count t End while Return W_best, B_best |
3. Results and Discussion
3.1. Experimental Setup
3.2. Performance Metrics
3.3. Performance Evaluation
4. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Alqifari, S.F.; AlMharwal, B.; Aldawish, R.; Almokhlef, S.A.; Alqifari, S.; Almokhlef, S. Impact of pharmacist-led clinics on health outcomes of patients with diabetes at a ministry of health diabetes & endocrinology center, Saudi Arabia: A retrospective study. Cureus 2022, 14, e25923. [Google Scholar] [PubMed]
- Paulsamy, P.; Ashraf, R.; Alshahrani, S.H.; Periannan, K.; Qureshi, A.A.; Venkatesan, K.; Manoharan, V.; Govindasamy, N.; Prabahar, K.; Arumugam, T.; et al. Social Support, Self-Care Behaviour and Self-Efficacy in Patients with Type 2 Diabetes during the COVID-19 Pandemic: A Cross-Sectional Study. Healthcare 2021, 9, 1607. [Google Scholar] [CrossRef] [PubMed]
- Gargioni, L.; Fogli, D.; Baroni, P. A Systematic Review on Pill and Medication Dispenser from a Human-Centered Perspectives. J. Healthc. Inform. Res. 2024, 8, 244–285. [Google Scholar] [CrossRef] [PubMed]
- Olyanasab, A.; Annabestani, M. Leveraging Machine Learning for Personalized Wearable Biomedical Devices: A Review. J. Pers. Med. 2024, 14, 203. [Google Scholar] [CrossRef] [PubMed]
- Lam, W.Y.; Fresco, P. Medication adherence measure: An overview. BioMed Res. Int. 2015, 2015, 217047. [Google Scholar] [CrossRef]
- Roosan, D.; Chok, J.; Karim, M.; Law, A.V.; Baskys, A.; Hwang, A.; Roosan, M.R. Artificial Intelligence–Powered Smartphone Apps to Facilitate Medication Adherence: Protocols for a Human Factor Design Study. JMIR Res Protoc. 2020, 9, e21659. [Google Scholar] [CrossRef] [PubMed]
- Odhiambo, C.O.; Ablonczy, L.; Wright, P.J.; Corbett, C.F.; Reichardt, S.; Valafar, H. Detecting Medications-Taking Gesture Using Machine Learning and Accelerometers Data Collected via Smartwatch Technology: Instruments Validation Study. JMIR Hum. Factors 2023, 10, e42714. [Google Scholar] [CrossRef]
- Bohlmann, A.; Mostafa, J.; Kumar, M. Machine learning and medication adherences: Scoping review. JMIRx Med. 2021, 2, e26993. [Google Scholar] [CrossRef] [PubMed]
- Sabry, F.; Eltaras, T.; Labda, W.; Alzoubi, K.; Malluhi, Q. Machine learning for health care wearable device: The big picture. J. Healthc. Eng. 2022, 2022, 4653923. [Google Scholar] [CrossRef]
- Manimurugan, S. Hybrid high performance intelligent computing approach of CACNN and RNN for skin cancer image grading. Soft Comput. 2023, 27, 579–589. [Google Scholar] [CrossRef]
- Khan, Y.H.; Alzarea, A.I.; Alotaibi, N.H.; Alatawi, A.D.; Khokhar, A.; Alanazi, A.S.; Butt, M.H.; Alshehri, A.A.; Alshehri, S.; Alatawi, Y.; et al. Evaluation of Impact of a Pharmacist-Led Educational Campaign on Disease Knowledge, Practices and Medication Adherence for Type-2 Diabetic Patients: A Prospective Pre- and Post-Analysis. Int. J. Environ. Res. Public Health 2022, 19, 10060. [Google Scholar] [CrossRef] [PubMed]
- Manimurugan, S.; Almutairi, S.; Aborokbah, M.M.; Narmatha, C.; Ganesan, S.; Chilamkurti, N.; Alzaheb, R.A.; Almoamari, H. Two-Stage Classification Model for the Prediction of Heart Disease Using IoMT and Artificial Intelligence. Sensors 2022, 22, 476. [Google Scholar] [CrossRef] [PubMed]
- Espírito-Santo, M.; Santos, S.; Estêvão, M.D. Digital Solution Available to Be Used by Informal Caregiver, Contributing to Medication Adherences: A Scoping Review. Pharmacy 2024, 12, 20. [Google Scholar] [CrossRef] [PubMed]
- Reeder, B.; David, A. Health at hand: A systematic review of smart watch use for health and wellness. J. Biomed. Inform. 2016, 63, 269–276. [Google Scholar] [CrossRef] [PubMed]
- Kristoffersson, A.; Lindén, M. A systematic review of wearable sensor for monitoring physical activity. Sensors 2022, 22, 573. [Google Scholar] [CrossRef] [PubMed]
- Yang, L.; Amin, O.; Shihada, B. Intelligent Wearable System: Opportunities and Challenge in Health and Sports. ACM Comput. Surv. 2024, 56, 1–42. [Google Scholar] [CrossRef]
- Marengo, L.L.; Barberato-Filho, S. Involvements of Human Volunteer in the Developments and Evaluations of Wearable Device Designed to Improve Medication Adherences: A Scoping Review. Sensors 2023, 23, 3597. [Google Scholar] [CrossRef] [PubMed]
- Mason, M.; Cho, Y.; Rayo, J.; Gong, Y.; Harris, M.; Jiang, Y. Technologies for medication adherences monitoring and technology assessments criteria: Narrative review. JMIR mHealth uHealth 2022, 10, e35157. [Google Scholar] [CrossRef]
- Li, L.; Wang, Z.; Cui, L.; Xu, Y.; Lee, H.; Guan, K. The efficacy of a novel smart watch on medicine adherences and symptom controls of allergic rhinitis patient: Pilot study. World Allergy Organ. J. 2023, 16, 100739. [Google Scholar] [CrossRef]
- Fozoonmayeh, D. A scalable smartwatch-based medications intake detections systems using distributed machine learning. J. Med. Syst. 2020, 44, 1–14. [Google Scholar] [CrossRef]
- Kalantarian, H.; Alshurafa, N.; Nemati, E.; Le, T.; Sarrafzadeh, M. A smartwatch-based medications adherences systems. In Proceedings of the 2015 IEEE 12th International Conferences on Wearables and Implantable Body Sensors Network (BSN), Cambridge, MA, USA, 9–12 June 2015; pp. 1–6. [Google Scholar]
- Kalantarian, H.; Motamed, B.; Alshurafa, N.; Sarrafzadeh, M. A wearable sensors system for medication adherences predictions. Artif. Intell. Med. 2016, 69, 43–52. [Google Scholar] [CrossRef]
- Wu, C.T.; Li, G.H.; Huang, C.T.; Cheng, Y.C.; Chen, C.H.; Chien, J.Y.; Kuo, P.H.; Kuo, L.C.; Lai, F. Acute exacerbations of a chronic obstructive pulmonary diseases predictions systems using wearable device data, machine learning, and deep learning: Developments and cohort study. JMIR mHealth uHealth 2021, 9, e22591. [Google Scholar] [CrossRef] [PubMed]
- Moccia, S.; Solbiati, S.; Khornegah, M.; Bossi, F.F.S.; Caiani, E.G. Automated classifications of hand gesture using a wristband and machine learning for possible applications in pill intakes monitoring. Comput. Methods Programs Biomed. 2022, 219, 106753. [Google Scholar] [CrossRef] [PubMed]
- Marquard, J.L.; Saver, B.; Kandaswamy, S.; Martinez, V.I.; Simoni, J.M.; Stekler, J.D.; Ganesan, D.; Scanlan, J. Designing a wrist-worn sensor to improve medication adherences: Accommodating diverse user behaviours and technology preference. JAMIA Open 2018, 1, 153–158. [Google Scholar] [CrossRef]
- Kalantarian, H.; Alshurafa, N.; Sarrafzadeh, M. Detections of gesture associated with medication adherences using smartwatch-based inertial sensor. IEEE Sens. J. 2015, 16, 1054–1061. [Google Scholar] [CrossRef] [PubMed]
- Lee, H.; Youm, S. Developments of a wearable camera and AI algorithms for medication behaviour recognitions. Sensors 2021, 21, 3594. [Google Scholar] [CrossRef]
- Ma, J.; Ovalle, A.; Woodbridge, D.M. Medhere: A smartwatch-based medication adherences monitoring systems using machine learning and distributed computing. In Proceedings of the 2018 40th Annual International Conferences of the IEEE Engineering in Medicines and Biology Society (EMBC), Honolulu, HI, USA, 18–21 July 2018; pp. 4945–4948. [Google Scholar]
- Odhiambo, C.; Wright, P.; Corbett, C.; Valafar, H. MedSensor: Medication adherences monitoring using neural network on smartwatch accelerometers sensor data. arXiv 2021, arXiv:2105.08907. [Google Scholar]
- Aldeer, M.; Ortiz, J.; Howard, R.E.; Martin, R.P. PatientSense: Patient discriminations from in-bottle sensor data. In Proceeding of the 16th EAI International Conferences on Mobile and Ubiquitous System: Computing, Networking and Services, Houston, TX, USA, 12–14 November 2018; pp. 143–152. [Google Scholar]
- Noble, F.; Xu, M.; Alam, F. Static hand gestures recognitions using capacitive sensing and machine learning. Sensors 2023, 23, 3419. [Google Scholar] [CrossRef]
- Aldeer, M.; Howard, R.E.; Martin, R.P.; Ortiz, J. Unobtrusive patient identifications using smart pill-bottles system. Internet Things 2021, 14, 100389. [Google Scholar] [CrossRef]
- Zijp, T.R.; Touw, D.J.; van Boven, J.F.M. User acceptability and technical robustness evaluations of a novel smart pill bottles prototypes designed to support medication adherences. Patient Prefer. Adherences 2020, 14, 625–634. [Google Scholar] [CrossRef]
- Altan, A.; Karasu, S.; Zio, E. A new hybrid model for wind speeds forecasting combining long short-terms memory neural networks, decompositions method and grey wolf optimizers. Appl. Soft Comput. 2021, 100, 106996. [Google Scholar] [CrossRef]
- Alshdaifat, E.; Alshdaifat, D.; Alsarhan, A.; Hussein, F.; El-Salhi, S.M.F.S. The Effects of Preprocessing Technique, Applied to Numeric Feature, on Classification Algorithm Performances. Data 2021, 6, 11. [Google Scholar] [CrossRef]
- Zhao, S.; Zhang, T.; Ma, S.; Wang, M. Sea-horse optimizer: A novel nature-inspired meta-heuristics for global optimization problem. Appl. Intell. 2023, 53, 11833–11860. [Google Scholar] [CrossRef]
- Alahmer, H.; Alahmer, A.; Alamayreh, M.I.; Alrbai, M.; Al-Rbaihat, R.; Al-Manea, A.; Alkhazaleh, R. Optimal Water Addition in Emulsion Diesel Fuel Using Machine Learning and Sea-Horse Optimizer to Minimize Exhaust Pollutants from Diesel Engine. Atmosphere 2023, 14, 449. [Google Scholar] [CrossRef]
- Zhou, R.; Tang, Y.; Li, H.; Liu, Z. Predicting the compressive strengths of ultra-high-performances concrete using a decision trees machine learning models enhanced by the integrations of two optimizations meta-heuristic algorithm. J. Eng. Appl. Sci. 2024, 71, 43. [Google Scholar] [CrossRef]
- Nadda, M.; Shah, S.K.; Roy, S.; Yadav, A. CFD-based deep neural network (DNN) models for predicting the hydrodynamic of fluidized bed. Digit. Chem. Eng. 2023, 8, 100113. [Google Scholar] [CrossRef]
- Singh, G.; Pal, M.; Yadav, Y.; Singla, T. Deep neural networks-based predictive modeling of road accident. Neural Comput. Appl. 2020, 32, 12417–12426. [Google Scholar] [CrossRef]
- Saad, A.; Manimurugan, S.; Byung-Gyu, K.; Majed, M.A.; Narmatha, C. Breast cancer classification using Deep Q Learning (DQL) and gorilla troops optimization (GTO). Appl. Soft Comput. 2023, 142, 110292. [Google Scholar]
Refs. | Approach Used | Application Scenario | Advantages | Disadvantages |
---|---|---|---|---|
[20] | Cloud-based data pipeline, Smartwatch application, ML model based on sensor data | Tracking medicine consumption, Activity classification | User-friendly method. Cloud-based architecture for scalability. Effective extraction and preprocessing of sensor data. Accurate activity classification. | Dependency on smartwatch and reliance on cloud infrastructure. |
[21,22] | Smartwatch sensor analysis, Pattern recognition | Identifying adherence to prescription medicine | Utilizes built-in smartwatch sensors. Patterns of medicine intake analyzed. Reduced human involvement. Real-time monitoring. | Limited to specific smartwatch sensors. Not captured all medication intake scenarios. |
[23] | Sensor data prediction, ML models | Diagnosing COPD | Utilizes environmental and lifestyle data. High accuracy in COPD prediction. | Limited to COPD prediction. Relies on sensor data availability. |
[24,25,26] | ML and DL algorithms, Wristband inertial sensors | Gesture categorization | Utilizes wristband sensors. High classification accuracy. Effective for multi-gesture and binary classification. | Reliance on wristband sensors. Requires additional hardware. |
[27] | Wearable camera image sensor, CNN-based training | Medication behavior assessment | Innovative use of wearable camera. High accuracy in medication behavior recognition. | Dependency on wearable camera. Privacy concerns. |
[28] | Smartwatch internal sensors, Apache Spark, ML methods | Tracking medication intake activities | Utilizes smartwatch sensors. Scalable data processing with Apache Spark. High recall and frequency in behavior anticipation. | Limited to smartwatch users. Reliance on server infrastructure. |
[29] | Smartwatch accelerometer data, Neural networks | Medication-taking behavior identification | Utilizes smartwatch sensors. High accuracy in gesture identification. Real-time data transmission. | Limited to smartwatch users. Requires continuous data transmission. |
[30] | Sensor-equipped pill bottle, Inertial, and switch sensors | Identifying medicine users | Discreet and wireless hardware. High accuracy in patient discrimination. | Dependency on specific pill bottle hardware. Limited to medication adherence monitoring. |
[31] | Capacitive sensing, ML classifiers (Decision Tree, Naïve Bayes, etc.) | Hand motion detection | Innovative use of capacitive sensors. High accuracy in gesture recognition. | Limited to static hand gestures. Relies on specific hardware. |
[32] | Accelerometer-based system, SVM-based user discrimination model | Off-body patient identification | Low-energy and unobtrusive hardware. High accuracy in user discrimination. | Dependency on accelerometer. Not captured all user scenarios. |
[33] | SPBP Adherence evaluation | Medication adherence monitoring | Real-world evaluation of SPBP. Positive user reception. Technical reliability assessment. | Limited to specific prototypes. Reliance on user acceptance. |
Step No. | Action | Description |
---|---|---|
1 | Opening the lid of the pill bottle by holding the bottle in one hand and rotating the bottle using a device-worn hand. | |
2 | Tipping the bottle using a device-worn hand and dispensing a pill in another hand. | |
3 | Tossing/placing a pill to mouth using a device worn by hand. | |
4 | Holding a glass of water, using the device’s worn hand to consume water to swallow the pill. | |
5 | Closing the pill bottle using a device-worn hand. |
Parameters | Values |
---|---|
Optimization Algorithm | SHO |
Number of Hidden Layers | 3 |
Number of Biases and Weights | 151 |
Number of Hidden Neurons | 10 |
Dropouts | Nil |
Output Layer Activation Function | Sigmoid |
Hidden Layer Activation Function | Radial Basis |
Feature | Value |
---|---|
Total Samples | 4116 |
No. of Participants | 15 |
No. of males | 10 |
No. of females | 5 |
Range of Age | 26–32 |
Range of Weight | 55–98 kg |
Range of Height | 151–182 cm |
Fold Test | Accuracy | Sensitivity | Precision | F1-Score |
---|---|---|---|---|
1st Fold | 96.14 | 94.40 | 95.54 | 96.05 |
2nd Fold | 97.65 | 95.87 | 96.28 | 97.16 |
3rd Fold | 97.40 | 96.22 | 96.88 | 97.07 |
4th Fold | 96.50 | 95.09 | 96.75 | 96.33 |
5th Fold | 97.21 | 96.13 | 97.60 | 97.45 |
6th Fold | 97.77 | 96.64 | 96.86 | 97.12 |
7th Fold | 97.45 | 96.28 | 96.57 | 97.09 |
8th Fold | 98.59 | 97.82 | 98.69 | 98.48 |
9th Fold | 96.80 | 95.55 | 97.94 | 96.30 |
10th Fold | 97.63 | 96.36 | 97.57 | 96.24 |
Models | Accuracy % | Sensitivity % | Precision % | F1-Score % |
---|---|---|---|---|
Random Forest | 91.40 | 87.70 | 95.50 | 91.40 |
AdaBoost | 88.86 | 82.20 | 95.20 | 88.20 |
DNN | 92.10 | 90.40 | 94.30 | 92.30 |
CNN | 95.70 | 96.00 | 94.00 | 92.50 |
CNN-LSTM | 96.30 | 95.50 | 94.00 | 92.50 |
Decision Tree | 91.18 | 77.96 | 77.95 | 77.85 |
Bayesian Network | NA | 90.00 | 90.62 | NA |
Gradient-Boost Tree | NA | NA | NA | 98.30 |
MLP | 95.94 | 89.84 | 89.75 | 89.77 |
SHO-DNN | 98.59 | 97.82 | 98.69 | 98.48 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Amirthalingam, P.; Alatawi, Y.; Chellamani, N.; Shanmuganathan, M.; Ali, M.A.S.; Alqifari, S.F.; Mani, V.; Dhanasekaran, M.; Alqahtani, A.S.; Alanazi, M.F.; et al. Sea Horse Optimization–Deep Neural Network: A Medication Adherence Monitoring System Based on Hand Gesture Recognition. Sensors 2024, 24, 5224. https://doi.org/10.3390/s24165224
Amirthalingam P, Alatawi Y, Chellamani N, Shanmuganathan M, Ali MAS, Alqifari SF, Mani V, Dhanasekaran M, Alqahtani AS, Alanazi MF, et al. Sea Horse Optimization–Deep Neural Network: A Medication Adherence Monitoring System Based on Hand Gesture Recognition. Sensors. 2024; 24(16):5224. https://doi.org/10.3390/s24165224
Chicago/Turabian StyleAmirthalingam, Palanisamy, Yasser Alatawi, Narmatha Chellamani, Manimurugan Shanmuganathan, Mostafa A. Sayed Ali, Saleh Fahad Alqifari, Vasudevan Mani, Muralikrishnan Dhanasekaran, Abdulelah Saeed Alqahtani, Majed Falah Alanazi, and et al. 2024. "Sea Horse Optimization–Deep Neural Network: A Medication Adherence Monitoring System Based on Hand Gesture Recognition" Sensors 24, no. 16: 5224. https://doi.org/10.3390/s24165224