Skip to main content
SpringerLink
Log in

IoHT-based deep learning controlled robot vehicle for paralyzed patients of smart cities

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

Paralysis caused by physical trauma is a common disease today, with approximately 30% of paralysis caused by this trauma. The disease in question both physically restricts mobility and brings along psychological problems. Especially in advanced ages, paralysis becomes much more difficult and requires serious care since it causes many effects in elderly people’s daily routines, required specific healthcare services, costs…etc. Therefore, in this study, it was aimed to design an Internet of Health Things (IoHT)-based unmanned robot vehicle for paralyzed patients, by using deep learning for control of the system and creating a connected healthcare synergy. In this context, the electronic part of the robot was designed first and then a deep learning-based model was created. Before creating the model, the data obtained from the sensors were adequately pre-processed, and the related problem formation was shaped for a Deep Learning process. In order to compare the Deep Learning model with other machine learning techniques from the state of the art, different models based on Random Forest (RF), Decision Trees (DT), Naive Bayes (NB), Support Vector Machines (SVM), k-Nearest Neighbors (k-NN), Logistic Regression (LR) and Artificial Neural Network (ANN) were generated using the same data. The performances of these models were compared and the obtained results were analyzed. According to the experimental results, the Deep Learning model has the highest performance with 99.5% success rate and 0.5% loss rate. This work presents some relevant results in which using deep learning techniques point excellent performances in the area of IoHT applications. A second contribution of this paper is related to the evaluation of the communication flow of the systems, to analyze if it was good enough to cover a smart environment. The findings in this manner were positive in terms of technical analysis and the patient feedback taken from a total of 10 paralyzed patients.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

References

  1. Karagoz Y, Gul S, Cetinel G (2017) An EOG based communication channel for paralyzed patients. In: Proceedings of the 2017 25thSignalProcessingand Communications Applications Conference (SIU). IEEE. pp 1–4

  2. Usakli AB (2015) EOG Based Communication for Paralyzed Patients, Gulhane Biomedical Days. Ankara, Turkey

    Google Scholar 

  3. McCarthy J (2007) What is Artificial Intelligence?. Stanford – Formal Reasoning Group. Online: http://www-formal.stanford.edu/jmc/whatisai/whatisai.html

  4. Nabiyev VV (2005) Artificial Intelligence: Problems-Methods-Algorithms. Seckin Press

    Google Scholar 

  5. Williams C (1983) A Brief Introduction to Artificial Intelligence. In: Proceedings of the OCEANS'83, Proceedings. IEEE. pp. 94–99

  6. Allahverdi N (2002) Expert Systems: An Artificial Intelligence Application. Atlas Press

    Google Scholar 

  7. Aydin AO (2013) Artificial Intelligence: Towards Integrated Cognition. Istanbul Gelisim University Press

    Google Scholar 

  8. Elmas C (2016) Artificial Intelligence Applications. Seckin Press

    Google Scholar 

  9. Strong AI (2016) Applications of artificial intelligence & associated technologies. Science [ETEBMS-2016], 5(6)

  10. Brougham D, Haar J (2018) Smart technology, artificial intelligence, robotics, and algorithms (STARA): employees’ perceptions of our future work place. J Manag Organ 24(2):239–257

    Article  Google Scholar 

  11. Brynjolfsson E, McAfee A (2014) The second machine age: Work, progress, and prosperity in a time of brilliant technologies. WW Norton & Company

    Google Scholar 

  12. Makridakis S (2017) The forthcoming artificial intelligence (AI) revolution: its impact on society and firms. Futures 90:46–60

    Article  Google Scholar 

  13. Niewiadomski R, Anderson D (2017) The Rise of Artificial Intelligence: Its Impact on Labor Market and Beyond. In: Batko Roman, Szopa Anna (eds) Strategic Imperatives and Core Competencies in the Era of Robotics and Artificial Intelligence. IGI Global, pp 29–49

    Chapter  Google Scholar 

  14. Jarrahi MH (2018) Artificial intelligence and the future of work: human-AI symbiosis in organizational decision making. Bus Horizons 61(4):577–586

    Article  Google Scholar 

  15. Exner-Stöhr M, Kopp A, Kühne-Hellmessen L, Oldach L, Roth D, Zimmermann A (2017) The potential of Artificial Intelligence in academic research at a Digital University. Gesellschaft für Informatik, Bonn

    Google Scholar 

  16. Li BH, Hou BC, Yu WT, Lu XB, Yang CW (2017) Applications of artificial intelligence in intelligent manufacturing: a review. Front Infor Technol Electron Eng 18(1):86–96

    Article  Google Scholar 

  17. Pan Y (2016) Heading toward artificial intelligence 2.0. Engineering 2(4):409–413

    Article  Google Scholar 

  18. Gocoglu V (2020) Digital transformation in delivery of public services: an investigation on internet of things. Manas J Soc Stud 9(1):615–628

    Google Scholar 

  19. Patel KK, Patel SM (2016) Internet of things-IOT: definition, characteristics, architecture, enabling technologies, application & future challenges. Int J Eng Sci Comput 6(5):6122–6131

    Google Scholar 

  20. Armour BS, Courtney-Long EA, Fox MH, Fredine H, Cahill A (2016) Prevalence and causes of paralysis—United States, 2013. Am J Public Health 106(10):1855–1857

    Article  Google Scholar 

  21. Li G, Lee CH, Jung JJ, Youn YC, Camacho D (2020) Deep learning for EEG data analytics: a survey. Concurr Comput: Pract Exp 32(18):e5199

    Article  Google Scholar 

  22. Al-Saegh A, Dawwd SA, Abdul-Jabbar JM (2021) Deep learning for motor imagery EEG-based classification: a review. Biomed Signal Process Control 63:102172

    Article  Google Scholar 

  23. Rivera MJ, Teruel MA, Maté A, Trujillo J (2021) Diagnosis and prognosis of mental disorders by means of EEG and deep learning: a systematic mapping study. Artif Intell Rev. https://doi.org/10.1007/s10462-021-09986-y

    Article  Google Scholar 

  24. Merlin Praveena D, Angelin Sarah D, Thomas George S (2020) Deep learning techniques for EEG signal applications–a review. IETE J Res. https://doi.org/10.1080/03772063.2020.1749143

    Article  Google Scholar 

  25. Sinha U, Kanthi M (2016) Mind controlled wheelchair. J Control Theory Appl 9(39):19–28

    Google Scholar 

  26. Ozdemir A, Barshan B (2014) Detecting falls with wearable sensors using machine learning techniques. Sensors 14(6):10691–10708

    Article  Google Scholar 

  27. Uyar E, Senli̇ K, Mutlu L (2012) Brain wave controlled prosthetic arm design. Sakarya Univ J Sci 16(3):164–169

    Article  Google Scholar 

  28. Roy Y, Banville H, Albuquerque I, Gramfort A, Falk TH, Faubert J (2019) Deep learning-based electroencephalography analysis: a systematic review. J Neural Eng 16(5):051001

    Article  Google Scholar 

  29. Bouallegue G, Djemal R, Alshebeili SA, Aldhalaan H (2020) A dynamic filtering DF-RNN deep-learning-based approach for EEG-based neurological disorders diagnosis. IEEE Access 8:206992–207007

    Article  Google Scholar 

  30. Lu W, Wei Y, Yuan J, Deng Y, Song A (2020) Tractor assistant driving control method based on EEG combined with RNN-TL deep learning algorithm. IEEE Access 8:163269–163279

    Article  Google Scholar 

  31. Penchina B, Sundaresan A, Cheong S, Martel A (2020) Deep LSTM Recurrent Neural Network for Anxiety Classification from EEG in Adolescents with Autism. In: Mahmud Mufti, Vassanelli Stefano, Shamim Kaiser M, Zhong Ning (eds) Brain Informatics: 13th International Conference on Brain Informatics. Springer, Cham, pp 227–238

    Chapter  Google Scholar 

  32. TUBITAK Bilim Genc (2014) Robotic Arm Working via Mind Control. Online: http://www.bilimgenc.tubitak.gov.tr/makale/zihin-kontroluyle-calisan-robot-kol

  33. Si Y (2020) Machine learning applications for electroencephalograph signals in epilepsy: a quick review. Acta Epileptologica 2(1):1–7

    Article  Google Scholar 

  34. Lin JS, Hsieh CH (2016) A wireless BCI-controlled integration system in smart living space for patients. Wireless Pers Commun 88(2):395–441

    Article  Google Scholar 

  35. Moraru A, Pesko M, Porcius M, Fortuna C, Mladenic D (2010) Using machine learning on sensor data. J Comput Inf Technol 18(4):341–347

    Article  Google Scholar 

  36. Siswoyo A, Arief Z, Sulistijono IA (2017) Application of artificial neural networks in modeling direction wheelchairs using neurosky mindset mobile (EEG) device. EMITTER Int J Eng Technol 5(1):170–191

    Article  Google Scholar 

  37. Aki K, Dirik AE (2020) Deep learning based and PID control based autonomous vehicle systems. J Eng Sci Design 8(5):306–316

    Google Scholar 

  38. Bingol MS, Kaymak Ç, Uçar A (2019) Learning of autonomous vehicles from the human driving using deep learning. Firat Univ J Eng Sci 31(1):177–185

    Google Scholar 

  39. Bayraktar E, Yigit CB, Boyraz P (2017) Robotic arm control by fine-tuned convolutional neural network model. In: Proceedings of the 2017 25th Signal Processing and Communications Applications Conference (SIU). IEEE. pp 1–4

  40. Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst 25:1097–1105

    Google Scholar 

  41. Calp MH (2021) Use of deep learning approaches in cancer diagnosis. In: Kose U, Alzubi J (eds) Deep learning for cancer diagnosis studies in computational intelligence. Springer, Singapore

    Google Scholar 

  42. Martín A, González-Carrasco I, Rodriguez-Fernandez V, Souto-Rico M, Camacho D, Ruiz-Mezcua B (2021) Deep-Sync: a novel deep learning-based tool for semantic-aware subtitling synchronisation. Neural Comput Appl. https://doi.org/10.1007/s00521-021-05751-y

    Article  Google Scholar 

  43. Breiman L (2001) Random forest. Mach Learn 45:5–32

    Article  MATH  Google Scholar 

  44. Gislason PO, Benediktsson JA, Sveinsson JR (2004) Random forest classification of multisource remote sensing and geographic data. In: Proceedings of the IGARSS 2004. 2004 IEEE International Geoscience and Remote Sensing Symposium. IEEE. Vol. 2, pp 1049–1052

  45. Cakir E, Kamal B (2021) Analysis of merchant vessel accidents in Istanbul strait through decision tree method. Aquatic Res 4(1):10–20

    Article  Google Scholar 

  46. Hand D, Mannila H, Smyth P (2001) Principles of Data Mining. MIT Press, Cambridge

    Google Scholar 

  47. Collu DA, Akgun L, Eyduran E (2020) financial failure prediction with decision tree algorithms: Textile, wearing apparel and leather sector application. Int J Econ Innov 6(2):225–246

    Google Scholar 

  48. Bayes T (1763) LII. An essay towards solving a problem in the doctrine of chances. By the late Rev. Mr. Bayes, FRS communicated by Mr. Price, in a letter to John Canton, AMFR S. Philos Trans Royal Soc London 53:370–418

    Article  MATH  Google Scholar 

  49. Yildiz HK, Genctav M, Usta N, Diri B, Amasyali MF (2007) New feature extraction in text classification, In: Proceedings of the 15. Conference on Signal Processing and Communications Applications

  50. Bayraktar C, Gokcen H (2020) Comparison of classification algorithms for anomaly detection in energy optimization of high rack storage systems. Int J Manag Inf Syst Comput Sci 4(2):89–109

    Google Scholar 

  51. Arslan H (2020) Estimation of Keban Dam Lake level using fuzzy logic and support vector machines method. Thesis, Iskenderun Technical University, Turkey, MSc

    Google Scholar 

  52. Cortes C, Vapnik V (1995) Support-vector networks. Mach Learn 20(3):273–297

    Article  MATH  Google Scholar 

  53. Osowski S, Siwekand K, Markiewicz T (2004) MLP and SVM Networks – a Comparative Study.In: Proceedings of the 6th Nordic Signal Processing Symposium – NORSIG

  54. Nitze I, Schulthess U, Asche H (2012) Comparison of machine learning algorithms random forest, artificial neural network and support vector machine to maximum likelihood for supervised crop type classification. In: Proceedings of the 4th GEOBIA, Janeiro - Brazil. pp 35–40

  55. Han J, Kamber M, Pei J (2011) Data mining concepts and techniques, 3rd edn. Morgan Kaufmann, Massachusetts

    MATH  Google Scholar 

  56. Hu LY, Huang MW, Ke SW, Tsai CF (2016) The distance function effect on k-nearest neighbor classification for medical datasets. Springerplus 5(1):1–9

    Article  Google Scholar 

  57. Dilki G, Başar ÖD (2020) Comparison study of distance measures using k-nearest neighbor algorithm on bankruptcy prediction. Istanb Commer Univ J Sci 19(38):224–233

    Google Scholar 

  58. Fix E, Hodges JL (1989) Discriminatory analysis. Nonparametric discrimination: consistency properties. Int Stat Rev/Revue Int de Stat 57(3):238–247

    Article  MATH  Google Scholar 

  59. Kilinc D, Borandag E, Yucalar F, Tunali V, Simsek M, Ozcift A (2016) Classification of scientific articles using text mining with kNN algorithm and R language. Marmara J Pure Appl Sci 28(3):89–94

    Google Scholar 

  60. Dolgun MO, Ozdemir T, Oguz D (2009) Unstructured data analysis in data mining: text and web mining. J Stat 2(2009):48–58

    Google Scholar 

  61. Ozdamar K (2005) Statistical data analysis with packet programs. Kaan Press

    Google Scholar 

  62. Yılmaz K, Yeşilova A (2009) Modeling categorical data by using neural network and logistic regression. Yuzuncu Yil Univ J Inst Nat Appl Sci 14(2):112–116

    Google Scholar 

  63. Tolles J, Meurer WJ (2016) Logistic regression: Relating patient characteristics to outcomes. JAMA 316(5):533–534

    Article  Google Scholar 

  64. Calp MH (2019) An estimation of personnel food demand quantity for businesses by using artificial neural networks. J Polytech 22(3):675–686

    Google Scholar 

  65. Calp MH, Kose U (2020) Estimation of burned areas in forest fires using artificial neural networks. Ing Solidar 16(3):1–22

    Article  Google Scholar 

  66. Arduino (2018) What is Arduino? Arduino Create. Online: https://www.arduino.cc/en/Guide/Introduction

  67. Sener AO, Yucel E, Tan N (2017) Robot design with image processing sensor pixy. Fatih project education technologies summit, Turkey, pp 20–23

    Google Scholar 

  68. Vourvopoulos A, Liarokapis F (2014) Evaluation of commercial brain–computer interfaces in real and virtual world environment: a pilot study. Comput Electr Eng 40(2):714–729

    Article  Google Scholar 

  69. Kocyi̇gi̇t M, Guven A, Cam F (2019) Classification of mental arithmetic-based task discrimination from electroencephalography signals. Electron Lett Sci Eng 15(3):57–65

    Google Scholar 

  70. Barman G (2014) Ultrasonic assisting device for the visually impaired. Karadenic Technical University, Faculty of Engineering, Trabzon

    Google Scholar 

  71. Bal O (2015) Realization of secure communication of microprocessors over bluetooth. MSc. Thesis, Istanbul Technical University, pp 1–39

  72. Ozerdem M, Cengi̇z R (2018) GSM based multi-tracking system application. Dicle Univ J Eng 9(1):153–160

    Google Scholar 

  73. Semiz TY (2016) What is Relay and Where It is Used? – Types of the Relay. Robotistan.com: Online https://maker.robotistan.com/role-nedir/#Role-Nedir-Calisma-Prensibi-Nasildir

  74. Salfner F, Lenk M, Malek M (2010) A survey of online failure prediction methods. ACM Comput Surv (CSUR) 42(3):1–42

    Article  Google Scholar 

  75. Hossin M, Sulaiman MN (2015) A review on evaluation metrics for data classification evaluations. Int J Data Min Knowl Manag Process 5(2):1

    Article  Google Scholar 

  76. Contla Hernández B, Lopez-Villalobos N, Vignes M (2021) Identifying health status in grazing dairy cows from milk mid-infrared spectroscopy by using machine learning methods. Animals 11(8):2154

    Article  Google Scholar 

Download references

Acknowledgements

The authors are grateful to the Deanship of Scientific Research at King Saud University for funding this work through the Vice Deanship of Scientific Research Chairs: Chair of Pervasive and Mobile Computing. The work by Prof. David Camacho has been partially supported by FightDIS (PID2020-117263GB-100), S2018/TCS-4566 (CYNAMON), and by CHISTERA 2017 BDSI PACMEL (PCI2019-103623) projects. The research was supported by also LAIRLab: Life with Artificial Intelligence Research Laboratory of Suleyman Demirel University, Turkey.

Author information

Authors and Affiliations

  1. Dept. of Management Information Systems, Karadeniz Technical University, Trabzon, Turkey

    Muhammed Hanefi Calp

  2. Field of Software Development, Ankara Beypazarı Fatih Vocational and Technical Anatolian High School, 06730, Ankara, Turkey

    Resul Butuner

  3. Dept. of Computer Engineering, Suleyman Demirel University, Isparta, Turkey

    Utku Kose

  4. Research Chair of Pervasive and Mobile Computing, Department of Information Systems, College of Computer and Information Sciences, King Saud University, Riyadh, 11362, Saudi Arabia

    Atif Alamri

  5. Computer Systems Engineering Department, Universidad Politécnica de Madrid, Madrid, Spain

    David Camacho

Authors
  1. Muhammed Hanefi Calp
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Resul Butuner
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Utku Kose
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Atif Alamri
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. David Camacho
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Atif Alamri.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Calp, M.H., Butuner, R., Kose, U. et al. IoHT-based deep learning controlled robot vehicle for paralyzed patients of smart cities. J Supercomput 78, 11373–11408 (2022). https://doi.org/10.1007/s11227-021-04292-4

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-021-04292-4

Keywords

Search

Navigation