Abstract
An effective continuous monitoring system on human activities and vital signs provides a rapid detection and assistance in times of critical events. Most of today’s existing systems concentrate only on providing indoor monitoring solutions, not taking into consideration that danger is more prominent outdoors. This work proposes a multimodal system solution to monitor elderly people outdoor. The proposed solution simultaneously monitors different modalities, and detect if any problem occurs. Using state-of-the-art transmission technology, the proposed solution makes use of a heart-rate monitor to detect heart problem issues, as well as the smartphone's three-axis accelerometer and GPS to detect if a person falls and if so, to identify a person’s location, accordingly. These monitoring services are combined together in order to obtain more pertinent information about a person’s condition, and to make use of assistance services, when needed. The proposed solution was evaluated through simulation, and experiments involving 20 subjects. From the 180 tests conducted involving three different fall scenarios, results show that falls can be detected from walking or standing with 97.77% precision, 95% sensitivity, and 99.16% specificity. Moreover, the proposed solution minimizes false positive and false negative. The results obtained also validate the detection of tachycardia, the fusion of the different monitoring services, and the pertinence of assistance services with 100% success. An application was developed, and its evaluation enabled us to validate the system’s interaction with the elderly.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Albert MV, Kording K, Herrmann M, Jayaraman A (2012) Fallclassification by machine learning using mobile phones. PLoS ONE 7(5):e36556. https://doi.org/10.1371/journal.pone.0036556
Al-Naimi I, Wong CB (2017) Indoor human detection and tracking using advanced smart floor. In: 2017 8th international conference on information and communication systems (ICICS), IEEE, pp 34–39. https://doi.org/10.1109/iacs.2017.7921942
Amini A, Banitsas K, Young WR (2018) Kinect4FOG: monitoring and improving mobility in people with Parkinson’s using a novel system incorporating the Microsoft Kinect v2. Disabil Rehabil Assist Technol. https://doi.org/10.1080/17483107.2018.1467975
Bauer A, Malik M, Schmidt G, Barthel P, Bonnemeier H, Cygankiewicz I, Schneider R et al (2008) Heart rate turbulence: standards of measurement, physiological interpretation, and clinical use: International Society for Holter and Noninvasive Electrophysiology Consensus. J Am Coll Cardiol 52(17):1353–1365. https://doi.org/10.1016/j.jacc.2008.07.041
Beauvais BS, Rialle V, Sablier J (2012) Myvigi: an android application to detect fall and wandering. In: Proceedings of the sixth international conference on mobile ubiquitous computing, systems, services and technologies, UBICOMM, pp. 156–160
Bourke AK, O’brien JV, Lyons GM (2007) Evaluation of a threshold-based tri-axial accelerometer fall detection algorithm. Gait Posture. 26(2):194–199. https://doi.org/10.1016/j.gaitpost.2006.09.012
Braun A, Heggen H, Wichert R (2011) CapFloor—a flexible capacitive indoor localization system. In: International competition on evaluating AAL systems through competitive benchmarking, Springer, Berlin, Heidelberg, pp 26–35. https://doi.org/10.1007/978-3-642-33533-4_3
CDC Centers for Disease Control and Prevention (2013) The State of aging and health in America. CDC, Atlanta
Chen J, Kwong K, Chang D, Luk J, Bajcsy R (2006) Wearable sensors for reliable fall detection. In: 2005 IEEE engineering in medicine and biology 27th annual conference, pp 3551–3554. IEEE. https://doi.org/10.1109/IEMBS.2005.1617246
Choi S, Youm S (2017) A study on a fall detection monitoring system for falling elderly using open source hardware. Multimed Tools Appl. https://doi.org/10.1007/s11042-017-5452-9
Cronin H, Anne Kenny R (2010) Cardiac causes for falls and their treatment. Clin Geriatr Med 26(4):539
Destatis (2016) Older people in Germany and the EU. Federal Statistical Office of Germany, Wiesbaden
Fox K, Borer JS, Camm AJ, Danchin N, Ferrari R, Sendon JLL, Heart Rate Working Group (2007) Resting heart rate in cardiovascular disease. J Am Coll Cardiol 50(9):823–830. https://doi.org/10.1016/j.jacc.2007.04.079
Gasparrini S, Cippitelli E, Spinsante S, Gambi E (2014) A depth-based fall detection system using a Kinect® sensor. Sensors 14(2):2756–2775. https://doi.org/10.3390/s140202756
Global Age Watch Index (2015). http://www.helpage.org/global-agewatch/. Accessed 29 Jan 2019
Gomez-Montalvo J, Lopez M, Curi F, Moo-Mena F, Menendez V (2020) PIANI: an ontology-based platform for outdoor activity recognition and non-intrusive assistance to the elderly. J Intell Fuzzy Syst. https://doi.org/10.3233/JIFS-179893 (Preprint)
Heinrich S, Rapp K, Rissmann U, Becker C, König HH (2010) Cost of falls in old age: a systematic review. Osteoporos Int 21(6):891–902. https://doi.org/10.1007/s00198-009-1100-1
Holzinger A, Röcker C, Ziefle M (2015) From smart health to smart hospitals. Smart health. Springer, Cham, pp 1–20. https://doi.org/10.1007/978-3-319-16226-3_1
Hsieh CY, Liu KC, Huang CN, Chu WC, Chan CT (2017) Novel hierarchical fall detection algorithm using a multiphase fall model. Sensors 17(2):307. https://doi.org/10.3390/s17020307
Hussain F, Ehatisham-ul-Haq M, Azam MA, Khalid A (2018) Elderly assistance using wearable sensors by detecting fall and recognizing fall patterns. In: Proceedings of the 2018 ACM international joint conference and 2018 international symposium on pervasive and ubiquitous computing and wearable computers, pp 770–777. https://doi.org/10.1145/3267305.3274129
Jensen K, Kristensen LM (2015) Colored Petri nets: a graphical language for formal modeling and validation of concurrent systems. Commun ACM 58(6):61–70. https://doi.org/10.1145/2663340
Jensen K, Kristensen LM, Wells L (2007) Coloured Petri nets and CPN tools for modelling and validation of concurrent systems. Int J Softw Tools Technol Transf 9(3–4):213–254. https://doi.org/10.1007/s10009-007-0038-x
Jokanović B, Amin M (2017) Fall detection using deep learning in range-Doppler radars. IEEE Trans Aerosp Electron Syst 54(1):180–189. https://doi.org/10.1109/TAES.2017.2740098
Karlsson MK, Magnusson H, von Schewelov T, Rosengren BE (2013) Prevention of falls in the elderly—a review. Osteoporos Int 24(3):747–762. https://doi.org/10.1007/s00198-012-2256-7
Khan Y, Ostfeld AE, Lochner CM, Pierre A, Arias AC (2016) Monitoring of vital signs with flexible and wearable medical devices. Adv Mater 28(22):4373–4395. https://doi.org/10.1002/adma.201504366
Khssibi S, Idoudi H, Van Den Bossche A, Val T, Saidane LA (2013) Presentation and analysis of a new technology for low-power wireless sensor network. Int J Digit Inf Wirel Commun 3(1):75. https://hal.archives-ouvertes.fr/hal-01138278
Kurniawan A, Hermawan AR, Purnama IKE (2016) A wearable device for fall detection elderly people using tri dimensional accelerometer. In: 2016 international seminar on intelligent technology and its applications (ISITIA), pp 671–674. https://doi.org/10.1109/ISITIA.2016.7828740
Lauterbach C, Steinhage A, Techmer A, Sousa M, Hoffmann R (2018) AAL functions for home care and security. Curr Dir Biomed Eng 4(1):127–129. https://doi.org/10.1515/cdbme-2018-0032
Li H, Shrestha A, Fioranelli F, Le Kernec J, Heidari H, Pepa M, Spinsante S, et al (2017) Multisensor data fusion for human activities classification and fall detection. In: 2017 IEEE SENSORS, pp 1–3. https://doi.org/10.1109/ICSENS.2017.8234179
Macaš M, Lesoin S, Périn A (2018) Camera based real time fall detection using pattern classification. In: Precision medicine powered by pHealth and connected health, Springer, Singapore, pp 157–161. https://doi.org/10.1007/978-981-10-7419-6_27
Maddox TM, Ross C, Ho PM, Masoudi FA, Magid D, Daugherty SL, Rumsfeld JS et al (2008) The prognostic importance of abnormal heart rate recovery and chronotropic response among exercise treadmill test patients. Am Heart J 156(4):736–744. https://doi.org/10.1016/j.ahj.2008.05.025
Majumder S, Mondal T, Deen MJ (2017) Wearable sensors for remote health monitoring. Sensors 17(1):130. https://doi.org/10.3390/s17010130
Makhlouf A, Boudouane I, Saadia N, Cherif AR (2019) Ambient assistance service for fall and heart problem detection. J Ambient Intell Humaniz Comput 10(4):1527–1546. https://doi.org/10.1007/s12652-018-0724-4
Mansor H, Shukor MHA, Meskam SS, Rusli NQAM, Zamery NS (2013) Body temperature measurement for remote health monitoring system. In: 2013 IEEE international conference on smart instrumentation, measurement and applications (ICSIMA), pp 1–5. https://doi.org/10.1109/ICSIMA.2013.6717956
Mao A, Ma X, He Y, Luo J (2017) Highly portable, sensor-based system for human fall monitoring. Sensors 17(9):2096. https://doi.org/10.3390/s17092096
Mazurek P, Wagner J, Morawski RZ (2015) Acquisition and preprocessing of data from infrared depth sensors to be applied for patients monitoring. In: 2015 IEEE 8th international conference on intelligent data acquisition and advanced computing systems: technology and applications (IDAACS), vol 2, pp 705–710. https://doi.org/10.1109/IDAACS.2015.7341395
Mendis S, Puska P, Norrving B (2011) Global atlas on cardiovascular disease prevention and control. World Health Organization, Geneva
Merrouche IN, Makhlouf A, Saadia N, Ramdane-Cherif A. (2016) Overview and systems of assistance to older people. In: 2016 4th international conference on control engineering and information technology (CEIT), pp 1–6. IEEE. https://doi.org/10.1109/CEIT.2016.7929050
Merrouche IN, Makhlouf A, Saadia N, Ramdane-Cherif A (2018) Cardiac disorder detection application and ANT + technology. In: Proceedings of the 10th international conference on agents and artificial intelligence (ICAART 2018), vol 2, pp 295–300. https://doi.org/10.5220/0006530202950300
Munoz-Organero M, Lotfi A (2016) Human movement recognition based on the stochastic characterisation of acceleration data. Sensors 16(9):1464. https://doi.org/10.3390/s16091464
Oner M, Pulcifer-Stump JA, Seeling P, Kaya T (2012) Towards the run and walk activity classification through step detection-an android application. In: 2012 annual international conference of the IEEE engineering in medicine and biology society, pp 1980–1983. IEEE. https://doi.org/10.1109/EMBC.2012.6346344
Owens M, Allen G (2010) SQLite. Apress LP, New York
Pierleoni P, Belli A, Palma L, Pellegrini M, Pernini L, Valenti S (2015) A high reliability wearable device for elderly fall detection. IEEE Sens J 15(8):4544–4553. https://doi.org/10.1109/JSEN.2015.2423562
Prokhorov MD, Kulminskiy DD, Borovkova EI, Karavaev AS, Ponomarenko VI, Kiselev AR, Bezruchko BP (2018) Mobile device for monitoring of cardiovascular system state based on assessment of synchronization of its low-frequency rhythms. Open Hypertens J. https://doi.org/10.2174/1876526201810010046
Raykov YP, Ozer E, Dasika G, Boukouvalas A, Little MA (2016) Predicting room occupancy with a single passive infrared (PIR) sensor through behavior extraction. In: Proceedings of the 2016 ACM international joint conference on pervasive and ubiquitous computing, pp 1016–1027. https://doi.org/10.1145/2971648.2971746
Sohn K, Merchant FM, Sayadi O, Puppala D, Doddamani R, Sahani A, Armoundas AA et al (2017) A novel point-of-care smartphone based system for monitoring the cardiac and respiratory systems. Sci Rep 7:44946. https://doi.org/10.1038/srep44946
Sposaro F, Danielson J, Tyson G (2010) iWander: an android application for dementia patients. In: Engineering in medicine and biology society (EMBC), 2010 annual international conference of the IEEE, pp 3875–3878. https://doi.org/10.1109/IEMBS.2010.5627669
Steg H, Strese H, Loroff C, Hull J, Schmidt S (2006) Europe is facing a demographic challenge. Ambient assisted living offers solutions. In: VDI/VDE/IT, Berlin
Sucerquia A, López JD, Vargas-Bonilla JF (2018) Real-life/real-time elderly fall detection with a triaxial accelerometer. Sensors 18(4):1101. https://doi.org/10.3390/s18041101
Tao S, Kudo M, Nonaka H (2012) Privacy-preserved behavior analysis and fall detection by an infrared ceiling sensor network. Sensors 12(12):16920–16936. https://doi.org/10.3390/s121216920
Tran TH, Le TL, Hoang VN, Vu H (2017) Continuous detection of human fall using multimodal features from Kinect sensors in scalable environment. Comput Methods Progr Biomed 146:151–165. https://doi.org/10.1016/j.cmpb.2017.05.007
Wang FT, Chan HL, Hsu MH, Lin CK, Chao PK, Chang YJ (2018) Threshold-based fall detection using a hybrid of tri-axial accelerometer and gyroscope. Physiol Meas 39(10):105002. https://doi.org/10.1088/1361-6579/aae0eb
Wang G, Li Q, Wang L, Zhang Y, Liu Z (2020) CMFALL: a cascade and parallel multi-state fall detection algorithm using waist-mounted tri-axial accelerometer signals. IEEE Trans Consum Electron 66(3):261–270. https://doi.org/10.1109/TCE.2020.3000338
World Health Organization (WHO). http://www.who.int/mediacentre/factsheets/fs344/en/. Accessed on Apr 2019
Yang L, Ren Y, Hu H, Tian B (2015) New fast fall detection method based on spatio-temporal context tracking of head by using depth images. Sensors 15(9):23004–23019. https://doi.org/10.3390/s150923004
Zapata BC (2013) Android studio application development. Packt Publishing Ld, Birmingham
Zhou CC, Tu CL, Gao Y, Wang FX, Gong HW, Lian P, Ye XS et al (2014) A low-power, wireless, wrist-worn device for long time heart rate monitoring and fall detection. In: 2014 international conference on orange technologies, pp 33–36. IEEE. https://doi.org/10.1109/ICOT.2014.6954670
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Nedjai-Merrouche, I., Saadia, N., RamdaneCherif, A. et al. Outdoor multimodal system based on smartphone for health monitoring and incident detection. J Ambient Intell Human Comput 12, 10699–10721 (2021). https://doi.org/10.1007/s12652-020-02880-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12652-020-02880-5