Abstract
The decrease in fertility rates and the increase in the average age of individuals are the main reasons behind the aging of the population. Challenges that come with an aging population include proper nursing care. Because the cost of healthcare is high and falls that cause injury or death in the elderly are escalating, they are a challenge for public welfare and research into reliable surveillance is essential. Non-intrusive fall detection systems are vital for reducing fall trauma and machine vision is an appropriate solution for detecting unusual events such as falls. Because there are varieties of vision-based fall detection (VBFD) methods and a comprehensive framework is lacking, comparison and evaluation of existing methods are difficult. In the current study, an analytical framework having three main components is proposed. First, existing VBFD methods are classified into three categories. Next, general evaluation criteria are defined for analysis of the proposed categorizations. Finally, each method is qualitatively analyzed using the proposed categorizations. The proposed framework can accurately provide identification and analytical comparison of existing methods. In addition, it can allow selection of the most appropriate methods and suggest improvements for existing methods.
Similar content being viewed by others
References
ADER NS (2013) Detecting falls and poses in image silhouettes. J Igual R, Medrano C, Plaza I. Challenges, issues and trends in fall detection systems 12(66):1–66
Ageing WHO, Unit LC (2008) WHO Global report on falls prevention in older age. World Health Organization
Alaliyat S (2008) Video-based fall detection in elderlys houses. Master’s thesis, Gjvik University College
Auvinet E, Multon F, Saint-Arnaud A, Rousseau J, Meunier J (2011) Fall detection with multiple cameras: an occlusion-resistant method based on 3-d silhouette vertical distribution. IEEE Trans Inf Technol Biomed 15(2):290–300
Auvinet E, Rougier C, Meunier J, St-Arnaud A, Rousseau J (2010) Multiple cameras fall dataset. DIRO-universite de Montreal, Tech Rep 1350
Baldewijns G, Debard G, Mertes G, Vanrumste B, Croonenborghs T (2016) Bridging the gap between real-life data and simulated data by providing a highly realistic fall dataset for evaluating camera-based fall detection algorithms. Healthcare Technology Letters 3(1):6–11
Baptista-Ríos M, Martínez-García C, Losada-Gutiérrez C, Marrón-Romera M (2016) Human activity monitoring for falling detection. a realistic framework. In: 2016 International Conference on Indoor Positioning and Indoor Navigation (IPIN), IEEE, pp 1–7
Castillo JC, Carneiro D, Serrano-Cuerda J, Novais P, Fernández-Caballero A, Neves J (2014) A multi-modal approach for activity classification and fall detection. Int J Syst Sci 45(4):810–824
Chen MC (2016) A video surveillance system designed to detect multiple falls. Adv Mech Eng 8(4):1687814016642,914
Chen YT, Lin YC, Fang WH (2010) A hybrid human fall detection scheme. In: 2010 17th IEEE International Conference on Image Processing (ICIP), IEEE, pp 3485–3488
Cheng WC, Jhan DM (2013) Triaxial accelerometer-based fall detection method using a self-constructing cascade-adaboost-svm classifier. IEEE J Biomed Health Inform 17(2):411–419
Chua JL, Chang YC, Lim WK (2015) A simple vision-based fall detection technique for indoor video surveillance. SIViP 3(9):623–633
Cucchiara R, Prati A, Vezzani R (2007) A multi-camera vision system for fall detection and alarm generation. Expert Syst 24(5):334–345
Dai X (2013) Vision-based 3d human motion analysis for fall detection and bed-exiting. Ph.D. thesis, University of Denver
Delahoz YS, Labrador MA (2014) Survey on fall detection and fall prevention using wearable and external sensors. Sensors 14(10):19,806–19,842
Doukas CN, Maglogiannis I (2011) Emergency fall incidents detection in assisted living environments utilizing motion, sound, and visual perceptual components. IEEE Trans Inf Technol Biomed 15(2):277–289
Doulamis A, Doulamis N, Kalisperakis I, Stentoumis C (2010) A real-time single-camera approach for automatic fall detection. ISPRS Commission V Close Range Image Measurements Techniques 38:207–212
El-Bendary N, Tan Q, Pivot FC, Lam A (2013) Fall detection and prevention for the elderly: a review of trends and challenges. Int J Smart Sens Intell Syst 6(3)
Ezatzadeh S, Keyvanpour MR (2017) Fall detection for elderly in assisted environments: Video surveillance systems and challenges. In: 9th International Conference on Information and Knowledge Technology (IKT 2017), IEEE, pp 93–98
Fan K, Wang P, Hu Y, Dou B (2017) Fall detection via human posture representation and support vector machine. Int J Distrib Sens Netw 13(5):1–21
Fan K, Wang P, Zhuang S (2018) Human fall detection using slow feature analysis. Multimedia Tools and Applications pp 1–28
Feng W, Liu R, Zhu M (2014) Fall detection for elderly person care in a vision-based home surveillance environment using a monocular camera. SIViP 6 (8):1129–1138
Foroughi H, Aski BS, Pourreza H (2008) Intelligent video surveillance for monitoring fall detection of elderly in home environments. In: 2008. ICCIT 2008. 11th International Conference on Computer and Information Technology, IEEE, pp 219–224
Foroughi H, Rezvanian A, Paziraee A (2008) Robust fall detection using human shape and multi-class support vector machine. In: 2008. ICVGIP’08. Sixth Indian Conference on Computer Vision, Graphics & Image Processing, IEEE, pp 413–420
Gripentog RJ (2015) Fall detection by using video. Master’s thesis. University of Nevada, Las Vegas
Hijaz F, Afzal N, Ahmad T, Hasan O (2010) Survey of fall detection and daily activity monitoring techniques. In: 2010 International Conference on Information and Emerging Technologies (ICIET), IEEE, pp 1–6
Hsieh CY, Liu KC, Huang CN, Chu WC, Chan CT (2017) Novel hierarchical fall detection algorithm using a multiphase fall model. Sensors 17(2):307
Htike ZZ, Egerton S, Chow KY (2011) A monocular view-invariant fall detection system for the elderly in assisted home environments. In: 2011 7th International Conference on Intelligent Environments (IE), IEEE, pp 40–46
Igual R, Medrano C, Plaza I (2013) Challenges, issues and trends in fall detection systems. Biomed Eng Online 12(1):66
Jansen B, Deklerck R (2006) Context aware inactivity recognition for visual fall detection. In: Pervasive Health Conference and Workshops, 2006, IEEE, pp 1–4
Jiang M, Chen Y, Zhao Y, Cai A (2013) A real-time fall detection system based on hmm and rvm. In: Visual Communications and Image Processing (VCIP), 2013, IEEE, pp 1–6
Khan SS, Hoey J (2017) Review of fall detection techniques: a data availability perspective. Med Eng Phys 39:12–22
Koohzadi M, Keyvanpour M (2015) Otwc: an efficient object-tracking method. SIViP 9(6):1235–1247
Koohzadi M, Keyvanpour MR (2014) An analytical framework for event mining in video data. Artif Intell Rev 41(3):401–413
Koshmak G, Loutfi A, Linden M (2016) Challenges and issues in multisensor fusion approach for fall detection. Journal of Sensors 2016
Liu H, Guo Y (2017) A vision-based fall detection algorithm of human in indoor environment. In: Second International Conference on Photonics and Optical Engineering, International Society for Optics and Photonics, pp 1025,644–1025,644
Lotfi A, Albawendi S, Powell H, Appiah K, Langensiepen C (2018) Supporting independent living for older adults; employing a visual based fall detection through analysing the motion and shape of the human body. IEEE Access 6:70,272–70,282
Ma X, Wang H, Xue B, Zhou M, Ji B, Li Y (2014) Depth-based human fall detection via shape features and improved extreme learning machine. IEEE J Biomed Health Inform 18(6):1915–1922
Makantasis K, Protopapadakis E, Doulamis A, Doulamis N, Matsatsinis N (2016) 3d measures exploitation for a monocular semi-supervised fall detection system. Multimed Tools Appl 75(22):15,017–15,049
Mastorakis G (2018) Human fall detection methodologies: from machine learning using acted data to fall modelling using myoskeletal simulation, Ph.D. thesis, Kingston University
Min W, Zou S, Li J (2018) Human fall detection using normalized shape aspect ratio. Multimedia Tools and Applications, pp 1–23
Mirmahboub B, Samavi S, Karimi N, Shirani S (2013) Automatic monocular system for human fall detection based on variations in silhouette area. IEEE Trans Biomed Eng 60(2):427–436
Mohamed O, Choi HJ, Iraqi Y (2014) Fall detection systems for elderly care: a survey. In: 2014 6th International Conference on New Technologies, Mobility and Security (NTMS), IEEE, pp 1–4
Mourchid Y, El Hassouni M, Cherifi H (2019) A general framework for complex network-based image segmentation. Multimedia Tools and Applications, pp 1–26
Mubashir M, Shao L, Seed L (2013) A survey on fall detection: Principles and approaches. Neurocomputing 100:144–152
Nadi M, El-Bendary N, Hassanien AE, Kim TH (2015) Falling detection system based on machine learning. In: 2015 4th International Conference on Advanced Information Technology and Sensor Application (AITS), IEEE, pp 71–75
Nizam Y, Mohd MNH, Jamil MMA (2016) A study on human fall detection systems: Daily activity classification and sensing techniques. International Journal of Integrated Engineering 8(1)
Noury N, Fleury A, Rumeau P, Bourke A, Laighin G, Rialle V, Lundy J (2007) Fall detection-principles and methods. In: Engineering in Medicine and Biology Society, 2007. EMBS 2007. 29th Annual International Conference of the IEEE, IEEE, pp 1663–1666
Núñez-Marcos A, Azkune G, Arganda-Carreras I (2017) Vision-based fall detection with convolutional neural networks. Wirel Commun Mob Comput 2017
Paul M, Haque SM, Chakraborty S (2013) Human detection in surveillance videos and its applications-a review. EURASIP Journal on Advances in Signal Processing 2013(1):176
Rajabi H, Nahvi M (2015) An intelligent video surveillance system for fall and anesthesia detection for elderly and patients. In: 2015 2nd International Conference on Pattern Recognition and Image Analysis (IPRIA), IEEE, pp 1–6
Rougier C, Meunier J, St-Arnaud A, Rousseau J (2006) Monocular 3d head tracking to detect falls of elderly people. In: Engineering in Medicine and Biology Society, 2006. EMBS’06. 28th Annual International Conference of the IEEE, IEEE, pp 6384–6387
Rougier C, Meunier J, St-Arnaud A, Rousseau J (2007) Fall detection from human shape and motion history using video surveillance. In: 2007, AINAW’07. 21st International Conference on Advanced Information Networking and Applications Workshops, vol 2. IEEE, pp 875–880
Rougier C, Meunier J, St-Arnaud A, Rousseau J (2011) Robust video surveillance for fall detection based on human shape deformation. IEEE Trans Circuits Syst Video Technol 21(5):611–622
Shoaib M, Dragon R, Ostermann J (2010) View-invariant fall detection for elderly in real home environment. In: 2010 Fourth Pacific-rim Symposium on Image and Video Technology (PSIVT), IEEE, pp 52–57
Solbach MD, Tsotsos JK (2017) Vision-based fallen person detection for the elderly. arXiv:1707.07608
Su S, Wu SS, Chen SY, Duh DJ, Li S (2016) Multi-view fall detection based on spatio-temporal interest points. Multimed Tools Appl 75(14):8469–8492
Suriani NS, Hussain A (2012) Sudden fall classification using motion features. In: 2012 IEEE 8th International Colloquium on Signal Processing and its Applications (CSPA), IEEE, pp 519–524
Thome N, Miguet S, Ambellouis S (2008) A real-time, multiview fall detection system: a lhmm-based approach. IEEE Trans Circuits Syst Video Technol 18 (11):1522–1532
Toreyin BU, Dedeoglu Y, Çetin AE (2005) Hmm based falling person detection using both audio and video. Lect Notes Comput Sci 3766:211
Tu Z (2007) Learning generative models via discriminative approaches. In: 2007. CVPR’07. IEEE Conference on Computer Vision and Pattern Recognition, IEEE, pp 1–8
Vaidehi V, Ganapathy K, Mohan K, Aldrin A, Nirmal K (2011) Video based automatic fall detection in indoor environment. In: 2011 International Conference on Recent Trends in Information Technology (ICRTIT), IEEE, pp 1016–1020
Vishwakarma V, Mandal C, Sural S (2007) Automatic detection of human fall in video. Pattern Recognition and Machine Intelligence, pp 616–623
Wang K, Cao G, Meng D, Chen W, Cao W (2016) Automatic fall detection of human in video using combination of features. In: 2016 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), IEEE, pp 1228–1233
Wang S, Chen L, Zhou Z, Sun X, Dong J (2016) Human fall detection in surveillance video based on pcanet. Multimedia Tools Appl 75(19):11,603–11,613
Yan C, Li L, Zhang C, Liu B, Zhang Y, Dai Q (2019) Cross-modality bridging and knowledge transferring for image understanding. IEEE Transactions on Multimedia
Yan C, Xie H, Chen J, Zha Z, Hao X, Zhang Y, Dai Q (2018) A fast uyghur text detector for complex background images. IEEE Trans Multimedia 20 (12):3389–3398. https://doi.org/10.1109/TMM.2018.2838320
Yang L, Ren Y, Hu H, Tian B (2015) New fast fall detection method based on spatio-temporal context tracking of head by using depth images. Sensors 15 (9):23,004–23,019
Yang L, Ren Y, Zhang W (2016) 3d depth image analysis for indoor fall detection of elderly people. Digital Communications and Networks 2(1):24–34
Yu M, Rhuma A, Naqvi SM, Wang L, Chambers J (2012) A posture recognition-based fall detection system for monitoring an elderly person in a smart home environment. IEEE Trans Inf Technol Biomed 16(6):1274–1286
Yu X (2008) Approaches and principles of fall detection for elderly and patient. In: 2008. Healthcom 2008. 10th International Conference on E-health Networking, Applications and services, IEEE, pp 42–47
Zandian ZK, Keyvanpour M (2017) Systematic identification and analysis of different fraud detection approaches based on the strategy ahead. International Journal of Knowledge-based and Intelligent Engineering Systems 21(2):123–134
Zerrouki N, Houacine A (2018) Combined curvelets and hidden markov models for human fall detection. Multimed Tools Appl 77(5):6405–6424
Zhang Z, Conly C, Athitsos V (2015) A survey on vision-based fall detection. In: Proceedings of the 8th ACM International Conference on PErvasive Technologies Related to Assistive Environments, ACM, p 46
Zhang Z, Liu W, Metsis V, Athitsos V (2012) A viewpoint-independent statistical method for fall detection. In: 2012 21st International Conference on Pattern Recognition (ICPR), IEEE, pp 3626–3630
Zolfaghari S, Keyvanpour MR (2016) Sarf: Smart activity recognition framework in ambient assisted living. In: 2016 Federated Conference on Computer Science and Information Systems (fedCSIS), IEEE, pp 1435–1443
Zolfaghari S, Keyvanpour MR, Zall R (2017) Analytical review on ontological human activity recognition approaches. Int J E-Bus Res (IJEBR) 13(2):58–78
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Ezatzadeh, S., Keyvanpour, M.R. ViFa: an analytical framework for vision-based fall detection in a surveillance environment. Multimed Tools Appl 78, 25515–25537 (2019). https://doi.org/10.1007/s11042-019-7720-3
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-019-7720-3