skip to main content
research-article

Learning and Vision-based approach for Human fall detection and classification in naturally occurring scenes using video data

Published: 21 November 2024 Publication History

Abstract

The advancement of medicine presents challenges for modern cultures, especially with unpredictable elderly falling incidents anywhere due to serious health issues. Delayed rescue for at-risk elders can be dangerous. Traditional elder safety methods like video surveillance or wearable sensors are inefficient and burdensome, wasting human resources and requiring caregivers' constant fall detection monitoring. Thus, a more effective and convenient solution is needed to ensure elderly safety. In this article, a method is presented for detecting human falls in naturally occurring scenes using videos through a traditional Convolutional Neural Network (CNN) model, Inception-v3, VGG-19, and two versions of the You Only Look Once (YOLO) working model. The primary focus of this work is human fall detection through the utilization of deep learning models. Specifically, the YOLO approach is adopted for object detection and tracking in video scenes. By implementing YOLO, human subjects are identified, and bounding boxes are generated around them. The classification of various human activities, including fall detection is accomplished through the analysis of deformation features extracted from these bounding boxes. The traditional CNN model achieves an impressive 99.83% accuracy in human fall detection, surpassing other state-of-the-art methods. However, training time is longer compared to YOLO-v2 and YOLO-v3, but significantly shorter than Inception-v3, taking only around 10% of its total training time.

References

[1]
M. Schneider. 2011. Introduction to Public Health. Sudbury, MA: Jones and Bartlett.
[2]
S. S. Khan, M. E. Karg, D. Kulić, and J. Hoey. 2017. Detecting falls with x-factor hidden Markov models. Applied Soft Computing 55 (2017), 168–177.
[3]
J. Yin, Q. Yang, and J. Pan. 2008. Sensor-based abnormal human-activity detection. IEEE Transactions on Knowledge and Data Engineering 20, 8 (2008), 1082–1090.
[4]
S. Nooruddin, M. M. Islam, F. A. Sharna, H. Y. Al-Hetari, and M. N. Kabir. 2021. Sensor-based fall detection systems: A review. Journal of Ambient Intelligence and Humanized Computing 13, 5 (2021), 2735–2751.
[5]
Jose Castillo, Davide Carneiro, Juan Novais, Paulo Fernández-Caballero, and Jose Antonio Neves. 2014. A multi-modal approach for activity classification and fall detection. International Journal of Systems Science 45 (2014), 810–824.
[6]
H. Li, A. Shrestha, H. Heidari, J. Le Kernec, and F. Fioranelli. 2020. Bi-LSTM network for multimodal continuous human activity recognition and fall detection, IEEE Sensors Journal 20, 3 (2020), 1191–1201.
[7]
C. Rougier, J. Meunier, A. St-Arnaud, and J. Rousseau. 2011. Robust video surveillance for fall detection based on human shape deformation. IEEE Trans. Circ. Syst. Video. Technol 21, 5 (2011), 611–622.
[8]
E. Auvinet, F. Multon, A. Saint-Arnaud, J. Rousseau, and J. Meunier. 2011. Fall detection with multiple cameras: An occlusion-resistant method based on 3-D silhouette vertical distribution. IEEE Transactions on Information Technology in Biomedicine 15, 2 (2011), 290–300.
[9]
Adrian Nunez-Marcos, Gorka Azkune, and Ignacio Arganda-Carreras. 2017. Vision-based fall detection with convolutional neural networks. Wireless Communications and Mobile Computing. 2017. 1–16.
[10]
C. Rougier, J. Meunier, A. St-Arnaud, and J. Rousseau. 2011. Robust video surveillance for fall detection based on human shape deformation. IEEE Transactions on Circuits and Systems for Video Technology 21, 5 (2011), 611–622.
[11]
Suad Albawendi, Ahmad Lot, Heather Powell, and Kofi Appiah. 2018. Video based fall detection using features of motion, shape and histogram. Proceeding of PETRA’18, (Corfu, Greece), 529–536
[12]
W. Chen, Z. Jiang, H. Guo, and X. Ni. 2020. Fall detection based on key points of human-skeleton using OpenPose. Symmetry. 12 (2020), 744.
[13]
Q. Xu, G. Huang, M. Yu, Y. Guo, and G. Huang. 2020. Fall prediction based on key points of human bones. Phys. A Stat. Mech. its Appl. 2020;540:123205.
[14]
X. Wang and K. Jia. 2020. Human fall detection algorithm based on YOLOv3. In Proceedings of the 2020 IEEE 5th International Conference on Image, Vision and Computing (ICIVC); (Qingdao, China). 23–25 50–54.
[15]
Y. Chen, X. Kong, L. Meng, and H. Tomiyama. 2020. An edge computing based fall detection system for elderly persons. Procedia Comput. Sci. 174 (2020), 9–14.
[16]
Y. Chen, W. Li, L. Wang, J. Hu, and M. Ye. 2020. Vision-based fall event detection in complex background using attention guided bi-directional LSTM. IEEE Access. 8 (2020), 161337–161348.
[17]
Edouard Auvinet, Caroline Rougier, Jean Meunier, Alain St-Arnaud, and Jacqueline Rousseau. 2010. Multiple cameras fall dataset. DIRO-Universit´e de Montr´eal, Tech. Rep, 1350.
[18]
Jantima Thummala and Suree Pumrin. 2020. Fall detection using motion history image and shape deformation. In Proceedings of the 2020 8th International Electrical Engineering Congress (iEECON); (Chiang Mai, Thailand).
[19]
S. F. Ali, R. Khan, A. Mahmood, M. T. Hassan, and M. Jeon. 2018. Using temporal covariance of motion and geometric features via boosting for human fall detection. Sensors. 18 (2018), 1918.
[20]
G. Demiris, M. Rantz, M. Aud, K. Marek, H. Tyrer, M. Skubic, and A. Hussam. 2004. Older adults’ attitudes towards and perceptions of “smart home” technologies: A pilot study. Medical Informatics and the Internet in Medicine 29, 2 (2004), 87–94.
[21]
J.-L. Chua, Y. C. Chang, and W. K. Lim. 2013. A simple vision-based fall detection technique for indoor video surveillance. Signal, Image and Video Processing 9, 3 (2013), 623–633.
[22]
G. Madhu, S. Kautish, Y. Gupta, G. Nagachandrika, S. M. Biju, and M. Kumar. 2023. XCovNet: An optimized Xception convolutional neural network for classification of COVID-19 from point-of-care lung ultrasound images. Multimedia Tools and Applications, 1–22.
[23]
A. Kumar, S. Jain, and M. Kumar. 2022. Automated human tracing using gait and face using artificial neural network in surveillance system. In International Conference on Data Analytics and Computing (277–292). Singapore: Springer Nature Singapore.
[24]
R. Nijhawan, G. Sinha, A. Batra, M. Kumar, and H. Sharma. 2023. VTnet+ handcrafted based approach for food cuisines classification. Multimedia Tools and Applications, 1–21.
[25]
M. Kumar and S. Srivastava. 2019. Image authentication by assessing manipulations using illumination. Multimedia Tools and Applications 78 (2019), 12451–12463.
[26]
C. Silver and T. Akilan. 2023. A novel approach for fall detection using thermal imaging and a stacking ensemble of autoencoder and 3D-CNN models. In 2023 IEEE Canadian Conference on Electrical and Computer Engineering (CCECE) (71–76). IEEE.
[27]
M. Amsaprabhaa. 2023. Multimodal spatiotemporal skeletal kinematic gait feature fusion for vision-based fall detection. Expert Systems with Applications 212 (2023), 118681.

Index Terms

  1. Learning and Vision-based approach for Human fall detection and classification in naturally occurring scenes using video data

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Transactions on Asian and Low-Resource Language Information Processing
    ACM Transactions on Asian and Low-Resource Language Information Processing  Volume 23, Issue 11
    November 2024
    248 pages
    EISSN:2375-4702
    DOI:10.1145/3613714
    Issue’s Table of Contents

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 21 November 2024
    Online AM: 10 August 2024
    Accepted: 01 August 2024
    Revised: 13 February 2024
    Received: 10 September 2023
    Published in TALLIP Volume 23, Issue 11

    Check for updates

    Author Tags

    1. Convolution neural network
    2. fall detection
    3. object detection
    4. video data
    5. You Only Look Once

    Qualifiers

    • Research-article

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 191
      Total Downloads
    • Downloads (Last 12 months)191
    • Downloads (Last 6 weeks)19
    Reflects downloads up to 02 Mar 2025

    Other Metrics

    Citations

    View Options

    Login options

    Full Access

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Full Text

    View this article in Full Text.

    Full Text

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media