Abstract
Recent studies by the World Health Organization have shown that human falls have become the leading cause of injury and death worldwide. Therefore, human fall detection is becoming an increasingly important research topic. Deep learning models have potential for fall detection, but they face challenges such as limited utilization of global contextual information, insufficient feature extraction, and high computational requirements. These issues constrain the performance of deep learning on human fall detection in terms of low accuracy, poor generalization, and slow inference. To overcome these challenges, this study proposes an Adaptive Multi-scale Detection Network (AMDNet) based on multi-scale deformable convolutions. The main idea of this method is as follows: 1) Introducing an improved multi-scale fusion module, enhances the network’s ability to learn object details and semantic features, thereby reducing the likelihood of false negatives and false positives during the detection process, especially for small objects. 2) Using the Wise-IoU v3 with two layers of attention mechanisms and a dynamic non-monotonic FM mechanism as the boundary box loss function of the AMDNet, improves the model’s robustness to low-quality samples and enhances the performance of the object detection. This work also proposes a diversified fall dataset that covers as many real-world fall scenarios as possible. Experimental results show that the proposed method outperforms the current state-of-the-art methods on a self-made dataset.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Ali, S.G., et al.: Experimental protocol designed to employ Nd: YAG laser surgery for anterior chamber glaucoma detection via UBM. IET Image Process. 16(8), 2171–2179 (2022)
Antwi-Afari, M.F., Li, H.: Fall risk assessment of construction workers based on biomechanical gait stability parameters using wearable insole pressure system. Adv. Eng. Inform. 38, 683–694 (2018)
Bochkovskiy, A., Wang, C.Y., Liao, H.Y.M.: YOLOv4: optimal speed and accuracy of object detection. arXiv preprint arXiv:2004.10934 (2020)
Cao, J., Lyu, J., Wu, X., Zhang, X., Yang, H.: Fall detection algorithm integrating motion features and deep learning. J. Comput. Appl. 41(2), 583 (2021)
Chen, Y., Li, W., Wang, L., Hu, J., Ye, M.: Vision-based fall event detection in complex background using attention guided bi-directional LSTM. IEEE Access 8, 161337–161348 (2020)
Fanez, M., Villar, J.R., de la Cal, E., Gonzalez, V.M., Sedano, J., Khojasteh, S.B.: Mixing user-centered and generalized models for fall detection. Neurocomputing 452, 473–486 (2021)
Hussain, F., Hussain, F., Ehatisham-ul Haq, M., Azam, M.A.: Activity-aware fall detection and recognition based on wearable sensors. IEEE Sens. J. 19(12), 4528–4536 (2019)
Ioffe, S., Szegedy, C.: Batch normalization: accelerating deep network training by reducing internal covariate shift. In: International Conference on Machine Learning, pp. 448–456. PMLR (2015)
Lee, J.S., Tseng, H.H.: Development of an enhanced threshold-based fall detection system using smartphones with built-in accelerometers. IEEE Sens. J. 19(18), 8293–8302 (2019)
Li, J., et al.: Automatic detection and classification system of domestic waste via multimodel cascaded convolutional neural network. IEEE Trans. Industr. Inf. 18(1), 163–173 (2021)
Li-zhan, W., Xia-li, W., Qian, Z., Wei-hao, W., Chao, L.: An object detection method of falling person based on optimized yolov5s. J. Graph. 43(5), 791 (2022)
Liu, S., Qi, L., Qin, H., Shi, J., Jia, J.: Path aggregation network for instance segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 8759–8768 (2018)
Montanini, L., Del Campo, A., Perla, D., Spinsante, S., Gambi, E.: A footwear-based methodology for fall detection. IEEE Sens. J. 18(3), 1233–1242 (2017)
Pandya, B., Pourabdollah, A., Lotfi, A.: Fuzzy logic web services for real-time fall detection using wearable accelerometer and gyroscope sensors. In: Proceedings of the 13th ACM International Conference on PErvasive Technologies Related to Assistive Environments, pp. 1–7 (2020)
Redmon, J., Divvala, S., Girshick, R., Farhadi, A.: You only look once: unified, real-time object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 779–788 (2016)
de Sousa, F.A.S.F., Escriba, C., Bravo, E.G.A., Brossa, V., Fourniols, J.Y., Rossi, C.: Wearable pre-impact fall detection system based on 3D accelerometer and subject’s height. IEEE Sens. J. 22(2), 1738–1745 (2021)
Tong, Z., Chen, Y., Xu, Z., Yu, R.: Wise-IoU: bounding box regression loss with dynamic focusing mechanism. arXiv preprint arXiv:2301.10051 (2023)
Wei, H., Zhang, Q., Qin, Y., Li, X., Qian, Y.: YOLOF-F: you only look one-level feature fusion for traffic sign detection. Vis. Comput. 1–14 (2023)
World Health Organization: Falls (2022). https://www.who.int/news-room/fact-sheets/detail/falls
Zhang, J., Wu, C., Wang, Y.: Human fall detection based on body posture spatio-temporal evolution. Sensors 20(3), 946 (2020)
Zhao, S., Li, W., Niu, W., Gravina, R., Fortino, G.: Recognition of human fall events based on single tri-axial gyroscope. In: 2018 IEEE 15th International conference on networking, sensing and control (ICNSC), pp. 1–6. IEEE (2018)
Zhu, X., Hu, H., Lin, S., Dai, J.: Deformable convnets V2: more deformable, better results. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 9308–9316 (2019)
Zhu, Y., Zhang, Y., Li, S.: Fall detection algorithm based on deep vision sensor and convolutional neural network. Opt. Tech. 47(1), 56–61 (2021)
Acknowledgment
This work was supported by national natural science foundation of China (No. 62202346), Hubei key research and development program (No. 2021BAA042), open project of engineering research center of Hubei province for clothing information (No. 2022HBCI01), Wuhan applied basic frontier research project (No. 2022013988065212), MIIT’s AI Industry Innovation Task unveils flagship projects (Key technologies, equipment, and systems for flexible customized and intelligent manufacturing in the clothing industry), and Hubei science and technology project of safe production special fund (Scene control platform based on proprioception information computing of artificial intelligence).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Jiang, M. et al. (2024). AMDNet: Adaptive Fall Detection Based on Multi-scale Deformable Convolution Network. In: Sheng, B., Bi, L., Kim, J., Magnenat-Thalmann, N., Thalmann, D. (eds) Advances in Computer Graphics. CGI 2023. Lecture Notes in Computer Science, vol 14497. Springer, Cham. https://doi.org/10.1007/978-3-031-50075-6_1
Download citation
DOI: https://doi.org/10.1007/978-3-031-50075-6_1
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-50074-9
Online ISBN: 978-3-031-50075-6
eBook Packages: Computer ScienceComputer Science (R0)