Skip to main content

Advertisement

Springer Nature Link
Log in

A new approach for physical human activity recognition based on co-occurrence matrices

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

In recent years, it has been observed that many researchers have been working on different areas of detection, recognition and monitoring of human activities. The automatic determination of human physical activities is often referred to as human activity recognition (HAR). One of the most important technology that detects and tracks the activity of the human body is sensor-based HAR technology. In recent days, sensor-based HAR attracts attention in the field of computers due to its wide use in daily life and is a rapidly growing field of research. Activity recognition (AR) application is carried out by evaluating the signals obtained from various sensors placed in the human body. In this study, a new approach is proposed to extract features from sensor signals using HAR. The proposed approach is inspired by the Gray Level Co-Occurrence Matrix (GLCM) method, which is widely used in image processing, but it is applied to one-dimensional signals, unlike GLCM. Two datasets were used to test the proposed approach. The datasets were created from the signals obtained from the accelerometer, gyro and magnetometer sensors. Heralick features were obtained from co-occurrence matrix created after 1D-GLCM (One (1) Dimensional-Gray Level Co-Occurrence Matrix) was applied to the signals. HAR operation has been carried out for different scenarios using these features. Success rates of 96.66 and 93.88% were obtained for two datasets, respectively. It has been observed that the new approach proposed within the scope of the study provides high success rates for HAR applications. It is thought that the proposed approach can be used in the classification of different signals.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

References

  1. Kuncan F, Kaya Y, Kuncan M (2019) A novel approach for activity recognition with down-sampling 1D local binary pattern. Adv Electr Comput Eng 19(1):35–44

    Article  Google Scholar 

  2. Kuncan F, Kaya Y, Kuncan M (2019) New approaches based on local binary patterns for gender identification from sensor signals. J Fac Eng Arch Gazi Univ 34(4):2173–2185

    Google Scholar 

  3. Györbíró N, Fábián A, Hományi G (2009) An activity recognition system for mobile phones. Mob Netw Appl 14(1):82–91

    Article  Google Scholar 

  4. Lara OD, Labrador MA (2013) A survey on human activity recognition using wearable sensors. IEEE Commun Surv Tutor 15(3):1192–1209

    Article  Google Scholar 

  5. Altun K, Barshan B, Tunçel O (2010) Comparative study on classifying human activities with miniature inertial and magnetic sensors. Pattern Recogn 43(10):3605–3620

    Article  Google Scholar 

  6. Barshan B, Yüksek MC (2014) Recognizing daily and sports activities in two open source machine learning environments using body-worn sensor units. Comput J 57(11):1649–1667

    Article  Google Scholar 

  7. Yin J, Yang Q, Pan JJ (2007) Sensor-based abnormal human-activity detection. IEEE Trans Knowl Data Eng 20(8):1082–1090

    Article  Google Scholar 

  8. Kwapisz JR, Weiss GM, Moore SA (2011) Activity recognition using cell phone accelerometers. ACM SIGKDD Explor Newsl 12(2):74–82

    Article  Google Scholar 

  9. Hassan MM, Uddin MZ, Mohamed A, Almogren A (2018) A robust human activity recognition system using smartphone sensors and deep learning. Futur Gener Comput Syst 81:307–313

    Article  Google Scholar 

  10. Abirami SP, Kousalya G, Balakrishnan P (2020) Activity recognition system through deep learning analysis as an early biomarker of ASD characteristics. In Interdisciplinary Approaches to Altering Neurodevelopmental Disorders (pp. 228–249). IGI Global

  11. Nweke HF, Teh YW, Al-Garadi MA, Alo UR (2018) Deep learning algorithms for human activity recognition using mobile and wearable sensor networks: state of the art and research challenges. Expert Syst Appl 105:233–261

    Article  Google Scholar 

  12. San-Segundo R, Blunck H, Moreno-Pimentel J, Stisen A, Gil-Martín M (2018) Robust human activity recognition using smartwatches and smartphones. Eng Appl Artif Intell 72:190–202

    Article  Google Scholar 

  13. Debache I, Jeantet L, Chevallier D, Bergouignan A, Sueur C (2020) A lean and performant hierarchical model for human activity recognition using body-mounted sensors. Sensors 20(11):3090

    Article  Google Scholar 

  14. Qin Z, Zhang Y, Meng S, Qin Z, Choo KKR (2020) Imaging and fusing time series for wearable sensor-based human activity recognition. Inf Fus 53:80–87

    Article  Google Scholar 

  15. Bianchi V, Bassoli M, Lombardo G, Fornacciari P, Mordonini M, De Munari I (2019) IoT wearable sensor and deep learning: An integrated approach for personalized human activity recognition in a smart home environment. IEEE Internet Things J 6(5):8553–8562

    Article  Google Scholar 

  16. Wang Y, Cang S, Yu H (2019) A survey on wearable sensor modality centred human activity recognition in health care. Expert Syst Appl 137:167–190

    Article  Google Scholar 

  17. Lin CC, Lin PY, Lu PK, Hsieh GY, Lee WL, Lee RG (2008) A healthcare integration system for disease assessment and safety monitoring of dementia patients. IEEE Trans Inf Technol Biomed 12(5):579–586

    Article  Google Scholar 

  18. Chen GC, Huang CN, Chiang CY, Hsieh CJ, Chan CT (2010) A reliable fall detection system based on wearable sensor and signal magnitude area for elderly residents, In International Conference on Smart Homes and Health Telematics, Berlin, 267–270

  19. Baig MM, Gholamhosseini H, Connolly MJ (2013) A comprehensive survey of wearable and wireless ECG monitoring systems for older adults. Med Biol Eng Compu 51(5):485–495

    Article  Google Scholar 

  20. Tamura T, Suda Y, Sekine M, Kimura Y, Uchiyama T (2013) A wearable motion sensor for evaluating walking performance in parkinson’s disease with treatments. In Converging Clinical and Engineering Research on Neurorehabilitation, Berlin, pp 717–720

    Google Scholar 

  21. Barnes K, Kauffman V, Connolly C (2014) Health wearables: Early days, PwC Health Research Institute Report

  22. Atallah L, Lo B, King R, Yang GZ (2011) Sensor positioning for activity recognition using wearable accelerometers. IEEE Trans Biomed Circuits Syst 5(4):320–329

    Article  Google Scholar 

  23. Chernbumroong S, Cang S, Atkins A, Yu H (2013) Elderly activities recognition and classification for applications in assisted living. Expert Syst Appl 40(5):1662–1674

    Article  Google Scholar 

  24. Elvira V, Naazabal-Renteria A, Artes-Rodrigues A (2014) A novel feature extraction technique for human activity recognition, Statistical Signal Processing (SSP), IEEE, Gold Coast, VIC, Australia

  25. Bayat A, Pomplun M, Tran DA (2014) A study on human activity recognition using accelerometer data from smartphones. Procedia Comput Sci 34:450–457

    Article  Google Scholar 

  26. Ponce H, Martinez-Villasenor ML, Miralles-Pechuan L (2016) A novel wearable sensor-based human activity recognition approach using artificial hydrocarbon networks. Sensors 16(7):1033

    Article  Google Scholar 

  27. Tuncer T, Dogan S, Subasi A (2020) Surface EMG signal classification using ternary pattern and discrete wavelet transform based feature extraction for hand movement recognition. Biomed Signal Process Control 58:101872

    Article  Google Scholar 

  28. Tuncer T, Ertam F, Dogan S, Subasi A (2020) An automated daily sports activities and gender recognition method based on novel multikernel local diamond pattern using sensor signals. IEEE Trans Instrum Meas 69(12):9441–9448

    Article  Google Scholar 

  29. Tuncer T, Ertam F, Dogan S, Aydemir E, Pławiak P (2020) Ensemble residual network-based gender and activity recognition method with signals. J Supercomput 76(3):2119–2138

    Article  Google Scholar 

  30. Banos O, Moral-Munoz J, Diaz-Reyes I, Arroyo-Morales M, Damas M, Herrera-Viedma E, Villalonga C (2015) mDurance: a novel mobile health system to support trunk endurance assessment. Sensors 15(6):13159–13183

    Article  Google Scholar 

  31. Banos O, Villalonga C, Garcia R, Saez A, Damas M, Holgado-Terriza JA, Rojas I (2015) Design, implementation and validation of a novel open framework for agile development. BioMed Eng 14(2):56

    Google Scholar 

  32. Malekzadeh M, Clegg RG, Cavallaro A, Haddadi H Protecting sensory data against sensitive inferences, In Proceedings of the 1st Workshop on Privacy by Design in Distributed

  33. Haralick RM, Shanmugam K (1973) Textural features for image classification. IEEE Trans Syst Man Cybern 6:610–621

    Article  Google Scholar 

  34. Weka: Data Mining Software in Java http://www.cs.waikato.ac.nz/ml/weka

  35. Hall MA (1998) Correlation-based Feature Subset Selection for Machine Learning. Hamilton, New Zealand

  36. Tunçel O, Altun K, Barshan B (2009) Jiroskop Sinyallerinin İşlenmesiyle Bacak Hareketlerinin Sınıflandırılması, Conference: IEEE 17th Conference on Signal Processing, Communications, and Applications (SIU 2009), Antalya

  37. Siirtola P, Röning J (2012) Recognizing human activities user-independently on smartphones based on accelerometer data. IJIMAI 1(5):38–45

    Article  Google Scholar 

  38. Kurban OC (2014) Classi̇fcati̇on of human activities with wearable sensors without feature extraction, Master Thesis, Yıldız Technical University, Institute of Science, İstanbul, Turkey

  39. Capela NA, Lemaire ED, Baddour N (2015) Feature selection for wearable smartphone-based human activity recognition with able-bodied elderly, and stroke patients. PLOS ONE 10(4):e0124414

    Article  Google Scholar 

  40. Damaševičius R, Vasiljevas M, Šalkevičius J, Woźniak M (2016) Human activity recognition in aal environments using random projections. Comput Mathe Methods Med 216:1–17

    MathSciNet  MATH  Google Scholar 

  41. Howcroft J, Kofman J, Lemaire ED (2017) Feature selection for elderly faller classification based on wearable sensors. J Neuro-Eng Rehabil. https://doi.org/10.1186/s12984-017-0255-9

    Article  Google Scholar 

  42. Chen Y, Shen C (2017) Performance analysis of smartphone-sensor behavior for human activity recognition. Ieee Access 5:3095–3110

    Article  Google Scholar 

  43. Wang W, Liu AX, Shahzad M, Ling K, Lu S (2017) Device-free human activity recognition using commercial WiFi devices. IEEE J Sel Areas Commun 35(5):1118–1131

    Article  Google Scholar 

  44. Huynh-The T, Hua CH, Kim DS (2019) Visualizing Inertial Data For Wearable Sensor Based Daily Life Activity Recognition Using Convolutional Neural Network. In 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) (pp. 2478–2481). IEEE

  45. Tuncer T, Ertam F (2020) Novel tent pooling based human activity recognition approach. Multimed Tools Appl 80(3):4639–4653

    Article  Google Scholar 

Download references

Acknowledgements

This study was performed in Siirt University Faculty of Engineering Machine Vision (MaVi) Laboratory. The authors of this article would like to thank the staff of MaVi Laboratory for their support.

Author information

Authors and Affiliations

  1. Computer Engineering, Siirt University, 56100, Siirt, Turkey

    Fatma Kuncan & Yılmaz Kaya

  2. Computer Engineering, Batman University, 72100, Batman , Turkey

    Ramazan Tekin

  3. Electrical and Electronics Engineering, Siirt University, 56100, Siirt, Turkey

    Melih Kuncan

Authors
  1. Fatma Kuncan
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Yılmaz Kaya
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Ramazan Tekin
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Melih Kuncan
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Fatma Kuncan.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kuncan, F., Kaya, Y., Tekin, R. et al. A new approach for physical human activity recognition based on co-occurrence matrices. J Supercomput 78, 1048–1070 (2022). https://doi.org/10.1007/s11227-021-03921-2

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-021-03921-2

Keywords