Skip to main content

Smartphone-Based Human Activity Recognition Using CNN in Frequency Domain

  • Conference paper
  • First Online:
Web and Big Data (APWeb-WAIM 2018)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 11268))

  • 1182 Accesses

Abstract

Human activity recognition (HAR) based on smartphone sensors provides an efficient way for studying the connection between human physical activities and health issues. In this paper, three feature sets are involved, including tri-axial angular velocity data collected from gyroscope sensor, tri-axial total acceleration data collected from accelerometer sensor, and the estimated tri-axial body acceleration data. The FFT components of the three feature sets are used to divide activities into six types like walking, walking upstairs, walking downstairs, sitting, standing and lying. Two kinds of CNN architectures are designed for HAR. The one is Architecture A in which only one set of features is combined at the first convolution layer; and the other one is Architecture B in which two sets of the features are combined at the first convolution layer. The validation data set is used to automatically determine the iteration number during the training process. It is shown that the performance of Architecture B is better compared to Architecture A. And the Architecture B is further improved by varying the number of the features maps at each convolution layer and the one producing the best result is selected. Compared with five other HAR methods using CNN, the proposed method could achieve a better recognition accuracy of 97.5% for a UCI HAR dataset.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Zebin, T., Scully, P.J., Ozanyan, K.B.: Human activity recognition with inertial sensors using a deep learning approach. In: SENSORS, 2016 IEEE, pp. 1–3. IEEE (2016)

    Google Scholar 

  2. Chen, Y., Xue, Y.: A deep learning approach to human activity recognition based on single accelerometer. In: 2015 IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp. 1488–1492. IEEE (2015)

    Google Scholar 

  3. Bayat, A., Pomplun, M., Tran, D.A.: A study on human activity recognition using accelerometer data from smartphones. Proc. Comput. Sci. 34, 450–457 (2014)

    Article  Google Scholar 

  4. Wu, W., Dasgupta, S., Ramirez, E.E., Peterson, C., Norman, G.J.: Classification accuracies of physical activities using smartphone motion sensors. J. Med. Internet Res. 14 (2012)

    Article  Google Scholar 

  5. Kwon, Y., Kang, K., Bae, C.: Unsupervised learning for human activity recognition using smartphone sensors. Expert Syst. Appl. 41, 6067–6074 (2014)

    Article  Google Scholar 

  6. Matsui, S., Inoue, N., Akagi, Y., Nagino, G., Shinoda, K.: User adaptation of convolutional neural network for human activity recognition. In: Signal Processing Conference (EUSIPCO), 2017 25th European, pp. 753–757. IEEE (2017)

    Google Scholar 

  7. Hanai, Y., Nishimura, J., Kuroda, T.: Haar-like filtering for human activity recognition using 3d accelerometer. In: Digital Signal Processing Workshop and 5th IEEE Signal Processing Education Workshop, 2009. DSP/SPE 2009. IEEE 13th, pp. 675–678. IEEE (2009)

    Google Scholar 

  8. Plötz, T., Hammerla, N.Y., Olivier, P.: Feature learning for activity recognition in ubiquitous computing. In: IJCAI Proceedings-International Joint Conference on Artificial Intelligence, pp. 1729 (2011)

    Google Scholar 

  9. LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature 521, 436 (2015)

    Article  Google Scholar 

  10. Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)

  11. Sharif Razavian, A., Azizpour, H., Sullivan, J., Carlsson, S.: CNN features off-the-shelf: an astounding baseline for recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 806–813 (2014)

    Google Scholar 

  12. An, D.C., Meier, U., Masci, J., Gambardella, L.M., Schmidhuber, J., rgen: Flexible, high performance convolutional neural networks for image classification. In: IJCAI 2011, Proceedings of the International Joint Conference on Artificial Intelligence, Barcelona, Catalonia, Spain, pp. 1237–1242. (2011)

    Google Scholar 

  13. Zeng, M., et al.: Convolutional neural networks for human activity recognition using mobile sensors. In: 2014 6th International Conference on Mobile Computing, Applications and Services (MobiCASE), pp. 197–205. IEEE (2014)

    Google Scholar 

  14. Wang, J., Chen, Y., Hao, S., Peng, X., Hu, L.: Deep learning for sensor-based activity recognition: a survey. arXiv preprint arXiv:1707.03502 (2017)

  15. Hammerla, N.Y., Halloran, S., Ploetz, T.: Deep, convolutional, and recurrent models for human activity recognition using wearables. arXiv preprint arXiv:1604.08880 (2016)

  16. Ronao, C.A., Cho, S.-B.: Human activity recognition with smartphone sensors using deep learning neural networks. Expert Syst. Appl. 59, 235–244 (2016)

    Article  Google Scholar 

  17. Ravi, D., Wong, C., Lo, B., Yang, G.-Z.: Deep learning for human activity recognition: A resource efficient implementation on low-power devices. In:2016 IEEE 13th International Conference on Wearable and Implantable Body Sensor Networks (BSN), pp. 71–76. IEEE (2016)

    Google Scholar 

  18. Hannun, A., et al.: Deep Speech: scaling up end-to-end speech recognition. Computer Science (2014)

    Google Scholar 

  19. Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.: Dropout: A simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15, 1929–1958 (2014)

    MathSciNet  MATH  Google Scholar 

  20. Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105 (2012)

    Google Scholar 

  21. Robert, C.: Machine learning, a probabilistic perspective. Taylor & Francis (2014)

    Google Scholar 

  22. Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)

  23. http://archive.ics.uci.edu/ml/datasets/Human+Activity+Recognition+Using+Smartphones

  24. Huynh, T., Schiele, B.: Analyzing features for activity recognition. In: Proceedings of the 2005 Joint Conference on Smart Objects and Ambient Intelligence: Innovative Context-Aware Services: Usages and Technologies, pp. 159–163. ACM (2005)

    Google Scholar 

  25. Ignatov, A.: Real-time human activity recognition from accelerometer data using convolutional neural networks. Appl. Soft Comput. 62, 915–922 (2018)

    Article  Google Scholar 

  26. Wang, X., Lu, Y., Wang, D., Liu, L., Zhou, H.: Using jaccard distance measure for unsupervised activity recognition with smartphone accelerometers. In: Asia-Pacific Web (APWeb) and Web-Age Information Management (WAIM) Joint Conference on Web and Big Data, pp. 74–83. Springer, Berlin (2017)

    Chapter  Google Scholar 

Download references

Acknowledgements

This work is supported by the National Key R&D Program of China (Grants No. 2017YFE0111900).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yonggang Lu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Jiang, X., Lu, Y., Lu, Z., Zhou, H. (2018). Smartphone-Based Human Activity Recognition Using CNN in Frequency Domain. In: U, L., Xie, H. (eds) Web and Big Data. APWeb-WAIM 2018. Lecture Notes in Computer Science(), vol 11268. Springer, Cham. https://doi.org/10.1007/978-3-030-01298-4_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-01298-4_10

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-01297-7

  • Online ISBN: 978-3-030-01298-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics