Skip to main content
SpringerLink
Log in

Multimedia-oriented action recognition in Smart City-based IoT using multilayer perceptron

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The Internet of Things (IoT) devices and technologies for smart city applications produces a vast amount of multimedia data (e.g., audio, video, image, text and sensorial data), such big data are difficult to handle with traditional techniques and algorithms. The emerging machine learning techniques have the potential to facilitate the development of a new class of applications that can deal with such multimedia big data. Recently, Activity Recognition systems suggest using of multimedia data to detect daily actions, since it provides more accurate patterns; prevent the arising complain on privacy issues (in case of using audio-base data) and able to work on a big data. In this paper, we propose a Deep Learning (DL) methodology for classifying audio data that is based on multilayer perceptron neural networks. The contributions of our work are to propose an efficient design of the network topology including hidden layers, neurons, and the fitness function. In addition, the proposed methodology contributed in producing high performance classifier in terms of accuracy and f-measure. The experiments have been conducted on four large audio-datasets that have been collected to represent different modalities in a smart city. The results indicated that the proposed methodology achieved high performance as compared to the state-of-the-art machine learning techniques.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  1. Al Zamil MG, Samarah SM, Rawashdeh M, Hossain MA (2017) An ODT-based abstraction for mining closed sequential temporal patterns in IoT-cloud smart homes. Clust Comput 20(2):1815–1829

    Article  Google Scholar 

  2. Al Zamil MG, Rawashdeh M, Samarah, Hossain MS, Alnusair A, Rahman SMM (2018) An annotation technique for in-home smart monitoring environments. IEEE Access 6:1471–1479

    Article  Google Scholar 

  3. Bouakaz S, Vacher M, Chaumon MEB, Aman F, Bekkadja S, Portet F, Guillou E, Rossato S, Desserée E, Traineau P, Vimont JP (2014) CIRDO: smart companion for helping elderly to live at home for longer. Irbm 35(2):100–108

    Article  Google Scholar 

  4. Chahuara P, Fleury A, Portet F, Vacher M (2016) On-line human activity recognition from audio and home automation sensors: comparison of sequential and non-sequential models in realistic smart homes. J Amb Intel Smart En 8(4):399–422

    Article  Google Scholar 

  5. Cook DJ, Youngblood M, Heierman EO, Gopalratnam K, Rao S, Litvin A, Khawaja F (2003) MavHome: an agent-based smart home. In: Pervasive Computing and Communications, 2003. (PerCom 2003). Proceedings of the First IEEE International Conference on. IEEE, pp 521–524

  6. De Carolis B, Cozzolongo G (2004) C@ sa: intelligent home control and simulation. Int J Comput Intell 1(1):1–12

    Google Scholar 

  7. Hossain MS, Muhammad G (2018) Environment classification for urban big data using deep learning. IEEE Commun Mag 56(11):44–50

    Article  Google Scholar 

  8. Hargreaves T, Wilson C, Hauxwell-Baldwin R (2018) Learning to live in a smart home. Build Res Inf 46(1):127–139

    Article  Google Scholar 

  9. Hossain MS, Muhammad G (2019) Emotion recognition using deep learning approach from audio-visual emotional big data. Inform Fusion 49(2019):69–78

    Article  Google Scholar 

  10. Hossain MS, Muhammad G, Alamri A (2017) Smart healthcare monitoring: a voice pathology detection paradigm for smart cities. Multimedia Systems. https://doi.org/10.1007/s00530-017-0561-x

    Article  Google Scholar 

  11. Hossain MS et al (2018) Cloud-assisted secure video transmission and sharing framework for smart cities. Futur Gener Comput Syst 83:596–606

    Article  Google Scholar 

  12. Hou L et al (2016) Internet of things cloud: architecture and implementation. IEEE Commun Mag 54(12):32–39

    Article  Google Scholar 

  13. Kidd CD, Orr R, Abowd GD, Atkeson CG, Essa IA, MacIntyre B, Mynatt E, Starner TE, Newstetter W (1999) The aware home: a living laboratory for ubiquitous computing research. In: International workshop on cooperative buildings. Springer, Berlin, pp 191–198

    Google Scholar 

  14. Krishnan NC, Cook DJ (2014) Activity recognition on streaming sensor data. Pervasive Mobile Comput 10:138–154

    Article  Google Scholar 

  15. Fang Q et al (2015) Relational user attribute inference in social media. IEEE Trans Multimedia 17(7):1031–1044

    Article  Google Scholar 

  16. LaMarca A, Chawathe Y, Consolvo S, Hightower J, Smith I, Scott J, Sohn T, Howard J, Hughes J, Potter F, Tabert J (2005) Place lab: device positioning using radio beacons in the wild. In: International conference on pervasive computing. Springer, Berlin, pp 116–133

    Chapter  Google Scholar 

  17. Lin B, Guo W, Xiong N, Chen G, Vasilakos AV, Zhang H (2016) A pretreatment workflow scheduling approach for big data applications in multicloud environments. IEEE Trans Netw Serv Manag 13(3):581–594

    Article  Google Scholar 

  18. Mozer M, Dodier R, Miller D, Anderson M, Anderson J, Bertini D, Bronder M, Colagrosso M, Cruickshank R, Daugherty B, Fontenot M (2005) The adaptive house. In: IEE Seminar Digests, vol 11059. IET, pp v1–39

  19. Pouyanfar S, Yang Y, Chen S-C, Shyu M-L, Iyengar SS (2018) Multimedia big data analytics: a survey. ACM Comput Surv 51(1):Article 10, 34 pages. https://doi.org/10.1145/3150226

    Article  Google Scholar 

  20. Rawashdeh M, Al Zamil MG, Samarah S, Hossain MS, Muhammad G (2017) A knowledge-driven approach for activity recognition in smart homes based on activity profiling. Futur Gener Comput Syst. https://doi.org/10.1016/j.future.2017.10.031

  21. Rawashdeh M, Zamil MGA, Hossain MS, Samarah S, Amin SU, Muhammad G (2018) Reliable service delivery in tele-health care systems. J Netw Comput Appl 115:86–93

    Article  Google Scholar 

  22. Qian S et al (2014) Social event classification via boosted multimodal supervised latent dirichlet allocation. ACM T Multim Comput 11(2):27:1–27:22

  23. Samarah S, Zamil MGA, Rawashdeh M, Hossain MS, Muhammad G, Alamri A (2018) Transferring activity recognition models in FOG computing architecture. J Parallel Distrib Com 122:122–130

    Article  Google Scholar 

  24. Yassine A et al (2019) IoT big data analytics for smart homes with fog and cloud computing. Futur Gener Comput Syst 91(2019):563–573

    Article  Google Scholar 

  25. Lin K et al (2017) Localization based on social big data analysis in the vehicular networks. IEEE Trans Ind Informat 13(4):1932–1940

    Article  Google Scholar 

  26. Zheng H, Guo W, Xiong N (2017) A Kernel-based compressive sensing approach for mobile data gathering in wireless sensor network systems. IEEE Trans Syst, Man, Cybern

  27. Zhou Y, Zhang D, Xiong N (2017) Post-cloud computing paradigms: a survey and comparison. Tsinghua Sci Technol 22(6):714–732

    Article  Google Scholar 

  28. Zuhairy RM, Al Zamil MG (2018) Energy-efficient load balancing in wireless sensor network: an application of multinomial regression analysis. Int J Distrib Sens N Journal 14(3):1550147718764641

    Article  Google Scholar 

Download references

Acknowledgements

The authors are very grateful for the support from the Deanship of Scientific Research, King Saud University through the Vice Deanship of Scientific Research Chairs.

Author information

Authors and Affiliations

  1. Department of Computer Information Systems, Yarmouk University, Irbid, Jordan

    Mohammed G. H. AL Zamil & Samer Samarah

  2. Department of Business Information Technology, Princess Sumaya University for Technology, Amman, Jordan

    Majdi Rawashdeh

  3. School of Electrical Engineering and Computer Science (EECS), University of Ottawa, Ottawa, Canada

    Ali Karime

  4. Research Chair of Pervasive and Mobile Computing, College of Computer and Information Sciences, King Saud University, Riyadh, 11543, Saudi Arabia

    M. Shamim Hossain

  5. Department of Software Engineering, College of Computer and Information Sciences, King Saud University, Riyadh, Saudi Arabia

    M. Shamim Hossain

Authors
  1. Mohammed G. H. AL Zamil
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Samer Samarah
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Majdi Rawashdeh
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ali Karime
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. M. Shamim Hossain
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to M. Shamim Hossain.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

AL Zamil, M.G.H., Samarah, S., Rawashdeh, M. et al. Multimedia-oriented action recognition in Smart City-based IoT using multilayer perceptron. Multimed Tools Appl 78, 30315–30329 (2019). https://doi.org/10.1007/s11042-018-6919-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-018-6919-z

Keywords

Search

Navigation