Skip to main content
SpringerLink
Log in

A Multilayered Contextually Intelligent Activity Recognition Framework for Smart Home

  • Conference paper
  • First Online:
Human Interaction, Emerging Technologies and Future Applications III (IHIET 2020)

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 1253))

Abstract

The future of Internet of Things (IoT)-based living spaces would involve interaction, coordination, collaboration and communication between humans, machines, robots and other technology-laden systems in the context of users performing their daily routine tasks. Through this Contextually Intelligent Activity Recognition framework, this work proposes to develop a long-term, robust, feasible, easily implementable, sustainable and economic solution for Activity Recognition and Activity Monitoring, that would be able to track, monitor, evaluate, analyze and access human behavior in the context of the multimodal aspects of these user interactions including the spatial and temporal features. This Multilayered Contextually Intelligent Activity Recognition Framework envisions to take a holistic approach to improve the quality of life, enhance the user experience, acceptance and trust on technology during Activities of Daily Living (ADLs), in the context of human-computer, human-machine and human-robot interactions. The results presented uphold the relevance and demonstrate the feasibility for practical implementation of this framework in the future of IoT-based living spaces, for instance Smart Homes and Smart Cities.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. United Nations Report, World Population Prospects 2019: Highlights. https://www.un.org/development/desa/publications/world-population-prospects-2019-highlights.html

  2. Kaptelinin, V., Nardi, B.: Activity theory in HCI fundamentals and reflections. Synth. Lect. Hum.-Centered Inform. 5, 1–105 (2012). Morgan and Claypool Publishers. ISBN: 9781608457045, eISBN: 9781608457052

    Google Scholar 

  3. Davies, N., Siewiorek, D.P., Sukthankar, R.: Activity-based computing. Pervasive Comput. IEEE 7, 20–21 (2008)

    Article  Google Scholar 

  4. Azkune, G., Almeida, A., López-de-Ipiña, D., Chen, L.: Extending knowledge driven activity models through data-driven learning techniques. Expert Syst. Appl. 42 (2015). https://doi.org/10.1016/j.eswa.2014.11.063

  5. Cheng, Z., Qin, L., Huang, Q., Jiang, S., Yan, S., Tian, Q.: Human group activity analysis with fusion of motion and appearance information. In: Proceedings of the 19th ACM International Conference on Multimedia, pp. 1401–1404, Scottsdale, Arizona, USA, 28 November–01 December 2011 (2011)

    Google Scholar 

  6. Skocir, P., Krivic, P., Tomeljak, M., Kusek, M., Jezic, G.: Activity detection in smart home environment. In: Proceedings of the 20th International Conference on Knowledge Based and Intelligent Information and Engineering Systems, 5–7 September 2016

    Google Scholar 

  7. Doryab, A., Bardram, J.E.: Designing activity-aware recommender systems for operating rooms. In: Proceedings of the 2011 Workshop on Context-awareness in Retrieval and Recommendation, 13 February 2011

    Google Scholar 

  8. Abascal, J., Bonail, B., Marco, A., Sevillano, J.L.: AmbienNet: an intelligent environment to support people with disabilities and elderly people. In: Proceedings of ASSETS 2008, 13–15 October 2008, Halifax, Nova Scotia, Canada (2008)

    Google Scholar 

  9. Chan, M., Campo, E., Bourennane, W., Bettahar, F., Charlon, Y.: Mobility behavior assessment using a smart-monitoring system to care for the elderly in a hospital environment. In: Proceedings of PETRA 2014, 27–30 May 2014, Island of Rhodes, Greece (2014)

    Google Scholar 

  10. Yared, R., Abdulrazak, B., Tessier, T., Mabilleau, P.: Cooking risk analysis to enhance safety of elderly people in smart kitchen. In: Proceedings of PETRA 2015, 01–03 July 2015, Corfu, Greece (2015)

    Google Scholar 

  11. Jamal Deen, M.: Information and communications technologies for elderly ubiquitous healthcare in a smart home. Pers. Ubiquit. Comput. 19, 573–599 (2015)

    Article  Google Scholar 

  12. Civitarese, G., Bettini, C., Belfiore, S.: Let the objects tell what you are doing. In: Proceedings of Ubicomp/ISWC 2016 Adjunct, 12–16 September 2016, Heidelberg, Germany (2016)

    Google Scholar 

  13. Iglesias, R., Gomez de Segura, N., Iturburu, M.: the elderly interacting with a digital agenda through an RFID pen and a touch screen. In: Proceedings of MSIADU 2009, 23 October 2009, Beijing, China (2009)

    Google Scholar 

  14. Angelini, L., Nyffeler, N., Caon, M., Jean-Mairet, M., Carrino, S., Mugellini, E., Bergeron, L.: Designing a desirable smart bracelet for older adults. In: Proceedings of UbiComp 2013, 8–12 September 2013, Zurich, Switzerland (2013)

    Google Scholar 

  15. Khosla, R., Chu, M.-T., Kachouie, R., Yamada, K., Yoshihiro, F., Yamaguchi, T.: Interactive multimodal social robot for improving quality of care of elderly in Australian nursing homes. In: Proceedings of MM 2012, 29 October–2 November 2012, Nara, Japan (2012)

    Google Scholar 

  16. Sarkar, D.P.: A nurse bot for elderly people. In: Proceedings of UbiComp/ISWC 2018 Adjunct, 8–12 October 2018, Singapore (2018)

    Google Scholar 

  17. Thakur, N., Han, C.Y.: An improved approach for complex activity recognition in smart homes. In: Reuse in the Big Data Era. Lecture Notes in Computer Science, vol. 11602, pp 220–231. Springer, Cham (2019)

    Google Scholar 

  18. Thakur, N., Han, C.Y.: Framework for a personalized intelligent assistant to elderly people for activities of daily living. Int. J. Recent Trends Hum. Comput. Interact. (IJHCI) 9(1), 1–22 (2019)

    Google Scholar 

  19. Thakur, N., Han, C.Y.: Framework for an intelligent affect aware smart home environment for elderly people. Int. J. Recent Trends Hum. Comput. Interact. (IJHCI) 9(1), 23–43 (2019)

    Google Scholar 

  20. Thakur, N., Han, C.Y.: A context-driven complex activity framework for smart home. In: Proceedings of the 9th Annual Information Technology, Electronics and Mobile Communication Conference (IEMCON) 2018, Vancouver, Canada, 1–3 November 2018 (2018)

    Google Scholar 

  21. Thakur, N., Han, C.Y.: A hierarchical model for analyzing user experiences in affect aware systems. In: Proceedings of the 9th Annual Information Technology, Electronics and Mobile Communication Conference (IEMCON) 2018, Vancouver, Canada, 1–3 November 2018 (2018)

    Google Scholar 

  22. Thakur, N., Han, C.Y.: An approach to analyze the social acceptance of virtual assistants by elderly people. In: Proceedings of the 8th International Conference on the Internet of Things (IoT) 2018, Santa Barbara, California, 15–18 October 2018 (2018)

    Google Scholar 

  23. Thakur, N., Han, C.Y.: Methodology for forecasting user experience for smart and assisted living in affect aware systems. In: Proceedings of the 8th International Conference on the Internet of Things (IoT) 2018, Santa Barbara, California, 15–18 October 2018 (2018)

    Google Scholar 

  24. Thakur, N., Han, C.Y.: An activity analysis model for enhancing user experiences in affect aware systems. In: Proceedings of the IEEE 5G World Forum Conference (IEEE 5GWF) 2018, Santa Clara, California, 09–11 July 2018 (2018)

    Google Scholar 

  25. Thakur, N., Han, C.Y.: A virtual wisdom mining ‘pan’ for connecting retired experts with currently active professionals. In: Proceedings of IT Research Symposium, University of Cincinnati, 10 April 2018 (2018)

    Google Scholar 

  26. Thakur, N., Han, C.Y.: A complex activity based emotion recognition algorithm for affect aware systems. In: Proceedings of IEEE 8th Annual Computing and Communication Workshop and Conference (IEEE CCWC) 2018, Las Vegas, 08–10 January 2018

    Google Scholar 

  27. Saguna, S., Zaslavsky, A., Chakraborty, D.: Complex activity recognition using contextdriven activity theory and activity signatures. ACM Trans. Comput. Hum. Interact. 20(6), 1–34 (2013). Article 32

    Google Scholar 

  28. Ordóñez, F.J., de Toledo, P., Sanchis, A.: Activity recognition using hybrid generative/discriminative models on home environments using binary sensors. Sensors 13, 5460–5477 (2013)

    Article  Google Scholar 

  29. Ritthoff, O., Klinkenberg, R., Fischer, S., Mierswa, I., Felske, S.: YALE: yet another learning environment (2001) https://doi.org/10.17877/de290r-15309

Download references

Author information

Authors and Affiliations

  1. Department of Electrical Engineering and Computer Science, University of Cincinnati, Cincinnati, OH, 45221-0030, USA

    Nirmalya Thakur & Chia Y. Han

Authors
  1. Nirmalya Thakur
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chia Y. Han
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Nirmalya Thakur .

Editor information

Editors and Affiliations

  1. Institute for Advanced Systems Engineering, University of Central Florida, Orlando, FL, USA

    Tareq Ahram

  2. Campus du Moulin de la Housse, Université de Reims Champagne-Ardenne, Reims, France

    Redha Taiar

  3. Fondation EFOM Boris DOLTO, Paris, France

    Karine Langlois

  4. IFMK Nicois, Université Côte d’Azur, Nice Cedex 3, France

    Arnaud Choplin

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Thakur, N., Han, C.Y. (2021). A Multilayered Contextually Intelligent Activity Recognition Framework for Smart Home. In: Ahram, T., Taiar, R., Langlois, K., Choplin, A. (eds) Human Interaction, Emerging Technologies and Future Applications III. IHIET 2020. Advances in Intelligent Systems and Computing, vol 1253. Springer, Cham. https://doi.org/10.1007/978-3-030-55307-4_42

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-55307-4_42

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-55306-7

  • Online ISBN: 978-3-030-55307-4

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation