Skip to main content
SpringerLink
Log in

Smart home resident identification based on behavioral patterns using ambient sensors

  • Original Article
  • Published:
Personal and Ubiquitous Computing Aims and scope Submit manuscript

Abstract

In this paper, a novel approach is presented to identify the smart home residents. The different behavioral patterns of smart home’s inhabitants are exploited to distinguish the residents. The variation of a specific individual behavior in smart homes is a significant challenge. We introduce different features that are useful to handle this problem. Moreover, we introduce an innovative strategy which considers the Bag of Sensor Events and Bayesian networks. In the Bag of Sensor Events approach, the frequency of each sensor event occurrence is considered, regardless of the order of sensor events. The efficiency of the Bag of sensor Events approach is compared to the Sequence of Sensor Events. Our experiments confirm that the Bag of Sensor Events approach outperformed the previous approaches. When the smart homes residents are people who repeat their daily activities frequently, applying the Bag of Sensor Events on Activity Based Window Frame features, which considers the performed daily activities, would identify them more accurately. In contrast, in cases where residents perform their activities in different ways, considering the Time Based Window Frame leads to higher accuracy in distinguishing residents. In this approach, the features are created by considering the constant time intervals. The F-measure of our proposed approach on the Twor2009, Tulum2009, and Tulum2010 datasets is 96%, 100%, and 99%, respectively, which improves the results of the previous researches which consider behavioral patterns to identify smart home residents.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Oppitz M, Tomsu P (2018) Internet of things. In: Oppitz M, Tomsu P (eds) Inventing the cloud century: how cloudiness keeps changing our life, economy and technology. Springer International Publishing, Cham, pp 435–469. https://doi.org/10.1007/978-3-319-61161-7_16

    Chapter  Google Scholar 

  2. Osseiran A, Elloumi O, Song J, Monserrat JF (2017) Internet of things. IEEE Communications Standards Magazine 1(2):84–84. https://doi.org/10.1109/MCOMSTD.2017.7992936

    Article  Google Scholar 

  3. Feng S, Setoodeh P, Haykin S (2017) Smart home: cognitive interactive people-centric internet of things. IEEE Commun Mag 55(2):34–39. https://doi.org/10.1109/MCOM.2017.1600682CM

    Article  Google Scholar 

  4. Zanella A, Bui N, Castellani A, Vangelista L, Zorzi M (2014) Internet of things for smart cities. IEEE Internet Things J 1(1):22–32. https://doi.org/10.1109/JIOT.2014.2306328

    Article  Google Scholar 

  5. Yacchirema D, de Puga JS, Palau C, Esteve M (2019) Fall detection system for elderly people using IoT and ensemble machine learning algorithm. Pers Ubiquit Comput. https://doi.org/10.1007/s00779-018-01196-8

  6. Rafferty J, Nugent CD, Liu J, Chen L (2017) From activity recognition to intention recognition for assisted living within smart homes. IEEE Transactions on Human-Machine Systems 47(3):368–379. https://doi.org/10.1109/THMS.2016.2641388

    Article  Google Scholar 

  7. Mshali H, Lemlouma T, Magoni D (2018) Adaptive monitoring system for e-health smart homes. Pervasive Mob Comput 43:1–19. https://doi.org/10.1016/j.pmcj.2017.11.001

    Article  Google Scholar 

  8. Zanjal SV, Talmale GR (2016) Medicine reminder and monitoring system for secure health using IOT. Proced Comput Sci 78:471–476. https://doi.org/10.1016/j.procs.2016.02.090

    Article  Google Scholar 

  9. Ahmed E, Islam A, Sarker F, Huda MN, Abdullah-Al-Mamun K (2016) A road to independent living with smart homes for people with disabilities. Paper presented at the 2016 5th international conference on informatics, electronics and vision (ICIEV), 13–14 May 2016

  10. Benmansour A, Bouchachia A, Feham M (2015) Multioccupant activity recognition in pervasive smart home environments. ACM Comput Surv 48(3):1–36. https://doi.org/10.1145/2835372

    Article  Google Scholar 

  11. Wong KB-Y, Zhang T, Aghajan H (2014) Extracting patterns of behavior from a network of binary sensors. J Ambient Intell Humaniz Comput 6(1):83–105. https://doi.org/10.1007/s12652-014-0246-7

    Article  Google Scholar 

  12. Voas J, Kshetri N (2017) Human Tagging. Computer 50(10):78–85. https://doi.org/10.1109/MC.2017.3641646

    Article  Google Scholar 

  13. Wang L, Gu T, Tao X, Lu J (2017) Toward a wearable RFID system for real-time activity recognition using radio patterns. IEEE Trans Mob Comput 16(1):228–242. https://doi.org/10.1109/TMC.2016.2538230

    Article  Google Scholar 

  14. J B AM (2011) Body-worn sensor design: what do patients and clinicians want? Ann Biomed Eng 39(9):2299–2312

    Article  Google Scholar 

  15. López G, Marín G, Calderón M (2017) Human aspects of ubiquitous computing: a study addressing willingness to use it and privacy issues. J Ambient Intell Humaniz Comput 8(4):497–511. https://doi.org/10.1007/s12652-016-0438-4

    Article  Google Scholar 

  16. Thielen M, Sigrist L, Magno M, Hierold C, Benini L (2017) Human body heat for powering wearable devices: from thermal energy to application. Energy Convers Manag 131:44–54. https://doi.org/10.1016/j.enconman.2016.11.005

    Article  Google Scholar 

  17. Mokhtari G, Zhang Q, Hargrave C, Ralston JC (2017) Non-wearable UWB sensor for human identification in smart home. IEEE Sensors J 17(11):3332–3340. https://doi.org/10.1109/JSEN.2017.2694555

    Article  Google Scholar 

  18. Alemdar H, Ertan H, Incel OD, Ersoy C (2013) ARAS human activity datasets in multiple homes with multiple residents. Paper presented at the 2013 7th International Conference on Pervasive Computing Technologies for Healthcare and Workshops, 5–8 May 2013

  19. Cook DJ, Crandall AS, Thomas BL, Krishnan NC (2013) CASAS: a smart home in a box. Computer 46(7):62–69. https://doi.org/10.1109/MC.2012.328

    Article  Google Scholar 

  20. Forkan ARM, Khalil I, Tari Z, Foufou S, Bouras A (2015) A context-aware approach for long-term behavioural change detection and abnormality prediction in ambient assisted living. Pattern Recogn 48(3):628–641. https://doi.org/10.1016/j.patcog.2014.07.007

    Article  Google Scholar 

  21. Kim J-C, Chung K (2017) Depression index service using knowledge based crowdsourcing in smart health. Wirel Pers Commun 93(1):255–268. https://doi.org/10.1007/s11277-016-3923-3

    Article  Google Scholar 

  22. Kim JY, Liu N, Tan HX, Chu CH (2017) Unobtrusive monitoring to detect depression for elderly with chronic illnesses. IEEE Sensors J 17(17):5694–5704. https://doi.org/10.1109/JSEN.2017.2729594

    Article  Google Scholar 

  23. Rashidi P, Cook DJ, Holder LB, Schmitter-Edgecombe M (2011) Discovering activities to recognize and track in a smart environment. IEEE Trans Knowl Data Eng 23:527–539

    Article  Google Scholar 

  24. Gayathri KS, Easwarakumar KS, Elias S (2017) Probabilistic ontology based activity recognition in smart homes using Markov logic network. Knowl-Based Syst 121:173–184. https://doi.org/10.1016/j.knosys.2017.01.025

    Article  Google Scholar 

  25. Tsai MJ, Wu CL, Pradhan SK, Xie Y, Li TY, Fu LC, Zeng YC (2016) Context-aware activity prediction using human behavior pattern in real smart home environments. Paper presented at the 2016 IEEE international conference on automation science and engineering (CASE), 21–25 Aug. 2016

  26. Koller D, Friedman N (2009) Probabilistic Graphical Models: principles and techniques - adaptive computation and machine learning. The MIT Press

  27. Nie Z, Liu Y, Duan C, Ruan Z, Li J, Wang L (2015) Wearable biometric authentication based on human body communication. Paper presented at the 2015 IEEE 12th international conference on wearable and implantable body sensor networks (BSN), 9–12 June 2015

  28. Cheng J, Sundholm M, Zhou B, Hirsch M, Lukowicz P (2016) Smart-surface: large scale textile pressure sensors arrays for activity recognition. Pervasive Mob Comput 30:97–112. https://doi.org/10.1016/j.pmcj.2016.01.007

    Article  Google Scholar 

  29. Chen YC, Zhu X, Zheng WS, Lai JH (2018) Person re-identification by camera correlation aware feature augmentation. IEEE Trans Pattern Anal Mach Intell 40(2):392–408. https://doi.org/10.1109/TPAMI.2017.2666805

    Article  Google Scholar 

  30. Camps O, Gou M, Hebble T, Karanam S, Lehmann O, Li Y, Radke RJ, Wu Z, Xiong F (2017) From the lab to the real world: re-identification in an airport camera network. IEEE Trans Circ Syst Video Technol 27(3):540–553. https://doi.org/10.1109/TCSVT.2016.2556538

    Article  Google Scholar 

  31. Ropponen A, Rimminen H, Sepponen R (2011) Robust system for indoor localisation and identification for the health care environment. Wirel Pers Commun 59(1):57–71. https://doi.org/10.1007/s11277-010-0189-z

    Article  Google Scholar 

  32. Lassabe F, Canalda P, Chatonnay P, Spies F (2009) Indoor Wi-fi positioning: techniques and systems. Annals of Telecommunications - Annales des Télécommunications 64(9):651–664. https://doi.org/10.1007/s12243-009-0122-1

    Article  Google Scholar 

  33. Yao Z, Liang D, Jiang W, Bo H, Yuzhuo F (Oct. 2008) (2008) implementing indoor positioning system via ZigBee devices. Paper presented at the 2008 42nd Asilomar conference on signals. Syst Comput:26–29

  34. Ferrara M, Franco A, Maio D (2014) On the use of the Kinect sensor for human identification in smart environments. J Ambient Intell Smart Environ 6(4):435–446

    Article  Google Scholar 

  35. BenAbdelkader C, Cutler R, Davis L (2002) Person identification using automatic height and stride estimation. Paper presented at the Object recognition supported by user interaction for service robots, 2002

  36. Mokhtari G, Bashi N, Zhang Q, Nourbakhsh G (2018) Non-wearable human identification sensors for smart home environment: a review. Sens Rev 38(3):391–404. https://doi.org/10.1108/SR-07-2017-0140

    Article  Google Scholar 

  37. Srinivasan V, Stankovic J, Whitehouse K (2010) Using Height Sensors for Biometric Identification in Multi-resident Homes. Paper presented at the Pervasive Computing, Berlin, Heidelberg, 2010

  38. Nguyen M-S, Vo T-L (2018) Resident Identification in Smart Home by Voice Biometrics. In: Cham. Future Data and Security Engineering. Springer International Publishing, pp 433–448

  39. Zhang J, Wei B, Hu W, Kanhere SS (2016) WiFi-ID: human identification using WiFi signal. Paper presented at the 2016 international conference on distributed computing in sensor systems (DCOSS), 26–28 May 2016

  40. Zeng Y, Pathak PH, Mohapatra P (2016) WiWho: WiFi-based person identification in smart spaces. Paper presented at the 2016 15th ACM/IEEE international conference on information processing in sensor networks (IPSN), 11–14 April 2016

  41. Shah SW, Kanhere SS (2019) Smart user identification using cardiopulmonary activity. Pervasive Mob Comput 58:101024. https://doi.org/10.1016/j.pmcj.2019.05.005

    Article  Google Scholar 

  42. Ren Y, Chen Y, Chuah MC, Yang J (2015) User verification leveraging gait recognition for smartphone enabled Mobile healthcare systems. IEEE Trans Mob Comput 14(9):1961–1974. https://doi.org/10.1109/TMC.2014.2365185

    Article  Google Scholar 

  43. Shi C, Liu J, Liu H, Chen Y (2017) Smart user authentication through actuation of daily activities leveraging WiFi-enabled IoT. Paper presented at the proceedings of the 18th ACM international symposium on Mobile ad hoc networking and computing, Chennai

  44. Kong H, Lu L, Yu J, Chen Y, Kong L, Li M (2019) FingerPass: finger gesture-based continuous user authentication for smart homes using commodity WiFi. Paper presented at the proceedings of the twentieth ACM International Symposium on Mobile Ad Hoc Networking and Computing, Catania

  45. Depatla S, Muralidharan A, Mostofi Y (2015) Occupancy estimation using only WiFi power measurements. IEEE J Sel Areas Commun 33(7):1381–1393. https://doi.org/10.1109/JSAC.2015.2430272

    Article  Google Scholar 

  46. Khalil N, Benhaddou D, Gnawali O, Subhlok J (2018) Nonintrusive ultrasonic-based occupant identification for energy efficient smart building applications. Appl Energy 220:814–828. https://doi.org/10.1016/j.apenergy.2018.03.018

    Article  Google Scholar 

  47. Khalil N, Benhaddou D, Gnawali O, Subhlok J (2016) Nonintrusive occupant identification by sensing body shape and movement. Paper presented at the proceedings of the 3rd ACM international conference on Systems for Energy-Efficient Built Environments, Palo Alto, CA

  48. Kalyanaraman A, Hong D, Soltanaghaei E, Whitehouse K (2017) Forma track: tracking people based on body shape. Proc ACM Interact Mob Wearable Ubiquitous Technol 1(3):1–21. https://doi.org/10.1145/3130926

    Article  Google Scholar 

  49. Khalil N, Gnawali O, Benhaddou D, Subhlok J (2018) SonicDoor: a person identification system based on modeling of shape, behavior, and walking patterns. ACM Trans Sen Netw 14(3–4):1–21. https://doi.org/10.1145/3229064

    Article  Google Scholar 

  50. Batool S, Saqib NA, Khattack MK, Hassan a identification of remote IoT users using sensor data analytics. In, Cham, 2020. Advances in information and communication. Springer International Publishing, pp 328–337

  51. Mokhtari G, Zhang Q, Nourbakhsh G, Ball S, Karunanithi M (2017) BLUESOUND: a new resident identification sensor using ultrasound Array and BLE Technology for Smart Home Platform. IEEE Sensors J 17(5):1503–1512. https://doi.org/10.1109/JSEN.2017.2647960

    Article  Google Scholar 

  52. Lesani FS, Ghazvini FF, Amirkhani H (2017) Smart home user identification using bag of events approach. Paper presented at the 2017 7th International Conference on Computer and Knowledge Engineering (ICCKE), 26–27 Oct. 2017

  53. Crandall AS, Cook DJ (2013) Behaviometrics for identifying smart home residents. In: Bosse T, Cook DJ, Neerincx M, Sadri F (eds) Human aspects in ambient intelligence: contemporary challenges and solutions. Atlantis Press, Paris, pp 55–71. https://doi.org/10.2991/978-94-6239-018-8_4

    Chapter  Google Scholar 

  54. Kim H, Kim I, Kim J (2015) Designing the smart foot mat and its applications: as a user identification sensor for smart home scenarios. Adv Sci Technol Lett 87:1–5

    Google Scholar 

  55. Carvalho RLd, Rosa PFF (2010) Identification system for smart homes using footstep sounds. Paper presented at the 2010 IEEE international symposium on industrial electronics, 4–7 July 2010

  56. Heo KH, Jeong SY, Kang SJ (2019) Real-time user identification and behavior prediction based on foot-pad recognition. Sensors 19(13). https://doi.org/10.3390/s19132899

  57. Crandall AS, Cook DJ (2008) Resident and caregiver: handling multiple people in a smart care facility. In Proceedings of the AAAI fall symposium—AI in eldercare: new solutions to old problems:39–47

  58. Crandall AS, Cook DJ (2008) Attributing events to individuals in multi-inhabitant environments. In Proceedings of the IET 4th international conference on intelligent environments:1–8

  59. Crandall AS, Cook DJ (2010) Using a Hidden Markov Model for resident identification. Paper presented at the 2010 sixth international conference on intelligent environments, 19–21 July 2010

  60. Hsu K-C, Chiang Y-T, Lin G-Y, Lu C-H, Hsu JY-J, Fu L-C (2010) Strategies for Inference Mechanism of Conditional Random Fields for Multiple-Resident Activity Recognition in a Smart Home. Paper presented at the Trends in Applied Intelligent Systems, Berlin, Heidelberg, 2010

  61. Amirkhani H, Rahmati M, Lucas PJF, Hommersom A (2017) Exploiting Experts' knowledge for structure learning of Bayesian networks. IEEE Trans Pattern Anal Mach Intell 39(11):2154–2170. https://doi.org/10.1109/TPAMI.2016.2636828

    Article  Google Scholar 

  62. Rabiner LR (1989) A tutorial on hidden Markov models and selected applications in speech recognition. Proc IEEE 77(2):257–286. https://doi.org/10.1109/5.18626

    Article  Google Scholar 

  63. Jolliffe IT (1986) Choosing a subset of principal components or variables. In: Jolliffe IT (ed) Principal component analysis. Springer New York, New York, pp 92–114. https://doi.org/10.1007/978-1-4757-1904-8_6

    Chapter  Google Scholar 

  64. Gama J, Pinto C (2006) Discretization from data streams: applications to histograms and data mining. Paper presented at the proceedings of the 2006 ACM symposium on applied computing, Dijon, France

  65. Cook D, Schmitter-Edgecombe M (2009) Assessing the quality of activities in a smart environment. Methods Inf Med 48(5):480–485

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Computer and Information Technology Engineering, University of Qom, Qom, 3716146611, Iran

    Fatemeh Sadat Lesani, Faranak Fotouhi Ghazvini & Hossein Amirkhani

Authors
  1. Fatemeh Sadat Lesani
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Faranak Fotouhi Ghazvini
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hossein Amirkhani
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Faranak Fotouhi Ghazvini.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lesani, F.S., Fotouhi Ghazvini, F. & Amirkhani, H. Smart home resident identification based on behavioral patterns using ambient sensors. Pers Ubiquit Comput 25, 151–162 (2021). https://doi.org/10.1007/s00779-019-01288-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00779-019-01288-z

Keywords

Search

Navigation