Skip to main content
SpringerLink
Log in

Activity Recognition in Smart Homes

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In recent years, activity recognition in smart homes is an active research area. It is an important problem of Human Computer Interaction (HCI), and has many applications in HCI, such as assistive living and healthcare. Recognition of users’ common behaviors allows an environment to provide personalized service. Unlike activity recognition in computer vision which uses cameras, it studies activities by embedded sensors in smart homes. In this paper, we propose a method to extract latent features from sensor data by Beta Process Hidden Markov Model (BP-HMM). The contributions of our method are twofold: 1, we extend BP-HMM by dependent Beta process, and integrate state constraints of sensors into the sampling process of BP-HMM. 2, we extract latent features automatically by our dependent BP-HMM, and train a structural support vector machine (SVM) by these features in a supervised way for activity recognition. To evaluate the proposed method, we performed experiments on the real-world smart home datasets. Our results suggest that extracting latent features from sensor data leads to good performance for activity recognition.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Alemdar H, Kasteren TV, Niessen M, Merentitis A, Ersoy C (2014) A unified model for human behavior modeling using a hierarchy with a variable number of states. In: Proc. of IEEE Int. Conf. on Pattern Recognition, Stockholm, Sweden, pp. 3804–3809

    Google Scholar 

  2. Alon J, Athitsos V, Yuan Q, Sclaroff S (2008) A unified framework for gesture recognition and spatiotemp oral gesture segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence 31:1685–1699

    Article  Google Scholar 

  3. Azkune G, Almeida A, de Ipia DL, Chen L (2015) Extending knowledge-driven activity models through data-driven learning techniques. Expert Syst Appl 42(6):3115–3128

    Article  Google Scholar 

  4. Blei DM, Ng AY, Jordan MI (2003) Latent dirichlet allocation. J Machine Learning Research 3:993–1022

    MATH  Google Scholar 

  5. Cook D, Schmitter-Edgecombe M, Crandall A, Sanders C, Thomas B (2009) Collecting and disseminating smart home sensor data in the casas project. Proceedings of the CHI Workshop on Developing Shared Home Behavior Datasets to Advance HCI and Ubiquitous Computing Research, pp 4763–4766

  6. Diethe T, Twomey N and Flach P (2015) Bayesian modelling of the temporal aspects of smart home activity with circular statistics. ECML PKDD, pp 279–294

  7. Doshi-Velez F, Ghahramani Z (2009) Correlated non-parametric latent feature models. Uncertainty in Artificial Intelligence, pp 143–150

  8. Fahad LG, Ali A, Rajarajan M (2013) Long term analysis of daily activities in smart home. In: In: Proc. of the European Symp. on Artificial Neural Networks, Computational Intelligence and Machine Learning. Bruges, Belgium, pp. 419–424

    Google Scholar 

  9. Fahad LG, Tahir SF, Rajarajan M (2014) Activity recognition in smart homes using clustering based classification. In: Proc. of IEEE Int. Conf. on Pattern Recognition, Stockholm, Sweden, pp 1348–1353

  10. Fatima I, Fahim M, Lee Y-K, Lee S (2013) Analysis and effects of smart home dataset characteristics for daily life activity recognition. J Supercomput 66:760–780

    Article  Google Scholar 

  11. Fleury A, Vacher M, Noury N (2010) SVM-based multimodal classification of activities of daily living in health smart homes: sensors, algorithms, and first experimental results. IEEE Trans Inf Technol Biomed 14(2):274–283

    Article  Google Scholar 

  12. Foerster F, Smeja M, Fahrenberg J (1999) Detection of posture and motion by accelerometry: a validation study in ambulatory monitoring. Computers in Human Behavior 15(5):571–583

    Article  Google Scholar 

  13. Fox EB, Sudderth EB, Jordan MI, Willsky AS (2009) Sharing features among dynamical systems with beta processes. Neural information processing systems (NIPS), Vancouver, Canada, pp 549–557

  14. Griffiths TL, Steyvers M (2004) Finding scientific topics. Proceedings of the National Academy of Sciences 101:5228–5235

    Article  Google Scholar 

  15. Intille S, Larson K, Tapia EM, Beaudin J, Kaushik P, Nawyn J, Rockinson R (2006) Using a live-in lab oratory for ubiquitous computing research. Proceedings of Pervasive: 349–365

  16. Kasteren TV, Englebienne G, Krose B (2011) Hierarchical activity recognition using automatically clustered actions. In: Proc. of Int. Conf. on Ambient Intelligence, Amsterdam, The Netherlands, pp 82–91

  17. Kidd CD, Orr RJ, Abowd GD, Atkeson CG, Essa IA, MacIntyre B, Mynatt E, Starner TE, Newstetter W (1999) The aware home: A living lab oratory for ubiquitous computing research. Proceedings of the Second International Workshop on Cooperative Buildings, pp 191–198

  18. Krishnan N, Cook D (2014a) Activity recognition on streaming sensor data. Pervasive and Mobile Computing 10(20):138–154

    Article  Google Scholar 

  19. Krishnan N, Cook D (2014b) Activity recognition on streaming sensor data. Pervasive and Mobile Computing 20:138–154

    Article  Google Scholar 

  20. Krishnan NC, Panchanathan S (2008) Analysis of low resolution accelerometer data for human activity recognition. International Conference on Acoustic Speech and Signal Processing. IEEE, Las Vegas, p 462–472

  21. Krse BJA, Kasteren TLMV, Gibson CHS, den Dool TV (2008) Care: Context awareness in residences for elderly. Proceedings of sixth international conference of the international society for Geron technology, pp 101–105

  22. Lester J, Choudhury T, Kern N, Borriello G, Hannaford B (2005) A hybrid discriminative/generative approach for modeling human activities. In: Proceedings of the 19th international joint conference on Artificial intelligence. Morgan Kaufmann Publishers Inc, San Francisco, p. 766–772

  23. Mahmoud S, Lotfi A, Langensiepen C (2013) Behavioural pattern identification and prediction in intelligent environments. Appl Soft Comput 13(4):1813–1822

    Article  Google Scholar 

  24. Miller KT, Griffiths TL, Jordan MI (2008) The phylogenetic indian buffet process: A nonexchangeable nonparametric prior for latent features. NIPS

  25. Ramage D, Hall D, Nallapati R, Manning CD (2009) Labeled LDA: a supervised topic model for credit attribution in multi-labeled corpora. Proceedings of the Conference on Empirical Methods in Natural Language Processing, 248-256

  26. Rashidi P, Cook DJ, Holder LB, Schmitter-Edgecombe M (2011) Discovering activities to recognize and track in a smart environment. IEEE Trans Knowl Data Eng 23(4):527–539

    Article  Google Scholar 

  27. Robert CP, Casella G (2004) Monte carlo statistical methods, 2nd edn, Springer

  28. Singla G, Cook D, Schmitter-Edgecombe M (2010) Recognizing independent and joint activities among multiple residents in smart environments. Ambient Intelligence and Humanized Computing Journal 1(1):57–63

    Article  Google Scholar 

  29. Tolstikov A, Hong X, Biswas J, Nugent C, Chen L, Parente G (2011) Comparison of fusion methods based on DST and DBN in human activity recognition. J Control Theory Appl 9(1):18–27

    Article  Google Scholar 

  30. Tsochantaridis I, Hofmann T, Joachims T, Altun Y (2004) Support vector learning for interdependent and structured output spaces. Proceedings of ICML: 104-110

  31. Wang Y, Mori G (2009) Human action recognition by semi-latent topic models. IEEE Transactions on Pattern Analysis and Machine Intelligence 31(10):1762–1774

    Article  Google Scholar 

  32. Wang C, Blei DM, Fei-Fei L (2009) Simultaneous image classification and annotation. In CVPR, pp 1903–1910

  33. Wen J, Zhong M (2015) Activity discovering and modelling with labelled and unlabelled data in smart environments. Expert Systems with Applications 42:5800–5810

    Article  Google Scholar 

  34. Wen J, Zhong M, Wang Z (2015) Activity recognition with weighted frequent patterns mining in smart environments. Expert Systems with Applications 42:6423–6432

    Article  Google Scholar 

  35. Williamson S, Orbanz P, Ghahramani Z (2010) Dependent indian buffet processes. International Conference on Artificial Intelligence and Statistics, pp 924–931

  36. Zhou M, Yang H, Sapiro, G, Dunson D, Carin L (2011) Dependent hierarchical beta process for image interpolation and denoising. Proceedings of the international conference on artificial intelligence and statistics, pp 883–891

  37. Zhu J, Ahmed A, Xing EP (2009) MedLDA: Maximum margin supervised topic models for regression and classification. In ICML, Montreal, Canada, pp 1257–1264

Download references

Acknowledgments

This work was supported by the following grants: Guangdong Public Welfare and Ability Construction Project 2015B010103003, and Guangdong Collaborative Innovation and Platform Construction Project 2016A040403048.

Author information

Authors and Affiliations

  1. School of Mathematics and Statistics, Guangdong University of Finance & Economics, Guangzhou, 510320, China

    Lu Lu

  2. School of Engineering, Sun Yat-sen University, Guangzhou, 510006, China

    Cai Qing-ling & Zhan Yi-Ju

Authors
  1. Lu Lu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Cai Qing-ling
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zhan Yi-Ju
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Cai Qing-ling.

Ethics declarations

Conflict of Interest

The authors declare no conflict of interest.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lu, L., Qing-ling, C. & Yi-Ju, Z. Activity Recognition in Smart Homes. Multimed Tools Appl 76, 24203–24220 (2017). https://doi.org/10.1007/s11042-016-4197-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-016-4197-1

Keywords

Search

Navigation