Abstract
The recognition of activities of daily living (ADLs) by home monitoring systems can be helpful in order to objectively assess the health-related living behaviour and functional ability of older adults. Many ADLs involve human interactions with household electrical appliances (HEAs) such as toasters and hair dryers. Advances in sensor technology have prompted the development of intelligent algorithms to recognise ADLs via inferential information provided from the use of HEAs. The use of robust unsupervised machine learning techniques with inexpensive and retrofittable sensors is an ongoing focus in the ADL recognition research. This paper presents a novel unsupervised activity recognition method for elderly people living alone. This approach exploits a fuzzy-based association rule-mining algorithm to identify the home occupant’s interactions with HEAs using a power sensor, retrofitted at the house electricity panel, and a few Kinect sensors deployed at various locations within the home. A set of fuzzy rules is learned automatically from unlabelled sensor data to map the occupant’s locations during ADLs to the power signatures of HEAs. The fuzzy rules are then used to classify ADLs in new sensor data. Evaluations in real-world settings in this study demonstrated the potential of using Kinect sensors in conjunction with a power meter for the recognition of ADLs. This method was found to be significantly more accurate than just using power consumption data. In addition, the evaluation results confirmed that, owing to the use of fuzzy logic, the proposed method tolerates real-life variations in ADLs where the feature values in new sensor data differ slightly from those in the learning patterns.
Similar content being viewed by others
References
Agrawal R, Imieliński T, Swami A (1993) Mining association rules between sets of items in large databases. ACM SIGMOD Record 22:207–216. doi:10.1145/170036.170072
Belley C, Gaboury S, Bouchard B, Bouzouane A (2014) An efficient and inexpensive method for activity recognition within a smart home based on load signatures of appliances. Pervasive Mob Comput 12:58–78
Berenguer M, Giordani M, Giraud-By F, Noury N Automatic detection of activities of daily living from detecting and classifying electrical events on the residential power line. e-health Networking, Applications and Services, 2008. HealthCom 2008. 10th International Conference on, 7–9 July 2008 2008. pp 29–32. doi:10.1109/health.2008.4600104
Chen L, Nugent CD, Wang H (2012) A knowledge-driven approach to activity recognition in smart homes. IEEE Trans Knowl Data Eng 24:961–974. doi:10.1109/TKDE.2011.51
Cho HS, Yamazaki T, Hahn M (2010) AERO: extraction of user’s activities from electric power consumption data. IEEE Trans Consum Electron 56:2011–2018. doi:10.1109/TCE.2010.5606359
Chung P-C, Liu C-D (2008) A daily behavior enabled hidden Markov model for human behavior understanding. Pattern Recogn 41:1572–1580. doi:10.1016/j.patcog.2007.10.022
Claes V, Devriendt E, Tournoy J, Milisen K (2015) Attitudes and perceptions of adults of 60 years and older towards in-home monitoring of the activities of daily living with contactless sensors: an explorative study. Int J Nurs Stud 52:134–148
Clement J, Ploennigs J, Kabitzsch K (2014) Detecting activities of daily living with smart meters. Ambient assisted living. Springer, Berlin, pp 143–160
Ester M, Kriegel H-P, Sander J Xu X (1996) A density-based algorithm for discovering clusters in large spatial databases with noise. Kdd 34:226–231
Gaddam A, Mukhopadhyay SC, Sen Gupta G (2011) Elder care based on cognitive sensor network. Sens J IEEE 11:574–581
Gayathri KS, Easwarakumar KS, Elias S (2017) Probabilistic ontology based activity recognition in smart homes using Markov Logic Network. Knowl Based Syst 121:173–184. doi:10.1016/j.knosys.2017.01.025
Gu T, Wu Z, Tao X, Pung HK, Lu J (2009) EPSICAR: An Emerging Patterns based approach to sequential, interleaved and Concurrent Activity Recognition. In: 2009 IEEE International Conference on Pervasive Computing and Communications, pp 1–9. doi:10.1109/PERCOM.2009.4912776
Huang Y-M, Hsieh M-Y, Chao H-C, Hung S-H, Park JH (2009) Pervasive, secure access to a hierarchical sensor-based healthcare monitoring architecture in wireless heterogeneous networks. IEEE J Sel Areas Commun 27:400–411
Kalekar PS (2004) Time series forecasting using Holt-Winters exponential smoothing. Kanwal Rekhi Sch Inf Technol 4329008:1–13
Kinect for Windows SDK 2.0 (2017) http://www.microsoft.com/en-au/download/details.aspx?id=44561. Accessed 15 June 2017
Krishnan NC, Cook DJ (2014) Activity recognition on streaming sensor data. Pervasive Mobile Comput 10:138–154
Krüger F, Nyolt M, Yordanova K, Hein A, Kirste T (2014) Computational state space models for activity and intention recognition. A Feasibility Study. PLOS One 9:e109381. doi:10.1371/journal.pone.0109381
Kukolj D (2002) Design of adaptive Takagi–Sugeno–Kang fuzzy models. Appl Soft Comput 2:89–103
Kuok CM, Fu A, Wong MH (1998) Mining fuzzy association rules in databases. ACM Sigmod Record 27:41–46
Mehr HD, Polat H, Cetin A (2016) Resident activity recognition in smart homes by using artificial neural networks. 20–21 April 2016 2016. 4th International Istanbul Smart Grid Congress and Fair (ICSG), pp 1–5. doi:10.1109/SGCF.2016.7492428
Noor MHM, Salcic Z, Wang KIK (2016) Enhancing ontological reasoning with uncertainty handling for activity recognition. Knowl Based Syst 114:47–60. doi:10.1016/j.knosys.2016.09.028
Noury N, Berenguer M, Teyssier H, Bouzid MJ, Giordani M (2011) Building an index of activity of inhabitants from their activity on the residential electrical power line. IEEE Trans Inf Technol Biomed 15:758–766. doi:10.1109/TITB.2011.2138149
Power-Mate 10AHD Serial (2016) POWER-MATE™ 10A Power Meter Serial. http://www.cabac.com.au/products/electrical-test-and-measurement/power-meters/PM10AHDS. Accessed 25 Dec 2016
Rafferty J, Nugent CD, Liu J, Chen L (2017) From activity recognition to intention recognition for assisted living within smart homes. IEEE Trans Hum Mach Syst 47:368–379. doi:10.1109/THMS.2016.2641388
Rahimi S, Chan AD, Goubran RA (2011) Usage monitoring of electrical devices in a smart home. In: 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp 5307–5310. doi:10.1109/IEMBS.2011.6091313
Röhlig M et al (2015) Supporting activity recognition by visual analytics. In: 2015 IEEE Conference on Visual Analytics Science and Technology (VAST), 25–30 Oct 2015, pp 41–48. doi:10.1109/VAST.2015.7347629
Srinivasan V, Stankovic J, Whitehouse K (2013) FixtureFinder: discovering the existence of electrical and water fixtures. In: Proceedings of the 12th international conference on Information processing in sensor networks, 2013. ACM, pp 115–128
Suryadevara NK, Quazi M, Mukhopadhyay SC (2012) Intelligent sensing systems for measuring wellness indices of the daily activities for the elderly. In: 2012 8th International Conference on Intelligent Environments (IE), pp 347–350. doi:10.1109/IE.2012.49
Webb J, Ashley J (2012) Beginning Kinect programming with the Microsoft Kinect SDK. Apress, New York
Whitehouse S, Yordanova K, Paiement A, Mirmehdi M (2016) Recognition of unscripted kitchen activities and eating behaviour for health monitoring. In: Proceedings of 2nd IET International Conference on Technologies for Active and Assisted Living (TechAAL 2016), 2016. Institution of Engineering and Technology, pp 1–6
Wilson C et al (2015) Identifying the time profile of everyday activities in the home using smart meter data. Paper presented at the the European Council for an Energy Efficient Economy (ECEEE), Toulon/Hyères, France
World Health Organization (2015) World report on ageing and health
Xiang Y, Tang Y-p, Ma B-q, Yan H-c, Jiang J, Tian X-y (2015) Remote Safety Monitoring for Elderly Persons Based on Omni-Vision Analysis. PloS One 10:e0124068
Yang C-C, Hsu Y-L (2012) Remote monitoring and assessment of daily activities in the home environment. J Clin Gerontol Geriatr 3:97–104. doi:10.1016/j.jcgg.2012.06.002
Zhan K, Faux S, Ramos F (2015) Multi-scale conditional random fields for first-person activity recognition on elders and disabled patients. Pervasive Mobile Comput 16 (Part B):251–267. doi:10.1016/j.pmcj.2014.11.004
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Pazhoumand-Dar, H. Fuzzy association rule mining for recognising daily activities using Kinect sensors and a single power meter. J Ambient Intell Human Comput 9, 1497–1515 (2018). https://doi.org/10.1007/s12652-017-0571-8
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12652-017-0571-8