research-article

FreeSia: A Cyber-physical System for Cognitive Assessment through Frequency-domain Indoor Locomotion Analysis

Authors:

Elham Khodabandehloo,

Abbas Alimohammadi,

Daniele RiboniAuthors Info & Claims

ACM Transactions on Cyber-Physical Systems (TCPS), Volume 6, Issue 2

Article No.: 12, Pages 1 - 31

https://doi.org/10.1145/3470454

Published: 11 April 2022 Publication History

Abstract

Thanks to the seamless integration of sensing, networking, and artificial intelligence, cyber-physical systems promise to improve healthcare by increasing efficiency and reducing costs. Specifically, cyber-physical systems are being increasingly applied in smart-homes to support independent and healthy aging. Due to the growing prevalence of noncommunicable diseases in the senior population, a key application in this domain is the detection of cognitive issues based on sensor data. In this article, we propose a novel cyber-physical system for cognitive assessment in smart-homes. Cognitive evaluation relies on clinical indicators characterizing symptoms of dementia based on the individual’s movement patterns. However, recognizing these patterns in smart-homes is challenging, because movement is constrained by the home layout and obstacles. Since different abnormal patterns are characterized by undulatory-like trajectories, we conjecture that frequency-based locomotion features may more effectively capture these patterns with respect to traditional features in the spatio-temporal domain. Based on this intuition, we introduce novel feature extraction techniques and adopt state-of-the-art machine learning algorithms for short- and long-term cognitive evaluation. Our system includes a user-friendly interface that enables clinicians to inspect the data and predictions. Extensive experiments carried out with a real-world dataset acquired from both cognitively healthy seniors and people with dementia show the superiority of our frequency-based features. Moreover, further experiments with an ensemble method show that prediction accuracy can be enhanced by combining features in the frequency and time domains.

References

[1]

David W. Aha, Dennis Kibler, and Marc K. Albert. 1991. Instance-based learning algorithms. Mach. Learn. 6, 1 (1991), 37–66.

[2]

Donna L. Algase, D. Helen Moore, Carla Vandeweerd, and D. J. Gavin-Dreschnack. 2007. Mapping the maze of terms and definitions in dementia-related wandering. Aging Ment. Health 11, 6 (2007), 686–698.

[3]

Jonathan Allen. 1977. Short term spectral analysis, synthesis, and modification by discrete Fourier transform. IEEE Trans. Acoust., Speech, Sig. Process. 25, 3 (1977), 235–238.

[4]

Alejandro Barredo Arrieta, Natalia Díaz-Rodríguez, Javier Del Ser, Adrien Bennetot, Siham Tabik, Alberto Barbado, Salvador García, Sergio Gil-López, Daniel Molina, Richard Benjamins et al. 2020. Explainable artificial intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI. Inf. Fusion 58 (2020), 82–115.

Digital Library

[5]

American Psychiatric Association et al. 2013. Diagnostic and Statistical Manual of Mental Disorders. American Psychiatric Pub.

[6]

Claudio Bettini and Daniele Riboni. 2015. Privacy protection in pervasive systems: State of the art and technical challenges. Pervas. Mob. Comput. 17 (2015), 159–174.

Digital Library

[7]

Andrew P. Bradley. 1997. The use of the area under the ROC curve in the evaluation of machine learning algorithms. Pattern Recog. 30, 7 (1997), 1145–1159.

Digital Library

[8]

Leo Breiman. 2001. Random forests. Mach. Learn. 45, 1 (2001), 5–32.

Digital Library

[9]

Pasquale Buonocunto, Andrea Giantomassi, Mauro Marinoni, Davide Calvaresi, and Giorgio C. Buttazzo. 2018. A limb tracking platform for tele-rehabilitation. ACM Trans. Cyber-phys. Syst. 2, 4 (2018), 30:1–30:23.

Digital Library

[10]

Paul W. Burgess. 2000. Strategy application disorder: The role of the frontal lobes in human multitasking. Psycholog. Res. 63, 3–4 (2000), 279–288.

[11]

Sarthak Chatterjee and Sérgio Pequito. 2019. Dealing with state estimation in fractional-order systems under artifacts. In American Control Conference (ACC). IEEE, 878–883.

[12]

William W. Cohen. 1995. Fast effective rule induction. In Machine Learning Proceedings 1995. Elsevier, 115–123.

Digital Library

[13]

Diane J. Cook, Aaron S. Crandall, Brian L. Thomas, and Narayanan C. Krishnan. 2013. CASAS: A smart home in a box. Computer 46, 7 (2013), 62–69.

Digital Library

[14]

Sina Dabiri and Kevin Heaslip. 2018. Inferring transportation modes from GPS trajectories using a convolutional neural network. Transport. Res. Part C: Emerg. Technol. 86 (2018), 360–371.

[15]

David H. Douglas and Thomas K. Peucker. 1973. Algorithms for the reduction of the number of points required to represent a digitized line or its caricature. Cartog.: Int. J. Geog. Inf. Geovis. 10, 2 (1973), 112–122.

[16]

Eibe Frank, Mark A. Hall, Geoffrey Holmes, Richard Kirkby, and Bernhard Pfahringer. 2005. WEKA - A machine learning workbench for data mining. In The Data Mining and Knowledge Discovery Handbook. Springer, 1305–1314.

[17]

Yoav Freund and Robert E. Schapire. 1999. Large margin classification using the perceptron algorithm. Mach. Learn. 37, 3 (1999), 277–296.

Digital Library

[18]

Nir Friedman, Dan Geiger, and Moisés Goldszmidt. 1997. Bayesian network classifiers. Mach. Learn. 29, 2–3 (1997), 131–163. DOI:

Digital Library

[19]

Iván García-Magarino, Marlón Cárdenas, Jorge Gómez-Sanz, and Juan L. Pérez Díez. 2019. Framework-supported mechanism of testing algorithms for assessing memory and detecting disorientation from IoT sensors. In 5th World Forum on Internet of Things (WF-IoT). IEEE, 899–904.

[20]

Jeffrey M. Hausdorff, Patrick L. Purdon, Chung-Kang Peng, Z. V. I. Ladin, Jeanne Y. Wei, and Ary L. Goldberger. 1996. Fractal dynamics of human gait: Stability of long-range correlations in stride interval fluctuations. J. Appl. Physiol. 80, 5 (1996), 1448–1457.

[21]

Jad Helmy and Ahmed Helmy. 2016. The Alzimio app for dementia, autism & Alzheimer’s: Using novel activity recognition algorithms and geofencing. In IEEE International Conference on Smart Computing (SMARTCOMP). IEEE, 1–6.

[22]

Hui Huang, Shiyan Hu, and Ye Sun. 2019. Energy-efficient ECG signal compression for user data input in cyber-physical systems by leveraging empirical mode decomposition. ACM Trans. Cyber-phys. Syst. 3, 4 (2019), 40:1–40:19.

Digital Library

[23]

Guillaume Joerger, Juliette Rambourg, Hélène Gaspard-Boulinc, Stéphane Conversy, Barbara Bass, Brian Dunkin, and Marc Garbey. 2018. A cyber-physical system to improve the management of a large suite of operating rooms. ACM Trans. Cyb.-phys. Syst. 2, 4 (2018), 34:1–34:24.

[24]

William D. Kearns, James L. Fozard, Vilis O. Nams, and Jeffrey D. Craighead. 2011. Wireless telesurveillance system for detecting dementia. Gerontechnology (2011), 90.

[25]

William D. Kearns, V. O. Nams, and James L. Fozard. 2010. Tortuosity in movement paths is related to cognitive impairment. Meth. Inf. Med. 49, 06 (2010), 592–598.

[26]

Arshia Khan and Arshia Zernab Hassan. 2018. Framework to predict and identify wandering behavior in individuals with Alzheimer’s using physiological and kinect sensors. In SAI Intelligent Systems Conference. Springer, 387–398.

[27]

Elham Khodabandehloo and Daniele Riboni. 2020. Collaborative trajectory mining in smart-homes to support early diagnosis of cognitive decline. IEEE Trans. Emerg. Topics Comput. 9, 3 (2020), 1194–1205.

[28]

Elham Khodabandehloo, Daniele Riboni, and Abbas Alimohammadi. 2021. HealthXAI: Collaborative and explainable AI for supporting early diagnosis of cognitive decline. Fut. Gen. Comput. Syst. 116 (2021), 168–189.

[29]

Ashish Kumar, Chiew Tong Lau, Maode Ma, Syin Chan, and William Kearns. 2017. Trend analysis in the trajectory of the dementia patients. In International Computer Science and Engineering Conference (ICSEC). IEEE, 1–5.

[30]

Saskia Le Cessie and Johannes C. Van Houwelingen. 1992. Ridge estimators in logistic regression. J. Roy. Statist. Societ.: Series C (Appl. Statist.) 41, 1 (1992), 191–201.

[31]

Joseph Lee Rodgers and W. Alan Nicewander. 1988. Thirteen ways to look at the correlation coefficient. Amer. Statist. 42, 1 (1988), 59–66.

[32]

Xun Li. 2014. Using complexity measures of movement for automatically detecting movement types of unknown GPS trajectories. Amer. J. Geog. Inf. Syst. 3, 2 (2014), 63–74.

[33]

Qiang Lin, Daqing Zhang, Liming Chen, Hongbo Ni, and Xingshe Zhou. 2014. Managing elders’ wandering behavior using sensors-based solutions: A survey. Int. J. Gerontol. 8, 2 (2014), 49–55.

[34]

Qiang Lin, Daqing Zhang, Xiaodi Huang, Hongbo Ni, and Xingshe Zhou. 2012. Detecting wandering behavior based on GPS traces for elders with dementia. In 12th International Conference on Control Automation Robotics & Vision. IEEE, 672–677.

[35]

Qiang Lin, Weichao Zhao, and Weilan Wang. 2018. Detecting dementia-related wandering locomotion of elders by leveraging active infrared sensors. J. Comput. Commun. 6, 05 (2018), 94.

[36]

David Martino-Saltzman, Bruce B. Blasch, Robin D. Morris, and Lisa Wynn McNeal. 1991. Travel behavior of nursing home residents perceived as wanderers and nonwanderers. Gerontologist 31, 5 (1991), 666–672.

[37]

Ríona McArdle, Silvia Del Din, Brook Galna, Alan Thomas, and Lynn Rochester. 2020. Differentiating dementia disease subtypes with gait analysis: Feasibility of wearable sensors?Gait Post. 76 (2020), 372–376.

[38]

Mohamed F. Mokbel, Walid G. Aref, and Ibrahim Kamel. 2003. Analysis of multi-dimensional space-filling curves. GeoInformatica 7, 3 (2003), 179–209.

Digital Library

[39]

Joy Ng and Haixun Kong. 2016. Not all who wander are lost: Smart tracker for people with dementia. In CHI Conference Extended Abstracts on Human Factors in Computing Systems. 2241–2248.

Digital Library

[40]

Mervan Pašić. 2003. Minkowski–Bouligand dimension of solutions of the one-dimensional p-Laplacian. J. Different. Equat. 190, 1 (2003), 268–305.

[41]

Christopher Pereyda, Nisha Raghunath, Bryan David Minor, Garrett Wilson, Maureen Schmitter-Edgecombe, and Diane J. Cook. 2020. Cyber-physical support of daily activities: A robot/smart home partnership. ACM Trans. Cyber-phys. Syst. 4, 2 (2020), 21:1–21:24.

Digital Library

[42]

Ronald C. Petersen and John C. Morris. 2005. Mild cognitive impairment as a clinical entity and treatment target. Arch. Neurol. 62, 7 (2005), 1160–1163.

[43]

William H. Press and Saul A. Teukolsky. 1990. Savitzky-Golay smoothing filters. Comput. Phys. 4, 6 (1990), 669–672.

Digital Library

[44]

J. Ross Quinlan. 2014. C4.5: Programs for Machine Learning. Elsevier.

[45]

Parisa Rashidi, Diane J. Cook, Lawrence B. Holder, and Maureen Schmitter-Edgecombe. 2011. Discovering activities to recognize and track in a smart environment. IEEE Trans. Knowl. Data Eng. 23, 4 (2011), 527–539.

Digital Library

[46]

Daniele Riboni and Flavia Murru. 2020. Unsupervised recognition of multi-resident activities in smart-homes. IEEE Access 8 (2020), 201985–201994.

[47]

Irina Rish. 2001. An empirical study of the naive Bayes classifier. In IJCAI 2001 Workshop on Empirical Methods in Artificial Intelligence, Vol. 3. 41–46.

[48]

Adrian Sapio, Shuvra S. Bhattacharyya, and Marilyn Wolf. 2020. Runtime adaptation in wireless sensor nodes using structured learning. ACM Trans. Cyber-phys. Syst. 4, 4 (2020), 1–28.

Digital Library

[49]

Samer Schaat, Philipp Koldrack, Kristina Yordanova, Thomas Kirste, and Stefan Teipel. 2020. Real-time detection of spatial disorientation in persons with mild cognitive impairment and dementia. Gerontology 66, 1 (2020), 85–94.

[50]

Adriana M. Seelye, Maureen Schmitter-Edgecombe, Diane J. Cook, and Aaron Crandall. 2013. Naturalistic assessment of everyday activities and prompting technologies in mild cognitive impairment. J. Int. Neuropsychol. Societ. 19, 4 (2013), 442–452.

[51]

Sarah C. Seligman, Tania Giovannetti, John Sestito, and David J. Libon. 2014. A new approach to the characterization of subtle errors in everyday action: Implications for mild cognitive impairment. Clin. Neuropsychol. 28 (2014), 97–115.

[52]

John Shawe-Taylor and Nello Cristianini. 2000. Support Vector Machines. Vol. 2. Cambridge University Press Cambridge.

[53]

Pamela L. Sheridan, Judi Solomont, Neil Kowall, and Jeffrey M Hausdorff. 2003. Influence of executive function on locomotor function: Divided attention increases gait variability in Alzheimer’s disease. J. Amer. Geriat. Societ. 51, 11 (2003), 1633–1637.

[54]

John A. Stankovic. 2016. Research directions for cyber physical systems in wireless and mobile healthcare. ACM Trans. Cyber-phys. Syst. 1, 1 (2016), 1:1–1:12.

[55]

Marc Sumner, Eibe Frank, and Mark Hall. 2005. Speeding up logistic model tree induction. In European Conference on Principles of Data Mining and Knowledge Discovery. Springer, 675–683.

Digital Library

[56]

Richard Tolimieri, Myoung An, and Chao Lu. 2012. Mathematics of Multidimensional Fourier Transform Algorithms. Springer Science & Business Media.

[57]

Daniela De Venuto, Valerio F. Annese, Giovanni Mezzina, Floriano Scioscia, Michele Ruta, Eugenio Di Sciascio, and Alberto L. Sangiovanni-Vincentelli. 2018. A mobile health system for neurocognitive impairment evaluation based on P300 detection. ACM Trans. Cyber-phys. Syst. 2, 4 (2018), 31:1–31:21.

Digital Library

[58]

N. K. Vuong, Syin Chan, Chiew Tong Lau, and K. M. Lau. 2011. Feasibility study of a real-time wandering detection algorithm for dementia patients. In 1st ACM MobiHoc Workshop on Pervasive Wireless Healthcare. 1–4.

[59]

Fang Wang, Erik E. Stone, Marjorie Skubic, James M. Keller, Carmen Abbott, and Marilyn Rantz. 2013. Toward a passive low-cost in-home gait assessment system for older adults. IEEE J. Biomed. Health Inform. 17, 2 (2013), 346–355.

[60]

James Weimer, Radoslav Ivanov, Sanjian Chen, Alexander Roederer, Oleg Sokolsky, and Insup Lee. 2017. Parameter-invariant monitor design for cyber–physical systems. Proc. IEEE 106, 1 (2017), 71–92.

[61]

Bruce J. West and Nicola Scafetta. 2003. Nonlinear dynamical model of human gait. Phys. Rev. E 67, 5 (2003), 051917.

[62]

Marilyn Wolf and Dimitrios Serpanos. 2017. Safety and security in cyber-physical systems and internet-of-things systems. Proc. IEEE 106, 1 (2017), 9–20.

[63]

Yung-Hung Wu and Ya-Chen Lu. 2014. Qualitative research on the importance and need for home-based telecare services for elderly people. J. Clin. Gerontol. Geriat. 5, 4 (2014), 105–110.

[64]

Yuankun Xue and Paul Bogdan. 2017. Constructing compact causal mathematical models for complex dynamics. In 8th International Conference on Cyber-Physical Systems. 97–107.

Digital Library

[65]

Yuankun Xue, Sergio Pequito, Joana R. Coelho, Paul Bogdan, and George J. Pappas. 2016. Minimum number of sensors to ensure observability of physiological systems: A case study. In 54th Annual Allerton Conference on Communication, Control, and Computing (Allerton). IEEE, 1181–1188.

Digital Library

[66]

Yuankun Xue, Saul Rodriguez, and Paul Bogdan. 2016. A spatio-temporal fractal model for a CPS approach to brain-machine-body interfaces. In Design, Automation & Test in Europe Conference & Exhibition (DATE). IEEE, 642–647.

[67]

Cha Zhang and Yunqian Ma. 2012. Ensemble Machine Learning: Methods and Applications. Springer.

[68]

Samaneh Zolfaghari, Elham Khodabandehloo, and Daniele Riboni. 2021. TraMiner: Vision-based analysis of locomotion traces for cognitive assessment in smart-homes. Cog. Comput. (2021), 1–22.

Cited By

Zolfaghari SKristoffersson AFolke MLindén MRiboni D(2024)Unobtrusive Cognitive Assessment in Smart-Homes: Leveraging Visual Encoding and Synthetic Movement Traces Data MiningSensors10.3390/s2405138124:5(1381)Online publication date: 21-Feb-2024
https://doi.org/10.3390/s24051381
Zolfaghari SMassa SRiboni D(2023)Activity Recognition in Smart Homes via Feature-Rich Visual Extraction of Locomotion TracesElectronics10.3390/electronics1209196912:9(1969)Online publication date: 24-Apr-2023
https://doi.org/10.3390/electronics12091969
Zolfaghari SLoddo APes BRiboni D(2022)A Combination of Visual and Temporal Trajectory Features for Cognitive Assessment in Smart Home2022 23rd IEEE International Conference on Mobile Data Management (MDM)10.1109/MDM55031.2022.00078(343-348)Online publication date: Jun-2022
https://doi.org/10.1109/MDM55031.2022.00078

Index Terms

FreeSia: A Cyber-physical System for Cognitive Assessment through Frequency-domain Indoor Locomotion Analysis

Recommendations

Preventing Hospital Acquired Infections through a Workflow-based Cyber-physical System
ENASE 2016: Proceedings of the 11th International Conference on Evaluation of Novel Software Approaches to Software Engineering

Hospital acquired infections (HAI) are infections acquired within the hospital from healthcare workers, patients or from the environment, but which have no connection to the initial reason for the patientâ s hospital admission. HAI are a serious world-...
An Intelligent Coaching System for Therapy Adherence

A healthy lifestyle contributes to better health and helps diminish risks for chronic diseases, such as cardiovascular disease or diabetes. Moreover, people who have already developed a chronic illness often improve or minimize their symptoms by ...
PHR Based Diabetes Index Service Model Using Life Behavior Analysis

Due to our rapidly aging society, there has been an increasing need for preventive management of chronic diseases and management of individual health conditions. Among the chronic diseases, diabetes has become one of the most important illnesses in the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Cyber-Physical Systems

ACM Transactions on Cyber-Physical Systems Volume 6, Issue 2

April 2022

247 pages

ISSN:2378-962X

EISSN:2378-9638

DOI:10.1145/3530302

Editor:
Chenyang Lu
Washington University in St. Louis, USA

Issue’s Table of Contents

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Journal Family

ACM Journals for the Design of Smart and Connected Systems

Publication History

Published: 11 April 2022

Online AM: 04 February 2022

Accepted: 01 June 2021

Revised: 01 April 2021

Received: 01 August 2020

Published in TCPS Volume 6, Issue 2

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Refereed

Funding Sources

POR FESR Sardegna 2014-2020 project “MISTER: Match Information System and Technologies for the Evaluation of the Performance” and by project “ADAM”

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
410
Total Downloads

Downloads (Last 12 months)69
Downloads (Last 6 weeks)8

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Zolfaghari SKristoffersson AFolke MLindén MRiboni D(2024)Unobtrusive Cognitive Assessment in Smart-Homes: Leveraging Visual Encoding and Synthetic Movement Traces Data MiningSensors10.3390/s2405138124:5(1381)Online publication date: 21-Feb-2024
https://doi.org/10.3390/s24051381
Zolfaghari SMassa SRiboni D(2023)Activity Recognition in Smart Homes via Feature-Rich Visual Extraction of Locomotion TracesElectronics10.3390/electronics1209196912:9(1969)Online publication date: 24-Apr-2023
https://doi.org/10.3390/electronics12091969
Zolfaghari SLoddo APes BRiboni D(2022)A Combination of Visual and Temporal Trajectory Features for Cognitive Assessment in Smart Home2022 23rd IEEE International Conference on Mobile Data Management (MDM)10.1109/MDM55031.2022.00078(343-348)Online publication date: Jun-2022
https://doi.org/10.1109/MDM55031.2022.00078

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Full Text

View this article in Full Text.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View full text|Download PDF

View Issue’s Table of Contents