Richard Chen
ABSTRACT
The ubiquity and remarkable technological progress of wearable consumer devices and mobile-computing platforms (smart phone, smart watch, tablet), along with the multitude of sensor modalities available, have enabled continuous monitoring of patients and their daily activities. Such rich, longitudinal information can be mined for physiological and behavioral signatures of cognitive impairment and provide new avenues for detecting MCI in a timely and cost-effective manner. In this work, we present a platform for remote and unobtrusive monitoring of symptoms related to cognitive impairment using several consumer-grade smart devices. We demonstrate how the platform has been used to collect a total of 16TB of data during the Lilly Exploratory Digital Assessment Study, a 12-week feasibility study which monitored 31 people with cognitive impairment and 82 without cognitive impairment in free living conditions. We describe how careful data unification, time-alignment, and imputation techniques can handle missing data rates inherent in real-world settings and ultimately show utility of these disparate data in differentiating symptomatics from healthy controls based on features computed purely from device data.
- Joaquin A Anguera, Jacqueline Boccanfuso, James L Rintoul, Omar Al-Hashimi, Farhoud Faraji, Jacqueline Janowich, Eric Kong, Yudy Larraburo, Christine Rolle, and Eric Johnston. 2013. Video game training enhances cognitive control in older adults. Nature 501, 7465 (2013), 97--101.Google Scholar
- Rabeea'hWAslam, Vickie Bates, Yenal Dundar, Juliet Hounsome, Marty Richardson, Ashma Krishan, Rumona Dickson, Angela Boland, Joanne Fisher, Louise Robinson, et al. 2018. A systematic review of the diagnostic accuracy of automated tests for cognitive impairment. International journal of geriatric psychiatry 33, 4 (2018), 561--575.Google Scholar
- Russell M Bauer, Grant L Iverson, Alison N Cernich, Laurence M Binder, Ronald M Ruff, and Richard I Naugle. 2012. Computerized neuropsychological assessment devices: joint position paper of the American Academy of Clinical Neuropsychology and the National Academy of Neuropsychology. The Clinical Neuropsychologist 26, 2 (2012), 177--196.Google ScholarCross Ref
- James Bergstra, Dan Yamins, and David D Cox. 2013. Hyperopt: A python library for optimizing the hyperparameters of machine learning algorithms. In Proceedings of the 12th Python in Science Conference. Citeseer, 13--20.Google ScholarCross Ref
- Andrea Bradford, Mark E Kunik, Paul Schulz, Susan P Williams, and Hardeep Singh. 2009. Missed and delayed diagnosis of dementia in primary care: prevalence and contributing factors. Alzheimer disease and associated disorders 23, 4 (2009), 306.Google ScholarCross Ref
- Zhengping Che, Sanjay Purushotham, Kyunghyun Cho, David Sontag, and Yan Liu. 2018. Recurrent neural networks for multivariate time series with missing values. Scientific reports 8, 1 (2018), 6085.Google Scholar
- Irene Chen, Fredrik D Johansson, and David Sontag. 2018. Why Is My Classifier Discriminatory? arXiv preprint arXiv:1805.12002 (2018). Google ScholarDigital Library
- Tianqi Chen and Carlos Guestrin. 2016. Xgboost: A scalable tree boosting system. In Proceedings of the 22nd acm sigkdd international conference on knowledge discovery and data mining. ACM, 785--794. Google ScholarDigital Library
- Clinical Trials Transformation Initiative (CTTI). 2018. CTTI Recommendations: Advancing the Use of Mobile Technologies for Data Capture & Improved Clinical Trials - Data Flow Diagram. www.ctti-clinicaltrials.org/sites/www.ctti-clinicaltrials.org/files/data-flow-diagram.pdfGoogle Scholar
- Bruce N Cuthbert. 2019. The PRISM project: Social withdrawal from an RDoC perspective. Neuroscience & Biobehavioral Reviews (2019), 34--37.Google Scholar
- E Ray Dorsey, Michael V McConnell, Stanley Y Shaw, Andrew D Trister, Stephen H Friend, et al. 2017. The use of smartphones for health research. Academic Medicine 92, 2 (2017), 157--160.Google ScholarCross Ref
- Marshal F. Folstein, Susan E. Folstein, and Paul R. McHugh. 1975. "Mini-mental state": A practical method for grading the cognitive state of patients for the clinician. Journal of Psychiatric Research 12, 3 (1975), 189 -- 198.Google ScholarCross Ref
- US Food and Drug Administration (FDA). 2018. FDA launches new digital tool to help capture real world data from patients to help inform regulatory decisionmaking. www.fda.gov/NewsEvents/Newsroom/FDAInBrief/ucm625228.htmGoogle Scholar
- US Food and Drug Administration (FDA). 2018. Framework for FDA's Real-World Evidence Program. www.fda.gov/downloads/ScienceResearch/SpecialTopics/RealWorldEvidence/UCM627769.pdfGoogle Scholar
- Timnit Gebru, Jamie Morgenstern, Briana Vecchione, JenniferWortman Vaughan, HannaWallach, Hal Daumeé III, and Kate Crawford. 2018. Datasheets for Datasets. arXiv preprint arXiv:1803.09010 (2018).Google Scholar
- Marzyeh Ghassemi, Tristan Naumann, Peter Schulam, Andrew L Beam, and Rajesh Ranganath. 2018. Opportunities in Machine Learning for Healthcare. arXiv preprint arXiv:1806.00388 (2018).Google Scholar
- Terry E Goldberg, Philip D Harvey, Keith A Wesnes, Peter J Snyder, and Lon S Schneider. 2015. Practice effects due to serial cognitive assessment: implications for preclinical Alzheimer's disease randomized controlled trials. Alzheimer's & Dementia: Diagnosis, Assessment & Disease Monitoring 1, 1 (2015), 103--111.Google ScholarCross Ref
- David Hallac, Sagar Vare, Stephen Boyd, and Jure Leskovec. 2017. Toeplitz inverse covariance-based clustering of multivariate time series data. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 215--223. Google ScholarDigital Library
- S. Hoops, S. Nazem, A. D. Siderowf, J. E. Duda, S. X. Xie, M. B. Stern, and D. Weintraub. 2009. Validity of the MoCA and MMSE in the detection of MCI and dementia in Parkinson disease. Neurology 73, 21 (2009), 1738--1745.Google ScholarCross Ref
- Diane Howieson. 2019. Current limitations of neuropsychological tests and assessment procedures. The Clinical Neuropsychologist 0, 0 (2019), 1--9.Google Scholar
- Clifford R. Jack, Marilyn S. Albert, David S. Knopman, Guy M. McKhann, Reisa A. Sperling, Maria C. Carrillo, Bill Thies, and Creighton H. Phelps. 2011. Introduction to the recommendations from the National Institute on Aging-Alzheimer's Association workgroups on diagnostic guidelines for Alzheimer's disease. Alzheimer's & Dementia 7, 3 (may 2011), 257--262.Google ScholarCross Ref
- Jeffrey A Kaye, Shoshana A Maxwell, Nora Mattek, Tamara L Hayes, Hiroko Dodge, Misha Pavel, Holly B Jimison, Katherine Wild, Linda Boise, and Tracy A Zitzelberger. 2011. Intelligent systems for assessing aging changes: home-based, unobtrusive, and continuous assessment of aging. Journals of Gerontology Series B: Psychological Sciences and Social Sciences 66, suppl_1 (2011), i180--i190.Google ScholarCross Ref
- Lampros C Kourtis, Oliver B Regele, Justin M Wright, and Graham Jones. 2019. Digital biomarkers for Alzheimer's disease: the mobile/wearable devices opportunity. NPJ Digital Medicine (2019).Google Scholar
- C. Leurent, E. Pickering, J. Goodman, S. Duvvuri, P. He, E. Martucci, S. Kellogg, D. Purcell, J. Barakos, G. Klein, JW. Kupiec, and R. Alexander. 2016. A Randomized, Double-Blind, Placeo Controlled Trial to Study Difference in Cognitive Learning Associated with Repeated Self-administration of Remote Computer Tablet-based Application Assessing Dual Task Performance Based on Amyloid Status in Healthy Elderly Volunteers. 4 (2016), 280--281.Google Scholar
- Jia Li, Yu Rong, Helen Meng, Zhihui Lu, Timothy Kwok, and Hong Cheng. 2018. TATC: Predicting Alzheimer's Disease with Actigraphy Data. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. ACM, 509--518. Google ScholarDigital Library
- Zachary C Lipton, David C Kale, Charles Elkan, and Randall Wetzel. 2015. Learning to diagnose with LSTM recurrent neural networks. arXiv preprint arXiv:1511.03677 (2015).Google Scholar
- Yun Liu, Krishna Gadepalli, Mohammad Norouzi, George E Dahl, Timo Kohlberger, Aleksey Boyko, Subhashini Venugopalan, Aleksei Timofeev, Philip Q Nelson, Greg S Corrado, et al. 2017. Detecting cancer metastases on gigapixel pathology images. arXiv preprint arXiv:1703.02442 (2017).Google Scholar
- Scott M Lundberg and Su-In Lee. 2017. A unified approach to interpreting model predictions. In Advances in Neural Information Processing Systems. 4765--4774. Google ScholarDigital Library
- P. Maruff, E. Thomas, L. Cysique, B. Brew, A. Collie, P. Snyder, and R. H. Pietrzak. 2009. Validity of the CogState Brief Battery: Relationship to Standardized Tests and Sensitivity to Cognitive Impairment in Mild Traumatic Brain Injury, Schizophrenia, and AIDS Dementia Complex. Archives of Clinical Neuropsychology 24, 2 (mar 2009), 165--178.Google ScholarCross Ref
- Manuel M Montero-Odasso, Yanina Sarquis-Adamson, Mark Speechley, Michael J Borrie, Vladimir C Hachinski, Jennie Wells, Patricia M Riccio, Marcelo Schapira, Ervin Sejdic, Richard M Camicioli, et al. 2017. Association of dual-task gait with incident dementia in mild cognitive impairment: results from the gait and brain study. JAMA neurology 74, 7 (2017), 857--865.Google Scholar
- Ziad S. Nasreddine, Natalie A. Phillips, Valérie Bédirian, Simon Charbonneau, Victor Whitehead, Isabelle Collin, Jeffrey L. Cummings, and Howard Chertkow. 2005. The Montreal Cognitive Assessment, MoCA: A Brief Screening Tool For Mild Cognitive Impairment. Journal of the American Geriatrics Society 53, 4 (2005), 695--699.Google ScholarCross Ref
- World Health Organization et al. 2017. Global action plan on the public health response to dementia 2017--2025. (2017).Google Scholar
- Emma Pierson, Tim Althoff, and Jure Leskovec. 2018. Modeling Individual Cyclic Variation in Human Behavior. In Proceedings of the 2018 World Wide Web Conference on World Wide Web. International World Wide Web Conferences Steering Committee, 107--116. Google ScholarDigital Library
- Tom Quisel, Luca Foschini, Alessio Signorini, and David C Kale. 2017. Collecting and analyzing millions of mhealth data streams. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 1971--1980. Google ScholarDigital Library
- Takaya Saito and Marc Rehmsmeier. 2015. The precision-recall plot is more informative than the ROC plot when evaluating binary classifiers on imbalanced datasets. PloS one 10, 3 (2015), e0118432.Google ScholarCross Ref
- G Stringer, S Couth, LJE Brown, D Montaldi, A Gledson, et al. 2018. Can you detect early dementia from an email? A proof of principle study of daily computer use to detect cognitive and functional decline. International Journal of Geriatric Psychiatry 33 (2018), 867--874.Google ScholarCross Ref
- Matei Zaharia, Reynold S Xin, Patrick Wendell, Tathagata Das, Michael Armbrust, Ankur Dave, Xiangrui Meng, Josh Rosen, Shivaram Venkataraman, Michael J Franklin, et al. 2016. Apache spark: a unified engine for big data processing. Commun. ACM 59, 11 (2016), 56--65. Google ScholarDigital Library
Index Terms
- Developing Measures of Cognitive Impairment in the Real World from Consumer-Grade Multimodal Sensor Streams
Recommendations
Modelling cognitive impairment to improve universal access
UAHCI'11: Proceedings of the 6th international conference on Universal access in human-computer interaction: users diversity - Volume Part IIThe purpose of this study is to develop a model of cognitive impairment to help designers consider the range of issues which affect the lives of people living with such impairment. A series of interviews with experts of cognitive impairment was ...
An agent for simulating cognitive impairment in elders: work in progress
ADS '14: Proceedings of the 2014 Symposium on Agent Directed SimulationAssistive technologies for cognition are designed to help elders with various forms of cognitive impairment maintain an independent style of living for as long as possible. This work discusses the use of an agent simulation to model the behaviors of an ...
Navigation and obstacle avoidance help (NOAH) for older adults with cognitive impairment: a pilot study
ASSETS '11: The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibilityMany older adults with cognitive impairment are excluded from powered wheelchair use because of safety concerns. This leads to reduced mobility, and in turn, higher dependence on caregivers. In this paper, we describe an intelligent wheelchair that uses ...
Comments