Hostname: page-component-8448b6f56d-sxzjt Total loading time: 0 Render date: 2024-04-23T20:32:03.994Z Has data issue: false hasContentIssue false
  • English
  • Français

Data analysis from cognitive games interaction in Smart TV applications for patients with Parkinson's, Alzheimer's, and other types of dementia

Published online by Cambridge University Press:  31 December 2019

Juan Pedro López Open the ORCID record for Juan Pedro López [Opens in a new window] ,
Francisco Moreno ,
Mirela Popa ,
Gustavo Hernández-Peñaloza  and
Federico Álvarez
Juan Pedro López*
Affiliation:
Grupo de Aplicación de Telecomunicaciones Visuales, Escuela Técnica Superior de Ingenieros de Telecomunicación, Universidad Politécnica de Madrid, 28040Madrid, Spain
Francisco Moreno
Affiliation:
Grupo de Aplicación de Telecomunicaciones Visuales, Escuela Técnica Superior de Ingenieros de Telecomunicación, Universidad Politécnica de Madrid, 28040Madrid, Spain
Mirela Popa
Affiliation:
Department of Data Science and Knowledge Engineering, Faculty of Science and Engineering, 6200 MD Maastricht, The Netherlands
Gustavo Hernández-Peñaloza
Affiliation:
Grupo de Aplicación de Telecomunicaciones Visuales, Escuela Técnica Superior de Ingenieros de Telecomunicación, Universidad Politécnica de Madrid, 28040Madrid, Spain
Federico Álvarez
Affiliation:
Grupo de Aplicación de Telecomunicaciones Visuales, Escuela Técnica Superior de Ingenieros de Telecomunicación, Universidad Politécnica de Madrid, 28040Madrid, Spain
*
Author for correspondence: Juan Pedro López, E-mail: juanpelopez@gmail.com
Get access Rights & Permissions [Opens in a new window]

Abstract

Parkinson's disease and Alzheimer's disease are progressive nervous system disorders that affect physical and cognitive capacities of individuals, including memory loss, motion impairment, or problem-solving dysfunctions. Leisure activities are associated with reducing the risk of dementia and are preventive policies for delaying the cognitive impairment in later stages of those neurodegenerative diseases. Electronic games related to cognitive abilities are an easy and inexpensive alternative for stimulating brain activity in this kind of patients. The previous research demonstrated the acceptance of these activities in the environment of Connected TV when playing at home and in daily care centers. Interaction in Connected TV applications has its own particularities that influence the design of the interface, including the viewing distance, the type of interaction through a remote control or other techniques, the size of the screen, or the collectiveness of consumption. Iterative testing with patients of these groups revealed how the physical characteristics and cognitive impairment of these concrete end-users affect the human–computer interaction, offering guidelines and recommendations in good practices for the Smart TV interface design. On the other hand, data analytics extracted from the interaction and evolution of the game offer important information enabling the creation of estimation prediction models about the cognitive state of the patient.

Keywords

Alzheimer'scognitive gamesdata analysisHCIParkinson'sSmart TV
Type
Research Article
Information
AI EDAM , Volume 33 , Special Issue 4: Intelligent Interaction Design , November 2019 , pp. 442 - 457
Copyright
Copyright © Cambridge University Press 2019

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Aarsland, D, Kvaløy, J, Andersen, K, Larsen, J, Tang, M, Lolk, A and Marder, K (2007) The effect of age of onset of PD on risk of dementia. Journal of Neurology 254, 38–45.CrossRefGoogle Scholar
Akbaraly, T, Portet, F, Fustinoni, S, Dartigues, JF, Artero, S, Rouaud, O and Berr, C (2009) Leisure activities and the risk of dementia in the elderly results from the three-city study. Neurology 73, 854–861.CrossRefGoogle ScholarPubMed
Alam, I, Khusro, S and Naeem, M (2017) A review of smart TV: past, present, and future. Proceedings of the International Conference on Open Source Systems and Technologies (ICOSST’ 2017), Lahore, Pakistan, 18–20 December 2017, pp. 35–41.Google Scholar
Alzheimer's Association (2018) 2018 Alzheimer's Disease Facts and Figures Report. Available at https://www.alz.org.Google Scholar
Baker, I (1999) Safe areas for widescreen transmission. EBU Technical Review 280, 35–38.Google Scholar
Ball, K, Berch, DB, Helmers, KF, Jobe, JB, Leveck, MD, Marsiske, M and Unverzagt, FW (2002) Effects of cognitive training interventions with older adults: a randomized controlled trial. JAMA 288, 2271–2281.CrossRefGoogle ScholarPubMed
Biundo, R, Weis, L and Antonini, A (2016) Cognitive decline in Parkinson's disease: the complex picture. NPJ Parkinson's Disease 2, 16018.CrossRefGoogle ScholarPubMed
Boot, WR (2015) Video games as tools to achieve insight into cognitive processes. Frontiers in Psychology 6, 3.CrossRefGoogle ScholarPubMed
Boy, GA (2017) The Handbook of Human-Machine Interaction: A Human-Centered Design Approach. Boca Raton, FL: CRC Press, Taylor & Francis.CrossRefGoogle Scholar
Choudhary, N (2017) Top 6 key considerations when developing smart TV application. Available at http://www.tothenew.com/Blog/Top-6-Key-Considerations-When-Developing-Smart-Tv-Application/.Google Scholar
Crawford, TJ (2015) The disengagement of visual attention in Alzheimer's disease: a longitudinal eye-tracking study. Frontiers in Aging Neuroscience 7, 118.CrossRefGoogle ScholarPubMed
Depp, CA, Schkade, DA, Thompson, WK and Jeste, DV (2010) Age, affective experience, and television use. American Journal of Preventive Medicine 39, 173–178.CrossRefGoogle ScholarPubMed
DIS (2009) 9241-210: 2010. Ergonomics of Human System Interaction-Part 210: Human-Centred Design for Interactive Systems, Switzerland: International Standardization Organization (ISO).Google Scholar
D'Onofrio, G, Sancarlo, D, Ricciardi, F, Ruan, Q, Yu, Z, Giuliani, F and Greco, A (2016) Cognitive stimulation and information communication technologies (ICT) in Alzheimer's disease: a systematic review. International Journal of Medical and Biological Frontiers 22, 97.Google Scholar
Espay, AJ, Bonato, P, Nahab, FB, Maetzler, W, Dean, JM, Klucken, J and Reilmann, R (2016) Technology in Parkinson's disease: challenges and opportunities. Movement Disorders 31, 1272–1282.CrossRefGoogle ScholarPubMed
Galna, B, Barry, G, Jackson, D, Mhiripiri, D, Olivier, P and Rochester, L (2014) Accuracy of the Microsoft Kinect sensor for measuring movement in people with Parkinson's disease. Gait & Posture 39, 1062–1068.CrossRefGoogle ScholarPubMed
García Vázquez, C, Moreno Martínez, E, Valero Duboy, MÁ, Martínez Juez, MT and Torre Calero, MS (2013) Servicio ubicuo de estimulación cognitiva orientado a personas con enfermedad de Parkinson. XI Jornadas de Ingeniería Telemática (JITEL 2013). Granada 28–30octubre, 28/10/2013 - 30/10/2013, Granada, pp. 273–280.Google Scholar
Green, J, McDonald, W, Vitek, J, Evatt, M, Freeman, A, Haber, M and DeLong, M (2002) Cognitive impairments in advanced PD without dementia. Neurology 59, 1320–1324.CrossRefGoogle ScholarPubMed
Guerreiro, T, Nicolau, H, Jorge, J and Gonçalves, D (2010) Towards accessible touch interfaces. Proceedings of ACM SIGACCESSconference on Computers and Accessibility (ASSETS ’10), Orlando, Florida, October 25–27, 2010, pp. 19–26.CrossRefGoogle Scholar
Halbrügge, M, Quade, M and Engelbrecht, K-P (2015) How can cognitive modeling benefit from ontologies? Evidence from the HCI domain. International Conference on Artificial General Intelligence. Springer, pp. 261–271.CrossRefGoogle Scholar
Hall, CB, Lipton, RB, Sliwinski, M, Katz, MJ, Derby, CA and Verghese, J (2009) Cognitive activities delay decline in persons who develop dementia. Neurology 73, 356–361.CrossRefGoogle ScholarPubMed
Helms, JW, Arthur, JD, Hix, D and Rex Hartson, H (2006) A field study of the wheel—a usability engineering process model. Journal of Systems and Software 79, 841–858. doi:10.1016/j.jss.2005.08.023.CrossRefGoogle Scholar
ICT4LIFE Consortium (2016) ICT4LIFE: ICT services for life improvement for the elderly. Available at http://ict4life.eu/Google Scholar
Javor, A, Ransmayr, G, Struhal, W and Riedl, R (2016) Parkinson patients’ initial trust in avatars: theory and evidence. PLoS One 11, e0165998.CrossRefGoogle ScholarPubMed
Jeong, S and Kim, H (2018) Appropriate size, spacing, expansion ratio, and location for clickable elements on smart TVs with remote motion control. International Journal of Industrial Ergonomics 64, 213–225.CrossRefGoogle Scholar
Karp, A, Paillard-Borg, S, Wang, H-X, Silverstein, M, Winblad, B and Fratiglioni, L (2006) Mental, physical and social components in leisure activities equally contribute to decrease dementia risk. Dementia and Geriatric Cognitive Disorders 21, 65–73.CrossRefGoogle ScholarPubMed
Keates, S and Trewin, S (2005) Effect of age and Parkinson's disease on cursor positioning using a mouse. Proceedings of the 7th International ACM Sigaccess Conference on Computers and Accessibility. ACM, Baltimore, MD, USA, October 9–12, 2005, pp. 68–75.Google Scholar
Khanom, S, Heimbürger, A and Kärkkäinen, T (2014) Icon recognition and usability for requirements engineering. Frontiers in Artificial Intelligence and Applications, 272, 192–204.Google Scholar
Lafferty, M (2016) Designing for television. Part 1: an introduction to the basic ingredients of a TV UI. Available at https://Medium.com/This-Also/Designing-for-Television-Part-1-54508432830f.Google Scholar
Laudate, TM, Neargarder, S, Dunne, TE, Sullivan, KD, Joshi, P, Gilmore, GC and Cronin-Golomb, A (2012) Bingo! Externally supported performance intervention for deficient visual search in normal aging, Parkinson's disease, and Alzheimer's disease. Aging, Neuropsychology, and Cognition 19, 102–121.CrossRefGoogle ScholarPubMed
Lazar, J, Feng, JH and Hochheiser, H (2017) Research Methods in Human-Computer Interaction. Cambridge, MA, United States: Morgan Kaufmann.Google Scholar
Li, N and Chen, W (2017) A mobile game for the social and cognitive well-being of elderly people in China. Studies in Health Technology and Informatics 242, 614–621.Google Scholar
Lopez, JP, Martín, D, Moreno, F, Hernández-Peñaloza, G, Álvarez, F, Marín, M and Burgos, M (2018) Acceptance of cognitive games through smart TV applications in patients with Parkinson's disease. Proceedings of the 11th Pervasive Technologies Related to Assistive Environments Conference, ACM. Corfu, Greece, June 26–29, 2018, pp. 428–433. doi:10.1145/3197768.3201553.CrossRefGoogle Scholar
Medina, M, Herrero, M and Guerrero, E (2015) Audience behaviour and multiplatform strategies: the path towards connected TV in Spain. Austral Comunicación 4(1), 153–172.Google Scholar
Moorthy, U and Gandhi, UD (2018) HCI Challenges and Privacy Preservation in Big Data Security. Hershey, Pennsylvania, USA: IGI Global, pp. 95–123.CrossRefGoogle Scholar
Nunes, F, Silva, PA, Cevada, J, Barros, AC and Teixeira, L (2016) User interface design guidelines for smartphone applications for people with Parkinson's disease. Universal Access in the Information Society 15, 659–679.CrossRefGoogle Scholar
Olesen, J, Gustavsson, A, Svensson, M, Wittchen, H-U and Jönsson, B (2012) The economic cost of brain disorders in Europe. European Journal of Neurology 19, 155–162.CrossRefGoogle Scholar
Parkinson's Disease Foundation (2018) Understanding Parkinson's: Statistics. Available at https://www.parkinson.org.Google Scholar
Pino, M, Boulay, M, Jouen, F and Rigaud, AS (2015) “Are we ready for robots that care for us?” Attitudes and opinions of older adults toward socially assistive robots. Frontiers in Aging Neuroscience 7, 141.CrossRefGoogle ScholarPubMed
Pirog, M (2018) The economics and policy ramifications of an aging population: ramifications of an ageing population. Contemporary Economic Policy 36, 431–434. doi:10.1111/coep.12389.CrossRefGoogle Scholar
Prince, M, Comas-Herrera, A, Knapp, M, Guerchet, M and Karagiannidou, M (2016) World Alzheimer Report 2016: Improving Healthcare for People Living with Dementia: Coverage, Quality and Costs Now and in the Future.Google Scholar
Robert, P, König, A, Amieva, H, Andrieu, S, Bremond, F, Bullock, R and Nave, S (2014) Recommendations for the use of serious games in people with Alzheimer's disease, related disorders and frailty. Frontiers in Aging Neuroscience 6, 54.CrossRefGoogle ScholarPubMed
Rogers, Y, Sharp, H and Preece, J (2011) Interaction Design: Beyond Human-Computer Interaction. John Wiley & Sons.Google Scholar
Sakamoto, K, Aoyama, S, Asahara, S, Yamashita, K and Okada, A (2009) Evaluation of viewing distance vs. TV size on visual fatigue in a home viewing environment. Digest of Technical Papers 2009 International Conference on Consumer Electronics (ICCE'09). IEEE, Las Vegas (USA), 2009, pp. 1–2.Google Scholar
Sanders, A and Verghese, J (2007) Leisure activities and the risk of dementia in the elderly. Research and Practice in Alzheimer's Disease 12, 54–58.Google Scholar
Scarmeas, N, Levy, G, Tang, M-X, Manly, J and Stern, Y (2001) Influence of leisure activity on the incidence of Alzheimer's disease. Neurology 57, 2236–2242.CrossRefGoogle ScholarPubMed
Serino, S, Morganti, F, Di Stefano, F and Riva, G (2015) Detecting early egocentric and allocentric impairments deficits in Alzheimer's disease: an experimental study with virtual reality. Frontiers in Aging Neuroscience 7, 88.CrossRefGoogle ScholarPubMed
Seungho, P, Yoojin, L and Tomimatsu, K (2018) Design proposal for smart TV interface and remote controller. International Journal of Asia Digital Art and Design Association 22, 1–13.Google Scholar
Sobel, BP (2001) Bingo vs. Physical intervention in stimulating short-term cognition in Alzheimer's disease patients. American Journal of Alzheimer's Disease & Other Dementias 16, 115–120.CrossRefGoogle ScholarPubMed
Tomlinson, CL, Patel, S, Meek, C, Herd, CP, Clarke, CE, Stowe, R and Ives, N (2012) Physiotherapy intervention in Parkinson's disease: systematic review and meta-analysis. BMJ 345, e5004.CrossRefGoogle ScholarPubMed
Verghese, J, Lipton, RB, Katz, MJ, Hall, CB, Derby, CA, Kuslansky, G and Buschke, H (2003) Leisure activities and the risk of dementia in the elderly. New England Journal of Medicine 348, 2508–2516.CrossRefGoogle ScholarPubMed
Vieira, D, Freitas, JD, Acartürk, C, Teixeira, A, Sousa, L, Silva, S and Dias, MS (2015) Read that article: Exploring synergies between gaze and speech interaction. Proceedings of the 17th International ACM Sigaccess Conference on Computers & Accessibility. ACM, Lisbon, Portugal, October 26–28, 2015, pp. 341–342.Google Scholar
W3C Web Accessibility Initiative (WAI) (n.d.) Introduction to web accessibility. Available at https://www.w3.org/WAI/Fundamentals/Accessibility-Intro/Google Scholar
Wang, S-M and Huang, C-J (2015) Service design for developing multimodal human computer interaction for smart TVs. International Journal of Advanced Computer Science and Applications 6, 227–234.CrossRefGoogle Scholar
Wilson, RS, De Leon, CFM, Barnes, LL, Schneider, JA, Bienias, JL, Evans, DA and Bennett, DA (2002) Participation in cognitively stimulating activities and risk of incident Alzheimer disease. JAMA 287, 742–748.CrossRefGoogle ScholarPubMed
Winblad, B, Amouyel, P, Andrieu, S, Ballard, C, Brayne, C, Brodaty, H and Fratiglioni, L (2016) Defeating Alzheimer's disease and other dementias: a priority for European Science and Society. The Lancet Neurology 15, 455–532.CrossRefGoogle ScholarPubMed
World Health Organization (2015) First Who Ministerial Conference on Global Action Against Dementia, Geneva, Switzerland, 16–17 March 2015.Google Scholar