Abstract
This paper reports our work on the development and evaluation of a multimodal interactive guidance system for navigating elderly persons in hospital environments. A list of design guidelines has been proposed and implemented in our system, addressing the needs of designing a multimodal interfaces for elderly persons. Meanwhile, the central component of an interactive system, the dialogue manager, has been developed according to a unified dialogue modelling method, which combines the conventional recursive transition network based generalized dialogue models and the classic agent-based dialogue theory, and supported by a formal language based development toolkit. In order to evaluate the minutely developed multimodal interactive system, the touch and speech input modalities of the current system were evaluated by an elaborated experimental study with altogether 31 elderly. The overall positive results on the effectiveness, efficiency and user satisfaction of both modalities confirm our proposed guidelines, approaches and frameworks on interactive system development. Despite the slightly different results, there is no significant evidence for one preferred modality. Thus, further study of their combination is considered necessary.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Jaimes, A., Sebe, N.: Multimodal human-computer interaction: A survey. In: Computational Vision and Image Understanding, pp. 116–134. Elsevier Science Inc., New York (2007)
Oviatt, S.T.: Ten myths of multimodal interaction. Communications of the ACM 42(11), 74–81 (1999)
Holzinger, A., Mukasa, K.S., Nischelwitzer, A.K.: Introduction to the Special Thematic Session: Human–Computer Interaction and Usability for Elderly (HCI4AGING). In: Miesenberger, K., Klaus, J., Zagler, W.L., Karshmer, A.I. (eds.) ICCHP 2008. LNCS, vol. 5105, pp. 18–21. Springer, Heidelberg (2008)
Walker, M.A., Litman, D.J., Kamm, C.A., Kamm, A.A., Abella, A.: Paradise: a framework for evaluating spoken dialogue agents. In: Proceedings of the Eighth Conference on European Chapter of Association for Computational Linguistics, NJ, USA, pp. 271–280 (1997)
Morris, J.M.: User interface design for older adults. Interacting with Computers 6(4), 373–393 (1994)
Jian, C., Scharfmeister, F., Rachuy, C., Sasse, N., Shi, H., Schmidt, H., Steinbüchel-Rheinwll, N.V.: Towards Effective, Efficient and Elderly-friendly Multimodal Interaction. In: PETRA 2011: Proceedings of the 4th International Conference on PErvasive Technologies Related to Assistive Environments. ACM, New York (2011)
Fozard, J.L.: Vision and hearing in aging. In: Birren, J., Sloane, R., Cohen, G.D. (eds.) Handbook of Metal Health and Aging, vol. 3, pp. 18–21. Academic Press (1990)
Mackay, D., Abrams, L.: Language, memory and aging. In: Birren, J.E., Schaie, K.W. (eds.) Handbook of the Psychology of Aging, vol. 4, pp. 251–265. Academic Press (1996)
Moeller, S., Goedde, F., Wolters, M.: Corpus analysis of spoken smart-home interactions with older users. In: Calzolari, N., Choukri, K., Maegaard, B., Mariani, J., Odjik, J., Piperidis, S., Tapias, D. (eds.) Proceedings of the Sixth International Conference on Language Resources Association. ELRA (2008)
Kline, D.W., Scialfa, C.T.: Sensory and Perceptual Functioning: basic research and human factors implications. In: Fisk, A.D., Rogers, W.A. (eds.) Handbook of Human Factors and the Older Adult. Academic Press (1996)
Schieber, F.: Aging and the senses. In: Birren, J.E., Sloane, R.B., Cohen, G.D. (eds.) Handbook of Mental Health and Aging, vol. 2. Academic Press (1992)
Walkder, N., Philbin, D.A., Fisk, A.D.: Age-related differences in movement control: adjust submovement structure to optimize performance. Journal of Gerontology: Psychological Sciences 52B, 40–52 (1997)
Charness, N., Bosman, E.: Human Factors and Design. In: Birren, J.E., Schaie, K.W. (eds.) Handbook of the Psychology of Aging, vol. 3, pp. 446–463. Academic Press (1990)
Kotary, L., Hoyer, W.J.: Age and the ability to inhibit distractor information in visual selective attention. Experimental Aging Research 21(2) (1995)
McDowd, J.M., Craik, F.: Effects of aging and task difficulty on divided attention performance. Journal of Experimental Psychology: Human Perception and Performance 14, 267–280 (1988)
Hoyer, W.J., Rybash, J.M.: Age and visual field differences in computing visual spatial relations. Psychology and Aging 7, 339–342 (1992)
Salthouse, T.A.: The aging of working memory. Neuropsychology 8, 535–543 (1994)
Craik, F., Jennings, J.: Human memory. In: Craik, F., Salthouse, T.A. (eds.) The Handbook of Aging and Cognition, pp. 51–110. Erlbaum (1992)
Shaie, K.W.: Intellectual development in adulthood. In: Birren, J.E., Shaie, K.W. (eds.) Handbook of the Psychology of Aging, vol. 4. Academic Press (1996)
Sitter, S., Stein, A.: Modelling the illocutionary aspects of information-seeking dialogues. Journal of Information Processing and Management 28(2), 165–180 (1992)
Traum, D., Larsson, S.: The information state approach to dialogue management. In: van Kuppevelt, J., Smith, R. (eds.) Current and New Directions in Discourse and Dialogue, pp. 325–354. Kluwer (2003)
Ross, J.R., Bateman, J., Shi, H.: Using Generalized Dialogue Models to Constrain Information State Based Dialogue Systems. In: Symposium on Dialogue Modelling and Generation (2005)
Alston, P.W.: Illocutionary acts and sentence meaning. Cornell University Press (2000)
Roscoe, A.W.: The Theory and Practice of Concurrency. Prentice Hall (1997)
Hall, A., Chapman, R.: Correctness by construction: Developing a commercial secure system. IEEE Software 19(1), 18–25 (2002)
Shi, H., Bateman, J.: Developing human-robot dialogue management formally. In: Proceedings of Symposium on Dialogue Modelling and Generation, Amsterdam, Netherlands (2005)
Broadfoot, P., Roscoe, B.: Tutorial on FDR and Its Applications. In: Havelund, K., Penix, J., Visser, W. (eds.) SPIN 2000. LNCS, vol. 1885, p. 322. Springer, Heidelberg (2000)
Folstein, M., Folstein, S., Mchugh, P.: “Mini-mental state”, a practical method for grading the cognitive state of patients for clinician. Journal of Psychiatric Research 12(3), 189–198 (1975)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Jian, C. et al. (2013). Touch and Speech: Multimodal Interaction for Elderly Persons. In: Gabriel, J., et al. Biomedical Engineering Systems and Technologies. BIOSTEC 2012. Communications in Computer and Information Science, vol 357. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-38256-7_26
Download citation
DOI: https://doi.org/10.1007/978-3-642-38256-7_26
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-38255-0
Online ISBN: 978-3-642-38256-7
eBook Packages: Computer ScienceComputer Science (R0)