Skip to main content
SpringerLink
Log in
Book cover

International Joint Conference on Biomedical Engineering Systems and Technologies

BIOSTEC 2013: Biomedical Engineering Systems and Technologies pp 378–393Cite as

Modality Preference in Multimodal Interaction for Elderly Persons

  • Conference paper
  • First Online:

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 452))

Abstract

This paper is focusing on two important aspects: on the one hand, it presents our work on designing, developing and implementing a multimodal interactive guidance system for elderly persons to be used in autonomous navigation within complex building; on the other hand, it summaries and compares the data of a series of empirical studies that have been conducted to evaluate the effectiveness, efficiency and user satisfaction of the elderly-centered multimodal interactive system regarding different multimodal input-possibilities such as speech, gesture via touch-screen and the combination of both under simulated conditions. The overall positive results validated our systematically developed and empirically improved design guidelines, foundations, models and frameworks for supporting multimodal interaction for elderly persons.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Oviatt, S.: Multimodal Interfaces. In: Jacko, J.A., Sears, A. (eds.) The Human-Computer Interaction Handbook, pp. 286–304. L. Erlbaum Associates Inc., Hillsdale (2002)

    Google Scholar 

  2. Jaimes, A., Sebe, N.: Multimodal human-computer interaction: a survey. In: Sebe, N., Lew, M., Huang, T. (eds.) Computational Vision and Image Understanding, pp. 116–134. Elsevier Science Inc., New York (2007)

    Google Scholar 

  3. Goldin-Meadow, S.: Hearing Gesture: How Our Hands Help Us Think. Harvard University Press, Cambridge (2005)

    Google Scholar 

  4. Kendon, A.: Gesture: Visible Action as Utterance. Cambridge University Press, Cambridge (2004)

    Google Scholar 

  5. Vitense, H.S., Jacko, J.A., Emery, V.K.: Multimodal feedback: establishing a performance baseline for improved access by individuals with visual impairments. In: Proceedings of the Fifth International ACM Conference on Assistive Technologies (Assets’02), pp. 49–56. ACM, New York (2002)

    Google Scholar 

  6. Reeves, L.M., Lai, J., Larson, J.A., Oviatt, S., Balaji, T.S., Buisine, S., Collings, P., Cohen, P., Kraal, B., Martin, J.-C., McTear, M., Raman, T.V., Stanney, K.M., Su, H., Wang, Q.Y.: Guidelines for multimodal user interface design. Commun. ACM – Multimodal Interfaces that Flex, Adapt, and Persist 47(1), 57–59 (2004). ACM, New York

    Google Scholar 

  7. Lutz, W., Sanderson, W., Scherbov, S.: The coming acceleration of global population ageing. Nature 451, 716–719 (2008). International Institute for Applied Systems Analysis, Laxenburg

    Article  Google Scholar 

  8. D’Andrea, A., D’Ulizia, A., Ferri, F., Grifoni, P.: A multimodal pervasive framework for ambient assisted living. In: Proceedings of the 2nd International Conference on PErvasive Technologies Related to Assistive Environments (PETRA’09), pp. 9–13. ACM, New York (2009)

    Google Scholar 

  9. Margetis, G., Antona, M., Ntoa, S., Stephanidis, C.: Towards accessibility in ambient intelligence environments. In: Paternò, F., de Ruyter, B., Markopoulos, P., Santoro, C., van Loenen, E., Luyten, K. (eds.) AmI 2012. LNCS, vol. 7683, pp. 328–337. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

  10. Anastasiou, D., Jian, C., Zhekova, D.: Speech and gesture interaction in an ambient assisted living lab. In: Proceedings of the 1st Workshop on Speech and Multimodal Interaction in Assistive Environments, pp. 18–27. Association for Computational Linguistics (ACL), Stroudsburg (2012)

    Google Scholar 

  11. Jian, C., Scharfmeister, F., Rachuy, C., Sasse, N., Shi, H., Schmidt, H., von Steinbüchel-Rheinwll, N.: Towards effective, efficient and elderly-friendly multimodal interaction. In: Proceedings of the 4th International Conference on PErvasive Technologies Related to Assistive Environments, pp. 45:1–45:8. ACM, New York (2011)

    Google Scholar 

  12. Jian, C., Scharfmeister, F., Rachuy, C., Sasse, N., Shi, H., Schmidt, H., von Steinbüchel-Rheinwll, N.: Evaluating a spoken language interface of a multimodal interactive guidance system for elderly persons. In: Proceedings of the Fifth International Conference on Health Informatics, pp. 87–96. SciTepress, Vilamoura (2012)

    Google Scholar 

  13. Jian, C., Shi, H., Schafmeister, F., Rachuy, C., Sasse, N., Schmidt, H., Hoemberg, V., von Steinbüchel, N.: Touch and speech: multimodal interaction for elderly persons. In: Gabriel, J., Schier, J., Van Huffel, S., Conchon, E., Correia, C., Fred, A., Gamboa, H. (eds.) BIOSTEC 2012. CCIS, vol. 357, pp. 385–400. Springer, Heidelberg (2013)

    Chapter  Google Scholar 

  14. Jian, C., Shi, H., Scharfmeister, F., Rachuy, C., Sasse, N., Schmidt, H., von Steinbuechel, N.: Better choice? combing speech and touch in multimodal interaction for elderly persons. In: Proceedings of the 6th International Conference on Health Informatics. SciTepress, Barcelona (2013)

    Google Scholar 

  15. Fozard, J.L.: Vision and hearing in aging. In: Birren, J., Sloane, R., Cohen, G.D. (eds.) Handbook of Metal Health and Aging, vol. 3, pp. 18–21. Academic Press, New York (1990)

    Google Scholar 

  16. Mackay, D., Abrams, L.: Language, memory and aging. In: Birren, J.E., Schaie, K.W. (eds.) Handbook of the psychology of Aging, vol. 4, pp. 251–265. Academic Press, San Diego (1996)

    Google Scholar 

  17. Moeller, S., Goedde, F., Wolters, M.: Corpus analysis of spoken smart-home interactions with older users. In: Calzolari, N., Choukri, K., Maegaard, B., Mariani, J., Odjik, J., Piperidis, S., Tapias, D. (eds.) Proceedings of the Sixth International Conference on Language Resources Association, pp. 735–740. ELRA (2008)

    Google Scholar 

  18. Kotary, L., Hoyer, W.J.: Age and the ability to inhibit distractor information in visual selective attention. Exp. Aging Res. (Experimental Aging Research) 21(2), 159–171 (1995)

    Article  Google Scholar 

  19. McDowd, J.M., Craik, F.: Effects of aging and task difficulty on divided attention performance. J. Exp. Psychol. Hum. Percept. Perfor. (American Psychological Association, Inc) 14(2), 267–280 (1988)

    Article  Google Scholar 

  20. Salthouse, T.A.: The aging of working memory. Neuropsychology (American Psychological Association, Inc) 8(4), 535–543 (1994)

    Google Scholar 

  21. Craik, F., Jennings, J.: Human memory. In: Craik, F., Salthouse, T.A. (eds.) The Handbook of Aging and Cognition, pp. 51–110. Erlbaum, Hillsdale (1992)

    Google Scholar 

  22. Hawthorn, D.: Possible implications of ageing for interface designer. Interact. Comput. 12, 507–528 (2000)

    Article  Google Scholar 

  23. Kline, D.W., Scialfa, C.T.: Sensory and perceptual functioning: basic research and human factors implications. In: Fisk, A.D., Rogers, W.A. (eds.) Handbook of Human Factors and the Older Adult, pp. 27–54. Academic Press, San Diego (1996)

    Google Scholar 

  24. Schieber, F.: Aging and the senses. In: Birren, J.E., Sloane, R.B., Cohen, G.D. (eds.) Handbook of Mental Health and Aging, vol. 2. Academic Press, San Diego (1992)

    Google Scholar 

  25. Charness, N., Bosman, E.: Human Factors and Design. In: Birren, J.E., Schaie, K.W. (eds.) Handbook of the Psychology of Aging, vol. 3, pp. 446–463. Academic Press, San Diego (1990)

    Chapter  Google Scholar 

  26. Smith, M.W., Sharit, J., Czaja, S.J.: Aging, motor control, and the performance of computer mouse tasks. Hum. Factors 41(3), 389–396 (1999)

    Article  Google Scholar 

  27. Czaja, S.J., Sharit, J.: The influence of age and experience on the performance of a data entry task. In: Proceedings of the Human Factors and Ergonomics Society 41st Annual Meeting, pp. 144–147 (1997)

    Google Scholar 

  28. Sharit, J., Czaja, S.J., Nair, S., Lee, C.C.: Effects of age, speech rate, and environmental support in using telephone voice menu system. Hum. Factors 45, 234–252 (2003)

    Article  Google Scholar 

  29. Ziefle, M., Bay, S.: How older adults meet complexity: aging effects on the usability of different mobile phones. Behav. Inf. Technol. 24(5), 375–389 (2005)

    Article  Google Scholar 

  30. Ross, R.J., Bateman, J., Shi, H.: Using generalised dialogue models to constrain information state based dialogue systems. In: The Symposium on Dialogue Modelling and Generation, Amsterdam, Netherlands (2005)

    Google Scholar 

  31. Traum, D., Larsson, S.: The information state approach to dialogue management. In: van Kuppevelt, J., Smith, R. (eds.) Current and New Directions in Discourse and Dialogue, pp. 325–354. Kluwer, Dordrecht (2003)

    Chapter  Google Scholar 

  32. Shi, H., Bateman, J.: Developing human-robot dialogue management formally. In: Proceedings of Symposium on Dialogue Modelling and Generation, Amsterdam, Netherlands (2005)

    Google Scholar 

  33. Roscoe, A.W.: The Theory and Practice of Concurrency. Prentice Hall, New York (1997)

    Google Scholar 

  34. Broadfoot, P., Roscoe, B.: Tutorial on FDR and its applications. In: Havelund, K., Penix, J., Visser, W. (eds.) SPIN 2000. LNCS, vol. 1885, p. 322. Springer, Heidelberg (2000)

    Chapter  Google Scholar 

  35. Mandel, C., Huebner, K., Vierhuff, T.: Towards an autonomous wheelchair: cognitive aspects in service robotics. In: Proceedings of Towards Autonomous Robotic Systems (TAROS 2005), pp. 165–172 (2005)

    Google Scholar 

  36. Folstein, M., Folstein, S., Mchugh, P.: “Mini-mental state”, a practical method for grading the cognitive state of patients for clinician. J. Psychiatr. Res. 12(3), 189–198 (1975)

    Article  Google Scholar 

  37. Walker, M.A., Litman, D.J., Kamm, C.A., Kamm, A.A., Abella, A.: Paradise: a framework for evaluating spoken dialogue agents. In: Proceedings of the Eighth Conference on European Chapter of Association for Computational Linguistics, NJ, USA, pp. 271–280 (1997)

    Google Scholar 

Download references

Acknowledgements

We gratefully acknowledge the support of the Deutsche Forschungsgemeinschaft (DFG) through the Collaborative Research Center SFB/TR8, the department of Medical Psychology and Medical Sociology and the department of Neurology of the University Medical Center Göttingen.

Author information

Authors and Affiliations

  1. SFB/TR8 Spatial Cognition, Universität Bremen, Bremen, Germany

    Cui Jian, Hui Shi & Carsten Rachuy

  2. Medical Psychology and Medical Sociology, University Medical Center Göttingen, Göttingen, Germany

    Nadine Sasse, Frank Schafmeister & Nicole von Steinbüchel

  3. Neurology, University Medical Center Göttingen, Göttingen, Germany

    Holger Schmidt

Authors
  1. Cui Jian
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hui Shi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Nadine Sasse
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Carsten Rachuy
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Frank Schafmeister
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Holger Schmidt
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Nicole von Steinbüchel
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Cui Jian .

Editor information

Editors and Affiliations

  1. Universitat Politècnica de Catalunya, Barcelona, Spain

    Mireya Fernández-Chimeno

  2. Instituto Gulbenkian de Ciência, Oeiras, Portugal

    Pedro L. Fernandes

  3. Boston College, Chestnut Hill, Massachusetts, USA

    Sergio Alvarez

  4. University of Guelph, Guelph, Canada

    Deborah Stacey

  5. University of Vic, Vic, Spain

    Jordi Solé-Casals

  6. Technical University of Lisbon, Lisbon, Portugal

    Ana Fred

  7. New University of Lisbon, Lisboa, Portugal

    Hugo Gamboa

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Jian, C. et al. (2014). Modality Preference in Multimodal Interaction for Elderly Persons. In: Fernández-Chimeno, M., et al. Biomedical Engineering Systems and Technologies. BIOSTEC 2013. Communications in Computer and Information Science, vol 452. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-44485-6_26

Download citation

  • DOI: https://doi.org/10.1007/978-3-662-44485-6_26

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-662-44484-9

  • Online ISBN: 978-3-662-44485-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation