Skip to main content

A Multi-lingual Augmentative Communication System

  • Conference paper
  • First Online:
  • 1264 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 2615))

Abstract

A positive aspect of aiming for universal design is that solutions developed for people with particular needs can prove of benefit to all users. Such a case is described here. A prototype augmentative communication system has been developed which could give non-speaking people a multilingual capability. It is based on research into conversational modelling and utterance prediction, making use of prestored material. In fact, the system could also be used by people whose only communication disadvantage is not being able to speak a foreign language. A unique feature of the system is that both the non-speaking person and the communication partner will use this communicator in their dialogue. In comparison with a multi-lingual phrase book, the system helped the users to have more natural conversation, and to take more control of the interaction.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Newell, A. F.: Speech communication technology lessons from the disabled. Electronics and Power (1986) 661–664

    Google Scholar 

  2. Newell, A. F.: Speech technology: Cross fertilization between research for the disabled and the non-disabled. Proceedings of the First ISAAC Research Symposium in Augmentative and Alternative Communication (1990) 131–134

    Google Scholar 

  3. von Tetzchner, S., Jensen, M. (Ed.).: Augmentative and Alternative Communication: European Perspectives. Whurr Publishers Ltd, London (1996)

    Google Scholar 

  4. Glennen, S.L., DeCoste D.C.: Handbook of Augmentative and Alternative Communication. Singular Publishing Group, Inc., San Diego (1997)

    Google Scholar 

  5. Beukelman, D. R., Mirenda, P.: Augmentative and Alternative Communication: Management of Severe Communication Disorders in Children and Adults. Second Edition. Paul H. Brookes Publishing Co., Baltimore (1998)

    Google Scholar 

  6. Alm, N., Arnott, J.L: Computer-assisted conversation for non-vocal people using prestored texts. IEEE Transactions on Systems, Man, and Cybernetics, Vol. 28 Part C No 3 (1998) 318–328

    Article  Google Scholar 

  7. Whitelock, P., Kilby, K.: Linguistic and Computational Techniques in Machine Translation. UCL Press, London (1995)

    Google Scholar 

  8. Varile, G. B., Zampolli, A. (Ed.): Survey of the State of the Art In Human Language Technology. Cambridge University Press, Cambridge (1997)

    Google Scholar 

  9. Newell, A.F., Arnott, J.L., Alm, N.A.: The use of models of human conversation patterns within a prosthesis for non-speaking people. Bulletin of the Institute of Mathematics and Its Applications, 27 (12) (1991) 225–231

    Google Scholar 

  10. Todman, J., Elder, L., Alm, N., File, P.: Sequential dependencies in computer-aided conversation. Journal of Pragmatics21 (1994) 141–169

    Article  Google Scholar 

  11. Todman, J., Alm, N., Elder, L.: Computer-aided conversation: a prototype system for non-speaking people with physical disabilities. Applied Psycholinguistics15 (1994) 45–73

    Article  Google Scholar 

  12. Hickey, M., Alm, N., Uytdenbroek, M.: Fuzzy information retrieval in an augmentative communication system. Proceedings of the 7th Biennial Conference of the International Society for Augmentative and Alternative Communication (1996) 483–484

    Google Scholar 

  13. Alm, N., Newell, A.F.: Lessons from applying conversation modeling to augmentative and alternative communication. Twelfth Annual Conference on Technology and Persons with Disabilities. Proceedings on disk. Rapidtext, Newport Beach, California (1997)

    Google Scholar 

  14. Schank, R.C.: Tell Me A Story: A New Look at Real and Artificial Intelligence. Macmillan Publishing Co., New York (1990).

    Google Scholar 

  15. Waller, A., Alm, N., Newell, A.F.: Aided communication using semantically linked text modules. Proceedings of the 13th Annual Conference of the Rehabilitation Engineers Society of North America (1990) 177–178

    Google Scholar 

  16. Waller, A., Broumley, L., Newell, A.F., Alm, N.: Predictive retrieval of conversational narratives in an augmentative communication system. Proceedings of the 14th Annual Conference of the Rehabilitation Engineers Society of North America (1991) 107–108

    Google Scholar 

  17. Waller, A.: Providing narratives in an augmentative communication system. Ph.D. Thesis, University of Dundee, Dundee, Scotland, U.K. (1992)

    Google Scholar 

  18. Alm, N., Waller, A., Arnott, J.L., Newell, A.F.: Improving assisted communication with narrative texts. Proceedings of ECART 2-European Conference on the Advancement of Rehabilitation Technology (1993) Section 26.1 (3 pages)

    Google Scholar 

  19. Schank, R. and Abelson, R.: Scripts, Plans, Goals, and Understanding. Lawrence Erlbaum, New Jersey (1977)

    MATH  Google Scholar 

  20. Alm, N., Morrison, A., Arnott, J.L.: A communication system based on scripts, plans, and goals for enabling non-speaking people to conduct telephone conversations. Proceedings of IEEE Systems Man and Cybernetics Conference (1995) 2408–2412

    Google Scholar 

  21. van Geel, R., Neumann, H., Alm, N., Kamphuis, H.: Scaena: An advanced language device for interaction. Proceedings of the 7th Biennial Conference of the International Society for Augmentative and Alternative Communication (1996) 171–172

    Google Scholar 

  22. Vanderheyden, P., Demasco, P., McCoy, K., Pennington, C.: A preliminary study into schema-based access and organization of reusable text in AAC. Proceedings of the RESNA Conference (1996) 59–61

    Google Scholar 

  23. Carpenter, T., McCoy, K., Pennington, C.: Schema-based organization of reusable texts in AAC: User interface considerations. Proceedings of the RESNA Conference. (1997) 57–59

    Google Scholar 

  24. Dye, R., Alm, N., Arnott, J.L., Harper, G., Morrison, A.: A script-based AAC system for transactional interaction. Natural Language Engineering, 1 (1), (1997) 1–13

    Google Scholar 

  25. Harper, G., Dye, R., Alm, N., Arnott, J.L., Murray, I.R.: A script-based speech aid for non-speaking people. Proceedings of the Institute of Acoustics, Vol. 20 Part 6 (1998) 289–296

    Google Scholar 

  26. Nakamura, K., Newell, A.F., Alm, N. and Waller, A.: How do members of different language communities compose sentences with a picture-based communication system?-a cross-cultural study of picture-based sentences constructed by English and Japanese speakers. Augmentative and Alternative Communication 14 (2), (1998) 71–79

    Article  Google Scholar 

  27. Cheepen, C. The Predictability of Informal Conversation. Pinter Publishers, London (1988)

    Google Scholar 

  28. Brown, P., S. Levinson: Universals in language usage: politeness phenomena. In Goody, E. (ed.) Questions and Politeness: Strategies in Social Interaction. Cambridge University Press, London (1987) 256–289

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2003 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Alm, N., Iwabuchi, M., Andreasen, P.N., Nakamura, K. (2003). A Multi-lingual Augmentative Communication System. In: Carbonell, N., Stephanidis, C. (eds) Universal Access Theoretical Perspectives, Practice, and Experience. UI4ALL 2002. Lecture Notes in Computer Science, vol 2615. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-36572-9_31

Download citation

  • DOI: https://doi.org/10.1007/3-540-36572-9_31

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-00855-2

  • Online ISBN: 978-3-540-36572-3

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics