Abstract
The current work presents the SPEAKYACUTATTILE system, a computer based platform designed to enable its users to access a number of ICT services such as house management, health status monitoring or recreational services. It is deeply grounded on voice interaction and represents a Spoken Language System (SLS) meant to be a sort of intelligent assistant with which the users can vocally interact. The paper dwells on an experimental assessment of the system. Linear regression analysis have been carried out in order to assess the influence of system performance—in terms of dialogue efficiency metrics and dialogue quality metrics—on the perceived satisfaction of users. Results show that longer dialogues are preferred in order to positively influence the users satisfaction, suggesting the importance for people to have time for getting confident with new ICT solutions. Moreover, from the experimental analysis, it clearly emerges how system intervention should be reduced, suggesting how a good balance between user and system turns represents an important aspect for a fluid interaction. The same can be speculated for dialogues with no met requests that also tended to be associated with lower satisfaction scores. These last results support the importance for a vocal assistant to be effective in its purpose in order to be perceived as useful and satisfying.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Kamm C, Walker M (1997) Design and evaluation of spoken dialogue systems. In: IEEE workshop on automatic speech recognition and understanding, pp 14–17
Carbonell N, Pierrel J (1988) Recent advances in speech understanding and dialog systems. NATO ASI series F: computer and systems sciences, vol 46. Task-oriented dialogue processing in human-computer voice communication, p 491–495. Springer
Haton J (1988) Recent advances in speech understanding and dialog systems. NATO ASI series F: computer and systems sciences, vol 46. Knowledge-based approaches in acoustic-phonetic decoding, pp 51–70. Springer
Niedermair GT, Streit M, Tropf H (1990) Linguistic processing related to speech understanding in SPICOS II. Speech Commun 9:565–585
Ermon LD, Lesser VR (1990) The hearsay-ii speech understanding system: a tutorial. In: Waibel A, Lee K-F (eds) Readings in speech recognition. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, pp 235–245
Kitano H (1990) Dmdialog: a speech-to-speech dialogue translation system. Mach Transl 5(4):301–338
Wood W (1990) Language processing for speech understanding. In: Waibel A, Lee K-F (eds) Readings in speech recognition. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, pp 519–533
Sagerer G, Kummert F (1988) Knowledge based systems for speech understanding. Springer, p 421–458
Young S, Russell N, Thornton J (1991) The use of syntax and multiple alternatives in the vodis voice operated database inquiry system. Comput Speech Lang 5(1):65–80
McGlashan S, Fraser N, Gilbert N, Bilange E, Heisterkamp P, Youd N (1992) Dialogue management for telephone information systems. In: Proceedings of the third conference on applied natural language processing, p 245–246. Association for Computational Linguistics
Young S, Hauptmann AG, Ward WH, Smith ET, Werner P (1989) High level knowledge sources in usable speech recognition systems. Commun ACM 32(2):183–194
Hoeppner W, Morik K, Marburger H (1986) Talking it over: the natural language dialog system ham-ans. In: Bolc L, Jarke M (eds) Cooperative interfaces to information systems. Springer, New York, NY, USA, pp 189–258
Mctear M (1987) The articulate computer. Blackwell Publishers Inc, Cambridge, MA, USA
Goetze S, Moritz N, Appell J-E, Meis M, Bartsch C, Bitzer J (2010) Acoustic user interfaces for ambient-assisted living technologies. Inform Health Soc Care 35(3–4):125–143
Becker E, Le Z, Park K, Lin Y, Makedon F (2009) Event-based experiments in an assistive environment using wireless sensor networks and voice recognition. In: Proceedings of the 2nd international conference on PErvasive technologies related to assistive environments, p 17. ACM
López-Cózar R, Callejas Z, Griol D, Quesada JF (2014) Review of spoken dialogue systems. Loquens 1(2):e012
Jian C, Schafmeister F, Rachuy C, Sasse N, Shi H, Schmidt H, von Steinbüchel N (2012) Evaluating a spoken language interface of a multimodal interactive guidance system for elderly persons. In: HEALTHINF 2012—proceedings of the international conference on health informatics, Vilamoura, Algarve, Portugal, 1–4 Feb 2012, pp 87–96
Krajewski J, Wieland R, Batliner A (2008) An acoustic framework for detecting fatigue in speech based human-computer-interaction. In: Proceedings of the 11th international conference on computers helping people with special needs, pp 54–61. Springer
Walker M, Kamm C, Litman D (2000) Towards developing general models of usability with paradise. Nat Lang Eng 6(3&4):363–377
Walker MA, Litman DJ, Kamm CA, Abella A (1997) Paradise: a framework for evaluating spoken dialogue agents. In: Proceedings of the eighth conference on European chapter of the association for computational linguistics, p 271–280. Association for Computational Linguistics
Hone KS, Graham R (2000) Towards a tool for the subjective assessment of speech system interfaces (sassi). Nat Lang Eng 6(3&4):287–303
Litman DJ, Walker MA, Kearns MS (1999) Automatic detection of poor speech recognition at the dialogue level. In: Proceedings of the 37th annual meeting of the association for computational linguistics on computational linguistics, pp 309–316. Association for Computational Linguistics
Litman DJ, Pan S (2002) Designing and evaluating an adaptive spoken dialogue system. User Model User-Adap Inter 12(2–3):111–137
Foster ME, Giuliani M, Knoll A (2009) Comparing objective and subjective measures of usability in a human-robot dialogue system. In: Proceedings of the joint conference of the 47th annual meeting of the ACL and the 4th international joint conference on natural language processing of the AFNLP, vol 2. pp 879–887. Association for Computational Linguistics
Davis F (1989) Perceived usefulness, perceived ease of use, and user acceptance of information technology. Manage Inf Syst Q 319–340
Venkatesh V, Morris M, Davis G, Davis F (2003) User acceptance of information technology: toward a unified view. Manage Inf Syst Q 425–478
Acknowledgements
Speaky Acutattile is partially supported by MISE under decr.conc. 00007MI01 27/05/2011.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Fracasso, F., Cortellessa, G., Cesta, A., Giacomelli, F., Manes, N. (2017). Evaluating SpeakyAcutattile: A System Based on Spoken Language for Ambient Assisted Living. In: Cavallo, F., Marletta, V., Monteriù, A., Siciliano, P. (eds) Ambient Assisted Living. ForItAAL 2016. Lecture Notes in Electrical Engineering, vol 426. Springer, Cham. https://doi.org/10.1007/978-3-319-54283-6_26
Download citation
DOI: https://doi.org/10.1007/978-3-319-54283-6_26
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-54282-9
Online ISBN: 978-3-319-54283-6
eBook Packages: EngineeringEngineering (R0)