skip to main content
10.1145/3491101.3519902acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
demonstration

KaraokeVUI: Utilizing Karaoke Subtitles for Voice User Interfaces to Navigate Users What They Would Say

Published:28 April 2022Publication History

ABSTRACT

Voice user interfaces (VUIs) have the problems in discoverability and learnability. Conventional VUIs tried to solve these problems by listing voice commands for using features on the screen of devices in combination with GUIs. However, with these VUI help tools, it is difficult to know how accurately the commands must be spoken and to determine whether the target operation is being executed if the words are rephrased or spoken incorrectly during speaking. Therefore, users are too preoccupied with speaking phrases correctly, and the advantage of VUIs, which can be used without awareness of the operation method, has not been fully demonstrated. To address these issues, we propose KaraokeVUI, which is a VUI help tool for supporting voice operation with feedback by displaying spoken words through filling in the blanks or overlaying on phrases, just like on a karaoke screen. In this paper, we evaluate and verify KaraokeVUI usefulness and usability.

Skip Supplemental Material Section

Supplemental Material

3491101.3519902-walkthrough.mp4

mp4

142 MB

3491101.3519902-preview.mp4

mp4

41.9 MB

References

  1. Ryen W. White and Resa A. Roth. Exploratory search: Beyond the query-response paradigm. Synth. Lec. on Inf. Conc., Retr., and Serv., 1(1):1–98, 2009.Google ScholarGoogle Scholar
  2. Marti A. Hearst. Search user interfaces. Cambridge University Press, 2009.Google ScholarGoogle ScholarCross RefCross Ref
  3. Laurent Karsenty. Shifting the Design Philosophy of Spoken Natural Language Dialogue: From Invisible to Transparent Systems. International Journal of Speech Technology 5, 147–157 (2002).Google ScholarGoogle Scholar
  4. Anushay Furqan, Chelsea Myers, and Jichen Zhu. 2017. Learnability through Adaptive Discovery Tools in Voice User Interfaces. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '17). Association for Computing Machinery, New York, NY, USA, 1617–1623.Google ScholarGoogle ScholarCross RefCross Ref
  5. Chelsea Myers, Anushay Furqan, Jessica Nebolsky, Karina Caro, and Jichen Zhu. 2018. Patterns for How Users Overcome Obstacles in Voice User Interfaces. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, Paper 6, 1–7.Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Chelsea M. Myers. 2019. Adaptive suggestions to increase learnability for voice user interfaces. In Proceedings of the 24th International Conference on Intelligent User Interfaces: Companion (IUI '19). Association for Computing Machinery, New York, NY, USA, 159–160.Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Tovi Grossman, George Fitzmaurice, and Ramtin Attar. 2009. A survey of software learnability: metrics, methodologies and guidelines. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). Association for Computing Machinery, New York, NY, USA, 649–658.Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Eric Corbett and Astrid Weber. 2016. What can I say?: addressing user experience challenges of a mobile voice user interface for accessibility. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '16). Association for Computing Machinery, New York, NY, USA, 72–82.Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Jonathan Huyghe, Jan Derboven, and Dirk De Grooff. 2014. ALADIN: demo of a multimodal adaptive voice interface. In Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational (NordiCHI '14). Association for Computing Machinery, New York, NY, USA, 1035–1038.Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Yu Zhong, T. V. Raman, Casey Burkhardt, Fadi Biadsy, and Jeffrey P. Bigham. 2014. JustSpeak: enabling universal voice control on Android. In Proceedings of the 11th Web for All Conference (W4A '14). Association for Computing Machinery, New York, NY, USA, Article 36, 1–4.Google ScholarGoogle Scholar
  11. John Brooke. (1996) SUS: a "quick and dirty" usability scale. In P W Jordan, B Thomas, B A Weerdmeester & A L McClelland (eds.) Usability Evaluation in Industry. London: Taylor and Francis.Google ScholarGoogle Scholar
  12. Bangor, A., Kortum, P. T., & Miller, J. T. (2009). Determining what individual SUS scores mean: Adding an adjective rating scale. Journal of Usability Studies. 4(3), 114–123.Google ScholarGoogle Scholar
  13. Nobuko Mizutani. [ From “synlogue” to “dialogue”] “Kyowa” kara “taiwa” e (in Japanese). Nihongo-gaku (Japanese linguistics). 1993, 12, 4, 4–10.Google ScholarGoogle Scholar

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in
  • Published in

    cover image ACM Conferences
    CHI EA '22: Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems
    April 2022
    3066 pages
    ISBN:9781450391566
    DOI:10.1145/3491101

    Copyright © 2022 Owner/Author

    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    • Published: 28 April 2022

    Check for updates

    Qualifiers

    • demonstration
    • Research
    • Refereed limited

    Acceptance Rates

    Overall Acceptance Rate6,164of23,696submissions,26%
  • Article Metrics

    • Downloads (Last 12 months)28
    • Downloads (Last 6 weeks)1

    Other Metrics

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format .

View HTML Format