Skip to main content
Log in

A Generic Widget Vocabulary for the Generation of Graphical and Speech-Driven User Interfaces

  • Published:
International Journal of Speech Technology Aims and scope Submit manuscript

Abstract

User interface (UI) design is changing due to the separation of front- and back-ends, even to the extent that a priori unknown remote devices can be used to control appliances. This paradigm calls for new formal and generic methodologies of UI design. This paper describes an approach for generating graphical (GUI) and voice-based user interfaces from a single source format. The proposed method introduces a generic dedicated widget vocabulary that aids in defining UI descriptions written in the UIML language. Subsequently, this generic description may be converted to multiple UI implementation formats suitable for the specific client terminals. These targets include GUI-like formats, e.g., HTML, WML and Java, as well as voice-based formats, most notably VoiceXML. A case study is presented for UI generation in a home environment for device-controlling applications.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Abrams, M., Phanouriou, C., Batongbacal, A.L., Williams, S.M., and Shuster J.E. (1999). UIML: An appliance-independent XML user interface language. Computer Networks, vol. 31, Amsterdam: Elsevier Science, pp. 1695–1708.

    Google Scholar 

  • Abrams, M. and Phanouriou, C. (1999). UIML: An XML languagefor building device-independent user interfaces. Proceedings of XML 99, Philadelphia: GCA (CD pub.).

    Google Scholar 

  • Beck, J., Gefflaut, A., and Islam, N. (1999). Moca: A service framework for mobile computing devices. Proceedings of the ACM InternationalWorkshop on Data Engineering forWireless & Mobile Access (MobiDE). Seattle, WA: ACM Press, pp. 62–68.

    Google Scholar 

  • Korva, J., Plomp, J., Määttä, P., and Metso, M. (2001). Onlineservice adaptation for mobile and fixed terminal devices. Proceedings of the 2nd International Conference on Mobile Data Management (MDM2001). Published in Springer Lecture Notes in Computer Science no 1987, Springer-Verlag, Berlin, pp. 252–259.

    Google Scholar 

  • Mir Farooq, A. and Abrams, M. (2001). Simplifying construction ofmulti-platfrom user interfaces using UIML. Proceedings of the European Conference UIML 2001. Paris: Harmonia & Aristote (CD pub.).

    Google Scholar 

  • Plomp, J. (2001). UIMLin future home environments.Proceedings of the European Conference UIML 2001. Paris: Harmonia & Aristote (CD pub.).

    Google Scholar 

  • Ramstein, C., Martial, O., Dufresne, A., Carignan, M., Chassé, P.,and Mabilleau, P. (1996). Touching & hearing GUIs: Design issues for the PC-Access system. Proceedings of ACM Assets 96. New York: ACM, pp. 2–9.

    Google Scholar 

  • Román, M., Beck, J., and Gefflaut, A. (2000). A device-independent representation for services. Proceedings of the Third IEEE Workshop on Mobile Computing Systems and Applications. Monterey, CA: IEEE, pp. 73–82.

    Google Scholar 

  • VoiceXML Forum. (2000, March). VXMLManual,Voice eXtensibleMarkup Language VoiceXML, Version: 1.00. VoiceXML Forum, March 2000. http://www.voicexml.org/specs/VoiceXML-100.pdf

  • Weiser, M. (1991, September). The computer for the twenty-first century. Scientific American, September 1991: pp. 94–100.

  • Yankelovich, N., Levow, G.A., and Marx, M. (1995). Designing SpeechActs: Issues in speech user interfaces. Proceedings of CHI '95 Conference on Human Factors in Computing Systems. New York: ACM, pp. 369–376.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Plomp, C., Mayora-Ibarra, O. A Generic Widget Vocabulary for the Generation of Graphical and Speech-Driven User Interfaces. International Journal of Speech Technology 5, 39–47 (2002). https://doi.org/10.1023/A:1013678514806

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1013678514806

Navigation