Skip to main content
SpringerLink
Log in
Book cover

International Workshop on Intelligent Virtual Agents

IVA 2009: Intelligent Virtual Agents pp 552–553Cite as

Web-Based Evaluation of Talking Heads: How Valid Is It?

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 5773))

Introduction and Material

Web-based tests are an established method for the evaluation (e.g. [1]). However, the validity of web-experiments has not yet been evaluated for the field of embodied conversation agents (ECAs). In this paper, evaluation results obtained in a non-interactive scenario in our lab [2] are compared to a similar web-based experiment. 3 different talking head components and 2 freely available speech synthesis systems (TTS) are combined. The head components used are the thinking head (TH), Massy (MS), and a speaker cloning system (CL). The TTS include Mary (‘hmm-bits3’) and Mbrola (’de2’). We recorded videos of the talking heads speaking sentences related to the smart home domain like: The following devices can be turned on or off: the TV, the lamps and the fan.’

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Koda, T., Ishida, T.: Cross-cultural study of avatar expression interpretation. In: International Symposium on Applications and the Internet, SAINT 2006 (2006)

    Google Scholar 

  2. Kühnel, C., Weiss, B., Wechsung, I., Fagel, S., Möller, S.: Evaluating talking heads for smart home systems. In: Proc. International Conference on Multimodal Interfaces (ICMI) (2008)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Quality & Usability Lab, Dt. Telekom Laboratories, TU Berlin, Germany

    Benjamin Weiss, Christine Kühnel, Ina Wechsung & Sebastian Möller

  2. Institut für Sprache und Kommunikation, TU Berlin, Germany

    Sascha Fagel

Authors
  1. Benjamin Weiss
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Christine Kühnel
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ina Wechsung
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Sebastian Möller
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Sascha Fagel
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Human Media Interaction (HMI), University of Twente, EWI (Zilverling), P.O.Box 217, 7500, Enschede, AE, The Netherlands

    Zsófia Ruttkay

  2. Deutsches Forschungszentrum für künstliche Intelligenz (DFKI), Campus D3.2, 66123, Saarbrücken, Germany

    Michael Kipp

  3. Human Media Interaction Group,Dept. of Computer Science, University of Twente, P.O. Box 217, 7500, Enschede, AE, The Netherlands

    Anton Nijholt

  4. Center for Analysis and Design of Intelligent Agents, CADIA, School of Computer Science, Reykjavik University, Kringlan 1, 103, Reykjavik, Iceland

    Hannes Högni Vilhjálmsson

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Weiss, B., Kühnel, C., Wechsung, I., Möller, S., Fagel, S. (2009). Web-Based Evaluation of Talking Heads: How Valid Is It?. In: Ruttkay, Z., Kipp, M., Nijholt, A., Vilhjálmsson, H.H. (eds) Intelligent Virtual Agents. IVA 2009. Lecture Notes in Computer Science(), vol 5773. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-04380-2_87

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-04380-2_87

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-04379-6

  • Online ISBN: 978-3-642-04380-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation