Skip to main content
Springer Nature Link
Log in

LAST MINUTE: An Empirical Experiment in User-Companion Interaction and Its Evaluation

  • Chapter
  • First Online:
Companion Technology

Part of the book series: Cognitive Technologies ((COGTECH))

  • 850 Accesses

Abstract

The LAST MINUTE Corpus (LMC) is a unique resource for research on issues of Companion-technology. LMC not only comprises 57.5 h of multimodal recordings (audio, video, psycho-biological data) from interactions between users—133 subjects in sum, balanced in age and gender—and a WoZ-simulated speech-based interactive dialogue system. LMC also includes full verbatim transcripts of all these dialogues, sociodemographic and psychometric data of all subjects as well as material from 73 in-depth user interviews focusing the user’s individual experience of the interaction. In this chapter the experimental design and data collection of the LMC are shortly introduced. On this basis, exemplifying results from semantic analyses of the dialogue transcripts as well as from qualitative analyses of the interview material are presented. These illustrate LMC’s potential for investigations from numerous research perspectives.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    Some subjects try to unpack items before it is necessary, but these are only single cases.

  2. 2.

    The distribution is visualized here—and in other figures—as a trellis boxplot: the rectangles represent the interquartile range (i.e. the range of 25% of the values above and below the median resp.); the filled dot gives the median; the whiskers extending the rectangle extend to the range of values, but maximally to 1.5 of the interquartile range; outlier values beyond the maximal whisker range are given as unfilled dots (cf. [1]).

  3. 3.

    Unless noted otherwise, all statistical tests and calculations have been performed with the R, language [1, 25].

  4. 4.

    In order to maximize variance, interviews were chosen randomly one by one considering a balanced allocation of groups according to the qualitative sample plan (cf. Sect. 13.3.4). When no more increase of variance could be detected, no further material was added (criterion of theoretical saturation).

  5. 5.

    Participant’s initials.

References

  1. Baayen, R.H.: Analyzing Linguistic Data – A Practical Introduction to Statistics Using R. Cambridge University Press, Cambridge (2008)

    Book  Google Scholar 

  2. Baumeister, R.F., Leary, M.R.: The need to belong: desire for interpersonal attachments as a fundamental human motivation. Psychol. Bull. 117(3), 497 (1995)

    Article  Google Scholar 

  3. Biundo, S., Wendemuth, A.: Companion-technology for cognitive technical systems. Künstl. Intell. (2016). doi:10.1007/s13218-015-0414-8

    Google Scholar 

  4. Dennett, D.C.: The Intentional Stance. MIT, Cambridge (1987)

    Google Scholar 

  5. Frommer, J., Rösner, D., Haase, M., Lange, J., Friesen, R., Otto, M.: Project A3 - Detection and Avoidance of Failures in Dialogs. Pabst Science Publisher, Lengerich (2012)

    Google Scholar 

  6. Frommer, J., Michaelis, B., Rösner, D., Wendemuth, A., Friesen, R., Haase, M., Kunze, M., Andrich, R., Lange, J., Panning, A., Siegert, I.: Towards emotion and affect detection in the multimodal last minute corpus. In: Calzolari, N., Choukri, K., Declerck, T., Doǧan, M.U., Maegaard, B., Mariani, J., Moreno, A., Odijk, J., Piperidis, S. (eds.) Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC’12). European Language Resources Association (ELRA), Paris (2012)

    Google Scholar 

  7. Galletta, A.: Mastering the Semi-Structured Interview and Beyond: From Research Design to Analysis and Publication. NYU, New York (2013)

    Book  Google Scholar 

  8. Hassenzahl, M., Burmester, M., Koller, F.: AttrakDiff: ein Fragebogen zur Messung wahrgenommener hedonischer und pragmatischer Qualität. In: Ziegler, J., Szwillus, G. (eds.) Mensch & Computer 2003. Berichte des German Chapter of the ACM, vol. 57, pp. 187–196. Vieweg+Teubner Verlag, Stuttgart (2003)

    Chapter  Google Scholar 

  9. Honold, F., Schüssel, F., Weber, M., Nothdurft, F., Bertrand, G., Minker, W.: Context models for adaptive dialogs and multimodal interaction. In: 2013 9th International Conference on Intelligent Environments (IE), pp. 57–64. IEEE, New York (2013)

    Google Scholar 

  10. Horowitz, L.M., Alden, L.E., Wiggins, J.S., Pincus, A.L.: Inventory of Interpersonal Problems Manual. Psychological Cooperation, San Antonio (2000)

    Google Scholar 

  11. Jurafsky, D., Martin, J.H.: Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition, 2nd edn. Prentice Hall, Englewood Cliffs (2008)

    Google Scholar 

  12. Karrer, K., Glaser, C., Clemens, C., Bruder, C.: Technikaffinität erfassen – der Fragebogen TA-EG. In: Lichtenstein, A., Stößel, C., Clemens, C. (eds.) Der Mensch im Mittelpunkt technischer Systeme, ZMMS Spektrum, Reihe 22, vol. 29, pp. 196–201. VDI Verlag GmbH, Düsseldorf (2008)

    Google Scholar 

  13. Kastner, M., Stangl, B.: Exploring a text-to-speech feature by describing learning experience, enjoyment, learning styles, and values–a basis for future studies. In: 2013 46th Hawaii International Conference on System Sciences (HICSS), pp. 3–12. IEEE, New York (2013)

    Google Scholar 

  14. King, J., Bond, T., Blandford, S.: An investigation of computer anxiety by gender and grade. Comput. Hum. Behav. 18(1), 69–84 (2002)

    Article  Google Scholar 

  15. Krämer, N.C., Eimler, S., von der Pütten, A., Payr, S.: Theory of companions: what can theoretical models contribute to applications and understanding of human-robot interaction? Appl. Artif. Intell. 25(6), 474–502 (2011)

    Article  Google Scholar 

  16. Krüger, J., Wahl, M., Frommer, J.: Making the system a relational partner: users’ ascriptions in individualization-focused interactions with companion-systems. In: Proceedings of the 8th International Conference on Advances in Human-oriented and Personalized Mechanisms, Technologies, and Services (CENTRIC 2015), pp. 48–54. IARIA XPS Press (2015). http://www.thinkmind.org/index.php?view=article&articleid=centric_2015_3_20_30079

  17. Lange, J., Frommer, J.: Subjektives Erleben und intentionale Einstellung in Interviews zur Nutzer-Companion-Interaktion. In: Informatik 2011. Lecture Notes in Informatics, vol. 192, p. 240. Köllen, Bonn (2011). http://www.user.tu-berlin.de/komm/CD/paper/060332.pdf

  18. Levenstein, S., Prantera, C., Varvo, V., Scribano, M.L., Berto, E., Luzi, C., Andreoli, A.: Development of the Perceived Stress Questionnaire: a new tool for psychosomatic research. J. Psychosom. Res. 37(1), 19–32 (1993)

    Article  Google Scholar 

  19. Mayring, P.: Qualitative content analysis. Theoretical foundations, basic procedures and software solution. n.p., Klagenfurth (2014). http://nbn-resolving.de/urn:nbn:de:0168-ssoar-395173[retrieved:09,2015]

    Google Scholar 

  20. McCrae, R.R., Costa, P.T.: A contemplated revision of the NEO Five-Factor Inventory. Personal. Individ. Differ. 36(3), 587–596 (2004)

    Article  Google Scholar 

  21. McKeown, G., Valstar, M.F., Cowie, R., Pantic, M.: The SEMAINE corpus of emotionally coloured character interactions. In: 2010 IEEE International Conference on Multimedia and Expo (ICME), pp. 1079–1084. IEEE, New York (2010)

    Google Scholar 

  22. Mori, M., MacDorman, K.F., Kageki, N.: The uncanny valley [from the field]. IEEE Robot. Autom. Mag. 19(2), 98–100 (2012)

    Article  Google Scholar 

  23. Naumann, A., Hermann, F., Peissner, M., Henke, K.: Interaktion mit Informations-und Kommunikationstechnologie: Eine Klassifikation von Benutzertypen. In: Herczeg, M., Kindsmüller, M.C. (eds.) Mensch & Computer 2008: Viel Mehr Interaktion, pp. 37–45. Oldenbourg Verlag, München (2008)

    Google Scholar 

  24. Peterson, C., Semmel, A., Baeyer, C.v., Abramson, L.Y., Metalsky, G.I., Seligman, M.E.P.: The attributional Style Questionnaire. Cogn. Ther. Res. 6(3), 287–299 (1982)

    Google Scholar 

  25. R Development Core Team: R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna (2010)

    Google Scholar 

  26. Rogers, C.: A theory of therapy, personality and interpersonal relationships as developed in the client-centered framework. In: Koch, S. (ed.) Psychology: A Study of a Science. Formulations of the Person and the Social Context, vol. 3. McGraw Hill, New York (1959)

    Google Scholar 

  27. Rösner, D., Friesen, R., Otto, M., Lange, J., Haase, M., Frommer, J.: Intentionality in interacting with companion systems – an empirical approach. In: Jacko, J. (ed.) Human-Computer Interaction. Towards Mobile and Intelligent Interaction Environments. Lecture Notes in Computer Science, vol. 6763, pp. 593–602. Springer, Berlin/Heidelberg (2011)

    Chapter  Google Scholar 

  28. Rösner, D., Frommer, J., Andrich, R., Friesen, R., Haase, M., Kunze, M., Lange, J., Otto, M.: LAST MINUTE: a novel corpus to support emotion, sentiment and social signal processing. In: Devillers, L., Schuller, B., Batliner, A., Rosso, P., Douglas-Cowie, E., Cowie, R., Pelachaud, C. (eds.) Proceedings of LREC’12 - Workshop Abstracts, Istanbul, p. 171 (2012)

    Google Scholar 

  29. Rösner, D., Frommer, J., Friesen, R., Haase, M., Lange, J., Otto, M.: LAST MINUTE: a multimodal corpus of speech-based user-companion interactions. In: LREC, pp. 2559–2566 (2012)

    Google Scholar 

  30. Rösner, D., Friesen, R., Günther, S., Andrich, R.: Modeling and evaluating dialog success in the LAST MINUTE corpus. In: Chair, N.C.C., Choukri, K., Declerck, T., Loftsson, H., Maegaard, B., Mariani, J., Moreno, A., Odijk, J., Piperidis, S. (eds.) Proceedings of LREC’14, Reykjavik (2014)

    Google Scholar 

  31. Rösner, D., Haase, M., Bauer, T., Günther, S., Krüger, J., Frommer, J.: Desiderata for the design of companion systems – insights from a large scale wizard of Oz experiment. Künstl. Intell. 30(1), 53–61 (2016). Online first: Oct 28, 2015; doi:10.1007/s13218-015-0410-z

    Google Scholar 

  32. Schmidt, T., Schütte, W.: Folker: an annotation tool for efficient transcription of natural, multi-party interaction. In: Chair, N.C.C, Choukri, K., Maegaard, B., Mariani, J., Odijk, J., Piperidis, S., Rosner, M., Tapias, D. (eds.) Proceedings of the Seventh conference on International Language Resources and Evaluation (LREC’10). European Language Resources Association (ELRA), Valletta (2010)

    Google Scholar 

  33. Selting, M., Auer, P., Barth-Weingarten, D., Bergmann, J.R., Bergmann, P., Birkner, K., Couper-Kuhlen, E., Deppermann, A., Gilles, P., Günthner, S., et al.: Gesprächsanalytisches Transkriptionssystem 2 (GAT 2). Gesprächsforschung-Online-Zeitschrift zur verbalen Interaktion 10 (2009)

    Google Scholar 

  34. Siegert, I., Philippou-Hübner, D., Hartmann, K., Böck, R., Wendemuth, A.: Investigation of speaker group-dependent modelling for recognition of affective states from speech. Cogn. Comput. 6(4), 892–913 (2014). doi:10.1007/s12559-014-9296-6

    Article  Google Scholar 

  35. Sieverding, M., Koch, S.C.: (Self-) evaluation of computer competence: how gender matters. Comput. Educ. 52(3), 696–701 (2009)

    Google Scholar 

  36. Veletsianos, G.: How do learners respond to pedagogical agents that deliver social-oriented non-task messages? Impact on student learning, perceptions, and experiences. Comput. Hum. Behav. 28(1), 275–283 (2012)

    Article  Google Scholar 

  37. Wilks, Y.: Close Engagements with Artificial Companions: Key Social, Psychological, Ethical and Design Issues, vol. 8. John Benjamins Publishing, Amsterdam (2010)

    Google Scholar 

Download references

Acknowledgements

This work was done within the Transregional Collaborative Research Centre SFB/TRR 62 “Companion-Technology for Cognitive Technical Systems” funded by the German Research Foundation (DFG).

Author information

Authors and Affiliations

  1. Universitätsklinik für Psychosomatische Medizin und Psychotherapie, Otto-von-Guericke-Universität, Magdeburg, Germany

    Jörg Frommer, Matthias Haase & Julia Krüger

  2. Institut für Wissens- und Sprachverarbeitung, Otto-von-Guericke Universität, Magdeburg, Germany

    Dietmar Rösner, Rico Andrich, Rafael Friesen & Stephan Günther

Authors
  1. Jörg Frommer
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dietmar Rösner
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Rico Andrich
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Rafael Friesen
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Stephan Günther
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Matthias Haase
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Julia Krüger
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jörg Frommer .

Editor information

Editors and Affiliations

  1. Institute of Artificial Intelligence, Universität Ulm, Ulm, Germany

    Susanne Biundo

  2. Cognitive Systems Group, Institute for Information Technology and Communications (IIKT) and Center for Behavioral Brain Sciences (CBBS), Otto-von-Guericke Universität Magdeburg, Magdeburg, Germany

    Andreas Wendemuth

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Frommer, J. et al. (2017). LAST MINUTE: An Empirical Experiment in User-Companion Interaction and Its Evaluation. In: Biundo, S., Wendemuth, A. (eds) Companion Technology. Cognitive Technologies. Springer, Cham. https://doi.org/10.1007/978-3-319-43665-4_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-43665-4_13

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-43664-7

  • Online ISBN: 978-3-319-43665-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics