Skip to main content

Visualizing the Importance of Medical Recommendations with Conversational Agents

  • Conference paper
Intelligent Virtual Agents (IVA 2008)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 5208))

Included in the following conference series:

Abstract

Embodied Conversational Agents (ECA) have the potential to bring to life many kinds of information, and in particular textual contents. In this paper, we present a prototype that helps visualizing the relative importance of sentences extracted from medical texts (clinical guidelines aimed at physicians). We propose to map rhetorical structures automatically recognized in the documents to a set of communicative acts controlling the expression of the ECA. As a consequence, the ECA will dramatize a sentence to reflect its perceived importance and degree of recommendation (advice, requirement, open proposal, etc). This prototype is constituted of three sub-systems: i) a text analysis module, ii) an ECA and iii) a mapping module which converts rhetorical structures produced by the text analysis module into nonverbal behaviors driving the ECA animation. This system could help authors of medical texts to reflect on the potential impact of the writing style they have adopted. The use of ECA re-introduces an affective element which won’t be captured by other methods for analyzing document style.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Hoorn, J., Konijn, E.: Personification: Crossover between Metaphor and Fictional Character in Computer Mediated Communication. In: The annual meeting of the International Communication Association, San Diego, CA (2003)

    Google Scholar 

  2. Nass, C., Steuer, J., Tauber, E.: Computers are Social Actors. In: Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, Boston, Massachusetts, United States, pp. 72–78 (1994)

    Google Scholar 

  3. Abbattista, F., Lops, P., Semeraro, G., Andersen, V., Andersen, H.: Evaluating virtual agents for e-commerce. In: Falcone, R., Barber, S., Korba, L., Singh, M.P. (eds.) AAMAS 2002. LNCS (LNAI), vol. 2631. Springer, Heidelberg (2003)

    Google Scholar 

  4. Allbeck, J., Badler, N.: Toward Representing Agent Behaviors Modified by Personality and Emotion. In: Falcone, R., Barber, S., Korba, L., Singh, M.P. (eds.) AAMAS 2002. LNCS (LNAI), vol. 2631. Springer, Heidelberg (2003)

    Google Scholar 

  5. Sackett, D., Rosenberg, W., Gray, J., Haynes, R., Richardson, W.: Evidence-based medicine: what it is and what it isn’t. BMJ 312(7023), 71–72

    Google Scholar 

  6. Georg, G., Jaulent, M.-C.: A Document Engineering Environment for Clinical Guidelines. In: Proceedings of the 2007 ACM Symposium on Document Engineering, Winnipeg, Manitoba, Canada, pp. 69–78. ACM Press, New York (2007)

    Google Scholar 

  7. Pelachaud, C.: Multimodal expressive embodied conversational agent. In: ACM Multimedia, Brave New Topics session, Singapore, pp. 683–689 (2005)

    Google Scholar 

  8. De Carolis, B., Pelachaud, C., Poggi, I., Steedman, M.: APML, a Markup Language for Believable Behavior Generation. In: Prendinger, H., Ishizuka, M. (eds.) Life-like Characters. Tools, Affective Functions and Applications, pp. 65–86. Springer, Heidelberg (2003)

    Google Scholar 

  9. Moulin, B., Rousseau, D.: Knowledge acquisition from prescriptive texts. In: Proceedings of the 3rd international conference on Industrial and engineering applications of artificial intelligence and expert systems, Charleston, South Carolina, United States, pp. 1112–1121 (1990)

    Google Scholar 

  10. Ekman, P.: About brows: Emotional and conversational signals. In: von Cranach, M., Foppa, K., Lepenies, W., Ploog, D. (eds.) Human ethology: Claims and limits of a new discipline: contributions to the Colloquium, pp. 169–248. Cambridge University Press, Cambridge (1979)

    Google Scholar 

  11. Chovil, N.: Discourse-oriented facial displays in conversation. Research on Language and Social Interaction 25, 163–194 (1991)

    Google Scholar 

  12. Poggi, I.: Mind Markers. In: Rector, M., Poggi, I., Trigo, N. (eds.) Gestures, Meaning and use, pp. 203–207. University Fernando Pessoa Press, Oporto (2003)

    Google Scholar 

  13. Bolinger, D.: Intonation and its Part. Stanford University Press (1996)

    Google Scholar 

  14. Silverman, K., Beckman, M., Pitrelli, J., Ostendorf, M., Wightman, C., Price, P., Pierrehumbert, J., Hirschberg, J.: ToBI: A Standard for Labeling English Prosody. In: Proceedings of the International Conference on Spoken Language Processing, Banff, Alberta, pp. 867–870 (1992)

    Google Scholar 

  15. Poggi, I., Pelachaud, C.: Performative faces. Speech Communication 26, 5–21 (1998)

    Article  Google Scholar 

  16. Darwin, C.R.: The expression of emotions in man and animals. Murray, London (1872)

    Google Scholar 

  17. Piwek, P., Hernault, H., Prendinger, H., Ishizuka, M.: T2D: Generating Dialogues Between Vir-tual Agents Automatically from Text. In: Intelligent Virtual Agents 2007, Paris, pp. 161–174 (2007)

    Google Scholar 

  18. Charon, R.: Narrative Medicine - A Model for Empathy, Reflection, Profession, and Trust. The Journal of the American Medical Association 286(15), 1897–1902 (2001)

    Article  Google Scholar 

  19. Marsella, S., Gratch, J., Rickel, J.: Expressive behaviors for virtual worlds. In: Prendinger, H., Ishizuka, M. (eds.) Life-like Characters. Tools, Affective Functions and Applications, pp. 317–376. Springer, Heidelberg (2003)

    Google Scholar 

  20. De Carolis, B., De Rosis, F., Carofiglio, V., Pelachaud, C., Poggi, I.: Interactive Information Presentation by Embodied Animated Agent. In: International Workshop on IPNMD, Verona, Italy (2001)

    Google Scholar 

  21. De Rosis, F., De Carolis, B., Carofiglio, V., Pizzutilo, S.: Shallow and Inner Forms of Emotional Intelligence in Advisory Dialog Simulation. In: Prendinger, H., Ishizuka, M. (eds.) Life-like Characters. Tools, Affective Functions and Applications, pp. 271–294. Springer, Heidelberg (2003)

    Google Scholar 

  22. De Rosis, F., Novielli, N., Carofiglio, V., Cavalluzzi, A., De Carolis, B.: User modeling and adaptation in health promotion dialogs with an animated character. Journal of Biomedical Informatics 39(5), 514–531 (2006)

    Article  Google Scholar 

  23. Bickmore, T., Caruso, L., Clough-Gorr, K.: Acceptance and usability of a relational agent interface by urban older adults. In: CHI 2005 extended abstracts on Human factors in computing systems, pp. 1212–1215 (2005)

    Google Scholar 

  24. Bickmore, T., Pfeifer, L., Paasche-Orlow, M.: Health Document Explanation by Virtual Agents. In: Intelligent Virtual Agents 2007, Paris, pp. 183–196 (2007)

    Google Scholar 

  25. Cassell, J., Torres, O., Prevost, S.: Turn Taking vs Discourse Strcuture: How Best to Model Multimodal Conversation. In: Wilks, Y. (ed.) Machine Conversations. Kluwer, Dordrecht (1999)

    Google Scholar 

  26. Burke, M., Dunlap, W.: Estimating interrater agreement with the average deviation index: a user’s guide. Organizational Research Methods 5(2), 159–172 (2002)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Helmut Prendinger James Lester Mitsuru Ishizuka

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Georg, G., Cavazza, M., Pelachaud, C. (2008). Visualizing the Importance of Medical Recommendations with Conversational Agents. In: Prendinger, H., Lester, J., Ishizuka, M. (eds) Intelligent Virtual Agents. IVA 2008. Lecture Notes in Computer Science(), vol 5208. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-85483-8_39

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-85483-8_39

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-85482-1

  • Online ISBN: 978-3-540-85483-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics