Skip to main content
SpringerLink
Log in

That’s a Rap

Increasing Engagement with Rap Music Performance by Virtual Agents

  • Conference paper
  • First Online:
Intelligent Virtual Agents (IVA 2017)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 10498))

Included in the following conference series:

Abstract

Many applications of virtual agents, including those in healthcare and education, require engaging users in dozens or hundreds of interactions over long periods of time. In this effort, we are developing conversational agents to engage young adults in longitudinal lifestyle health behavior change interventions. Hip-hop and rap are one of the most popular genres of music among our stakeholders, and we are exploring rap as an engagement mechanism and communication channel in our agent-based interventions. We describe a method for integrating rap into a counseling dialog by a conversational agent, including the acoustic manipulation of synthetic speech and accompanying character dance animation. We demonstrate in a within-subjects study that the participants who like rap music preferred the rapping character significantly more than an equivalent agent that does not rap in its dialog, based on both self-report and behavioral measures. Participants also found the rapping agent significantly more engaging than the non-rapping one.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Battaglino, C., Bickmore, T.: Increasing the engagement of conversational agents through co-constructed storytelling. In: Eighth Workshop on Intelligent Narrative Technologies (2015)

    Google Scholar 

  2. Ring, L., Utami, D., Olafsson, S., Bickmore, T.: Increasing engagement with virtual agents using automatic camera motion. In: Traum, D., Swartout, W., Khooshabeh, P., Kopp, S., Scherer, S., Leuski, A. (eds.) IVA 2016. LNCS, vol. 10011, pp. 29–39. Springer, Cham (2016). doi:10.1007/978-3-319-47665-0_3

    Chapter  Google Scholar 

  3. Bickmore, T., Schulman, D., Yin, L.: Maintaining Engagement in Long-Term Interventions With Relational Agents. Appl. Artif. Intell. 24, 648–666 (2010)

    Article  Google Scholar 

  4. Hoffman, A.S., Lowenstein, L.M., Kamath, G.R., Housten, A.J., Leal, V.B., Linder, S.K., Jibaja-Weiss, M.L., Raju, G.S., Volk, R.J.: An entertainment-education colorectal cancer screening decision aid for African American patients: A randomized controlled trial. Cancer 123, 1401–1408 (2017)

    Article  Google Scholar 

  5. Lemieux, A.F., Fisher, J.D., Pratto, F.: A music-based HIV prevention intervention for urban adolescents. Heal. Psychol. 27, 349–357 (2008)

    Article  Google Scholar 

  6. Hip-hop is the most listened to genre in the world | The Independent, http://www.independent.co.uk/arts-entertainment/music/news/hip-hop-is-the-most-listened-to-genre-in-the-world-according-to-spotify-analysis-of-20-billion-10388091.html. Accessed 4/23/17

  7. Paukste, E., Harris, N.: Using rap music to promote adolescent health: pilot study of VoxBox. Heal. Promot. J. Aust. 26, 24 (2015)

    Article  Google Scholar 

  8. Levy, I.: Hip hop and spoken word therapy with urban youth. J. Poet. Ther. 25, 219–224 (2012)

    Article  Google Scholar 

  9. Elligan, D.: Rap therapy: a culturally sensitive approach to psychotherapy with young African American men. J. African Am. Men. 5, 27–37 (2000)

    Article  Google Scholar 

  10. DeCarlo, A., Hockman, E.: RAP Therapy: A Group Work Intervention Method for Urban Adolescents. Soc. Work Groups. 26, 45–59 (2004)

    Article  Google Scholar 

  11. Olson-McBride, L., Page, T.F.: Song to Self: Promoting a Therapeutic Dialogue with High-Risk Youths Through Poetry and Popular Music. Soc. Work Groups. 35, 124–137 (2012)

    Article  Google Scholar 

  12. Mancini, M., Bresin, R., Pelachaud, C.: A virtual-agent head driven by musical performance. In: IEEE Transactions on Audio, Speech, and Language Processiong, pp. 1883–1841 (2007)

    Google Scholar 

  13. Reidsma, D., Nijholt, A., Bos, P.: Temporal interaction between an artificial orchestra conductor and human musicians. Comput. Entertain. 6, 1 (2008)

    Article  Google Scholar 

  14. Reidsma, D., Nijholt, A., Poppe, R., Rienks, R., Hondorp, H.: Virtual rap dancer. In: CHI 2006 Extended Abstracts on Human Factors in Computing Systems - CHI 2006, p. 263 (2006)

    Google Scholar 

  15. Malmi, E., Takala, P., Toivonen, H., Raiko, T., Gionis, A.: DopeLearning: a computational approach to rap lyrics generation. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining - KDD 2016, pp. 195–204 (2016)

    Google Scholar 

  16. Cassell, J., Vilhjálmsson, H.H., Bickmore, T.: BEAT: the behavior expression animation toolkit. In: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques - SIGGRAPH 2001, pp. 477–486. ACM Press, New York (2001)

    Google Scholar 

  17. Jay-Z, Keys’ “Empire” Tops Hot 100 For Fifth Week | Billboard, http://www.billboard.com/articles/news/266366/jay-z-keys-empire-tops-hot-100-for-fifth-week. Accessed 4/23/17

  18. Bigi, B.: SPPAS: a tool for the phonetic segmentations of speech. In: The Eighth International Conference on Language Resources and Evaluation, pp. 1748–1755 (2012)

    Google Scholar 

  19. Lee, A., Kawahara, T.: Recent development of open-source speech recognition engine julius. In: 2009 Annual Summit and Conference on: Asia-Pacific Signal and Information Processing Association, APSIPA ASC 2009, pp. 131–137 (2009)

    Google Scholar 

  20. Boersma, P.: Praat, a system for doing phonetics by computer. Glot Int. 5, 341–345 (2001)

    Google Scholar 

  21. Tyson, E.H.: Rap-music Attitude and Perception Scale: A Validation Study. Res. Soc. Work Pract. 16, 211–223 (2006)

    Article  Google Scholar 

  22. Wheeless, L.R., Grotz, J.: The Measurement of Trust and Its Relationship to Self-Disclosure. Hum. Commun. Res. 3, 250–257 (1977)

    Article  Google Scholar 

  23. Zhou, S., Bickmore, T., Paasche-Orlow, M., Jack, B.: Agent-user concordance and satisfaction with a virtual hospital discharge nurse. In: Bickmore, T., Marsella, S., Sidner, C. (eds.) IVA 2014. LNCS, vol. 8637, pp. 528–541. Springer, Cham (2014). doi:10.1007/978-3-319-09767-1_63

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. College of Computer and Information Science, Northeastern University, Boston, MA, USA

    Stefan Olafsson, Everlyne Kimani, Reza Asadi & Timothy Bickmore

Authors
  1. Stefan Olafsson
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Everlyne Kimani
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Reza Asadi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Timothy Bickmore
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Stefan Olafsson .

Editor information

Editors and Affiliations

  1. KTH Royal Institute of Technology, Stockholm, Sweden

    Jonas Beskow

  2. KTH Royal Institute of Technology, Stockholm, Sweden

    Christopher Peters

  3. Uppsala University, Uppsala, Sweden

    Ginevra Castellano

  4. Trinity College, Dublin, Ireland

    Carol O'Sullivan

  5. KTH Royal Institute of Technology, Stockholm, Sweden

    Iolanda Leite

  6. University of Bielefeld, Bielefeld, Germany

    Stefan Kopp

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Olafsson, S., Kimani, E., Asadi, R., Bickmore, T. (2017). That’s a Rap. In: Beskow, J., Peters, C., Castellano, G., O'Sullivan, C., Leite, I., Kopp, S. (eds) Intelligent Virtual Agents. IVA 2017. Lecture Notes in Computer Science(), vol 10498. Springer, Cham. https://doi.org/10.1007/978-3-319-67401-8_41

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-67401-8_41

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-67400-1

  • Online ISBN: 978-3-319-67401-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation