Skip to main content

Evaluating Customers’ Engagement Preferences for Multi-party Interaction with a Robot Bartender

  • Conference paper
  • First Online:
Social Robotics (ICSR 2023)

Abstract

In this paper, we present a two parts study where we investigate whether socially relevant interactions depend on a bartender robot’s ability to maintain engaged interactions with two users at a time, by alternating its attention between the two customers, and by capturing their attention by personalising the discussion topics to the users’ preferences. We recruited 20 participants in the first study, and 6 participants in the second study. We observed that participants were more comfortable and enjoyed interacting with the robot when the robot personalised interaction and alternated the service between the two users, compared to when the robot did not personalise the talk and served the users according to their arrival time. However, we observed that in both conditions, the participants did not feel excluded while waiting for the other to finish their interaction with the robot. Finally, personalised interaction topics increased participants’ interest in the conversation with the robot. These results guide us to design and deploy a robot that adapts its behaviours to have rich and multi-party interactions in real settings.

This work has been supported by Italian PON I &C 2014-2020 within BRILLO research project “Bartending Robot for Interactive Long-Lasting Operations”, no. F/190066/01-02/X44 and Italian PON R &I 2014-2020 - REACT-EU Azione IV.4 (CUP E65F21002920003).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    Tweepy libraries https://www.tweepy.org/.

  2. 2.

    Furhat Robotics https://furhat.io.

References

  1. Ball, P.: Listeners’ responses to filled pauses in relation to floor apportionment. Br. J. Soc. Clin. Psychol. 14(4), 423–424 (1975). https://doi.org/10.1111/j.2044-8260.1975.tb00198.x

    Article  Google Scholar 

  2. Becker-Asano, C., Kanda, T., Ishi, C., Ishiguro, H.: How about laughter? perceived naturalness of two laughing humanoid robots. In: 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, pp. 1–6 (2009). https://doi.org/10.1109/ACII.2009.5349371

  3. Di Napoli, C., Ercolano, G., Rossi, S.: Personalized home-care support for the elderly: a field experience with a social robot at home. User Model. User-Adap. Inter. 33(2), 405–440 (2023)

    Article  Google Scholar 

  4. D Gravano, A., Hirschberg, J.: Turn-taking cues in task-oriented dialogue. Comput. Speech Lang. 25(3), 601–634 (2011). https://doi.org/10.1016/j.csl.2010.10.003

  5. Holler, J., Kendrick, K., Levinson, S.: Processing language in face-to-face conversation: questions with gestures get faster responses. Psychon. Bull. Unexpected Ampersand Rev. 25, 1900–1908 (2017). https://doi.org/10.3758/s13423-017-1363-z

    Article  Google Scholar 

  6. Lee, M.K., Forlizzi, J., Kiesler, S., Rybski, P., Antanitis, J., Savetsila, S.: Personalization in HRI: A longitudinal field experiment. In: Proceedings of the 7th ACM/IEEE International Conference on HRI, pp. 319–326 (2012)

    Google Scholar 

  7. Lim, M., Robb, D., Wilson, B., Hastie, H.: Feeding the coffee habit: a longitudinal study of a robo-barista. In: Proceedings - IEEE International Conference on Robot and Human Interactive Communication (RO-MAN 2023), pp. 1–8 (2023)

    Google Scholar 

  8. Oertel, C., et al.: Engagement in human-agent interaction: an overview. Front. Robot. AI 7, 92 (2020)

    Article  Google Scholar 

  9. Prescott, T.J., Robillard, J.M.: Are friends electric? the benefits and risks of human-robot relationships. Iscience 24(1), 101993 (2021). https://doi.org/10.1016/j.isci.2020.101993

    Article  Google Scholar 

  10. Rehm, M., Jensen, M.L.: Accessing cultural artifacts through digital companions: the effects on children’s engagement. In: 2015 International Conference on Culture and Computing (Culture Computing), pp. 72–79 (2015). https://doi.org/10.1109/Culture.and.Computing.2015.44

  11. Rossi, A., John, N.E., Taglialatela, G., Rossi, S.: Generating emotional gestures for handling social failures in HRI. In: 2022 31st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), pp. 1399–1404 (2022)

    Google Scholar 

  12. Rossi, A., Maro, M.D., Origlia, A., Palmiero, A., Rossi, S.: A ROS architecture for personalised HRI with a bartender social robot (2022)

    Google Scholar 

  13. Rossi, A., Perugia, G., Rossi, S.: Investigating customers’ perceived sensitivity of information shared with a robot bartender. In: Li, H., et al. (eds.) ICSR 2021. LNCS (LNAI), vol. 13086, pp. 119–129. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-90525-5_11

    Chapter  Google Scholar 

  14. Rossi, A., Rossi, S.: Engaged by a bartender robot: recommendation and personalisation in human-robot interaction, pp. 115–119 (2021). https://doi.org/10.1145/3450614.3463423

  15. Salam, H., Çeliktutan, O., Hupont, I., Gunes, H., Chetouani, M.: Fully automatic analysis of engagement and its relationship to personality in human-robot interactions. IEEE Access 5, 705–721 (2017)

    Google Scholar 

  16. Vázquez, M., Steinfeld, A., Hudson, S.E., Forlizzi, J.: Spatial and other social engagement cues in a child-robot interaction: effects of a sidekick. In: Proceedings of the 2014 ACM/IEEE International Conference on HRI, pp. 391–398 (2014)

    Google Scholar 

  17. Youssef, A.B., Varni, G., Essid, S., Clavel, C.: On-the-fly detection of user engagement decrease in spontaneous human-robot interaction. Int. J. Soc. Robot. 11, 815–828 (2019). https://doi.org/10.1007/s12369-019-00591-2

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Alessandra Rossi .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Rossi, A., Menna, C., Giordano, E., Rossi, S. (2024). Evaluating Customers’ Engagement Preferences for Multi-party Interaction with a Robot Bartender. In: Ali, A.A., et al. Social Robotics. ICSR 2023. Lecture Notes in Computer Science(), vol 14454. Springer, Singapore. https://doi.org/10.1007/978-981-99-8718-4_32

Download citation

  • DOI: https://doi.org/10.1007/978-981-99-8718-4_32

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-99-8717-7

  • Online ISBN: 978-981-99-8718-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics