Skip to main content

Gaze-Aware Social Interaction Techniques for Human-Robot Collaborative Shopping

  • Conference paper
  • First Online:
Collaboration Technologies and Social Computing (CollabTech 2023)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 14199))

  • 270 Accesses

Abstract

Robots that provide customer service in physical stores are being researched as a means of coexisting with people in everyday situations. One issue with such robots is that their suggestions are usually ignored and may not effectively promote purchasing behavior among customers. This paper aims to investigate whether customers are more likely to accept a robot’s suggestion by having the robot use personalized information that can enhance the shopping experience. To investigate the effectiveness of a robot’s suggestions, we conducted an experiment in a physical retail store in a real-world environment. The study aimed to encourage customers to pick up products by utilizing their posture information. As a result, the number of customers who picked up the product increased when the robot made suggestions when customers leaned forward to look at the product. This suggests that using a customer’s posture information to make suggestions can increase the likelihood of a customer accepting a robot’s proposal.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 49.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 64.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Peck, J., Shu, S.B.: The effect of mere touch on perceived ownership. J. Consum. Res. 36(3), 434–447 (2009)

    Google Scholar 

  2. Reb, J., Connolly, T.: Possession, feelings of ownership and the endowment effect. Judgment Decis. Mak. 2(2), 107–114 (2023). https://doi.org/10.1017/S1930297500000085

    Article  Google Scholar 

  3. Wolf, J.R., Arkes, H.R., Muhanna, W.A.: The power of touch: an examination of the effect of duration of physical contact on the valuation of objects. Judgm. Decis. Mak. 3(6), 476–482 (2008). https://doi.org/10.1017/S193029750000005X

    Article  Google Scholar 

  4. Yamazaki, A., Yamazaki, K., Kuno, Y., Burdelski, M., Kawashima, M., Kuzuoka, H.: Precision timing in human-robot interaction: coordination of head movement and utterance. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2008), pp. 131–140 (2008)

    Google Scholar 

  5. Yamazaki, K., et al.: Revealing gaugian: engaging visitors in robot guide’s explanation in art museum. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2009), pp. 1437–1446 (2009)

    Google Scholar 

  6. Bennewitz, M., Faber, F., Joho, D., Schreiber, M., Behnke, S.: Towards a Humanoid museum guide robot that interacts with multiple persons. In: 5th IEEE-RAS International Conference on Humanoid Robots, pp. 418–423 (2005)

    Google Scholar 

  7. Gehle, R., Pitsch, K., Wrede, S.: Signaling trouble in robot-to-group interaction. emerging visitor dynamics with a museum guide robot. In: Proceedings of the Second International Conference on Human-Agent Interaction (HAI 2014), pp. 361–368 (2014)

    Google Scholar 

  8. Kuno, Y., Sadazuka, K., Kawashima, M., Yamazaki, K., Yamazaki, A., Kuzuoka, H.: Museum guide robot based on sociological interaction analysis. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2007), pp. 1191–1194 (2007)

    Google Scholar 

  9. Tanaka, F., Isshiki, K., Takahashi, F., Uekusa, M., Sei, R., Hayashi, K.: Pepper learns together with children: development of an educational application. Humanoid Robots (Humanoids). In: 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids), pp. 270–275 (2015)

    Google Scholar 

  10. Saerbeck, M., Schut, T., Bartneck, C., Janse, M.D.: Expressive robots in education: Varying the degree of social supportive behavior of a robotic tutor. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2010), pp. 1613–1622 (2010)

    Google Scholar 

  11. Nakanishi, J., Kuramoto, I., Baba, J., Kohei, O., Yoshikawa, Y., Ishiguro, H.: Can a Humanoid Robot Engage in Heartwarming Interaction Service at a Hotel? In: Proceedings of the 6th International Conference on Human-Agent Interaction (HAI 2018), pp. 45–53 (2018)

    Google Scholar 

  12. Heerink, M., Krose, B., Evers, V., Wielinga, B.: Influence of social presence on acceptance of an assistive social robot and screen agent by elderly users. Adv. Robot. 23(14), 1909–1923 (2009)

    Google Scholar 

  13. Kim, S., Kim, J., Badu-Baiden, F., Giroux, M., Choi, Y.: Preference for robot service or human service in hotels? Impacts of the COVID-19 pandemic. Int. J. Hospital. Manage. 93 (2021)

    Google Scholar 

  14. Shiomi, M., et al.: Recommendation effects of a social robot for advertisement-use context in a shopping mall. Int. J. Soc. Robot. 5(2), 251–262 (2013). https://doi.org/10.1007/s12369-013-0180-4

  15. Iwamoto, T., et al.: The effectiveness of self-recommending agents in advancing purchase behavior steps in retail marketing. In: HRI 2021: Proceedings of the 9th International Conference on Human-Agent Interaction, pp. 209–217 (2021)

    Google Scholar 

  16. Iwamoto, T., Baba, J., Nakanishi, J., Hyodo, K., Yoshikawa, Y., Ishiguro, H.: Playful recommendation: sales promotion that robots stimulate pleasant feelings instead of product explanation. IEEE Robot. Autom. Let. 17(4), 11815–11822 (2022)

    Google Scholar 

  17. Iwasaki, M., Ikeda, M., Kawamura, T., Nakanishi, H.: State-transition modeling of human–robot interaction for easy crowdsourced robot control. Sensors 20(22) (2020)

    Google Scholar 

  18. Iwasaki, M., et al.: Enabling shared attention with customers strengthens a sales robot’s social presence. In: HAI 2022: Proceedings of the 10th International Conference on Human-Agent Interaction, pp. 176–184 (2022)

    Google Scholar 

Download references

Acknowledgments

We would like to express our gratitude to everyone at Jintora, a specialized Shichimi shop, for generously providing us with the experimental space. This research project was supported by JSPS KAKENHI Grant Numbers JP19H00605, JP19K21718, JP18KK0053, JP20H01585, JP22K18548 and Artificial Intelligence Research Promotion Foundation.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Masaya Iwasaki .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Iwasaki, M., Ogawa, K., Kawamura, T., Nakanishi, H. (2023). Gaze-Aware Social Interaction Techniques for Human-Robot Collaborative Shopping. In: Takada, H., Marutschke, D.M., Alvarez, C., Inoue, T., Hayashi, Y., Hernandez-Leo, D. (eds) Collaboration Technologies and Social Computing. CollabTech 2023. Lecture Notes in Computer Science, vol 14199. Springer, Cham. https://doi.org/10.1007/978-3-031-42141-9_16

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-42141-9_16

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-42140-2

  • Online ISBN: 978-3-031-42141-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics