Skip to main content
SpringerLink
Log in

Towards a Design Toolkit for Designing AR Interface with Head-Mounted Display for Close-Proximity Human-Robot Collaboration in Fabrication

  • Conference paper
  • First Online:
Collaboration Technologies and Social Computing (CollabTech 2023)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 14199))

  • 353 Accesses

Abstract

Industry 5.0 puts forward clear requirements for improving the interactive experience of human-machine collaboration, but few design tools currently exist to assist designers to think through how to design human-robot interactions, with a focus on turn-taking, coordination and communication of the interactive intention flow. We present a design toolkit for designers to explore, specify, analyse and document the unfolding interaction between human(s) and robot(s) through a model of interaction where the roles of leader and follower shape the forms of collaborative behaviour. We illustrate our preliminary design toolkit in action and demonstrate how it can be used to aid in exploring new augmented reality applications in robotic fabrication.

Supported by DMaF Lab, The University of Sydney.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 49.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 64.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Bartneck, C., Belpaeme, T., Eyssel, F., Kanda, T., Keijsers, M., Šabanović, S.: Human-Robot Interaction: An Introduction. Cambridge University Press (2020)

    Google Scholar 

  2. Dierichs, K., Menges, A.: Aggregate architecture: simulation models for synthetic non-convex granulates. In: Proceedings of the 33rd Annual Conference ACADIA, vol. 301 (2013)

    Google Scholar 

  3. Frayling, C.: Research in art and design (royal college of art research papers, vol 1, no 1, 1993/4) (1994)

    Google Scholar 

  4. Gannon, M.: Human-centered interfaces for autonomous fabrication machines (2017)

    Google Scholar 

  5. Leng, J., et al.: Industry 5.0: prospect and retrospect. J. Manuf. Syst. 65, 279–295 (2022)

    Article  Google Scholar 

  6. Lupetti, M.L., Zaga, C., Cila, N.: Designerly ways of knowing in HRI: broadening the scope of design-oriented HRI through the concept of intermediate-level knowledge. In: Proceedings of the 2021 ACM/IEEE International Conference on Human-Robot Interaction, pp. 389–398 (2021)

    Google Scholar 

  7. Malik, A.A., Bilberg, A.: Developing a reference model for human-robot interaction. Int. J. Interact. Des. Manuf. (IJIDeM) 13, 1541–1547 (2019)

    Article  Google Scholar 

  8. Sean-Kerawala: Instinctual interactions - mixed reality. https://learn.microsoft.com/en-us/windows/mixed-reality/design/interaction-fundamentals. Accessed 05 Jul 2023

  9. Skantze, G.: Turn-taking in conversational systems and human-robot interaction: a review. Comput. Speech Lang. 67, 101178 (2021)

    Article  Google Scholar 

  10. Suzuki, R., Karim, A., Xia, T., Hedayati, H., Marquardt, N.: Augmented reality and robotics: a survey and taxonomy for AR-enhanced human-robot interaction and robotic interfaces. In: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems, pp. 1–33 (2022)

    Google Scholar 

  11. Wang, L., Liu, S., Liu, H., Wang, X.V.: Overview of human-robot collaboration in manufacturing. In: Wang, L., Majstorovic, V.D.., Mourtzis, D., Carpanzano, E., Moroni, G., Galantucci, L.M. (eds.) Proceedings of 5th International Conference on the Industry 4.0 Model for Advanced Manufacturing. LNME, pp. 15–58. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-46212-3_2

    Chapter  Google Scholar 

  12. Yin, Y., Zheng, P., Li, C., Wang, L.: A state-of-the-art survey on augmented reality-assisted digital twin for futuristic human-centric industry transformation. Robot. Comput. Integr. Manuf. 81, 102515 (2023)

    Article  Google Scholar 

  13. Zhao, Y., Loke, L., Reinhardt, D.: Preliminary explorations of conceptual design tools for students learning to design human-robot interactions for the case of collaborative drawing. In: 2022 17th ACM/IEEE International Conference on Human-Robot Interaction (HRI), pp. 1135–1139. IEEE (2022)

    Google Scholar 

  14. Zimmerman, J., Forlizzi, J.: Research through design in HCI. In: Olson, J.S., Kellogg, W.A. (eds.) Ways of Knowing in HCI, pp. 167–189. Springer, New York (2014). https://doi.org/10.1007/978-1-4939-0378-8_8

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. The University of Sydney, Sydney, Australia

    Yi Zhao, Lynn Masuda, Lian Loke & Dagmar Reinhardt

Authors
  1. Yi Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Lynn Masuda
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Lian Loke
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Dagmar Reinhardt
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yi Zhao .

Editor information

Editors and Affiliations

  1. Ritsumeikan University, Shiga, Japan

    Hideyuki Takada

  2. Kyoto University of Advanced Science, Kyoto, Japan

    D. Moritz Marutschke

  3. Universidad de Los Andes, Las Condes, RM - Santiago, Chile

    Claudio Alvarez

  4. University of Tsukuba, Tsukuba, Japan

    Tomoo Inoue

  5. Ritsumeikan University, Ibaraki, Japan

    Yugo Hayashi

  6. Pompeu Fabra University, Barcelona, Spain

    Davinia Hernandez-Leo

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Zhao, Y., Masuda, L., Loke, L., Reinhardt, D. (2023). Towards a Design Toolkit for Designing AR Interface with Head-Mounted Display for Close-Proximity Human-Robot Collaboration in Fabrication. In: Takada, H., Marutschke, D.M., Alvarez, C., Inoue, T., Hayashi, Y., Hernandez-Leo, D. (eds) Collaboration Technologies and Social Computing. CollabTech 2023. Lecture Notes in Computer Science, vol 14199. Springer, Cham. https://doi.org/10.1007/978-3-031-42141-9_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-42141-9_9

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-42140-2

  • Online ISBN: 978-3-031-42141-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation