Skip to main content

An AR-Enabled See-Through System for Vision Blind Areas

  • Conference paper
  • First Online:

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1498))

Abstract

The manual assembly has a high proportion in industry. However, in many industrial scenarios, manual assembly in the Vision Blind Areas (VBAs) is time-consuming and challenging due to the lack of necessary visual information. This study presented a see-through Augmented Reality (AR) system to solve the problems during manual assembly in the vision blind area. This system enabled users to see the inner components of the VBAs cross the surface of mechanical products. The human hand and the mechanical part in a VBA were tracked and rendered in an AR HMD. We developed a prototype system and conducted a user study to evaluate the system usability, users’ performance and workload. The results indicated that this system was well integrated and easy to use. Moreover, participants worked with this system had a lower workload with improved performance.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Behzadan, A.H., Timm, B.W., Kamat, V.R.: General purpose modular hardware and software framework for mobile outdoor augmented reality applications in engineering. Adv. Eng. Inform. 22(1), 90–105 (2008)

    Article  Google Scholar 

  2. Lorenz, M., Knopp, S., Kim, J., et al.: Industrial augmented reality: 3D-content editor for augmented reality maintenance worker support system. In: 2020 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). IEEE, Brazil (2020)

    Google Scholar 

  3. Heinrich, F., Joeres, F., Kai, L., et al.: Comparison of projective augmented reality concepts to support medical needle insertion. IEEE Trans. Vis. Comput. Graph. 25, 2157–2167 (2019)

    Article  Google Scholar 

  4. Livingston. M.A., Rosenblum, L.J., Julier, S.J., et al.: An augmented reality system for military operations in urban terrain. In: Proceedings of Interservice/Industry Training, Simulation & Education Conference 2002, Orlando (2008)

    Google Scholar 

  5. Köse, H., Güner-Yildiz, N.: Augmented reality (AR) as a learning material in special needs education. Educ. Inf. Technol. 26(2), 1921–1936 (2020). https://doi.org/10.1007/s10639-020-10326-w

    Article  Google Scholar 

  6. Wang, X., Ong, S.K., Nee, A.: Multi-modal augmented-reality assembly guidance based on bare-hand interface. Adv. Eng. Inform. 30(3), 406–421 (2016)

    Article  Google Scholar 

  7. Caudell, T.P., Mizell, D.W.: Augmented reality: an application of heads-up display technology to manual manufacturing processes. In: Hawaii International Conference on System Sciences. IEEE (1992)

    Google Scholar 

  8. Henderson, S., Feiner, S.: Exploring the benefits of augmented reality documentation for maintenance and repair. IEEE Trans. Vis. Comput. Graph. 17(10), 1355–1368 (2011)

    Article  Google Scholar 

  9. Yin, X., Fan, X., Zhu, W., et al.: Synchronous AR assembly assistance and monitoring system based on ego-centric vision. Assem. Autom. 39(1), 1–16 (2019)

    Article  Google Scholar 

  10. Jung, S., Bruder, G., Wisniewski, P.J., et al.: Over my hand: using a personalized hand in VR to improve object size estimation, body ownership, and presence. In: The Symposium. ACM, Berlin (2018)

    Google Scholar 

  11. Saurabh, Dargar, Rebecca, et al.: Haptic technology Immersive virtual reality surgical learning Surgical simulations. J, Comput. Surg. 2(2), 1–26 (2015)

    Google Scholar 

  12. Chu, C.H., Ko, C.H.: An experimental study on augmented reality assisted manual assembly with occluded components. J. Manuf. Syst. (2021)

    Google Scholar 

  13. Grochola, L.F., Soll, C., Zehnder, A., et al.: Robot-assisted single-site compared with laparoscopic single-incision cholecystectomy for benign gallbladder disease: protocol for a randomized controlled trial. BMC Surg. 17(1), 13 (2017)

    Article  Google Scholar 

  14. Brooke, J.: SUS: a quick dirty usability scale. Usability Eval. Ind. 189(1), 15 (1996)

    Google Scholar 

Download references

Acknowledgement

This work is partially supported by the National Key R&D Program of China (Grant No. 2019YFB1703800), Natural Science Basic Research Plan in Shaanxi Province of China (Grant No. 2016JM6054), the Programme of Introducing Talents of Discipline to Universities (111 Project), China (Grant No. B13044).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Weiping He .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Zhang, S., He, W., Wang, S., Feng, S., Hou, Z., Hu, Y. (2021). An AR-Enabled See-Through System for Vision Blind Areas. In: Stephanidis, C., Antona, M., Ntoa, S. (eds) HCI International 2021 - Late Breaking Posters. HCII 2021. Communications in Computer and Information Science, vol 1498. Springer, Cham. https://doi.org/10.1007/978-3-030-90176-9_28

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-90176-9_28

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-90175-2

  • Online ISBN: 978-3-030-90176-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics