Skip to main content

Seamless Virtual Object Transitions: Enhancing User Experience in Cross-Device Augmented Reality Environments

  • Conference paper
  • First Online:
Extended Reality (XR Salento 2023)

Abstract

The integration of augmented reality (AR) headsets and projector displays has the potential to enhance shared experiences in various fields. However, the seamless transition of virtual objects between these devices remains a challenge. In this paper, we present a combined cross-device system that evaluates user experience based on different virtual object transition methods during both passive and active interactions. We hypothesize that certain transition techniques may result in confusion, discomfort, or disorientation, while others can improve immersion and ease of use. Our study comprises a virtual zoo scenario, where participants observe and interact with virtual alpacas, providing insights into their experiences with the different transition methods. The results reveal the impact of the content type and size on transitions between devices. We explain how to minimize confusion and discomfort while maximizing immersion and ease of use. Based on our findings, we propose future research directions to further refine cross-device interaction techniques, with the goal of creating more immersive, accessible, and user-friendly experiences in diverse applications, such as education, entertainment, and professional settings.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Jorjin j7ef plus ar smartglasses. https://www.jorjin.com/products/ar-smart-glasses/j-reality/j7ef-plus/. Accessed 02 Jun 2023

  2. Unity. https://unity.com/. Accessed 02 Jun 2023

  3. Alejandro, S.: Github repository for slam saving and loading. https://github.com/AlejandroSilvestri/osmap. Accessed 02 Jun 2023

  4. Batmaz, A.U., Mutasim, A.K., Malekmakan, M., Sadr, E., Stuerzlinger, W.: Touch the wall: comparison of virtual and augmented reality with conventional 2D screen eye-hand coordination training systems. In: 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 184–193 (2020). https://doi.org/10.1109/VR46266.2020.00037

  5. Billinghurst, M., Poupyrev, I., Kato, H., May, R.: Mixing realities in shared space: an augmented reality interface for collaborative computing. In: 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532). vol. 3, pp. 1641–1644 vol 3 (2000). https://doi.org/10.1109/ICME.2000.871085

  6. Cools, R., Esteves, A., Simeone, A.L.: Blending spaces: cross-reality interaction techniques for object transitions between distinct virtual and augmented realities. In: 2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 528–537 (2022). https://doi.org/10.1109/ISMAR55827.2022.00069

  7. Cools, R., Gottsacker, M., Simeone, A., Bruder, G., Welch, G., Feiner, S.: Towards a desktop-AR prototyping framework: Prototyping cross-reality between desktops and augmented reality. In: 2022 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), pp. 175–182 (2022). https://doi.org/10.1109/ISMAR-Adjunct57072.2022.00040

  8. Ghinea, M., Frunză, D., Chardonnet, J.-R., Merienne, F., Kemeny, A.: Perception of absolute distances within different visualization systems: HMD and CAVE. In: De Paolis, L.T., Bourdot, P. (eds.) AVR 2018. LNCS, vol. 10850, pp. 148–161. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-95270-3_10

    Chapter  Google Scholar 

  9. Google: Protocol buffers. https://protobuf.dev/. Accessed 02 Jun 2023

  10. Gugenheimer, J., Stemasov, E., Frommel, J., Rukzio, E.: ShareVR: enabling co-located experiences for virtual reality between HMD and non-HMD users. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, pp. 4021–4033. CHI 2017, Association for Computing Machinery, New York, USA (2017). https://doi.org/10.1145/3025453.3025683

  11. Hobson, T., Duncan, J., Raji, M., Lu, A., Huang, J.: Alpaca: AR graphics extensions for web applications. In: 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 174–183 (2020). https://doi.org/10.1109/VR46266.2020.00036

  12. Martin-Gomez, A., Winkler, A., Yu, K., Roth, D., Eck, U., Navab, N.: Augmented mirrors. In: 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 217–226 (2020). https://doi.org/10.1109/ISMAR50242.2020.00045

  13. Meta Platforms Inc,: Quest hardware specifications (2023). https://en.wikipedia.org/wiki/Meta_Quest_Pro

  14. Mur-Artal, R., Tardós, J.D.: ORB-SLAM2: an open-source slam system for monocular, stereo, and RGB-D cameras. IEEE Trans. Robot. 33(5), 1255–1262 (2017). https://doi.org/10.1109/TRO.2017.2705103

    Article  Google Scholar 

  15. Schwajda, D., Friedl, J., Pointecker, F., Jetter, H.C., Anthes, C.: Transforming graph data visualisations from 2D displays into augmented reality 3D space: a quantitative study. Front. Virtual Reality 4, 28 (2023)

    Article  Google Scholar 

  16. Tang, X., Hu, X., Fu, C.W., Cohen-Or, D.: GrabAR: occlusion-aware grabbing virtual objects in AR. In: Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology, pp. 697–708. UIST 2020, Association for Computing Machinery, New York, USA (2020). https://doi.org/10.1145/3379337.3415835

  17. Ying: Github repository for unity slam integration. https://github.com/ygx2011/AR_course. Accessed 02 Jun 2023

  18. Zhang, Y., Tang, L.: Collaborative mixed reality annotations system for science and history education based on UWB positioning and low-cost AR glasses. In: De Paolis, L.T., Arpaia, P., Sacco, M. (eds.) Extended Reality. XR Salento 2022. Lecture Notes in Computer Science. vol. 13446. Springer, Cham (2022). https://doi.org/10.1007/978-3-031-15553-6_12

Download references

Acknowledgements

We’d like to acknowledge that various open source images from https://www.pngegg.com were used in this study. This work was supported in part by a grant from Jorjin Technologies Inc. and the Ministry of Science and Technology of Taiwan, and NTU Center for Artificial Intelligence Advanced Robotics, under the grant numbers MOST 110-2634-F-002-049, MOST 110-2221-E-002-166-MY3, MOST 111-2622-E-002-032.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Robin Fischer .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Fischer, R., Lian, WX., Wang, SJ., Hsu, WE., Fu, LC. (2023). Seamless Virtual Object Transitions: Enhancing User Experience in Cross-Device Augmented Reality Environments. In: De Paolis, L.T., Arpaia, P., Sacco, M. (eds) Extended Reality. XR Salento 2023. Lecture Notes in Computer Science, vol 14218. Springer, Cham. https://doi.org/10.1007/978-3-031-43401-3_26

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-43401-3_26

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-43400-6

  • Online ISBN: 978-3-031-43401-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics