skip to main content
10.1145/3520495.3520528acmotherconferencesArticle/Chapter ViewAbstractPublication PagesozchiConference Proceedingsconference-collections
short-paper

Improving Visual Search Tasks by Bending the Virtual City Twins: A Preliminary Study in Virtual Reality

Published: 15 September 2022 Publication History

Abstract

Visually searching for physical entities can be challenging as other entities often block the targets. The rapid advancement of head-mounted displays (HMDs) and cyber-physical mappings in smart cities may offer an alternative solution, where users can quickly locate the target by manipulating the digital representations of their surrounding environments. For example, a user wearing an HMD can reveal the hidden target by “lifting” the cyber world to create a curved virtual map on top of the physical world.
This paper presents a virtual reality (VR)-based preliminary study that investigates how such cyber-physical bending interaction affects visual search tasks. A virtual environment is used to emulate a physical world and its virtual twin. The results demonstrate that vertically bending the virtual twin can significantly improve users’ (N = 20) performance in a city infrastructure inspection task (160% faster) and a landmark navigation task (50% faster) in the virtual city environment.

References

[1]
Günter Alce, Eva-Maria Ternblad, and Mattias Wallergård. 2019. Design and Evaluation of Three Interaction Models for Manipulating Internet of Things (IoT) Devices in Virtual Reality. In Human-Computer Interaction – INTERACT 2019, David Lamas, Fernando Loizides, Lennart Nacke, Helen Petrie, Marco Winckler, and Panayiotis Zaphiris (Eds.). Springer International Publishing, Cham, 267–286.
[2]
Benjamin Avery, Christian Sandor, and Bruce H. Thomas. 2009. Improving Spatial Perception for Augmented Reality X-Ray Vision. In 2009 IEEE Virtual Reality Conference. IEEE, Lafayette, LA, USA, 79–82. https://doi.org/10.1109/VR.2009.4811002
[3]
Abdulmotaleb El Saddik. 2018. Digital Twins: The Convergence of Multimedia Technologies. IEEE Multimedia 25, 2 (apr 2018), 87–92. https://doi.org/10.1109/MMUL.2018.023121167
[4]
Niklas Elmqvist and Philippas Tsigas. 2008. A Taxonomy of 3D Occlusion Management for Visualization. IEEE Transactions on Visualization and Computer Graphics 14, 5(2008), 1095–1109. https://doi.org/10.1109/TVCG.2008.59
[5]
Okan Erat, Werner Alexander Isop, Denis Kalkofen, and Dieter Schmalstieg. 2018. Drone-Augmented Human Vision: Exocentric Control for Drones Exploring Hidden Areas. IEEE Transactions on Visualization and Computer Graphics 24, 4(2018), 1437–1446. https://doi.org/10.1109/TVCG.2018.2794058
[6]
Facebook Technologies, LLC.2021. Map Controllers. Retrieved June 22, 2021 from https://developer.oculus.com/documentation/unity/unity-ovrinput/?device=QUEST
[7]
Angelo Furfaro, Luciano Argento, Andrea Parise, and Antonio Piccolo. 2017. Using virtual environments for the assessment of cybersecurity issues in IoT scenarios. Simulation Modelling Practice and Theory 73 (2017), 43–54. https://doi.org/10.1016/j.simpat.2016.09.007 Smart Cities and Internet of Things.
[8]
Michael Grieves. 2014. Digital twin: manufacturing excellence through virtual factory replication. White paper 1(2014), 1–7.
[9]
Y. Kameda, T. Takemasa, and Y. Ohta. 2004. Outdoor see-through vision utilizing surveillance cameras. In Third IEEE and ACM International Symposium on Mixed and Augmented Reality. IEEE, Arlington, VA, USA, 151–160. https://doi.org/10.1109/ISMAR.2004.45
[10]
Thomas Kapler, Robert King, and Dario Segura. 2019. “SkyMap”: World-Scale Immersive Spatial Display. In Symposium on Spatial User Interaction (New Orleans, LA, USA) (SUI ’19). Association for Computing Machinery, New York, NY, USA, Article 16, 3 pages. https://doi.org/10.1145/3357251.3358749
[11]
Zhihan Lv, Tengfei Yin, Xiaolei Zhang, Houbing Song, and Ge Chen. 2016. Virtual Reality Smart City Based on WebVRGIS. IEEE Internet of Things Journal 3, 6 (2016), 1015–1024. https://doi.org/10.1109/JIOT.2016.2546307
[12]
Christopher Nolan. 2010. Inception. (2010).
[13]
Pilaiwan Phupattanasilp and Sheau-Ru Tong. 2019. Augmented Reality in the Integrative Internet of Things (AR-IoT): Application for Precision Farming. Sustainability 11, 9 (2019). https://doi.org/10.3390/su11092658
[14]
Synty Studios. 2020. POLYGON City - Low Poly 3D Art by Synty. Retrieved June 22, 2021 from https://assetstore.unity.com/packages/3d/environments/urban/polygon-city-low-poly-3d-art-by-synty-95214
[15]
Synty Studios. 2021. Curved World. Retrieved June 22, 2021 from https://assetstore.unity.com/packages/vfx/shaders/curved-world-2020-173251
[16]
Jeremy M Wolfe. 2015. Visual search.In The handbook of attention.Boston Review, Cambridge, MA, US, 27–56.

Cited By

View all
  • (2023)An empirical evaluation of enhanced teleportation for navigating large urban immersive virtual environmentsFrontiers in Virtual Reality10.3389/frvir.2022.10758113Online publication date: 10-Jan-2023

Index Terms

  1. Improving Visual Search Tasks by Bending the Virtual City Twins: A Preliminary Study in Virtual Reality

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Other conferences
      OzCHI '21: Proceedings of the 33rd Australian Conference on Human-Computer Interaction
      November 2021
      361 pages
      Publication rights licensed to ACM. ACM acknowledges that this contribution was authored or co-authored by an employee, contractor or affiliate of a national government. As such, the Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only.

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 15 September 2022

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. curvature
      2. cyber-physical manipulation
      3. infrastructure inspection
      4. mixed reality
      5. navigation

      Qualifiers

      • Short-paper
      • Research
      • Refereed limited

      Conference

      OzCHI '21
      OzCHI '21: 33rd Australian Conference on Human-Computer Interaction
      November 30 - December 2, 2021
      VIC, Melbourne, Australia

      Acceptance Rates

      Overall Acceptance Rate 362 of 729 submissions, 50%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)30
      • Downloads (Last 6 weeks)2
      Reflects downloads up to 05 Mar 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2023)An empirical evaluation of enhanced teleportation for navigating large urban immersive virtual environmentsFrontiers in Virtual Reality10.3389/frvir.2022.10758113Online publication date: 10-Jan-2023

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format.

      HTML Format

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media