Abstract
Regulations restrict UAVs to fly only within direct view of the pilot, limiting their ability to support critical societal functions. One potential way to move beyond this limitation is by placing a 360-degree camera on the vehicle and using its feed to provide operators with a view that is the equivalent to being on the vehicle. This necessitates a cockpit user interface (UI) that amongst other things highlights flying objects, so that collision with these can be avoided. In this paper, virtual reality (VR) was used to build a prototype of such a system and evaluate three UIs that were designed to facilitate detecting aerial. Conclusions are drawn regarding which UI features support detection performance and a positive user experience.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
- 2.
- 3.
https://publicapps.caa.co.uk/docs/33/CAP%201861%20-%20BVLOS%20Fundamentals%20v2.pdf.
- 4.
- 5.
- 6.
References
Alce, G., Hermodsson, K., Wallergård, M., Thern, L., Hadzovic, T.: A prototyping method to simulate wearable augmented reality interaction in a virtual environment-a pilot study. Int. J. Virtual Worlds Hum. Comput. Interact. 3, 18–28 (2015)
Alce, G., Roszko, M., Edlund, H., Olsson, S., Svedberg, J., Wallergård, M.: [poster] ar as a user interface for the internet of things-comparing three interaction models. In: 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct), pp. 81–86. IEEE (2017)
Alce, G., Ternblad, E.-M., Wallergård, M.: Design and evaluation of three interaction models for manipulating Internet of Things (IoT) devices in virtual reality. In: Lamas, D., Loizides, F., Nacke, L., Petrie, H., Winckler, M., Zaphiris, P. (eds.) INTERACT 2019. LNCS, vol. 11749, pp. 267–286. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-29390-1_15
Bagassi, S., De Crescenzio, F., Piastra, S.: Augmented reality technology selection based on integrated QFD-AHP model. Int. J. Interact. Des. Manuf. (IJIDeM) 14(1), 285–294 (2019). https://doi.org/10.1007/s12008-019-00583-6
Bork, F., Schnelzer, C., Eck, U., Navab, N.: Towards efficient visual guidance in limited field-of-view head-mounted displays. IEEE Trans. Vis. Comput. Graph. 24(11), 2983–2992 (2018)
Davies, R.: Applications of systems design using virtual environments. In: The Handbook of Virtual Environments, pp. 1079–1100 (2002)
FLARM: The affordable collision avoidance technology for general aviation and UAV (2017). https://flarm.com/wp-content/uploads/man/FLARM-General-EN.pdf
Funk, M.: Human-drone interaction: let’s get ready for flying user interfaces!. Interactions 25(3), 78–81 (2018)
Garcia, J., et al.: Designing human-drone interactions with the paparazzi UAV system. In: 1st International Workshop on Human-Drone Interaction (2019)
Gorbunov, A.L., Nechaev, E.E.: Augmented reality technologies in air transport control systems. In: 2022 Systems of Signals Generating and Processing in the Field of on Board Communications, pp. 1–5 (2022). https://doi.org/10.1109/IEEECONF53456.2022.9744399
Jung, T., tom Dieck, M.C., Moorhouse, N., tom Dieck, D.: Tourists’ experience of virtual reality applications. In: 2017 IEEE International Conference on Consumer Electronics (ICCE), pp. 208–210. IEEE (2017)
Kim, H., Gabbard, J.L., Anon, A.M., Misu, T.: Driver behavior and performance with augmented reality pedestrian collision warning: an outdoor user study. IEEE Trans. Vis. Comput. Graph. 24(4), 1515–1524 (2018)
Niehorster, D.C., Li, L., Lappe, M.: The accuracy and precision of position and orientation tracking in the HTC vive virtual reality system for scientific research. i-Perception 8(3), 2041669517708205 (2017)
Park, H., Kim, K.: Efficient information representation method for driver-centered AR-HUD system. In: Marcus, A. (ed.) DUXU 2013. LNCS, vol. 8014, pp. 393–400. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-39238-2_43
Santel, C.G., Gerber, P., Mehringskoetter, S., Schochlow, V., Vogt, J., Klingauf, U.: How glider pilots misread the flarm collision alerting display. Aviat. Psychol. Appl. Hum. Factors 4(2), 86 (2014)
Vienne, C., Masfrand, S., Bourdin, C., Vercher, J.L.: Depth perception in virtual reality systems: effect of screen distance, environment richness and display factors. IEEE Access 8, 29099–29110 (2020). https://doi.org/10.1109/ACCESS.2020.2972122
Wickens, C.D., Dempsey, G., Pringle, A., Kazansky, L., Hutka, S.: The joint tactical air controller: cognitive modeling and augmented reality HMD design. In: 20th International Symposium on Aviation Psychology, p. 163 (2019)
Acknowledgment
The authors would like to thank all participants who did the tests.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Alce, G., Alm, P., Tyllström, R., Smoker, A., Niehorster, D.C. (2022). Design and Evaluation of Three User Interfaces for Detecting Unmanned Aerial Vehicles Using Virtual Reality. In: Zachmann, G., Alcañiz Raya, M., Bourdot, P., Marchal, M., Stefanucci, J., Yang, X. (eds) Virtual Reality and Mixed Reality. EuroXR 2022. Lecture Notes in Computer Science, vol 13484. Springer, Cham. https://doi.org/10.1007/978-3-031-16234-3_3
Download citation
DOI: https://doi.org/10.1007/978-3-031-16234-3_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-16233-6
Online ISBN: 978-3-031-16234-3
eBook Packages: Computer ScienceComputer Science (R0)