Abstract
This paper describes the development of a HoloLens application for experimenting the ability to collaboratively monitor flight tests by a shared holographic-like tabletop approach. The situational awareness arising from a high sense of presence deriving from the glasses-based holographic representation of the flying scenario leads to effective decision making. Moreover, the optical see-through MR approach to in-site collaboration makes inter-person communication as easy as in the reality. Finally, the shared holographic representation virtually recreated in the in-between space among participants promises a visually coherent basis for “look here” collaboration style.
A flexible architecture is proposed for this application separating the core app from the data feeds for a slimmer development-deployment process, and technologies and data source to be used for the realization are reviewed.
Finally, the paper reports the results of experimental use of the system collected in a couple of flight tests held in our Center, and allows readers to draw a perspective pathway to future MR developments.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Description of MixedRealityToolkit.Sharing from the Github webpage [12].
References
Boeing drones and Microsoft holograms to fight wildfires. Commercial UAV News web site. [www.commercialuavnews.com/public-safety/boeing-drones-microsoft-holograms-fight-wildfires]
Su, S., Perry, V., Guan, Q., Durkee, A., Neigel, A.R., Kase, S.: Sensor data fusion framework to improve holographic object registration accuracy for a shared augmented reality mission planning scenario. In: Chen, J.Y.C., Fragomeni, G. (eds.) VAMR 2018. LNCS, vol. 10909, pp. 202–214. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-91581-4_15
Chusetthagarn, D.,Visoottiviseth, V., Haga, J.: A prototype of collaborative augmented reality environment for hololens. In: 2018 22nd International Computer Science and Engineering Conference (ICSEC), pp. 1–5 Chiang Mai, Thailand, (2018)
Kase, S., Su, S., Perry, V., Roy, H., Gamble, K.: An augmented reality shared mission planning scenario: observations on shared experience. In: Chen, J.Y.C., Fragomeni, G. (eds.) HCII 2019. LNCS, vol. 11575, pp. 490–503. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-21565-1_33
Croft, B.L., et al.: Command and Control Collaboration Sand Table (C2-CST). In: Chen, J.Y.C., Fragomeni, G. (eds.) VAMR 2018. LNCS, vol. 10910, pp. 249–259. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-91584-5_20
Saab Australia Mixed Reality web site. [saab.com/region/saab-australia/mixed-reality]
Persiani, F., De Crescenzio, F., Fantini, M., Bagassi, S.: A tabletop-based interface to simulate air traffic control in a distributed virtual environment. In: Proceedings of the XVI ADM Congress and XIX Ingegraf Congress. June 6–8, Perugia, Italy (2007)
Bagassi, S., De Crescenzio; F., Persiani, F.: Design and development of an ATC distributed training system. In: Proceedings of the 26th Congress of the International Council of Aeronautical. Sciences (ICAS 2008)/8th AIAA Aviation, Technology, Integration and Operations. September 14–19, Anchorage, Alaska (2008)
Masotti, N., Bagassi, S., De Crescenzio, F.: Augmented Reality for the Control Tower: The RETINA Concept. In: De Paolis, L.T., Mongelli, A. (eds.) AVR 2016. LNCS, vol. 9768, pp. 444–452. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-40621-3_32
Han, K., Hammad, H.S.S., Weon Lee, J.: Holographic mixed reality system for air traffic control and management. Appl. Sci. 9, 3370 (2019). https://doi.org/10.3390/app9163370
Unity. [unity.com]
Microsoft-NASA MixedRealityToolkit.Sharing [github.com/microsoft/MixedRealityToolkit/tree/master/Sharing]
Automatic Dependent Surveillance - Broadcast ADS-B [en.wikipedia.org/wiki/Automatic_dependent_surveillance_%E2%80%93_broadcast]
ESRI ArcGIS WorldElevation3D/Terrain3D ImageServer [elevation3d.arcgis.com/arcgis/rest/services/WorldElevation3D/Terrain3D/ImageServer]
OpenStreetMap.[www.openstreetmap.org]
OpenStreetMap map features. [wiki.openstreetmap.org/wiki/Map_Features]
OSM2World Create 3D models from OpenStreetMap. [osm2world.org/,wiki.openstreetmap.org/wiki/OSM2World]
Digital Elevation Data.[www.viewfinderpanoramas.org]
OpenSoundControl: an Enabling Encoding for Media Applications [opensoundcontrol.org]
ADS-B Flightaware Pro Stick Plus USB SDR receiver
ADS-B omnidirectional antenna Yilianduo EUOL-2957 9dBi 1090 MHz
Zadig: USB driver installation made easy. [zadig.akeo.ie]
MRTK-Unity [github.com/microsoft/MixedRealityToolkit-Unity]
HoloLens Terrain Viewer. ESRI Prototype Lab. [github.com/Esri/hololens-terrain-viewer]
OpenXR. Khronos Group. [www.khronos.org/openxr/]
Acknowledgments
The activity described in the present work has been partially supported by the PRORA UAV National research program. In particular, the experimental activity has been carried out by flight test campaigns held in the second half of 2019 in the airspace around the Capua airport, based on the FLARE flight testbed. The authors wish to acknowledge Pier Paolo de Matteis, Attilio Rispoli and all the FLARE team at CIRA for their technical and management support.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Sikorski, B., Leoncini, P., Luongo, C. (2020). A Glasses-Based Holographic Tabletop for Collaborative Monitoring of Aerial Missions. In: De Paolis, L., Bourdot, P. (eds) Augmented Reality, Virtual Reality, and Computer Graphics. AVR 2020. Lecture Notes in Computer Science(), vol 12242. Springer, Cham. https://doi.org/10.1007/978-3-030-58465-8_26
Download citation
DOI: https://doi.org/10.1007/978-3-030-58465-8_26
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-58464-1
Online ISBN: 978-3-030-58465-8
eBook Packages: Computer ScienceComputer Science (R0)