Skip to main content

Augmented Reality Space Informatics System

  • Conference paper
  • First Online:
HCI International 2020 – Late Breaking Posters (HCII 2020)

Abstract

The Augmented Reality Space Informatics System (ARSIS) is a Microsoft HoloLens application developed for the NASA SUITS (Spacesuit User Interfaces for Students) challenge that provides an augmented reality (AR) interface for information display and communication to be used by astronauts during extravehicular activity (EVA) procedures. Astronauts are required to deal with complex and changing circumstances on EVA. The current status quo requires heavy reliance on voice communication with Mission Control Centers (MCCs) for everything from biometric data to assistance with procedures. ARSIS is designed with the dual purpose of increasing astronaut autonomy and making communication with MCCs more effective. Features of ARSIS include voice and gaze user interface (UI) navigation, anchored menus, planetary navigation aids, biometric information display, procedure instructions, and a suite of tools for enhanced communication with Mission Control including spatial telestration. User experience (UX) testing results for ARSIS have been generally positive overall, with the biggest takeaway being that users would prefer alternative modes of UI navigation to voice control. Eye tracking for UI navigation is a promising area of exploration in the future.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Dourish, P.: Where the Action Is. MIT Press, Cambridge (2001)

    Book  Google Scholar 

  2. Wexelblat, A.: Virtual Reality: Applications and Explorations. Academic Press, Cambridge (1993)

    Google Scholar 

  3. NASA EMU Hardware Data Book. https://www.nasa.gov/sites/default/files/atoms/files/esoc-13_rev._v_emu_hardware_data_book_jsc-e-daa-tn55224.pdf. Accessed 14 June 2020

  4. NASA General EVA Guidelines. https://msis.jsc.nasa.gov/sections/section14.htm#_14.1_GENERAL_EVA. Accessed 14 June 2020

  5. Cometti, C., Païzis, C., Casteleira, A., Pons, G., Babault, N.: Effects of mixed reality head-mounted glasses during 90 minutes of mental and manual tasks on cognitive and physiological functions. PeerJ 6, e5847 (2018)

    Article  Google Scholar 

  6. Leonard, S., Fitzgerald, R.: Holographic learning: a mixed reality trial of Microsoft HoloLens in an Australian secondary school. Res. Learn. Technol. 2160(26), 1–12 (2018)

    Google Scholar 

  7. Former Astronaut Steve Swanson, personal interview

    Google Scholar 

  8. NASA SUITS Challenge Descriptions. https://microgravityuniversity.jsc.nasa.gov/docs/suits/SUITS%202020%20Mission%20Description.8.22.19.pdf. Accessed 14 June 2020

  9. Astronauts adopt Mozilla speech tech to control Moon robots. https://www.zdnet.com/article/astronauts-adopt-mozilla-speech-tech-to-control-moon-robots/. Accessed 14 June 2020

  10. Boudoin, P., Otmane, S., Mallem, M.: Design of a 3D navigation technique supporting VR interaction. In: AIP Conference Proceedings, vol. 1019, no. 1, pp. 149–153 (2008)

    Google Scholar 

  11. Zhu, D., Gedeon, T., Taylor, K.: “Moving to the centre”: a gaze-driven remote camera control teleperation. Interact. Comput. 23(1), 85–95 (2011)

    Article  Google Scholar 

  12. Jarc, A.M., et al.: Beyond 2D telestration: an evaluation of novel proctoring tools for robot-assisted minimally invasive surgery. J. Robotic Surg. 10(2), 103–109 (2016). https://doi.org/10.1007/s11701-016-0564-1

    Article  Google Scholar 

  13. Kato, H., Billinghurst, M.: Marker tracking and HMD calibration for a video-based augmented reality conferencing system. In: Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR), San Francisco, CA, USA, pp. 85–94 (1999)

    Google Scholar 

  14. Arora, R., Kazi, R.H., Anderson, F., Grossman, T., Sign, K., Fitzmaurice, G.: Experimental evaluation of sketching on surfaces in VR. In: Proceedings of the CHI, Denver, CO, USA (2017)

    Google Scholar 

Download references

Acknowledgements

Special thanks to our faculty advisors, Dr. Karen Doty and Dr. Steve Swanson, as well as our community advisor Charles Burnell.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Olivia Thomas .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Thomas, O., Lambert, D., Dayrit, B. (2020). Augmented Reality Space Informatics System. In: Stephanidis, C., Antona, M., Ntoa, S. (eds) HCI International 2020 – Late Breaking Posters. HCII 2020. Communications in Computer and Information Science, vol 1294. Springer, Cham. https://doi.org/10.1007/978-3-030-60703-6_28

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-60703-6_28

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-60702-9

  • Online ISBN: 978-3-030-60703-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics