Skip to main content

Design and Cognitive Considerations for Industrial Mixed Reality Systems

  • Conference paper
  • First Online:
HCI International 2020 – Late Breaking Posters (HCII 2020)

Abstract

In this paper we expound our theoretical hypothesis covering Design and Cognitive factors to be considered while designing an effective Augmented/Mixed Reality system solution for industrial use cases. For demonstration purposes, the targeted scenario chosen is an offshore oil-rig maintenance scenario: this scenario involves critical tasks in the areas of equipment maintenance, quick error recognition, safety, and effectiveness. With the goal towards enhanced effective Situational Awareness of the Oil Rig industrial system, the scenario involves oil-rig stakeholder collaboration/participation and remote assistance.

An additional aim of the paper is introducing new perspectives for effective operations in an industrial maintenance scenario using mixed reality systems: the perspectives extends towards the following principles of study - Experience Design, Usability, Cognitive Science and Situational Awareness. Using Cognitive Science principles and Design Thinking approach, we try to bridge the existing white gap in the research space and intend to spearhead research towards surfacing the points to be considered in effectively designing Mixed Reality systems in such Industrial scenarios. The use of multimodal sensory augmentations such as sound and haptics to aid a better experience in performing a particular task, is also given attention. Elucidation of a functional prototype built using Microsoft Hololens1 is shared and next steps and targets are showcased as well.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Chen, L., Day, T.W., Tang, W., John, N.W.: Recent developments and future challenges in medical mixed reality. In: Proceedings of 16th IEEE International Symposium on Mixed and Augmented Reality (ISMAR) (2017)

    Google Scholar 

  2. Clark, A., Chalmers, D.J.: The extended mind. Analysis 58, 7–19 (1998)

    Article  Google Scholar 

  3. Cosco, F., et al.: Visuo-haptic mixed reality with unobstructed tool-hand integration. IEEE Trans. Vis. Comput. Graph. 19(1), 159–172 (2013)

    Article  Google Scholar 

  4. Doswell, J.T., Skinner, A.: Augmenting human cognition with adaptive augmented reality. In: Schmorrow, D.D., Fidopiastis, C.M. (eds.) AC 2014. LNCS (LNAI), vol. 8534, pp. 104–113. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-07527-3_10

    Chapter  Google Scholar 

  5. Endsley, M.R.: Toward a theory of situation awareness in dynamic systems. Hum. Factors J. 37(1), 32–64 (1995)

    Article  Google Scholar 

  6. Hoenig, W., Milanes, C., Scaria, L., Phan, T., Bolas, M., Ayanian, N.: Mixed reality for robotics. In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Hamburg, Germany, 28 September–2 October 2015. IEEE, Piscataway (2015)

    Google Scholar 

  7. Lukosch, S., Billinghurst, M., Alem, L., Kiyokawa, K.: Collaboration in augmented reality. Comput. Supported Coop. Work (CSCW) 24(6), 515–525 (2015). https://doi.org/10.1007/s10606-015-9239-0

    Article  Google Scholar 

  8. Lundberg, J., Johansson, J.: Resilience, stability, and requisite interpretation in accident investigations. In: Proceedings of 2nd Resilience Engineering Symposium, pp. 191–198 (2006)

    Google Scholar 

  9. Lundberg, J.: Situation awareness systems, states and processes: a holistic framework. Theor. Issues Ergon. Sci. 16(5), 447–473 (2015)

    Article  Google Scholar 

  10. Schnabel, M.A., et al.: From virtuality to reality and back. In: Poggenpohl, S. (ed.) International Association of Societies of Design Research 2007 (IASDR 2007), School of Design, The Hong Kong Polytechnic University 2007 Core A, The Hong Kong Polytechnic University Hung Hom, Kowloon, Hong Kong, 12–15 November 2007, Digital Proceedings, Day 4, Session D: Interaction/Interface (2007). ISBN 988-99101-4-4

    Google Scholar 

  11. Westrum, R.: A typology of resilience situations. In: Hollnagel, E., Woods, D.D., Leveson, N. (eds.) Resilience Engineering Concepts and Precepts. Safety Culture and Resilience Engineering: Theory and Application in Improving Gold Mining Safety. Ashgate Publishing, Aldershot (2006)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Prithvi Raj Ramakrishnaraja .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Ramakrishnaraja, P.R., Abhilasha, Ghosh, S. (2020). Design and Cognitive Considerations for Industrial Mixed Reality Systems. In: Stephanidis, C., Antona, M., Ntoa, S. (eds) HCI International 2020 – Late Breaking Posters. HCII 2020. Communications in Computer and Information Science, vol 1294. Springer, Cham. https://doi.org/10.1007/978-3-030-60703-6_27

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-60703-6_27

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-60702-9

  • Online ISBN: 978-3-030-60703-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics