Skip to main content
SpringerLink
Log in

Visual Design for Predictive Display in Spatial Time-Delay Environments Considering Workload

  • Conference paper
  • First Online:
Design, User Experience, and Usability (HCII 2023)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 14031))

Included in the following conference series:

  • 744 Accesses

Abstract

Time delay is an inherent technical feature that cannot be eliminated during space robot teleoperation and can significantly impact operator workload. In this paper, based on predictive display technology, we investigate the change of operator workload during teleoperation by image prediction graphical interface and virtual reality prediction graphical interface. By constructing a virtual simulation experiment platform for a remote operation system, 20 participants were tested and analyzed in a fetch-place experiment; TAM, NASA-TLX, and AB-directed questionnaires were distributed for subjective measurements to understand the personal perceptions and visual preferences of the participants on their workloads, and to investigate the applicability of the predictive display technology to reduce the operator’s cognitive load. The results showed that the subjective and objective performance of the virtual reality predictive graphical interface (VR-PGI) was higher than that of the image predictive graphical interface (I-PGI) in the fetch-place operation scenario. It was found that the operator’s workload did not change significantly with the increase of spatial time delay in the predictive graphical interface, which proved the practicality of applying the predictive graphical interface to the spatial teleoperation scenario.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Wang, X., Cao, J.: Dual-arm collaborative robot technology. Autom. Panor. 328(10), 84–90 (2020)

    Google Scholar 

  2. Chen, J., Huang, W., Song, A.: Dynamic model of human operator in force telepresence system based on virtual reality technology. J. Trans. Technol. 15(1), 230–236 (2001)

    Google Scholar 

  3. Arcara, P., Melchiorri, C.: Control schemes for teleoperation with time delay: a comparative study. Robot. Auton. Syst. 38(1), 49–64 (2002)

    Article  MATH  Google Scholar 

  4. Sweller, J.: Cognitive load theory. Psychol. Learn. Motiv. 2011(55), 37–76 (2011)

    Article  Google Scholar 

  5. Bejczy, A.K., Kim, W.S., Venema, S.C.: The phantom robot: predictive displays for teleoperation with time delay. In: International Conference on Robotics and Automation, Cincinnati, OH, USA, pp. 546–551 (1990)

    Google Scholar 

  6. Chou, W., Meng, C., Chen, J., Li, S.: Robot-assisted remote operating system for space science experiments. China Space Sci. Technol. 2003(06), 10–16 (2003)

    Google Scholar 

  7. Sheridan, T.B.: Human supervisory control of robot systems. In: 1986 IEEE International Conference, pp. 808–812 (1986)

    Google Scholar 

  8. Hirzinger, G., Landzettel, K., Dietrich, J.: Sensor-based space robotics - ROTEX and its telerobotic features. In: IEEE Transactions on Robotics and Automation, Graz, Austri, pp. 649–663 (1993)

    Google Scholar 

  9. Freund, E., Rossmann, J.: A new telepresence approach through the combination of virtual reality and robot control techniques. SPIE’s Int. Tech. Gr. Newsl. (2001)

    Google Scholar 

  10. Dybvik, H., Loland, M., Gerstenberg, A., Slattsveen, K.B., Steinert, M.: A low-cost predictive display for teleoperation: investigating effects on human performance and workload. Int. J. Hum. Comput. Stud. 145(1), 10–15 (2021)

    Google Scholar 

  11. Deying, G.: Optimization Management of Cognitive Load in Multimedia Learning. Southwest University, Chongqing (2009)

    Google Scholar 

  12. Kalyuga, S.: Expertise reversal effect and its implications for learner-tailored instruction. Educ. Psychol. Rev. 19(4), 509–539 (2007)

    Article  Google Scholar 

  13. Sweller, J.: Cognitive load during problem solving: effects on learning. Cogn. Sci. 12(2), 257–285 (1988)

    Article  Google Scholar 

  14. Gombolay, M., Bair, A., Huang, C., Shah, J.: Computational design of mixed-initiative human–robot teaming that considers human factors: situational awareness, workload, and workflow preferences. Int. J. Robot. Res. 36, 597–617 (2017)

    Article  Google Scholar 

  15. Parasuraman, R., Sheridan, T.B., Wickens, C.D.: Situation awareness, mental workload, and trust in automation: viable, empirically supported cognitive engineering constructs. J. Cognit. Eng. Decis. Mak. 2(2), 140–160 (2008)

    Article  Google Scholar 

  16. Jia, Y., Xi, N., Liu, S., et al.: Quality of teleoperator adaptive control for teleroboticoperations. Int. J. Robot. Res. 33(14), 1765–1781 (2014)

    Article  Google Scholar 

  17. Li, Y., Liu, S., Xi, N., et al.: A study of the relationship between brain states and skill level of teleoperator. In: 2013 IEEE International Conference on Robotics and Biomimetics (ROBIO), pp. 390–395 (2013)

    Google Scholar 

  18. Schmidlin, E.A., Jones, K.S.: Do tele-operators learn to better judge whether a robot can passthrough an aperture? Hum. Factors 58(2), 360–369 (2016)

    Article  Google Scholar 

  19. Loft, S., Sanderson, P., Neal, A., et al.: Modeling and predicting mental workload in en route air traffic control: critical review and broader implications. Hum. Factors 49(3), 376–399 (2007)

    Article  Google Scholar 

  20. Brookings, J.B., Wilson, G.F., Swain, C.R.: Psychophysiological responses to changes in workload during simulated air traffic control. Biol. Psychol. 42(3), 361–377 (1996)

    Article  Google Scholar 

  21. Hart, S.G., Staveland, L.E.: Development of NASA-TLX (task load index): results of empirical and theoretical research. Adv. Psychol. 52, 139–183 (1988)

    Article  Google Scholar 

  22. Kramer, A.F.: Physiological metrics of mental workload: a review of recent progress. Physiol. Metr. Ment. Workload Rev. Recent Prog. 279–328 (1991)

    Google Scholar 

  23. Steinfeld, A., Fong, T., Kaber, D., et al.: Common metrics for human-robot interaction. In: Proceedings of the 1st ACM SIGCHI/SIGART Conference on Human-Robot Interaction, New York, pp. 33–40 (2006)

    Google Scholar 

  24. Clarke, M.A., Schuetzler, R.M., Windle, J.R., et al.: Usability and cognitive load in the design of a personal health record. Health Policy Technol. 9(2), 218–224 (2020)

    Article  Google Scholar 

  25. You, Q.: Research and Application of Virtual Reality Oriented Digital Interface Usability. Guizhou University, Guiyang (2020)

    Google Scholar 

  26. Davis, F.D.: A technology Acceptance Model for Empirically Testing New end-User Information Systems: Theoryand Results. Sloan School of Management, Massachusetts Institute of Technology, Cambridge, MA, pp. 40–64 (1986)

    Google Scholar 

Download references

Funding

The Funding Agency is CHINA VIDEO INDUSTRY ASSOCIATION (CVIA), and the grant number is ZSXKT2023002.

Author information

Authors and Affiliations

  1. School of Design Art, Changsha University of Science and Technology, Changsha, China

    Jiadai Yan, Jiahao Sun, TianLe Tang & Zhuohao Chen

Authors
  1. Jiadai Yan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jiahao Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. TianLe Tang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zhuohao Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jiadai Yan .

Editor information

Editors and Affiliations

  1. Aaron Marcus and Associates, Berkeley, CA, USA

    Aaron Marcus

  2. World Usability Day and Bubble Mountain Consulting, Newton Center, MA, USA

    Elizabeth Rosenzweig

  3. Southern University of Science and Technology – SUSTech, Shenzhen, China

    Marcelo M. Soares

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Yan, J., Sun, J., Tang, T., Chen, Z. (2023). Visual Design for Predictive Display in Spatial Time-Delay Environments Considering Workload. In: Marcus, A., Rosenzweig, E., Soares, M.M. (eds) Design, User Experience, and Usability. HCII 2023. Lecture Notes in Computer Science, vol 14031. Springer, Cham. https://doi.org/10.1007/978-3-031-35696-4_24

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-35696-4_24

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-35695-7

  • Online ISBN: 978-3-031-35696-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation