Abstract
In this paper, we present the development of a situated virtual reality simulation for control and training in a telerobotic mining setting. The original research scenario is derived from a real-world rock breaking task in mining teleoperation. With the intention of having better situational awareness and user control model for this application, we simulate the entire setting in a 3D Virtual Reality (VR) environment. Therefore, users are able to obtain more information (e.g. depth information) and feedback from the remote environment in this simulation than only working with real video streams from the remote camera(s). In addition, the concept of natural interaction has been applied in building more intuitive user control interfaces than conventional manual modes. Both human eye gaze and head movements have been used to develop natural and interactive viewpoint control models for users to complete the teleoperation task. By using such a 3D simulation, training in the complex teletobotic control process can be effectively carried out with the capability of changing visual and control conditions easily. A user study has also been conducted as the preliminary evaluation of the simulation. Encouraging feedback has been provided by the experimental participants regarding task learning, which suggests the effectiveness of using the simulation.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Dai, F., Hopgood, F.R., Lucas, M., Requicha, A.G., Hosaka, M., Guedy, R.A., Bo, K., Foley, J.D., Hagen, P.J.: Virtual Reality for Industrial Applications. Springer, New York (1997)
Duff, E., Caris, C., Bochis, A., Taylor, K., Gunn, C., Adcock, M.: The Development of a Telerobotic Rock Breaker. In: Proceedings of FSR 2009, pp. 1–10 (2009)
FaceLab: Seeingmachines, Inc. (2012), http://www.seeingmachines.com/product/facelab/
Kunkler, K.: The Role of Medical Simulation: an Overview. The International Journal of Medical Robotics and Computer Assisted Surgery 2(3), 203–210 (2006)
Maya: Autodesk, Inc. (2012), http://usa.autodesk.com/maya/
OpenCV (2012), http://www.opencv.org/
Slater, M., Usoh, M., Steed, A.: Depth of Presence in Virtual Environments. Presence 3, 130–144 (1994)
Unity3D: Unity Technologies (2012), http://unity3d.com/
Zhang, L., Liu, Q.: Application of Simulation and Virtual Reality to Physical Education and Athletic Training. In: Pan, Z., Cheok, A.D., Müller, W., Chang, M., Zhang, M. (eds.) Transactions on Edutainment VII. LNCS, vol. 7145, pp. 24–33. Springer, Heidelberg (2012)
Zhu, D., Gedeon, T., Taylor, K.: Exploring Camera Viewpoint Control Models for a Multi-Tasking Setting in Teleoperation. In: Proceedings of CHI 2011, pp. 53–62. ACM Press (2011)
Zhu, D., Gedeon, T., Taylor, K.: Keyboard before Head Tracking Depresses User Success in Remote Camera Control. In: Gross, T., Gulliksen, J., Kotzé, P., Oestreicher, L., Palanque, P., Prates, R.O., Winckler, M. (eds.) INTERACT 2009. LNCS, vol. 5727, pp. 319–331. Springer, Heidelberg (2009)
Zhu, D., Gedeon, T., Taylor, K.: Moving to the Centre: A Gaze-Driven Remote Camera Control for Teleoperation. Interacting with Computers 23(1), 85–95 (2011)
Zyda, M.: From Visual Simulation to Virtual Reality to Games. IEEE Computers 38(9), 25–32 (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Gedeon, T., Zhu, D., Bersot, S. (2012). Developing a Situated Virtual Reality Simulation for Telerobotic Control and Training. In: Göbel, S., Müller, W., Urban, B., Wiemeyer, J. (eds) E-Learning and Games for Training, Education, Health and Sports. Edutainment GameDays 2012 2012. Lecture Notes in Computer Science, vol 7516. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33466-5_2
Download citation
DOI: https://doi.org/10.1007/978-3-642-33466-5_2
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-33465-8
Online ISBN: 978-3-642-33466-5
eBook Packages: Computer ScienceComputer Science (R0)