Abstract
Augmented Reality brings technology developed for virtual environments into the real world. This approach can be used to provide instructions for routine maintenance and error diagnostics of technical devices. The Rockwell Science Center is developing a system that utilizes Augmented Reality techniques to provide the user with a form of “X-Ray Vision” into real objects. The system can overlay 3D rendered objects, animations, and text annotations onto the video image of a known object, registered to the object during camera motion. This allows the user to localize problems of the device with the actual device in his view. The user can query the status of device components using a speech recognition system. The response is given as an animation of the relevant device module and/or as auditory cues using spatialized 3D audio. The diagnostics system also allows the user to leave spoken annotations attached to device modules for other users to retrieve. The position of the user/camera relative to the device is tracked by a computer-vision-based tracking system especially developed for this purpose. The system is implemented on a distributed network of PCs, utilizing standard commercial off-the-shelf components (COTS).
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Azuma, R. T. A survey of Augmented Reality. Presence: Teleoperators and Virtual Environments 6, 4 (1997), 355–385.
Blauert, J. Spatial Hearing: The Psychophysics of Human Sound Localization. MIT Press, 1997.
Caudell, T. P. Introduction to Augmented and Virtual Reality. In Proc. of SPIE Conf. on Telemanipulator and Telepresence Technologies (Boston, MA, Oct. 1994), SPIE, pp. 272–281.
Cohen, M., Aoki, S., and Koizumi, N. Augmented audio reality: Telepresence/VR hybrid acoustic environments. In Proc. of Workshop on Robot and Human Communication (Tokyo, Japan, Nov. 1993), IEEE Press, pp. 361–4.
Espiah, B., Chaumette, F., and Rives, P. A new approach to visual servoing in robotics. IEEE Transactions on Robotics and Automation 8, 3 (1992), 313–326.
Feddema, J., and Mitchell, O. Vision-guided servoing with feature-based trajectory generation. IEEE Transactions on Robotics and Automation 5, 5 (1989), 691–700.
Feiner, S., Macintyre, B., Höllerer, T., and Webster, A. A touring machine: prototyping 3D mobile Augmented Reality systems for exploring the urban environment. In Proc. of 1st In. Symp. on Wearable Computers ( Cambridge, MA, Oct. 1997 ), pp. 74–81.
Horn, B. K. P. Robot Vision. MIT Press, Cambridge, 1987.
Koller, D., Klinker, G., Rose, E., Breen, D., Whitaker, R., and Tuceryan, M. Real-time vision-based camera tracking for Augmented Reality applications. In Proc. of VRST ‘87 ( Lausanne, Switzerland, Sept. 1997 ).
Mackay, W., Pagani, D., Faber, L., Inwood, B., Launiainen, P., Brenta, L., and Pouzol, V. ARIEL: Augmenting paper engineering drawings. In Proc. Of Conf. on Human Factors in Computing Systems (CHI) (Denver, CO, May 1995), IEEE Press, pp. 421–422.
Milgram, P., Takemura, H., Utsumi, A., and Kishino, F. Augmented Reality: a class of displays on the reality-virtuality continuum. In Proc. of SPIE Conf. on Telemanipulator and Telepresence Technologies (Boston, MA, Oct. 1994), SPIE, pp. 282–292.
Mizell, D. Virtual reality and Augmented Reality in aircraft design and manufacturing. In Proc. of Wescon Conference (Anaheim, CA, Sept. 1994), p. 91ff.
Mynatt, E. D., Back, M., Want, R., and Frederick, R. Audio Aura: lightweight audio Augmented Reality. In Proc. of ACM UIST ‘87 (Banff, Canada, Oct. 1997), ACM, pp. 211–12.
Neumann, U., and Cho, Y. Multi-ring fiducial systems for scalable fiducial Augmented Reality. In Proc. of VRAIS ‘88 ( Atlanta, Mar. 1998 ).
Papanikolopolous, N., Khosla, P., and Kanade, T. Visual tracking of a moving target by a camera mounted on a robot: a combination of control and vision. IEEE Transactions on Robotics and Aautomation 9, 1 (1993), 14–35.
Rauterberg, M., Mauch, T., and Stebler, R. Digital playing desk: A case study for Augmented Reality. In Proc. of IEEE Workshop on Robot and Human Communication (Tsukuba, Japan, Nov. 1996), IEEE Press, pp. 410–415.
Sharma, R., and Molineros, J. Computer vision-based Augmented Reality for guiding manual assembly. PRESENCE: Teleoperators and Virtual Environments 6, 3 (June 1997), 292–317.
Sundareswaran, V., and Behringer, R. Visual servoing-based Augmented Reality. In Proc. of First Int. Workshop on Augmented Reality (IWAR) ‘88 ( San Francisco, CA, Nov. 1998 ).
Sundareswaran, V., Bouthemy, P., and Chaumette, F. Exploiting image motion for active vision in a visual servoing framework. International Journal of Robotics Research 15, 6 (1996), 629–645.
Sutherland, I. E. A head-mounted three dimensional display. In Proc. of Fall Joint Computer Conference (Washington, DC, 1968), Thompson Books, pp. 757–764.
Szalavari, Z., Gervautz, M., Fuhrmann, A., and Schmalstieg, D. Augmented Reality enabled colaborative work in “Studierstube”. In Proc. of EUROVR ‘87 ( Amsterdam, The Netherlands, 1997 ).
Weiss, L., Sanderson, A., and Neumann, C. Dynamic sensor-based control of robots with visual feedback. IEEE Transactions on Robotics and Automation 3, 5 (1987), 404–417.
Wenzel, E. M., Arruda, M., Kistler, D. J., and Wightman, F. L. Localization using non-individualized head-related transfer functions. Journal of the Acoustical Society of America (1993), 111–123.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1999 Springer-Verlag/Wien
About this paper
Cite this paper
Behringer, R., Chen, S., Sundareswaran, V., Wang, K., Vassiliou, M. (1999). A Distributed Device Diagnostics System Utilizing Augmented Reality and 3D Audio. In: Gervautz, M., Schmalstieg, D., Hildebrand, A. (eds) Virtual Environments ’99. Eurographics. Springer, Vienna. https://doi.org/10.1007/978-3-7091-6805-9_11
Download citation
DOI: https://doi.org/10.1007/978-3-7091-6805-9_11
Publisher Name: Springer, Vienna
Print ISBN: 978-3-211-83347-6
Online ISBN: 978-3-7091-6805-9
eBook Packages: Springer Book Archive