Abstract
Augmented Reality (AR) provides users with enhanced interaction experiences by allowing computer-generated virtual imagery to overlay physical objects. Here we aim to integrate desktop and handheld AR into a cross-platform environment in which personal-computer and mobile users can collaborate with each other in a shared scene to accomplish physically realistic experiences during the course of interaction. Particularly, users can intuitively pick up and move virtual objects using their hands in the desktop environment. In realizing the system, we exploit 1) a Client/Server architecture to connect different computing devices, where the server is responsible for maintaining and managing the virtual scene objects shared by users; 2) a marker-based tracking method that computes relationship between the camera view and markers; 3) a computer graphics API to render the scene in a Scene Graph structure; 4) an approach that combines hand tracking and occlusion-based interaction to estimate hand position in video frames.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Milgram, P., Kishino, F.A.: Taxonomy of mixed reality visual displays. Institute of Electronics, Information and Communication Engineers (IEICE) Trans. on Information and Systems (special issue on networked reality) E77-D(12), 1321–1929 (1994)
Azuma, R.T.: A survey of augmented reality. Presence: Teleoperators and Virtual Environments 6(4), 355–385 (1997)
Azuma, R.T., Baillot, Y., Behringer, R., Feiner, S., Julier, S., MacIntyre, B.: Recent advances in augmented reality. IEEE Computer Graphics and Applications 21(6), 34–47 (2001)
ARToolKit, http://www.hitl.washington.edu/artoolkit/
Fiala, M.: ARTag: a fiducial marker system using digital techniques. In: CVPR 2005 (2005)
Wagner, D., Schmalstieg, D.: ARToolKitPlus for pose tracking on mobile devices. In: Proceedings of 12th Computer Vision Winter Workshop (2007)
Studierstube ES, http://studierstube.icg.tu-graz.ac.at/handheld_ar/stbtracker.php
Simplified Spatial Target Tracker, http://technotecture.com/content/marker-based-tracking-augmented-reality-sstt
Kato, H., Billinghurst, M.: Marker tracking and HMD calibration for a video-based augmented reality conferencing system. In: 2nd IEEE and ACM International Symposium on Augmented Reality, pp. 85–94 (1999)
Buchmann, V., Violich, S., Billinghurst, M., Cockburn, A.: FingARtips: gesture based direct manipulation in augmented reality. In: 2nd international conference on Computer graphics and interactive techniques in Australasia and SouthEast Asia, pp. 212–221 (2004)
Lee, M., Green, R., Billinghurst, M.: 3D natural hand interaction for AR applications. In: 23rd International Conference on Image and Vision Computing, New Zealand (2008)
Fernandes, B., Fernandes, J.: Bare hand interaction in tabletop augmented reality. In: International Conference on Computer Graphics and Interactive Techniques, ACM Special Interest Group on GRAPHics and Interactive Techniques (2009)
Seichter, H., Grasset, R., Looser, J., Billinghurst, M.: Multitouch interaction for tangible user interfaces. In: IEEE 8th International Symposium on Mixed and Augmented Reality, pp. 213–214 (2009)
Wagner, D., Pintaric, T., Ledermann, F., Schmalstieg, D.: Towards massively multi-user augmented reality on handheld devices. In: Gellersen, H.-W., Want, R., Schmidt, A. (eds.) PERVASIVE 2005. LNCS, vol. 3468, pp. 208–219. Springer, Heidelberg (2005)
Schmalstieg, D., Fuhrmann, A., Hesina, G., Szalavári, Z., Encarnacão, L.M., Gervautz, M., Purgathofer, W.: The Studierstube augmented reality project. Teleoperators and Virtual Environments 11 (2002)
Henrysson, A., Billinghurst, M., Ollila, M.: Face to face collaborative AR on mobile phones. In: IEEE and ACM International Symposium on Mixed and Augmented Reality (2005)
Kovac, J., Peer, P., Solina, F.: Human skin color clustering for face detection. European Science Fiction Convention. The IEEE Region 8(2), 144–148 (2003)
Hardenberg, C.V., Berard, F.: Bare-hand human-computer interaction. In: ACM International Conference Proceeding Series, vol. 15 (2001)
Lee, G.A., Billinghurst, M., Kim, G.J.: Occlusion based interaction methods for tangible augmented reality environments. Virtual Reality Continuum and its Applications in Industry, 419–426 (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Liu, D.SM., Yung, CH., Chung, CH. (2010). A Cross-Platform Framework for Physics-Based Collaborative Augmented Reality. In: Taylor, R., Boulanger, P., Krüger, A., Olivier, P. (eds) Smart Graphics. SG 2010. Lecture Notes in Computer Science, vol 6133. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-13544-6_8
Download citation
DOI: https://doi.org/10.1007/978-3-642-13544-6_8
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-13543-9
Online ISBN: 978-3-642-13544-6
eBook Packages: Computer ScienceComputer Science (R0)