Abstract
This paper presents a novel software framework called AR-Room for fast prototyping of a variety of augmented reality applications. AR-Room consists of a lot of deployable components for core augmented reality technologies, modules for hardware abstraction, and an authoring toolkit for the rapid content design. On the AR-Room, application developers are only required to describe their content scenarios together with a configuration of software components. A content scenario is represented by a set of event-action pairs. Four major procedures in an augmented reality application are an image analyzer, an interaction handler, a rendering engine and an image synthesizer. According to the provided scenarios the designated components cooperatively provide real-time analysis and synthesis of input video frames. Several augmented reality applications are implemented on the AR-Room to show how the framework can be efficiently used for the fast prototyping of applications.
Similar content being viewed by others
References
Ababsa F, Mallem M (2004) Robust camera pose estimation using 2d fiducials tracking for real-time augmented reality systems. International Conference on Virtual-Reality Continuum and its Applications in Industry, pp 431–435
Abawi DF, Bienwald J, Dörner R (2004) Accuracy in optical tracking with fiducial markers: an accuracy function for ARToolKit. Proc International Symposium on Mixed and Augmented Reality, pp 260–261
Aitkin AL (2005) Playing at reality: exploring the potential of the digital game as a medium for science communication. PhD thesis, The Australian National University
Asutay AV, Indugula AP, Borst CW (2005) Virtual tennis: a hybrid distributed virtual reality environment with fishtank vs. HMD. IEEE International Symposium on Distributed Simulation and Real-Time Applications, pp 213–220
Azuma RT (1997) A survey of augmented reality. Presence: Teleoperators and Virtual Environments 6(4):355–385
Balcisoy S, Kallmann M, Fua P, Thalmann D (2000) A framework for rapid evaluation of prototypes with augmented reality, Proceedings of the ACM Virtual Reality Software and Technology, pp 61–66
Balcisoy S, Torre R, Ponder M, Fua P, Thalmann D (2000) Augmented reality for real and virtual humans. Proceedings of the International Conference on Computer Graphics, pp 303–308
Bauer M, Bruegge B, Klinker G, MacWilliams A, Reicher T, Riss S, Sandor C, Wagner M (2001) Design of a component-based augmented reality framework. Proceedings of the Second IEEE/ACM International Symposium on Augmented Reality (ISAR), pp 45–54
Blair M (1999) Exploratory programming of distributed augmented environments. PhD Thesis, Columbia University
Borst CW, Volz RA (2005) Evaluation of a haptic mixed reality system for interactions with a virtual control panel. Presence: Teleoperators and Virtual Environments 14(6):677–696
Bradski G, Kaehler RA (2008) Learning OpenCV: computer vision with the OpenCV Library. O’Reilly, Cambridge
Broil W, Lindt I, Ohlenburg J, Herbst I, Wittkamper M, Novotny T (2005) An infrastructure for realizing custom-tailored augmented reality user interfaces. IEEE Trans Vis Comput Graph 11(6):722–733
Costanza E, Huang J (2009) Designable visual markers. Proc International Conference on Human Factors in Computing Systems, pp 1879–1888
Dementhon D, Davis L (1995) Model-based object pose in 25 lines of code. Int J Comput Vision 15:123–141
Dörner R, Geiger C, Haller M, Paelke V (2002) Authoring mixed reality—a component and framework-based approach. Proceedings of the International Workshop on Entertainment Computing—Special Session on Mixed Reality, pp 405–413
Fellner DW, Behr J, Bockholt U (2009) InstantReality—a framework for industrial augmented and virtual reality applications. Proceedings of the 2nd Sino-German Workshop on Virtual Reality & Augmented Reality in Industry, pp. 78–83
Fiala M (2005) ARTag, a fiducial marker system using digital techniques. IEEE Conference on Computer Vision and Pattern Recognition, pp. 590–596
Freeman RM, Julier SJ, Steed AJ (2007) A method for predicting marker tracking error. Proc International Symposium on Mixed and Augmented Reality, pp. 157–160
Gottschalk S, Lin MC, Manocha D (1996) OBBTree: a hierarchical structure for rapid interference detection. Proceedings of the ACM SIGGRAPH Conference, pp 171–180
Govil A, You S, Neumann U (2000) A video-based augmented reality golf simulator. ACM Multimedia, pp 489–490
Hardenberg C, Brard F (2001) Bare-hand human-computer interaction. Proceedings of Perceptual User Interfaces, pp 113–120
Ishii H, Wisneski C, Orbanes J, Chun B, Paradiso J (1999) PingPongPlus: design of an athletic-tangible interface for computer supported cooperative play. Proceedings of Conference on Human Factors in Computing Systems, pp 394–401
Jiang B, You S, Neumann U (2000) Camera tracking for augmented reality media. IEEE International Conference on Multimedia and Expo 3:1637–1640
Kallmann M, Thalmann D (1998) Modeling objects for interaction tasks. Proceedings of the 9th Eurographics Workshop on Animation and Simulation, pp 73–86
Kato H, Billinghurst M (1999) Marker tracking and HMD calibration for a video-based augmented reality conferencing system. International Workshop on Augmented Reality, pp 85–93
Kato H, Billinghurst M, Poupyrev I, Imamoto K, Tachibana K (2000) Virtual object manipulation on a table-top AR environment. Proceedings of the International Symposium on Augmented Reality, pp 111–119
Lee GA, Nelles C, Billinghurst M, Kim GJ (2004) Immersive authoring of tangible augmented reality applications. Proceedings of the 3rd IEEE/ACM International Symposium on Mixed and Augmented Reality, pp 172–181
Lenman S, Bretzner L, Thuresson B (2002) Using marking menus to develop command sets for computer vision based hand gesture interfaces. Proceedings of the second Nordic conference on Human-computer interaction, pp 239–242
Looser J (2007) AR magic lenses: addressing the challenge of focus and context in augmented reality. PhD Thesis, University of Canterbury
Lourakis MIA, Argyros AA (2004) Vision-based camera motion recovery for augmented reality. Proceedings of Computer Graphics International, pp 569–576
Lourakis M, Argyros A (2005) Camera matchmoving in unprepared, unknown environments. IEEE Conference on Computer Vision and Pattern Recognition 2:1190
MacIntyre B, Gandy M, Dow S, Bolter JD (2004) DART: a toolkit for rapid design exploration of augmented reality experiences. Proceedings of the 2004 ACM Symposium on User Interface Software and Technology, pp 197–206
Nilsen T, Looser J (2005) Tankwar—tabletop war gaming in augmented reality. Proceedings of 2nd International Workshop on Pervasive Gaming Applications, pp 86–91
Owen C, Tang A, Xiao F (2003) ImageTclAR: a blended script and compiled code development system for augmented reality. Proceedings of the International Workshop on Software Technology for Augmented Reality Systems, pp 537–544
Park JS, Lee BJ (2008) Vision-based real-time camera matchmoving using a known marker. Opt Eng 47(2):027201
Ponder M (2004) Component-based methodology and development framework for virtual and augmented reality systems, PhD Thesis No 3046, EPFL
Quek F, Mysliwiec T, Zhao M (1995) Fingermouse: a freehand computer pointing interface. Proc of Int’l Conference on Automatic Face and Gesture Recognition, pp 372–377
Sandor C, Klinker G (2005) A rapid prototyping software infrastructure for user interfaces in ubiquitous augmented reality. Pers Ubiquit Comput 9(3):169–18547
Schmalstieg D, Fuhrmann A, Hesina G, Szalavári Z, Encarnação LM, Gervautz M, Purgathofer W (2002) The Studierstube augmented reality project. Presence 11(1):33–54
Seichter H, Looser J, Billinghurst M (2008) ComposAR: an intuitive tool for authoring AR applications. Proceedings of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality, pp 177–178
Uchiyama S, Takemoto K, Satoh K, Yamamoto H, Tamura H (2002) MR platform: a basic body on which mixed reality applications are built. Proceedings of the International Symposium on Mixed and Augmented Reality, pp 246–320
Uematsu Y, Saito H (2005) AR registration by merging multiple planar markers at arbitrary positions and poses via projective space. International Conference on Virtual Reality and Telexistence, pp 48–55
Woodward C, Honkamaa P, Jappinen J, Pyokkimies E (2004) Camball—augmented virtual table tennis with real rackets. Proc ACE, pp 275–276
Yoon JH, Park JS, Kim C (2006) Increasing camera pose estimation accuracy using multiple markers. Proc International Conference on Artificial Reality and Telexistence, pp 239–248
Zauner J, Haller M (2004) Authoring of mixed reality applications including multi-marker calibration for mobile devices. Eurographics Symposium on Virtual Environments, pp 87–90
Zhang Z, Wu Y, Shan Y, Shafer S (2001) Visual panel: virtual mouse keyboard and 3D controller with an ordinary piece of paper. Workshop on Perceptive User Interfaces, pp 1–8
Acknowledgements
This work was supported by the University of Incheon Research Grant in 2010.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Park, JS. AR-Room: a rapid prototyping framework for augmented reality applications. Multimed Tools Appl 55, 725–746 (2011). https://doi.org/10.1007/s11042-010-0592-1
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-010-0592-1