ABSTRACT
Virtual prototyping has become an established design tool in complex interdisciplinary development processes using state-of-the-art virtual reality techniques. Due to numerous benefits virtual prototyping has seen increasing acceptance in recent years, especially in the development of systems that involve complex interactions between components or require the integration of newly developed hardware. Mixed reality, considered as an extension to VR, has high potential to support the development of complex systems that operate in a real world environment even further. In this paper we demonstrate that the principles of mixed reality prototyping can also be effectively applied to the development of complex systems if a structured process is defined and supported by a proper software framework. In our paper we present a system that supports an iterative approach to prototype complex dynamical systems. Using this approach allows the designer to seamlessly progress from an initial virtual prototype to the final system along the mixed reality continuum. We describe MiReAS, a mixed reality software framework that supports an iterative design evolution with arbitrary combinations of real and virtual elements. The use of the system is demonstrated by the development of interaction techniques and control strategies for an unmanned aerial vehicle.
- Boeck, J. D., Vanacken, D., Raymaekers, C., and Coninx, K. 2007. High-level modeling of multimodal interaction techniques using nimmit. Journal of Virtual Reality and Broadcasting 4, 2 (January).Google Scholar
- Broll, W., Herling, J., and Blum, L. 2008. Interactive bits: Prototyping of mixed reality applications and interaction techniques through visual programming. 3DUI IEEE Symposium on 3D User Interfaces 0 (January), 109--115. Google ScholarDigital Library
- Cruz-Neira, C., Bierbaum, A., Hartling, P., Just, C., and Meinert, K. 2002. Vrjuggler - an open source platform for virtual reality applications. In 40th AIAA Aerospace Sciences Meeting and Exhibit 2002.Google ScholarCross Ref
- Cuppens, E., Raymaekers, C., and Coninx, K. 2006. A model-based design process for interactive virtual environments. Lecture Notes in Computer Science (January).Google Scholar
- Dachselt, R., Figueroa, P., Lindt, I., and Broll, W. 2007. Mixed reality user interfaces: Specification, authoring, adaptation. In IEEE Virtual Reality 2007 Conference.Google Scholar
- Darken, R., McDowell, P., and Johnson, E. 2005. The delta3d open source game engine. IEEE Computer Graphics and Applications 25, 10--12. Google ScholarDigital Library
- Dassault, 2009. The 3dvia virtools website form dassault systems. http://www.3ds.com/products/3dvia/3dvia-virtools/.Google Scholar
- Geiger, C., Stöcklein, J., Klompmaker, F., and Fritze, R. 2007. Development of an augmented reality game by extending a 3d authoring system. ACE '07: Proceedings of the international conference on Advances in computer entertainment technology (June). Google ScholarDigital Library
- Grimm, P., Haller, M., Paelke, V., Reinhold, S., Reimann, C., and Zauner, J. 2002. Amire - authoring mixed reality. In The First IEEE International Augmented Reality Toolkit Workshop.Google Scholar
- MacIntyre, B., Gandy, M., Dow, S., and Bolter, J. D. 2004. Dart: a toolkit for rapid design exploration of augmented reality experiences. Symposium on User Interface Software and Technology, 17 (January), 197--206. Google ScholarDigital Library
- Milgram, P., and Kishino, F. 1994. A taxonomy of mixed reality visual displays. IEICE Transactions On Information And Systems E77-D, 12 (January).Google Scholar
- OSG-Community, 2007. The openscenegraph community website, http://www.openscenegraph.org.Google Scholar
- Reitmayr, G., and Schmalstieg, D. 2001. Opentracker-an open software architecture for reconfigurable tracking based on xml. In VR '01: Proceedings of the Virtual Reality 2001 Conference (VR'01), IEEE Computer Society, Washington, DC, USA, 285. Google ScholarDigital Library
- Schmalstieg, D., Fuhrmann, A., Hesina, G., Szalavári, Z., Encarnação, L. M., Gervautz, M., and Purgathofer, W. 2002. The studierstube augmented reality project presence - teleoperators and virtual environments. Teleoperators and Virtual Environments 11, 1. Google ScholarDigital Library
- Schwaber, K. 2004. Agile project management with scrum. Microsoft Press Redmond, WA, USA (January). Google ScholarDigital Library
- SEARIS, 2008. Software engineering and architectures for realtime interactive systems on http://www.searis.net.Google Scholar
- Stöcklein, J., and Pogscheba, P. 2009. Development of complex technical systems: 'the mixed reality in the loop' design process. In HC2009: 12th International Conference on Humans and Computers.Google Scholar
- Vanderdonckt, J., Chieu, C. K., Bouillon, L., and Trevisan, D. 2004. Model-based design, generation, and evaluation of virtual user interfaces. In Web3D '04: Proceedings of the ninth international conference on 3D Web technology, ACM, New York, NY, USA, 51--60. Google ScholarDigital Library
Index Terms
- MiReAS: a mixed reality software framework for iterative prototyping of control strategies for an indoor airship
Recommendations
Feasibility and infrastructural study of AR interfacing and intuitive simulation on 3D nonlinear systems
High-fidelity simulations with intuitive user interfaces expedite real-world tasks. Augmented Reality (AR), enables 3D computer-generated entities to coexist in users' view of their real workspace. In this paper, the AR methodology is combined with ...
Design and Realization of 3D Simulation Training System for Mechanical Equipment
ICINIS '13: Proceedings of the 2013 6th International Conference on Intelligent Networks and Intelligent SystemsThis virtual simulation training system is a kind of generation using virtual reality technology, and it is suitable for simulation training virtual environment, it can be a true reproduction of a practical training bases or facilities, can also be a ...
A Remote Training System of Hydropower Plant Based on Interactive Virtual Environments
ICECE '10: Proceedings of the 2010 International Conference on Electrical and Control EngineeringBased on conclusion of difficulty and problems of hydropower plant training and the latest information techniques, the architecture of an interactive virtual environments based remote training system of hydropower plant is proposed. In addition, the key ...
Comments