Nicholas F. Polys
ABSTRACT
As computing and displays become more pervasive and wireless networks are increasing the connections between people and things, humans inhabit both digital and physical realities. In this paper we describe our prototype Mirror Worlds framework, which is designed to fuse these realities: Fusality. Our goal for Fusality is to support innovative research and exhibitions in presence and collaboration, sensors and smart buildings and mixed reality in applications from engineering to art. By fusing live sensor data from the building and its occupants with online 3D environments and participants, we demonstrate a first-principles approach to online multi-entity messaging communication. This demonstration shows how the variety of Mirror Worlds clients can be supported through the open Web architecture. These technologies enable new possibilities for collaboration as well as directions for interoperability. Finally, we layout out our research agenda for the framework and discuss its transformative applications.
- Behr, J., Eschler, P., Jung, Y. and Zöllner, M. 2009. X3DOM: a DOM-based HTML5/X3D integration model. In Proceedings of the 14th International Conference on 3D Web Technology (Web3D '09). ACM, New York, NY, USA, 127--135. Google Scholar
Digital Library
- Behr, J., Jung, Y., Keil, J., Drevensek, T., Zoellner, M., Eschler, P. and D. Fellner, D. 2010. A scalable architecture for the HTML5/X3D integration model X3DOM. In Proceedings of the 15th International Conference on Web 3D Technology (Web3D '10). ACM, New York, NY, USA, 185--194. Google ScholarDigital Library
- Behr, J., Jung, Y., Drevensek, T. and Aderhold, A. 2011. Dynamic and interactive aspects of X3DOM. In Proceedings of the 16th International Conference on 3D Web Technology (Web3D '11). ACM, New York, NY, USA, 81--87. Google ScholarDigital Library
- Bouras, Ch., Panagopoulos, A. and Tsiatsos, Th. Advances in X3D multi-user virtual environments. 2005. In Proceedings of the Seventh IEEE International Symposium on Multimedia (ISM '05). IEEE Computer Society, Washington, DC, USA, 136--142. Google ScholarDigital Library
- Buttussi, F., Chittaro, L., and Coppo M. 2007. Using Web3D technologies for visualization and search of signs in an international sign language dictionary. In Proceedings of the twelfth international conference on 3D web technology (Web3D '07). ACM, New York, NY, USA, 61--70. Google ScholarDigital Library
- Cobo, M. and Bieri, H., 2002. A Web3D toolbox for creating H-Anim compatible actors. Computer Animation,. Proceedings of, pp. 120, 125. Google ScholarDigital Library
- Coleman, B., 2009. "Using Sensor Inputs to Affect Virtual and Real Environments," Pervasive Computing, IEEE, vol. 8, no. 3, pp. 16, 23, July-Sept. Google ScholarDigital Library
- Doyle, J., Loane, J., O'Mullane, B., Bortz, B. and Knapp, B. 2012. "Looking for Similarities in Movement between and within Homes using Cluster Analysis", Health Informatics Journal, Volume 18, Number 3, September.Google Scholar
- Dublon, G., Pardue, L. S., Mayton, B., Swartz, N., Joliat, N., Hurst, P. and Paradiso, J. A. 2011. "DoppelLab: Tools for Exploring and Harnessing Multimodal Sensor Network Data" IEEE SENSORS Conference.Google Scholar
- Dublon, Gershon and Paradiso Joseph A., 2014 Extra Sensory Perception - How a world filled with sensors will change the way we see, hear, think and live. Scientific American, Vol. 311, No. 1, July, pp. 36--41.Google ScholarCross Ref
- Fürst, J., et al. "BUSICO 3D: building simulation and control in unity 3D." 2014. Proceedings of the 12th ACM Conference on Embedded Network Sensor Systems. ACM. Google ScholarDigital Library
- Ieronutti L. and Chittaro, L. 2005. A virtual human architecture that integrates kinematic, physical and behavioral aspects to control H-Anim characters. In Proceedings of the tenth international conference on 3D Web technology (Web3D '05). ACM, New York, NY, USA, 75--83. Google ScholarDigital Library
- Jung Y. and Behr, J. 2008. Extending H-anim and X3D for advanced animation control. In Proceedings of the 13th international symposium on 3D web technology (Web3D '08). ACM, New York, NY, USA, 57--65. Google ScholarDigital Library
- Lifton, J., Laibowitz, M., Harry, D., Nan-Wei Gong, Mittal, M., Paradiso, J. A., 2009. Metaphor and Manifestation Cross-Reality with Ubiquitous Sensor/Actuator Networks. Pervasive Computing, IEEE, vol. 8, no. 3, pp. 24, 33, July-Sept. Google ScholarDigital Library
- Lin, Q., Neo, H., Zhang, L., Huang, G. and Gay, R. 2007. Grid-based large-scale Web3D collaborative virtual environment. In Proceedings of the twelfth international conference on 3D web technology (Web3D '07). ACM, New York, NY, USA, 123--132. Google ScholarDigital Library
- Liu, Y. and Li., T. 2003. A multi-user virtual environment system with extensible animations. In Proceedings of the eighth international conference on 3D Web technology (Web3D '03). ACM, New York, NY, USA, 129--134. Google ScholarDigital Library
- Loane, J., O'Mullane, B., Bortz, B. and R. B. Knapp. 2011. "Interpreting Presence Sensor Data and Looking for Similarities Between Homes Using Cluster Analysis," Proceedings of the IEEE Pervasive Health Conference, Dublin.Google Scholar
- Macedonia, M. R., Zyda, M. J., Pratt, D. R., Brutzman, D. P., and Barham, P. T. 1995. Exploiting reality with multicast groups: a network architecture for large-scale virtual environments. In Proceedings of the Virtual Reality Annual International Symposium (VRAIS'95) (VRAIS '95). IEEE Computer Society, Washington, DC, USA. Google ScholarDigital Library
- Macedonia, M. R., Zyda, M. J., Pratt, D. R., Brutzman, D. P., and Barham, P. T. 1995. Exploiting Reality with Multicast Groups. IEEE Comput. Graph. Appl. 15, pp 38--45. Google ScholarDigital Library
- Macedonia, M. R., Brutzman, D. P., Zyda, M. J., Pratt, D. R., Barham, P. T., Falby, J., Locke, J. 1995. NPSNET: a multi-player 3D virtual environment over the Internet. In Proceedings of the 1995 symposium on Interactive 3D graphics (I3D '95). ACM, New York, NY, USA. Google ScholarDigital Library
- Milgram, P., and Kishino, F. 1994. A taxonomy of mixed reality visual displays. IEICE TRANSACTIONS on Information and Systems 77.12: 1321--1329.Google Scholar
- Mori, M. (1970). The uncanny valley. Energy, 7(4), 33--35.Google Scholar
- Ortiz, A., Oyarzun, D., Aizpurua, I., Posada, J. 2004. "Three-dimensional whole body of virtual character animation for its behavior in a virtual environment using H-Anim and Inverse kinematics," Computer Graphics International Proceedings pg. 307; 19 June. Google ScholarDigital Library
- Pena-Rios, A., Callaghan, V., Gardner, M., Alhaddad, M. J. 2014. Using Mixed-Reality to Develop Smart Environments, International Conference on Intelligent Environments (IE), vol., no., pp. 182, 189, June 30. Google ScholarDigital Library
- Polys, Nicholas F. 2011. "Recall the Lost Frontiers of Virtual Worlds". Communications of the ACM, 54(5). Association for Computing Machinery.Google Scholar
- Singhal, S. and Zyda, M. 1999. Networked virtual environments: design and implementation, ACM Press/Addison-Wesley Publishing Co., New York, NY. Google ScholarDigital Library
- Steed A. and Oliveira, M. 2009. Networked Graphics: Building Networked Games and Virtual Environments. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA. Google ScholarDigital Library
- Tilden, D., Singh, A., Polys, N. F. and Sforza, P. 2011. Multimedia mashups for mirror worlds. In Proceedings of the 16th International Conference on 3D Web Technology (Web3D '11). ACM, New York, NY, USA, 155--164. Google ScholarDigital Library
- Wang, Q. and Ressler, S. 2007. Generation and manipulation of H-Anim CAESAR scan bodies. In Proceedings of the twelfth international conference on 3D web technology (Web3D '07). ACM, New York, NY, USA, 191--194. Google ScholarDigital Library
- Weiser, M. 1993. Some computer science issues in ubiquitous computing, Commun. ACM. 36(7): 75--84. Google ScholarDigital Library
Index Terms
- Fusality: an open framework for cross-platform mirror world installations
Recommendations
Mixed Reality MIDI Keyboard Demonstration
AM '17: Proceedings of the 12th International Audio Mostly Conference on Augmented and Participatory Sound and Music ExperiencesThe Mixed Reality MIDI Keyboard is a prototype designed to augment virtual reality experiences through the inclusion of a physical interface which aligns the user's senses with the virtual environment. It also serves as a platform on which the uses of ...
X3DOM virtual reality book store
Web3D '12: Proceedings of the 17th International Conference on 3D Web TechnologyVirtual reality commer1ce (VR-commerce) is a potential candidate for a wide adoption of the next wave of the e-commerce platform, since its advantages and novel shopping experience derived from the VR interface. Currently, platform dependence and ...
INSIDE: Using a Cubic Multisensory Controller for Interaction With a Mixed Reality Environment
The field of electronic games is a great experimental area that contributes to the implementation of new technologies in a variety of applications. This article explores the field of mixed reality through the use of physical computing for the ...
Comments