Towards adaptive Web scriptable user interfaces for virtual environments

Abstract

The vast majority of Web-based technology, its ability to visualize static and time varying information and the pervasive nature of its content have lead the development of applications and user interfaces that port between a broad range of operating systems, databases and devices. However the integration of this immense resource in virtual environments (VEs) remains elusive. In this paper we present a Web scriptable user interface that utilizes Web browser technology to enable the user to search the internet for arbitrary information and to seamlessly augment this information into the VE. WebVRI provides access to the standard data input and query mechanisms offered by conventional Web browsers, with the difference that it generates active texture-skins of the Web contents that can be mapped onto arbitrary surfaces within the environment. Once mapped, the corresponding texture functions as a fully integrated Web-browser that will respond to traditional events such as the selection of links or text input. As a result, any surface within the environment can be turned into a Web-enabled resource that provides access to user-definable data. Using WebVRI, users can merge Web contents into their VE, control its behavior and collaborate with other users inside and outside the VE. This provides a completely new mechanism to access readily available Web-based data, documents, images, animations, simulations and visualization. WebVRI also enables game-based education by providing the ability to create contents rich, pervasive VR-based edutainment environments.