Skip to main content
Log in

Mixed reality web service platform

  • Regular Paper
  • Published:
Multimedia Systems Aims and scope Submit manuscript

Abstract

This paper presents a RESTful Web service platform for applications for both Web browsers and mobile clients. Having a common service backend makes creating applications fast, simple, and open to third parties. The paper presents two mixed reality applications that have been built on the platform. It summarizes requirements for a mixed reality platform and defines a mixed reality domain model that the platform and applications share. In addition, it describes how the clients can use the REST interface to perform operations on user-generated content, as well as access real-life commercial geo-content such as street-view panoramas and building models.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

Notes

  1. http://layar.com/.

  2. http://www.wikitude.org/.

  3. http://flickr.com.

  4. http://oauth.net.

  5. A building footprint is the outline of the total area of a lot or site that is surrounded by the exterior walls of a building or portion of a building.

References

  1. The Ply Format. Online at http://www.cc.gatech.edu/projects/large_models/ply.html. Accessed 19 Sept 2011

  2. The Unified Modeling Language. Online at http://www.omg.org/spec/UML/2.3. Accessed 19 Sept 2011

  3. Allamaraju, S.: RESTful Web Services Cookbook. O’Reilly Media (2010)

  4. Azuma, R.T.: A survey of augmented reality. Presence Teleoperators Virtual Environ. 6(4), 355–385 (1997)

    Google Scholar 

  5. Belimpasakis, P., Selonen, P., You, Y.: Bringing user-generated content from internet services to mobile augmented reality clients. In: Virtual Reality Workshop (CMCVR), 2010 Cloud-Mobile Convergence for, pp. 14–17 (2010). doi:10.1109/CMCVR.2010.5560611

  6. Chen, X., Kohlmeyer, B., Stroila, M., Alwar, N., Wang, R., Bach, J.: Next generation map making: geo-referenced ground-level LIDAR point clouds for automatic retro-reflective road feature extraction. In: Proceedings of the 17th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, GIS ’09, pp. 488–491. ACM, New York, USA (2009)

  7. Fielding, R.T.: Architectural styles and the design of network-based software architectures. PhD thesis (2000). AAI9980887

  8. Hllerer, T., Wither, J., Diverdi, S.: Anywhere augmentation: Towards mobile augmented reality in unprepared environments. In: In Location Based Services and Telecartography Series. Lecture Notes in Geoinformation and Cartography, pp. 393–416. Springer (2007)

  9. Kähäri, M., Murphy, D.J.: MARA—sensor based augmented reality system for mobile imaging. In: Fifth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR06) (2006)

  10. Lucero, A., Boberg, M., Uusitalo, S.: Image Space: capturing, sharing and contextualizing personal pictures in a simple and playful way. In: Proceedings of the International Conference on Advances in Computer Entertainment Technology, ACE ’09, pp. 215–222. ACM, New York, NY, USA (2009)

  11. Luo, X.: From augmented reality to augmented computing: a look at cloud-mobile convergence. In: Proceedings of the 2009 International Symposium on Ubiquitous Virtual Reality, pp. 29–32. IEEE Computer Society, Washington, DC, USA (2009). doi:10.1109/ISUVR.2009.13. http://portal.acm.org/citation.cfm?id=1636705.1637085

  12. Milgram, P., Kishino, F.: A taxonomy of mixed reality visual displays. IEICE Trans. Inf. Syst. E77-D(12) (1994)

  13. Murphy, D.J., Kahari, M., Mattila, V.V.: An augmented reality view on mirror world content, with image space. In: Proceedings of the IEEE Virtual Reality Conference (VR2010), pp. 291–292 (2010). doi:10.1109/VR.2010.5444761

  14. Pylvanainen, T., Roimela, K., Vedantham, R., Itaranta, J., Grzeszczuk, R.: Automatic alignment and multi-view segmentation of street-view data using 3d shape prior. In: Fifth International Symposium on 3D Data Processing, Visualization and Transmission (3DPVT). Paris, France (2010)

  15. Richardson, L., Ruby, S.: ReSTful Web Services. O’Reilly Media, pp. 108–136 (2007)

  16. Segerdahl, D., Elmqvist, N., So, Y.T., Fjeld, M., Svensson, A., Axblom, D., Thorn, M., Claesson, J., Wiklander, M., Hagberg, J.: 3dvn: A mixed reality platform for mobile navigation assistance. In: ACM CHI2007 Workshop on Mobile Spatial Interaction (2007)

  17. Selonen, P.: From requirements to a restful web service—engineering content oriented web services with rest. In: Wilde, E., Pautasso, C. (eds.): REST: From Research to Practice, Signals & Communication. Springer (2011)

  18. Selonen, P., Belimpasakis, P., You, Y.: Experiences in building a restful mixed reality web service platform. In: Benatallah, B., Casati, F., Kappel, G., Rossi, G. (eds.): Web Engineering. Lecture Notes in Computer Science, vol. 6189, pp. 400–414. Springer, Berlin (2010)

  19. Uchiyama, S., Takemoto, K., Satoh, K., Yamamoto, H., Tamura, H.: Mr platform: A basic body on which mixed reality applications are built. In: ISMAR, pp. 246–253. IEEE Computer Society (2002)

  20. Uusitalo, S., Eskolin, P., Belimpasakis, P.: A solution for navigating user-generated content. In: IEEE International Symposium on Mixed and Augmented Reality ISMAR 2009 (2009). doi:10.1109/ISMAR.2009.5336451

  21. You, Y., Belimpasakis, P., Selonen, P.: Enabling rapid creation of content for consumption in mobile augmented reality. Next Generation Mobile Applications, Services and Technologies (2010). doi:10.1109/NGMAST.2010.13

Download references

Acknowledgments

The authors would like to thank the Mixed Reality Solutions program at Nokia Research Center, and in particular people that were involved in the design and implementation of the City Scene and Image Space clients on top of our MRSWS APIs.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Petros Belimpasakis.

Additional information

Communicated by Thomas Plagemann.

Appendices

Appendix 1: Example of retrieving geo-content

An example of retrieving a building representation is as follows:

The building has a binary 3D model that can be retrieved by requesting the resource described in the 3d_model attribute. The 3D representations are provided in the PLY file format [1]. The elevation of the building’s base relative to sea level is described in base_elev in meters. The roof_elev describes the elevation of the roof, again relative to sea level. The 2D geometry of the building a multipolygon describing the building footprint, is presented as point s of ( lon, lat ) pairs.

Appendix 2: Example of collections of MR resources

The contents of a particular container can be retrieved as follows:

Appendix 3: Example of updating an MR resource

An existing resource can be updated using PUT with the new updated representation. For example, if we assume an existing photo resource:

Appendix 4: MRSWS API overview

A summary of the current MRSWS API is given in Table 2. By adhering to the RESTful architecture style and uniform interface, the core of the API specification can be captured by a resource model.

Table 2 MRSWS API overview

Rights and permissions

Reprints and permissions

About this article

Cite this article

Selonen, P., Belimpasakis, P., You, Y. et al. Mixed reality web service platform. Multimedia Systems 18, 215–230 (2012). https://doi.org/10.1007/s00530-011-0254-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00530-011-0254-9

Keywords

Navigation