Skip to main content
SpringerLink
Log in

Mobile Real-Time Collaboration for Semantic Multimedia

A Case Study with Mobile Augmented Reality Systems

  • Published:
Mobile Networks and Applications Aims and scope Submit manuscript

Abstract

Advanced mobile applications that enable new ways of interaction with digital objects become increasingly important for on-site professional communities. These new ways of interaction, e.g. in Mobile Augmented Reality (MAR) via position and 3D movement, are real needs for fieldwork domains such as cultural heritage management and the construction industry. In addition, on-site professional communities generate shared knowledge bases with multimedia content and semantic annotations through collaboration. However, current MAR applications lack real-time collaboration features. In practice, blending multimedia semantics in mobile real-time collaboration is challenging due to the limitations of mobile devices, the lack of mature dedicated designed communication infrastructures and the constraints of the remote environments. This paper presents a mobile real-time collaboration system for semantic multimedia annotations with augmented reality features. We use XMPP as a real-time protocol for the secure, scalable and interoperable processing of XML-based semantic multimedia metadata described in MPEG-7. Our prototype was evaluated in the digital documentation of historical sites for cultural heritage management. The evaluation results indicate potential for increased productivity and enhanced mutual awareness in on-site professional communities.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Notes

  1. http://abcnews.go.com/Technology/smartphones-military-pentagon-tests-apps-androids-iphones-ipads/story?id=14615595

  2. http://learning-layers.eu

References

  1. Agius H, Angelides MC, Daylamani ZD (2012) Experimenting with tagging and context for collaborative MPEG-7 metadata. Multimed Tools Appl 1–35

  2. Bailer W, Brunie L, Doller M, Granitzer M, Klamma R, Kosch H, Lux M, Spaniol M (2008) Multimedia metadata standards. In: Furht B (ed) Encyclopedia of multimedia. Springer, pp 568–575

  3. Benkler Y (2006) The wealth of networks: how social production transforms markets and freedom. Yale University Press, New Haven

    Google Scholar 

  4. Cao Y, Jarke M, Klamma R, Mendoza O, Srirama S (2009) Mobile access to MPEG-7 based multimedia services. In: 2009 tenth international conference on mobile data management: systems, services and middleware. IEEE, Taipei, pp 102–111

    Google Scholar 

  5. Davis AH, Sun C, Lu J (2002) Generalizing operational transformation to the standard general markup language. In: Proceedings of the 2002 ACM conference on computer supported cooperative work (CSCW’02). ACM Press, pp 58–67

  6. Ellis CA, Gibbs SJ (1989) Concurrency control in groupware systems. In: Proceedings of the 1989 ACM SIGMOD international conference on management of data. ACM Press, pp 399–407

  7. Ellis CA, Gibbs SJ, Rein G (1991) Groupware: some issues and experiences. Commun ACM 34: 39–58

    Article  Google Scholar 

  8. Gerlicher ARS (2007) Developing collaborative XML editing systems. Ph.D. thesis, University of the Arts London

  9. Gotow JB, Zienkiewicz K, White J, Schmidt DC (2010) Addressing challenges with augmented reality applications on Smartphones. In: Proceedings of the third international conference on mobile wireless middleware, operating systems, and applications (Mobileware 2010), LNCS, vol 48. Springer, pp 129–143

  10. Gu YX, Li N, Chang L, Duh HBL (2011) A collaborative augmented reality networked platform for edutainment. Springer, pp 117–126

  11. Höllerer TH, Feiner SK (2004) Telegeoinformatics: location-based computing and services, chap. Mobile augmented reality. Taylor and Francis Books Ltd

  12. Ignat CL, Norrie MC (2003) Customizable collaborative editor relying on TreeOPT algorithm. In: Proceedings of the eighth conference on computer supported cooperative work. Kluwer, Norwell, pp 315–334

  13. Ignite Realtime:Openfire XMPP Server. [Online], http://www.igniterealtime.org/projects/openfire/. Accessed April 2011

  14. Ignite Realtime:Smack XMPP Library. [Online], http://www.igniterealtime.org/projects/smack/. Accessed April 2011

  15. Klamma R, Spaniol M, Jarke M, Cao Y, Jansen M, Toubekis G (2005) ACIS: intergenerational community learning supported by a hypermedia sites and monuments database. In: Proceedings of the 5th international conference on advanced learning technologies (ICALT 2005), Kaohsiung, Taiwan, July 5–8. IEEE Computer Society, Los Alamitos, pp 108–112

  16. Kosch H (2003) Distributed multimedia database technologies supported by MPEG-7 and MPEG-21. CRC Press, Boca Raton et al

  17. Lechner M (2010) ARML—augmented reality markup language. Tech. rep. Mobilizy GmbH, http://www.perey.com/ARStandards/Mobilizy_ARML.eps

  18. Lowry PB, Curtis AM, Lowry MR (2004) A taxonomy of collaborative writing to improve empirical research, writing practice, and tool development. J Bus Commun (JBC) 41(1): 66–99

    Article  Google Scholar 

  19. Lugiez D, Martin S (2009) Peer to peer optimistic collaborative editing on XML-like trees. Online http://arxiv.org/abs/0901.4201. Accessed March 2013

  20. Meyer EM, Wichmann D, Busch H, Boll S (2012) Supporting mobile collaboration in spatially distributed workgroups with digital interactive maps. Mob Netw Appl 17(3): 365–375

    Article  Google Scholar 

  21. Mixare:Mixare augmented reality engine. [Online], http://www.mixare.org/. Accessed April 2011

  22. Muldowney T, Miller M, Eatmon R (2004) XEP-0096: SI file transfer. XEP-0096(Standards Track). http://xmpp.org/extensions/xep-0096.html

  23. Nichols DA, Curtis P, Dixon M, Lamping J (1995) High-latency, low-bandwidth windowing in the Jupiter collaboration system. In: Proceedings of the 8th annual ACM symposium on user interface and software technology, UIST ’95. ACM, pp 111–120.

  24. Novell, Inc:Novell vibe cloud (2011) [Online] Accessed April. https://vibe.novell.com/

  25. Saint-Andre P (2008) XEP-0045: multi-user chat,XMPP XEP-0045 (Standards Track), http://xmpp.org/extensions/xep-0045.htm

  26. Saint-Andre P (2011) RFC 6121: extensible messaging and presence protocol (XMPP): instant messaging and presence. Tech. rep., XMPP Standards Foundation

  27. Schmidt A (2012) At the boundaries of peer production: the organization of internet security production in the cases of Estonia 2007 and Conficker. Telecommun Policy 36(6): 451–461

    Article  Google Scholar 

  28. Schuster D, Springer T, Schill A (2010) Service-based development of mobile real-time collaboration applications for social networks. In: Proceedings of IEEE PerCom workshops (PerCol’10), pp 232–237

  29. Spaniol M, Klamma R, Janßen H, Renzel D (2006) LAS: a lightweight application server for MPEG-7 services in community engines. In: Proceedings of I-KNOW ’06, 6th international conference on knowledge management, September 6–8, 2006. Graz, pp 592–599

  30. Stanford Mobile and Social Computing Research Group:Junction Documentation for Application Developers [Online], http://mobisocial.stanford.edu/index.php?page=junction. Accessed March 2013

  31. Suleiman M, Cart M, Ferri J (1997) Serialization of concurrent operations in a distributed collaborative environment. In: Proceedings of the international ACM SIGGROUP conference on supporting group work (GROUP’97). ACM, pp 435–445

  32. Sun C, Jia X, Zhang Y, Yang Y, Chen D (1998) Achieving convergence, causality preservation, and intention preservation in real-time cooperative editing systems. ACM Trans Computer-Human Interact 5: 63–108

    Article  Google Scholar 

  33. Sun D, Sun C (2006) Operation context and context-based operational transformation. In: Proceedings of the 2006 20th anniversary conference on computer supported cooperative work (CSCW’06). ACM Press, pp 279–288

  34. Tapscott D, Williams AD (2008) Wikinomics: how mass collaboration changes everything. Portfolio

  35. Voigt M (2009) Erweiterung und Anpassung des collaborative editing framework for XML (CEFX). Master’s thesis, University of Applied Sciences Erfurt

  36. Wang D, Mah A, Lassen S (2010) Google wave operational transformation. Whitepaper, Google Inc

  37. Wang XLayar augmented reality browser. [Online]. http://layar.pbworks.com/. Accessed April 2011

  38. Wikitude GmbH (2013) Wikitude mobile augmented reality app. [Online], http://www.wikitude.com/app. Accesses March 2013

  39. Wilkinson DM (2008) Strong regularities in online peer production. In: Proceedings of the 9th ACM conference on electronic commerce—EC ’08. ACM Press, p 302

  40. Xia S, Sun D, Sun C, Chen D, Shen H (2004) Leveraging single-user applications for multi-user collaboration: the Coword approach. In: Proceedings of the 2004 ACM conference on computer supported cooperative work (CSCW’04). ACM Press, pp 162–171

  41. You Y, Belimpasakis P, Selonen P (2010) A hybrid content delivery approach for a mixed reality web service platform. In: Ubiquitous intelligence and computing, LNCS, vol 6406. Springer, pp 563–576

Download references

Author information

Authors and Affiliations

  1. Information Systems and Databases, RWTH Aachen University, Ahornstr. 55, 52056, Aachen, Germany

    Dejan Kovachev, Petru Nicolaescu & Ralf Klamma

Authors
  1. Dejan Kovachev
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Petru Nicolaescu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ralf Klamma
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Dejan Kovachev.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Kovachev, D., Nicolaescu, P. & Klamma, R. Mobile Real-Time Collaboration for Semantic Multimedia. Mobile Netw Appl 19, 635–648 (2014). https://doi.org/10.1007/s11036-013-0453-z

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11036-013-0453-z

Keywords

Search

Navigation