Skip to main content
SpringerLink
Log in

A mixed reality 3D system for the integration of X3DoM graphics with real-time IoT data

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

A mixed reality system is a set of interlinked real-time sensors’ and actuators’ data presented within a virtual world with graphics and texts. This paper describes a methodology for the implementation of mixed reality systems that interconnect real-world IoT systems with 3D virtual worlds. In particular, this paper presents the steps for integrating X3DoM graphics with real-time data and discusses the associated technologies from a developer’s point of view. Such a mixed reality 3D system, interconnecting real-time sensors and actuators from a real-world wastewater management system, with all the corresponding components and controls was developed. This mixed reality 3D world was created using open source web technologies that provide users, in this case the building tenants, with the ability to monitor and control the water consumption of their homes at anytime and from anywhere. It provides not only a comprehensive monitoring 3D model of the real building management system but also an easy to use controlling platform, where the commands are executed in the real building infrastructure.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

References

  1. 3ds Max Design (2016) Autodesc, Inc. [Online]. Available: http://www.autodesk.com/education/free-software/3ds-max-design. Accessed 19 Sept 2016

  2. 3ds Max Export Fraunhofer-Gesellschaft, [Online]. Available: http://www.x3dom.org/documentation/tutorials/3ds-max-export/. Accessed 19 Sept 2016

  3. Agrusa R, Mazza VG, Penso R (2009) Advanced 3d visualization for manufacturing and facility controls, in 2nd Conference on Human System Interactions, Catania, Italy

  4. Atila U, Karas IR, Rahman AA (2013) A 3d–gis implementation for realizing 3d network analysis and routing simulation for evacuation purpose. In: Progress and New Trends in 3D Geoinformation Sciences. Springer: Berlin Heidelberg, pp 249–260

  5. Atsali G, Katrinakis D, Panagiotakis S, Athanasaki D, Kalochristianakis M, Manios T, Malamos A (2016) First Flush Rainwater Harvesting Application with Fuzzy Logic Control, in International Symposium on Ambient Intelligence and Embedded Systems, Heraklion, Crete, Greece

  6. Back M, Kimber D, Rieffel E, Dunnigan A, Liew B, Gattepally S, Foote J, Shingu J, Vaughan J (2010) The virtual chocolate factory: Building a real world mixed-reality system for industrial collaboration and control, in IEEE International Conference on Multimedia and Expo, TBD Singapore

  7. Behr J, Eschler P, Jung Y, Zöllner M (2009) X3DOM: a DOM-based HTML5/X3D integration model, in 14th International Conference on 3D Web Technology, Darmstadt, Germany

  8. Cagalaban G. A., J.-G. Song, S. Jung and SS Kim, "Software vulnerability design and approaches for securing SCADA control systems", International Journal of Smart Home, vol. 3, no. 1, pp. 49–56, 2009

  9. Cheng T, Teizer J (2013) Real-time resource location data collection and visualization technology for construction safety and activity monitoring applications. Autom Constr 34:3–15

    Article  Google Scholar 

  10. Choras M, Flizikowski A, Kozik R, Holubowicz W (2009) Decision Aid Tool and Ontology-Based Reasoning for Critical Infrastructure Vulnerabilities and Threats Analysis, in Critical Information Infrastructures Security: 4th International Workshop, Bonn, Germany

  11. Díaz L, Bröring A, McInerney D, Libertá G, Foerster T (2013) Publishing sensor observations into geospatial information infrastructures: a use case in fire danger assessment. Environ Model Softw 48:65–80

    Article  Google Scholar 

  12. Duquennoy S, Grimaud G, Vandewalle J-J (2009) The Web of Things: interconnecting devices with high usability and performance, in 6th IEEE International Conference on Embedded Software and Systems, HangZhou, Zhejiang, China

  13. Dykes J., A. M. MacEachren and M.-J. Kraa, “Exploring Geovisualization: a volume in international cartographic association”, Amsterdam: Elsevier Ltd., 2005, ISBN: 978-0-08-044531-1

  14. Eicke TN, Jung Y, Kuijper A (2015) Stable dynamic webshadows in the X3DOM framework. Expert Syst Appl 42(7):3586–3609

    Article  Google Scholar 

  15. Espındola DB, Fumagalli L, Garetti M, Pereira CE, Botelho SS, Henriques RV (January 2013) A model-based approach for data integration to improve maintenance management by mixed reality. Comput Ind 64:376–391

    Article  Google Scholar 

  16. Evans A, Romeo M, Bahrehmand A, Agenjo J, Blat J (June 2014) 3D graphics on the web: a survey. Comput Graph 41:43–61

    Article  Google Scholar 

  17. Feldhorst S, Fiedler M, Heinemann M, Hompel MT, Krumm H (2010) Event-based 3D–Monitoring of Material Flow Systems in Real-Time, in 8th IEEE International Conference on Industrial Informatics (INDIN), Osaka, Japan

  18. Guinard D, Trifa V, Mattern F, Wilde E (2011) From the Internet of Things to the Web of Things: Resource-oriented Architecture and Best Practices. In: Architecting the Internet of Things. Springer: Berlin Heidelberg, pp 97–129

  19. Hamza-Lup FG, Maghiar M (2016) Web3D graphics enabled through sensor networks for cost-effective assessment and management of energy efficiency in buildings. Graph Model 88:66–74

    Article  MathSciNet  Google Scholar 

  20. Hilda JJ, Srimathi C, Bonthu B (2016) A review on the development of big data analytics and Efective data visualization techniques in the context of massive and multidimensional data. Indian Journal of Science and Technology 9(27):1–13

    Article  Google Scholar 

  21. Kalochristianakis M, Katrinakis D, Atsali G, Malamos A, Manios T, Panagiotakis S (2016) HOLISTIC: An IoT system for residential water recycling based on open source technologies, in International Conference on Telecommunications and Multimedia, Heraklion, Crete, Greece

  22. Kim J-S, Polys N, Sforza P (2015) Preparing and Evaluating Geospatial Data Models using X3D encodings for Web 3D Geovisualization Services, in 20th International Conference on 3D Web Technology, Heraklion, Crete, Greece

  23. Olbrich M, Franke T, Rojtberg P (2014) Remote visual tracking for the (mobile) web, in The 19th international conference on Web3D Technology, Vancouver, BC, Canada

  24. Paradiso JA, Landay JA (October 2009) Guest editors’ introduction: cross-reality environments. IEEE Pervasive Computing 8:14–15

    Article  Google Scholar 

  25. Robles T, Alcarria R, Martín D, Morales A, Navarro M, Calero R, Iglesias S, López M (2014) An Internet of Things-based model for smart water management, in 28th International Conference on Advanced Information Networking and Applications Workshops, Victoria, Canada

  26. Robles T, Alcarria R, Martín D, Navarro M, Calero R, Iglesias S, López M (2015) An IoT based reference architecture for smart water management processes. JoWUA 6(1):4–23

    Google Scholar 

  27. Seo D, Lee J (2013) Direct hand touchable interactions in augmented reality environments for natural and intuitive user experiences. Expert Syst Appl 40(9):3784–3793

    Article  Google Scholar 

  28. Stangl M, Pielmeier J, Berger C, Braunreuther S, Reinhart G (2016) Development of a web based monitoring system for a distributed and modern production. Procedia CIRP 52:222–227

    Article  Google Scholar 

  29. Stein C, Limper M, Kuijper A (2014) Spatial data structures for accelerated 3d visibility computation to enable large model visualization on the web, in The 19th international conference on Web3D technology, Vancouver, BC, Canada

  30. Syberfeldt A, Karlsson I, Ng A, Svantesson J, Almgren T (2013) A web-based platform for the simulation–optimization of industrial problems. Comput Ind Eng 64:987–998

    Article  Google Scholar 

  31. Thürlimann CM, Dürrenmatt DJ, Villez K (2015) Energy and process data processing and visualisation for optimising wastewater treatment plants. Water Practice and Technology 10(1):10–18

    Article  Google Scholar 

  32. Walker JD, Chapra SC (2014) A client-side web application for interactive environmental simulation modeling. Environ Model Softw 55:49–60

    Article  Google Scholar 

  33. Wong BP, Kerkez B (2016) Real-time environmental sensor data: an application to water quality using web services. Environ Model Softw 84:505–517

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Multimedia, Networks and Communications Laboratory, Department of Informatics Engineering, Technological Educational Institute of Crete, GR 71004, Heraklion, Crete, Greece

    Georgia Atsali, Spyros Panagiotakis, Evangelos Markakis, George Mastorakis, Evangelos Pallis & Athanasios Malamos

  2. Department of Computer Science, University of Nicosia, Nicosia, Cyprus

    Constandinos X. Mavromoustakis

Authors
  1. Georgia Atsali
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Spyros Panagiotakis
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Evangelos Markakis
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. George Mastorakis
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Constandinos X. Mavromoustakis
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Evangelos Pallis
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Athanasios Malamos
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Spyros Panagiotakis.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Atsali, G., Panagiotakis, S., Markakis, E. et al. A mixed reality 3D system for the integration of X3DoM graphics with real-time IoT data. Multimed Tools Appl 77, 4731–4752 (2018). https://doi.org/10.1007/s11042-017-4988-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-017-4988-z

Keywords

Search

Navigation