Skip to main content

UNITY-Things: An Internet-of-Things Software Framework Integrating Arduino-Enabled Remote Devices with the UNITY Game Engine

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12789))

Abstract

We present a software framework that integrates Arduino-enabled remote devices with the UNITY game engine through Internet-of-Things technology. The framework allows a technology stack where networked physical devices become digital-twin game objects in UNITY. This makes it possible for game developers without competence in electronics or Arduino programming to develop hybrid pervasive games directly in UNITY. The framework was implemented in C# on the UNITY side and C++ on the Arduino side, using MQTT as a message broker. The first version of the framework was evaluated empirically with UNITY game developers, resulting in requirements for an updated version. The updated version was used to develop a hybrid pervasive exergame for elderly, which is presented in the paper. The overall positive feedback from the evaluation with game developers and our own experience using the framework encourages us to develop the framework further and integrating it as much as possible with the UNITY development environment. Our aim is to make developing hybrid pervasive games possible for UNITY game developers, without requiring them to concern themselves with the troubles of networks, electronics, or low-level microcontroller programming.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Severance, C.: Massimo banzi: building arduino. Computer 47(1), 11–12 (2014)

    Article  Google Scholar 

  2. Haas, J.: A history of the unity game engine. Dissertation Worchester Polytechnic Institute (2014)

    Google Scholar 

  3. Wortmann, F., Flüchter, K.: Internet of things. Bus. Inf. Syst. Eng. 57(3), 221–224 (2015)

    Article  Google Scholar 

  4. Glaessgen, E., Stargel, D.: The digital twin paradigm for future NASA and us air force vehicles. In: 53rd AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics and Materials (2012). Conference 20th AIAA/ASME/AHS Adaptive Structures Conference 14th AIAA

    Google Scholar 

  5. Grieves, M., Vickers, J.: Digital twin: mitigating unpredictable, undesirable emergent behavior in complex systems. In: Kahlen, F.-J., Flumerfelt, S., Alves, A. (eds.) Transdisciplinary perspectives on complex systems, pp. 85–113. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-38756-7_4

    Chapter  Google Scholar 

  6. Tao, F., Cheng, J., Qi, Q., Zhang, M., Zhang, H., Sui, F.: Digital twin-driven product design, manufacturing and service with big data. Int. J. Adv. Manuf. Technol. 94(9–12), 3563–3576 (2017). https://doi.org/10.1007/s00170-017-0233-1

    Article  Google Scholar 

  7. Bass, L., Clements, P., Kazman, R.: Software Architecture in Practice. Addison-Wesley Professional, Boston (2003)

    Google Scholar 

  8. Ashton, K., et al.: That ‘internet of things’ thing. RFID J. 22(7), 97–114 (2009)

    Google Scholar 

  9. Ecclipse. An open source mqtt broker. https://mosquitto.org/. Accessed 01 Oct 2020

  10. Adafruit: Adafruit feather huzzah with esp8266 - loose headers. https://www.adafruit.com/product/2821. Accessed 02 Oct 2020

  11. Subramanian, S., Dahl, Y., Vereijken, B., Svanæs, D.: ExerTiles: a tangible interactive physiotherapy toolkit for balance training with older adults. In: OZCHI 2020 - Proceedings of the 32nd Australian Conference on Human-Computer-Interaction (2020)

    Google Scholar 

Download references

Acknowledgments

We thank the UNITY developers and students taking part in the usability test for contributing their time and effort to the project.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Dag Svanæs .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Svanæs, D., Scharvet Lyngby, A., Bärnhold, M., Røsand, T., Subramanian, S. (2021). UNITY-Things: An Internet-of-Things Software Framework Integrating Arduino-Enabled Remote Devices with the UNITY Game Engine. In: Fang, X. (eds) HCI in Games: Experience Design and Game Mechanics. HCII 2021. Lecture Notes in Computer Science(), vol 12789. Springer, Cham. https://doi.org/10.1007/978-3-030-77277-2_29

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-77277-2_29

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-77276-5

  • Online ISBN: 978-3-030-77277-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics