Abstract
We present a software framework that integrates Arduino-enabled remote devices with the UNITY game engine through Internet-of-Things technology. The framework allows a technology stack where networked physical devices become digital-twin game objects in UNITY. This makes it possible for game developers without competence in electronics or Arduino programming to develop hybrid pervasive games directly in UNITY. The framework was implemented in C# on the UNITY side and C++ on the Arduino side, using MQTT as a message broker. The first version of the framework was evaluated empirically with UNITY game developers, resulting in requirements for an updated version. The updated version was used to develop a hybrid pervasive exergame for elderly, which is presented in the paper. The overall positive feedback from the evaluation with game developers and our own experience using the framework encourages us to develop the framework further and integrating it as much as possible with the UNITY development environment. Our aim is to make developing hybrid pervasive games possible for UNITY game developers, without requiring them to concern themselves with the troubles of networks, electronics, or low-level microcontroller programming.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Severance, C.: Massimo banzi: building arduino. Computer 47(1), 11–12 (2014)
Haas, J.: A history of the unity game engine. Dissertation Worchester Polytechnic Institute (2014)
Wortmann, F., Flüchter, K.: Internet of things. Bus. Inf. Syst. Eng. 57(3), 221–224 (2015)
Glaessgen, E., Stargel, D.: The digital twin paradigm for future NASA and us air force vehicles. In: 53rd AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics and Materials (2012). Conference 20th AIAA/ASME/AHS Adaptive Structures Conference 14th AIAA
Grieves, M., Vickers, J.: Digital twin: mitigating unpredictable, undesirable emergent behavior in complex systems. In: Kahlen, F.-J., Flumerfelt, S., Alves, A. (eds.) Transdisciplinary perspectives on complex systems, pp. 85–113. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-38756-7_4
Tao, F., Cheng, J., Qi, Q., Zhang, M., Zhang, H., Sui, F.: Digital twin-driven product design, manufacturing and service with big data. Int. J. Adv. Manuf. Technol. 94(9–12), 3563–3576 (2017). https://doi.org/10.1007/s00170-017-0233-1
Bass, L., Clements, P., Kazman, R.: Software Architecture in Practice. Addison-Wesley Professional, Boston (2003)
Ashton, K., et al.: That ‘internet of things’ thing. RFID J. 22(7), 97–114 (2009)
Ecclipse. An open source mqtt broker. https://mosquitto.org/. Accessed 01 Oct 2020
Adafruit: Adafruit feather huzzah with esp8266 - loose headers. https://www.adafruit.com/product/2821. Accessed 02 Oct 2020
Subramanian, S., Dahl, Y., Vereijken, B., Svanæs, D.: ExerTiles: a tangible interactive physiotherapy toolkit for balance training with older adults. In: OZCHI 2020 - Proceedings of the 32nd Australian Conference on Human-Computer-Interaction (2020)
Acknowledgments
We thank the UNITY developers and students taking part in the usability test for contributing their time and effort to the project.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Svanæs, D., Scharvet Lyngby, A., Bärnhold, M., Røsand, T., Subramanian, S. (2021). UNITY-Things: An Internet-of-Things Software Framework Integrating Arduino-Enabled Remote Devices with the UNITY Game Engine. In: Fang, X. (eds) HCI in Games: Experience Design and Game Mechanics. HCII 2021. Lecture Notes in Computer Science(), vol 12789. Springer, Cham. https://doi.org/10.1007/978-3-030-77277-2_29
Download citation
DOI: https://doi.org/10.1007/978-3-030-77277-2_29
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-77276-5
Online ISBN: 978-3-030-77277-2
eBook Packages: Computer ScienceComputer Science (R0)