Abstract
Designing, setting up and running experiments is a key phases of studies, but it can be quite tedious due to the need to synchronise signals from data-collecting sensors, change variables between experiments, and manage volunteers. This article presents the architecture of a framework for managing and running experiments. It allows to easily manage the parameters of each of the tests assigned to the users and the information about them. It also enables the remote control of experiments via TCP communication, the integration and synchronisation of different devices via OpenViBE, and storage of data and signals in time series databases via InfluxDB. To illustrate the capabilities of the framework more clearly, we will also present a case study in an augmented reality environment using the HoloLens2 device. It describes the use of the framework in an experiment involving the display of different appearances of assistive drones to study participants to analyse their acceptance. After viewing the different drones in an augmented environment, participants are asked to provide subjective feedback through questionnaires and objective feedback through heart rate and eye-tracking sensors. This case study shows how the use of this framework streamlines testing by allowing test configuration, uniquely identifying the information provided by each participant and synchronising the information obtained from the different sensors.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bebko, A.O., Troje, N.F.: bmlTUX: design and control of experiments in virtual reality and beyond. i-Perception 11(4) (2020). https://doi.org/10.1177/2041669520938400
Belmonte, L.M., Garcia, A.S., Segura, E., Novais, P., Morales, R., Fernández-Caballero, A.: Virtual reality simulation of a quadrotor to monitor dependent people at home. IEEE Trans. Emerg. Top. Comput. 9(3), 1301–1315 (2021). https://doi.org/10.1109/TETC.2020.3000352
Bovo, R., Giunchi, D., Steed, A., Heinis, T.: MR-RIEW: an MR toolkit for designing remote immersive experiment workflows. In: 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, pp. 766–767. IEEE (2022). https://doi.org/10.1109/VRW55335.2022.00234
Brookes, J.: UXF - Unity Experiment Framework. https://immersivecognition.com/unity-experiment-framework/. Accessed 04 July 2023
Brookes, J., Warburton, M., Alghadier, M., Mon-Williams, M., Mushtaq, F.: Studying human behavior with virtual reality: the unity experiment framework. Behav. Res. Methods 52(2), 455–463 (2020). https://doi.org/10.3758/s13428-019-01242-0
Choukou, M.A., et al.: Evaluating the acceptance of ambient assisted living technology (AALT) in rehabilitation: a scoping review. Int. J. Med. Informatics 150, 104461 (2021). https://doi.org/10.1016/j.ijmedinf.2021.104461
Grübel, J.: The design, experiment, analyse, and reproduce principle for experimentation in virtual reality. Front. Virt. Realit. 4 (2023). https://doi.org/10.3389/frvir.2023.1069423
Herdel, V., Kuzminykh, A., Hildebrandt, A., Cauchard, J.R.: Drone in love: emotional perception of facial expressions on flying robots. In: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, p. 716. ACM (2021). https://doi.org/10.1145/3411764.3445495
influxdata: InfluxDB | Real-time insights at any scale. https://www.influxdata.com/. Accessed 05 July 2023
INRIA Rennes: OpenViBE | Software for Brain Computer Interfaces and Real Time Neurosciences. http://openvibe.inria.fr/. Accessed 04 July 2023
Jaschinski, C.: Ambient assisted living: towards a model of technology adoption and use among elderly users. In: Adjunct Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing, pp. 319–324 (2014). https://doi.org/10.1145/2638728.2638838
Jost, C., (eds.): Human-Robot Interaction. SSBN, vol. 12. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-42307-0
Lee, J., Natarrajan, R., Rodriguez, S.S., Panda, P., Ofek, E.: RemoteLab: a VR remote study toolkit. In: Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology, p. 51. ACM (2022). https://doi.org/10.1145/3526113.3545679
Liu, Z.M., Chen, Y.H.: A modularity design approach to behavioral research with immersive virtual reality: a SkyrimVR-based behavioral experimental framework. Behav. Res. Methods (2022). https://doi.org/10.3758/s13428-022-01990-6
Macwhinney, B., James, J., Schunn, C., Li, P., Schneider, W.: STEP - a system for teaching experimental psychology using E-Prime. Behav. Res. Methods 33, 287–296 (2001). https://doi.org/10.3758/BF03195379
Sánchez-Reolid, R., Sánchez-Reolid, D., Pereira, A., Fernández-Caballero, A.: Acquisition and synchronisation of multi-source physiological data using microservices and event-driven architecture. In: Ambient Intelligence-Software and Applications–13th International Symposium on Ambient Intelligence, pp. 13–23. Springer, Cham (2023). https://doi.org/10.1007/978-3-031-22356-3_2
Schuetz, I., Karimpur, H., Fiehler, K.: vexptoolbox: a software toolbox for human behavior studies using the vizard virtual reality platform. Behav. Res. Methods (2022). https://doi.org/10.3758/s13428-022-01831-6
Tools, P.S.: E-Primeő|Psychology Software Tools. https://pstnet.com/products/e-prime/. Accessed 04 July 2023
Yeh, A., et al.: Exploring proxemics for human-drone interaction. In: Proceedings of the 5th International Conference on Human Agent Interaction, pp. 81–88. ACM (2017). https://doi.org/10.1145/3125739.3125773
Acknowledgements
This paper has been funded by Junta de Comunidades de Castilla-La Mancha and by European Regional Development Fund (SBPLY/21/180501/000030), by Universidad de Castilla-La Mancha (2022-GRIN-34436), and by MCIN/AEI/ 10.13039/501100011033 and by “ERDF A way to make Europe” (PID2020-115220RB-C21). This work was also partially supported by CIBERSAM of the Instituto de Salud Carlos III.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Jiménez-Ruescas, J., Sánchez, R., Maya, Y., Fernández-Caballero, A., García, A.S., González, P. (2023). A Framework for Managing the Experimental Evaluation of Ambient Assisted Living Systems. In: Bravo, J., Urzáiz, G. (eds) Proceedings of the 15th International Conference on Ubiquitous Computing & Ambient Intelligence (UCAmI 2023). UCAmI 2023. Lecture Notes in Networks and Systems, vol 835. Springer, Cham. https://doi.org/10.1007/978-3-031-48306-6_13
Download citation
DOI: https://doi.org/10.1007/978-3-031-48306-6_13
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-48305-9
Online ISBN: 978-3-031-48306-6
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)