Abstract
As a key facet of the mobile user experience, mobile phone-based gesture design has established its importance in the competitive landscape of leading manufacturers. Mobile phone-based gestures, distinguished by high cognitive load and metaphorical nature, contribute to a continuing divergence between the user's subjective perceptions and the designer's official definitions in the scope of gesture design and experience evaluation. Furthermore, the obstacles presented by the COVID-19 pandemic's isolation measures have curtailed short-term user involvement in gesture experience appraisals. Online user testing platforms, while providing basic research tools, fall short of adequate integration with gesture operation experience knowledge and lack sufficient validation of tool usage procedures for gesture studies. In light of a potentially prolonged COVID-19 period, our research endeavors to refine and authenticate user research techniques for gesture experience, advancing the flexibility of gesture Quality of Experience evaluations and circumventing irrelevant or detrimental research results. Informed by the literature review, the study constructed the ‘Gesture Hub’ - a user evaluation framework specifically designed for gesture experiences. Applied in a remote user testing project, this framework's efficacy was corroborated, with ensuing analysis highlighting its merits and demerits. The study broadens the user QoE evaluation methodologies in the gesture interaction arena, providing crucial direction for remote user-expert collaborations and enhancing the accuracy of user gesture experience evaluations and requirements.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bolt, N., Tulathimutte, T.: Remote Research: Real Users, Real Time, Real Research. Rosenfeld Media (2010)
Braun, V., Clarke, V.: Using thematic analysis in psychology. Qual. Res. Psychol. 3(2), 77–101 (2006)
Brdnik, S., Heričko, T., Šumak, B.: Intelligent user interfaces and their evaluation: a systematic mapping study. Sensors (Basel) 22(15) (2022). https://doi.org/10.3390/s22155830
Brudy, F., et al.: Cross-device taxonomy: survey, opportunities and challenges of interactions spanning across multiple devices. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, pp. 1–28 (2019)
DeJonckheere, M., Vaughn, L.M.: Semistructured interviewing in primary care research: a balance of relationship and rigour. Family Medicine Community Health 7(2) (2019)
Dey, A.K.: Understanding and using context. Pers. Ubiquit. Comput. 5, 4–7 (2001)
Fan, M., Wang, Y., Xie, Y., Li, F.M., Chen, C.: Understanding how older adults comprehend COVID-19 interactive visualizations via think-aloud protocol. Int. J. Hum.–Comput. Interact. 1–17 (2022)
Flórez-Aristizábal, L., Collazos, C.A., Cano, S., Solano, A.: CollabABILITY cards: supporting researchers and educators to co-design computer-supported collaborative learning activities for deaf children. Sustainability 14(22), 14703 (2022)
George, T.: Semi-Structured Interview | Definition, Guide & Examples (2022). https://www.scribbr.com/methodology/semi-structured-interview/
Giroux, F., et al.: Guidelines for collecting automatic facial expression detection data synchronized with a dynamic stimulus in remote moderated user tests. In: Human-Computer Interaction. Theory, Methods and Tools: Thematic Area, HCI 2021, Held as Part of the 23rd HCI International Conference, HCII 2021, Virtual Event, July 24–29, 2021, Proceedings, Part I 23 (2021)
Guan, L.L., Zhu, Z.M., Zhang, L., Wang, S.L.: Research on the functions and services of scientific research crowdsourcing platform in the perspective of open science: a case study of Daemo. Res. Lib. Sci. (05), 59–66 (2020). https://doi.org/10.15941/j.cnki.issn1001-0424.2020.05.009
Habib, H., Li, M., Young, E., Cranor, L.: “Okay, whatever”: an evaluation of cookie consent interfaces. In: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems, pp. 1–27 (2022)
Heo, S., Lee, G.: ForceTap: extending the input vocabulary of mobile touch screens by adding tap gestures. In: Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services, pp. 113–122 (2011)
Hesenius, M., Gruhn, V.: GestureCards: a hybrid gesture notation. In: Proceedings of the ACM on Human-Computer Interaction, 3(EICS), 1–35 (2019)
Hesenius, M., Sternal, S., Gruhn, V.: A multi-touch-recognizer for gesturecards. In: Proceedings of the ACM SIGCHI Symposium on Engineering Interactive Computing Systems, pp. 75–80 (2017)
Hu, Y., Du, X., Bryan-Kinns, N., Guo, Y.: Identifying divergent design thinking through the observable behavior of service design novices. Int. J. Technol. Des. Educ. 29, 1179–1191 (2019)
Ikematsu, K., Tsubouchi, K., Yamanaka, S.: PredicTaps: latency reduction technique for single-taps based on recognition for single-tap or double-tap. In: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems, pp. 1–9 (2020)
Jiang, L.: Interactive Data Exploration using Gestures [Doctoral dissertation, The Ohio State University] (2017)
Juran, J.: Quality 4.0: the future of quality? Web blog. In (2021)
Larsen, J.N., Jacobsen, T.H., Boring, S., Bergström, J., Pohl, H.: The influence of hand size on touch accuracy. In: Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services, pp. 1–11 (2019)
Liu, J., Kim, S.: Space design guide for public areas in a multicultural environment: based on the theory of social atomism. Arch. Des. Res. 34(2), 21–31 (2021)
Marques Correa, C., Diniz Junqueira Barbosa, G., Diniz Junqueira Barbosa, S., Selbach Silveira, M.: HCI research experiences during the pandemic: lessons learned for the road ahead. Interact. Comput., iwac036 (2022)
Meng, M., Zhu, Q.H.: A review of research on user experience at home and abroad. Res. Lib. Sci. (09), 9–19 (2021). https://doi.org/10.15941/j.cnki.issn1001-0424.2021.09.002
Nielsen, J., Clemmensen, T., Yssing, C.: Getting access to what goes on in people’s heads? Reflections on the think-aloud technique. In: Proceedings of the Second Nordic Conference on Human-Computer Interaction, pp. 101–110 (2002)
Pahk, Y., Self, J., Baek, J.S.: COVALENT, a method for co-designing value exchange in community-centred design. CoDesign 14(4), 275–292 (2018)
Paz, F., Pow-Sang, J.A.: Usability evaluation methods for software development: a systematic mapping review. In: 2015 8th International Conference on Advanced Software Engineering & Its Applications (ASEA), pp. 1–4. IEEE (2015)
Prates, R.O., De Souza, C.S., Barbosa, S.D.: Methods and tools: a method for evaluating the communicability of user interfaces. Interactions 7(1), 31–38 (2000)
Pu, Y.-H., Chiu, P.-S., Chen, T.-S., Huang, Y.-M.: The design and implementation of a mobile library app system. Library Hi Tech 33(1), 15–31 (2015)
Qi, W., Li, D.: A user experience study on short video social apps based on content recommendation algorithm of artificial intelligence. Int. J. Pattern Recognit Artif Intell. 35(02), 2159008 (2021)
Quesenbery, W.: Balancing the 5Es of usability. Cutter IT Journal 17(2), 4–11 (2004)
Rodda, J., Ranscombe, C., Kuys, B.: A method to explore strategies to communicate user experience through storyboards: an automotive design case study. AI EDAM 36, e16 (2022)
Statista: Mobile network subscriptions worldwide 2028 (2022). https://www.statista.com/statistics/330695/number-of-smartphone-users-worldwide/
Sun, P.: The gesture-based context user interface. Pack. Eng. 35(08), 96–100 (2014). https://doi.org/10.19554/j.cnki.1001-3563.2014.08.024
Truong, K.N., Hayes, G.R., Abowd, G.D.: Storyboarding: an empirical determination of best practices and effective guidelines. In: Proceedings of the 6th Conference on Designing Interactive Systems, pp. 12–21 (2006)
Vyas, D., van der Veer, G.C.: APEC: a framework for designing experience. Spaces, Places & Experience in HCI, pp. 1–4 (2005)
Wei, W., Gong, X.D.: HCI develop trend based on user-experience. J. Beijing Univ. Aeronaut. Astronaut. 37(07), 868–871 (2011). https://doi.org/10.13700/j.bh.1001-5965.2011.07.009
Xia, H., Glueck, M., Annett, M., Wang, M., Wigdor, D.: Iteratively designing gesture vocabularies: a survey and analysis of best practices in the HCI literature. ACM Trans. Comput.-Hum. Interact. (TOCHI) 29(4), 1–54 (2022)
Zhang, J., Liu, Y., Chen, K.J.: Gesture interaction design for wearable devices based on scenario model. Pack. Eng. 40(12), 140–146 (2019). https://doi.org/10.19554/j.cnki.1001-3563.2019.12.025
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Dong, H., Zhang, J., Wang, W., Yang, Y., Chen, Q., Du, L. (2023). Gesture Hub Design: A Remote User Study Method for Evaluating the Quality of Experience in Mobile Phone-Based Gesture Interaction. In: Kurosu, M., et al. HCI International 2023 – Late Breaking Papers. HCII 2023. Lecture Notes in Computer Science, vol 14054. Springer, Cham. https://doi.org/10.1007/978-3-031-48038-6_3
Download citation
DOI: https://doi.org/10.1007/978-3-031-48038-6_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-48037-9
Online ISBN: 978-3-031-48038-6
eBook Packages: Computer ScienceComputer Science (R0)