Abstract
Hand gestures are an essential component of our behavior and are often considered a valuable way for Ambient Assisted Living solutions. Gestural commands are particularly helpful in hectic home environments, like the kitchen, where we often have greasy hands. Yet, gestures can be challenging to learn and recall especially for non-tech savvy users. The adoption of a user-centered approach to select the gestural commands typically allows to generate postures and moves that are easier to perform and remember. Following this approach, we report on an agile and cost-effective elicitation study based on a virtual prototype that was conducted to design a set of gestural commands to operate the lighting system embedded into an extraction hood. Spontaneous gestures by 30 participants were video recorded and categorized through computer-supported structured video analysis. Our findings indicate the feasibility of the proposed approach with able-bodied users and open to the involvement of physically and cognitively challenged individuals.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Akers D (2006) Wizard of Oz for participatory design: inventing a gestural inter-face for 3D selection of neural pathway estimates. In: CHI’06 extended abstracts on human factors in computing systems. ACM, pp 454–459
Anastasiou D, Jian C, Zhekova D (2012) Speech and gesture interaction in an ambient assisted living lab. In: Proceedings of the 1st workshop on speech and multimodal interaction in assistive environments. Association for Computational Linguistics, pp 18–27
Bhuiyan M, Picking R (2009) Gesture-controlled user interfaces, what have we done and what’s next. In: Proceedings of the fifth collaborative research symposium on security, E-Learning, Internet and Networking (SEIN 2009), Darmstadt, Germany. 25–29.
Brereton M, Bidwell N, Donovan J, Campbell B, Buur J (2003) Work at hand: an exploration of gesture in the context of work and everyday life to inform the design of gestural input devices. In: Proceedings of the fourth Australasian user interface conference on user interfaces 2003-Volume 18. Australian Computer Society, Inc., pp 1–10
Choi E, Kwon S, Lee D, Lee H, Chung MK (2014) Towards successful user interaction with systems: Focusing on user-derived gestures for smart home systems. Appl Ergon 45(4), 1196–1207
Connell S, Kuo P, Liu L, Piper AM (2013) A Wizard-of-Oz elicitation study examining child-defined gestures with a whole-body interface. In: Proceedings of the 12th international conference on interaction design and children. ACM, pp 277–280
Cárdenas M, Gómez Sanz J, Pavón J (2018) Testing Ambient assisted living solutions with simulations. In: IFIP International conference on testing software and systems. Springer, pp 56–61
Dudley JJ, Schuff H, Kristensson PO (2018) Bare-handed 3D drawing in augmented reality. In: Proceedings of the 2018 on designing interactive systems conference 2018. ACM, pp 241–252
Ferron M, Mana N, Mich O (2019) Designing mid-air gesture interaction with mobile devices for older adults. in: perspectives on human-computer interaction research with older people. Springer, pp 81–100
Gamberini L, Spagnolli A, Prontu L, Furlan S, Martino F, Solaz BR, Lozano JA et al (2013) How natural is a natural interface? An evaluation procedure based on action breakdowns. Pers Ubiquit Comput 17(1), 69–79
Grguric´ A, Mošmondor M, Kušek M, Stocklöw C, Salvi D (2013) Introducing gesture interaction in the ambient assisted living platform universal. In: Telecommunications (ConTEL), 2013 12th international conference on. IEEE, pp 215–222
Hsieh Y, Jylhä A, Orso V, Gamberini L, Jacucci G (2016) Designing a willing-to-use-in-public hand gestural interaction technique for smart glasses. In: Proceedings of the 2016 CHI conference on human factors in computing systems. ACM, pp 4203–4215
Löcken A, Hesselmann T, Pielot M, Henze N, Boll S (2012) User-centred process for the definition of free-hand gestures applied to controlling music playback. Multimedia Syst 18(1):15–31
Marquardt N, Greenberg S (2012) Informing the design of proxemic interactions. IEEE Pervasive Comput 11(2):14–23
McAweeney E, Zhang H, Nebeling M (2018) User-driven design principles for gesture representations. In: Proceedings of the 2018 CHI conference on human factors in computing systems. ACM, p 547
Neßelrath R, Lu C, Schulz CH, Frey J, Alexandersson J (2011) A gesture-based system for context–sensitive interaction with smart homes. In: Ambient assisted living. Springer, pp 209–219
Nielsen M, Störring M, Moeslund TB, Granum E (2003) A procedure for developing intuitive and ergonomic gesture interfaces for HCI. In: International gesture workshop. Springer, pp 409–420
Norman DA (2010) Natural user interfaces are not natural. Interactions 17(3), 6–10
Orso V, Gullà F, Menghi R, Ceccacci S, Cavalieri L, Germani M, Gamberini L (2017) A digital cookbook for elderly people: investigating interface concept. In: Proceedings of the international conference on interfaces and human computer interaction, pp 159–166
O’hara K, Harper R, Mentis H, Sellen A, Taylor A (2013) On the natural-ness of touchless: Putting the interaction˙ back into NUI. In: ACM Transactions on Computer-Human Interaction (TOCHI), vol 20, no 1, p 5
Panger G (2012) Kinect in the kitchen: testing depth camera interactions in practical home environments. In: CHI’12 extended abstracts on human factors in computing systems. ACM, pp 1985–1990
Pham T, Vermeulen J, Tang A, MacDonald Vermeulen L (2018) Scale impacts elicited gestures for manipulating holograms: implications for AR gesture design. In: Proceedings of the 2018 on designing interactive systems conference 2018. ACM, pp 227–240
Ringel Morris M, Huang A, Paepcke A, Winograd T (2006) Cooperative gestures: multi-user gestural interactions for co-located groupware. In: Proceedings of the SIGCHI conference on Human Factors in computing systems. ACM, pp 1201–1210
Ruiz J, Li Y, Lank E (2011) User-defined motion gestures for mobile inter-action. In: Proceedings of the SIGCHI conference on human factors in computing systems. ACM, pp 197–206
Sorathia K, Jain M, Amrit M, Mokashi Punekar R, Srivastava S, Rajput N (2015) Gesture selection study for a maternal healthcare information system in rural Assam, India. J Usability Stud 11(1), 7–20
Stern HI, Wachs JP, Edan Y (2008) Optimal consensus intuitive hand gesture vocabulary design. In: Semantic Computing, 2008 IEEE
Wachs JP, Kölsch M, Stern H, Edan Y (2011) Vision-based hand-gesture applications. Commun ACM 54(2), 60–71
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Orso, V., Bettelli, A., Zamboni, L., Gamberini, L. (2021). How Would Do that? An Agile Elicitation Technique to Explore Users’ Spontaneous Gestural Commands. In: Monteriù, A., Freddi, A., Longhi, S. (eds) Ambient Assisted Living. ForItAAL 2019. Lecture Notes in Electrical Engineering, vol 725. Springer, Cham. https://doi.org/10.1007/978-3-030-63107-9_10
Download citation
DOI: https://doi.org/10.1007/978-3-030-63107-9_10
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-63106-2
Online ISBN: 978-3-030-63107-9
eBook Packages: EngineeringEngineering (R0)