Shreya Chopra
Frank Maurer
ABSTRACT
We investigate user preferences for controlling IoT devices with headset-based Augment Reality (AR), comparing gestural control and voice control. An elicitation study is performed with 16 participants to gather their preferred voice commands and gestures for a set of referents. We analyzed 784 inputs (392 gestures and 392 voice) as well as observations and interviews to develop an empirical basis for design recommendations that form a guideline for future designers and implementors of such voice commands and gestures for interacting with the IoT via headset-based AR.
- AR Critic. What are the Magic Leap One Input Methods?. 2018. Retrieved: September 13, 2019 from https://arcritic.com/2293/what-are-the-magic-leap-one-input-methods/.Google Scholar
- Augmented Reality | Definition of Augmented Reality by Lexico. 2019. Retrieved: September 13, 2019 from https://www.lexico.com/en/definition/augmented_reality.Google Scholar
- Ceylan Beşevli, Oğuz Turan Buruk, Merve Erkaya, and Oğuzhan Özcan. 2018. Investigating the Effects of Legacy Bias.In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility (DIS '18). ACM Press, New York, NY, 277--281. http://doi.acm.org/10.1145/3197391.3205449.Google Scholar
- Richard A. Bolt. 1980. "Put-that-there: Voice and gesture at the graphics interface. In Proceedings of the 7th annual conference on Computer graphics and interactive techniques (SIGGRAPH '80). ACM, New York, NY, USA, 262--270. DOI=http://dx.doi.org/10.1145/800250.807503.Google ScholarDigital Library
- Edwin Chan. 2017. User-defined Single-hand Microgestures. Master's thesis. University of Calgary, Calgary, Canada. Retrieved: March 28, 2020 from: https://prism.ucalgary.ca/bitstream/handle/11023/3827/ucalgary_2017_chan_edwin.pdf?sequence=3Google Scholar
- Edwin Chan, Frank Maurer. 2016. User Elicitation on Single-hand Microgestures. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM Press, New York, NY, 3403--3414. http://doi.acm.org/10.1145/2858036.2858589.Google ScholarDigital Library
- Qing Chen. 2018.Immersive Analytics Interaction: User Preferences and Agreements by Task Type. Master's thesis. University of Calgary, Calgary, Canada. Retrieved: March 28, 2020 from: https://prism.ucalgary.ca/handle/1880/106633Google Scholar
- Shreya Chopra. 2019. Evaluating User Preferences for Augmented Reality Interactions for the Internet of Things. Master's thesis. University of Calgary, Calgary, Canada. Retrieved: March 28, 2020 from https://prism.ucalgary.ca/handle/1880/111455eGoogle Scholar
- , Lester F. Ludwig. 1991. Multidimensional audio window management, International Journal of Man-Machine Studies, Volume 34, Issue 3, 1991, Pages 319--336, ISSN 0020-7373, https://doi.org/10.1016/0020-7373(91)90023-Z.Google ScholarDigital Library
- Janet Groeber. 2015. Mixed Reality. Design: Retail. 27, 4 (Apr/May 2015) 22.Google Scholar
- Alaric Hamacher, Jahanzeb Hafeez, Roland Csizmazia. 2019. Augmented Reality User Interface Evaluation - Performance Measurement of Hololens, Moverio and Mouse Input.International Journal of Interactive Mobile Technologies (iJIM). 13, 03 (2019), 95--107. https://doi.org/10.3991/ijim.v13i03.10226Google Scholar
- Alexander G.Hauptmann, Paul McAvinney. 1993. Gestures with speech for graphic manipulation. International Journal of Man-Machine Studies. 38, 2 (Feb. 1993), 231--249. https://doi.org/10.1006/imms.1993.1011Google ScholarDigital Library
- Help - Google Glass. 2019. Retrieved: September 13, 2019 from https://www.google.com/glass/help/.Google Scholar
- O. Hilliges D. Kim S. Izadi et al. "HoloDesk: direct 3d interactions with a situated see-through display In Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems. pp. 2421--2430 2012.Google Scholar
- Helge Hüttenrauch, Mike Tate, Martin Böcker, Rosemary Orr, and Françoise Petersen. 2008. Standardising SPOKEN commands for mobile devices and services. In Proceedings of the International Conference on Mobile Technology, Applications, and Systems (Mobility '08). https://doi.org/10.1145/1506270.1506345Google ScholarDigital Library
- IFTTT. 2019. Retrieved: September 13, 2019 from https://play.google.com/store/apps/details?id=com.ifttt.ifttt&hl=en.Google Scholar
- Internet of things | Definition of Internet of things by Lexico. 2019. Retrieved: September 13, 2019 from https://www.lexico.com/en/definition/internet_of_things.Google Scholar
- Stephen Kimani. 2009. WIMP Interfaces. In: Ling Liu, M. Tamer Özsu (Eds.) Encyclopedia of Database Systems. (2009), 3529--3533. https://doi.org/10.1007/978-0-387-39940-9_467Google ScholarCross Ref
- Sang-Su Lee, Jeonghun Chae, Hyunjeong Kim, Youn-kyung Lim, and Kun-pyo Lee. 2013. Towards more natural digital content manipulation via user freehand gestural interaction in a living room. In Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing (UbiComp '13), 617--626. https://doi.org/10.1145/2493432.2493480Google ScholarDigital Library
- Cherlynn Low. Lenovo launches ThinkReality AR and VR headset for enterprises. 2019. Retrieved: September 13, 2019 from https://www.engadget.com/2019/05/13/lenovo-thinkreality-ar-vr-headset-hololens-2/#/.Google Scholar
- Meredith Ringel Morris. 2012. Web on the wall: Insights from a Multimodal Interaction Elicitation Study. In Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces (ITS '12), 95--104. https://doi.org/10.1145/2396636.2396651Google ScholarDigital Library
- Meredith Ringel Morris, Andreea Danielescu, Steven Drucker, Danyel Fisher, Bongshin Lee, M.C. Schraefel, and Jacob O. Wobbrock. 2014. Reducing legacy bias in gesture elicitation studies. interactions. 21, 3 (May/June 2014), 40--45. https://doi.org/10.1145/2591689Google ScholarDigital Library
- Meredith Ringel Morris, Jacob O. Wobbrock, & Andrew D. Wilson. (2010). Understanding Users' Preferences for Surface Gestures. Graphics Interface 2010, 261--268. Canadian Information Processing Society.Google Scholar
- Michael Muller. 2014. Curiosity, Creativity, and Surprise as Analytic Tools: Grounded Theory Method. In: Olson J., Kellogg W. (eds) Ways of Knowing in HCI. (2014), 25--48. https://doi.org/10.1007/978-1-4939-0378-8_2.Google ScholarCross Ref
- Michael Nebeling, Alexander Huber, David Ott and Moira C. Norrie. 2014. Web on the Wall Reloaded. In Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces (ITS '14), 15--24. https://doi.org/10.1145/2669485.2669497.Google ScholarDigital Library
- Scott Orgera. 2019. The Top 100 Google Assistant and Google Home Commands. Retrieved: September 13, 2019 from https://www.lifewire.com/top-google-assistant-and-google-home-commands-4158256.Google Scholar
- Ekaterina Peshkova, Martin Hitz, David Ahlström. 2016. Exploring User-Defined Gestures and Voice Commands to Control an Unmanned Aerial Vehicle. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering. (2016), 47--62. https://doi.org/10.1007/978-3-319-49616-0_5Google Scholar
- T. Piumsomboon A. Clark M. Billinghurst P. Kotzé G. Marsden G. Lindgaard et al. User-Defined Gestures for Augmented Reality. In Proceedings of the International Conference on Human-Computer Interaction (INTERACT 2013). Heidelberg:Springer pp. 282--299 2013.Google ScholarCross Ref
- Jaime Ruiz, Daniel Vogel. 2015. Soft-Constraints to Reduce Legacy and Performance Bias to Elicit Whole-body Gestures with Low Arm Fatigue. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15), 3347--3350. https://doi.org/10.1145/2702123.2702583Google ScholarDigital Library
- Jim Tanous. 2019. The Lenovo ThinkReality A6 Is a Lightweight AR Headset for Businesses. Retrieved: September 13, 2019 from https://pcper.com/2019/05/lenovo-thinkreality-a6/.Google Scholar
- Radu-Daniel Vatavu, Jacob O. Wobbrock. 2016. Between-Subjects Elicitation Studies: Formalization and Tool Support. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16), 3390--3402. https://doi.org/10.1145/2858036.2858228.Google ScholarDigital Library
- Jacob O. Wobbrock, Meredith Ringel Morris, Andrew D. Wilson. 2009. User-Defined Gestures for Surface Computing. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '09), 1083--1092. https://doi.org/10.1145/1518701.1518866.Google ScholarDigital Library
Index Terms
- Evaluating User Preferences for Augmented Reality Interactions with the Internet of Things
Recommendations
Exploring Unimodal Notification Interaction and Display Methods in Augmented Reality
VRST '23: Proceedings of the 29th ACM Symposium on Virtual Reality Software and TechnologyAs we develop computing platforms for augmented reality (AR) head-mounted display (HMDs) technologies for social or workplace environments, understanding how users interact with notifications in immersive environments has become crucial. We researched ...
"Megereality": Leveraging Physical Affordances for Multi-Device Gestural Interaction in Augmented Reality
CHI EA '20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing SystemsWe present a novel gestural interaction strategy for multi-device interactions in augmented reality (AR), in which we leverage existing physical affordances of everyday products and spaces for intuitive interactions in AR. To explore this concept, we ...
‘Address and command’: Two-handed mid-air interactions with multiple home devices
- The A&C approach enables two-handed mid-air interactions with multiple devices
- An ...
AbstractMid-air gestural interaction with multiple targets (or devices) in the physical space presents several challenges: gesture design gets more complex in the attempt to avoid gesture conflicts and accidental activations; the potential ...
Comments