skip to main content
research-article

How Subtle Can It Get?: A Trimodal Study of Ring-sized Interfaces for One-Handed Drone Control

Published: 15 June 2020 Publication History

Abstract

Flying drones have become common objects in our daily lives, serving a multitude of purposes. Many of these purposes involve outdoor scenarios where the user combines drone control with another activity. Traditional interaction methods rely on physical or virtual joysticks that occupy both hands, thus restricting drone usability. In this paper, we investigate one-handed human-to-drone-interaction by leveraging three modalities: force, touch, and IMU. After prototyping three different combinations of these modalities on a smartphone, we evaluate them against the current commercial standard through two user experiments. These experiments help us to find the combination of modalities that strikes a compromise between user performance, perceived task load, wrist rotation, and interaction area size. Accordingly, we select a method that achieves faster task completion times than the two-handed commercial baseline by 16.54% with the merits of subtle user behaviours inside a small-size ring-form device and implements this method within the ring-form device. The last experiment involving 12 participants shows that thanks to its small size and weight, the ring device displays better performance than the same method implemented on a mobile phone. Furthermore, users unanimously found the device useful for controlling a drone in mobile scenarios (AVG = 3.92/5), easy to use (AVG = 3.58/5) and easy to learn (AVG = 3.58/5). Our findings give significant design clues in search of subtle and effective interaction through finger augmentation devices with drone control. The users with our prototypical system and a multi-modal on-finger device can control a drone with subtle wrist rotation (pitch gestures: 43.24° amplitude and roll gestures: 46.35° amplitude) and unnoticeable thumb presses within a miniature-sized area of (1.08 * 0.61 cm2).

Supplementary Material

yau (yau.zip)
Supplemental movie, appendix, image and software files for, How Subtle Can It Get?: A Trimodal Study of Ring-sized Interfaces for One-Handed Drone Control

References

[1]
L A Jones and S J Lederman. 2006. Human Hand Function. Vol. 32. https://doi.org/10.1093/acprof:oso/9780195173154.001.0001
[2]
Muhammad Abdullah, Minji Kim, Waseem Hassan, Yoshihiro Kuroda, and Seokhee Jeon. 2017. HapticDrone: An Encountered-Type Kinesthetic Haptic Interface with Controllable Force Feedback: Initial Example for 1D Haptic Feedback. In Adjunct Publication of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17). ACM, New York, NY, USA, 115--117. https://doi.org/10.1145/3131785.3131821
[3]
Parastoo Abtahi, Benoit Landry, Jackie ( Junrui) Yang, Marco Pavone, Sean Follmer, and James A. Landay. 2019. Beyond The Force: Using Quadcopters to Appropriate Objects and the Environment for Haptics in Virtual Reality. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, New York, NY, USA, Article 359, 13 pages. https://doi.org/10.1145/3290605.3300589
[4]
Parastoo Abtahi, David Y. Zhao, Jane L. E., and James A. Landay. 2017. Drone Near Me: Exploring Touch-Based Human-Drone Interaction. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 3, Article 34 (Sept. 2017), 8 pages. https://doi.org/10.1145/3130899
[5]
Charlie Anderson, Benji Barash, Charlie McNeill, Denis Ogun, Michael Wray, Jarrod Knibbe, Christopher H. Morris, and Sue Ann Seah. 2015. The Cage: Towards a 6-DoF Remote Control with Force Feedback for UAV Interaction. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '15). ACM, New York, NY, USA, 1687--1692. https://doi.org/10.1145/2702613.2732877
[6]
Axel Antoine, Sylvain Malacria, and Géry Casiez. 2017. ForceEdge: Controlling Autoscroll on Both Desktop and Mobile Computers Using the Force. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 3281--3292. https://doi.org/10.1145/3025453.3025605
[7]
Jatin Arora, Kartik Mathur, Aryan Saini, and Aman Parnami. 2019. Gehna: Exploring the Design Space of Jewelry As an Input Modality. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, New York, NY, USA, Article 521, 12 pages. https://doi.org/10.1145/3290605.3300751
[8]
Mehmet Aydin Baytas, Damla undefineday, Yuchong Zhang, Mohammad Obaid, Asim Evren Yantaç, and Morten Fjeld. 2019. The Design of Social Drones: A Review of Studies on Autonomous Flyers in Inhabited Environments. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). Association for Computing Machinery, New York, NY, USA, Article Paper 250, 13 pages. https://doi.org/10.1145/3290605.3300480
[9]
Roger Boldu, Alexandru Dancu, Denys J.C. Matthies, Pablo Gallego Cascón, Shanaka Ransir, and Suranga Nanayakkara. 2018. Thumb-In-Motion: Evaluating Thumb-to-Ring Microgestures for Athletic Activity. In Proceedings of the Symposium on Spatial User Interaction (SUI '18). ACM, New York, NY, USA, 150--157. https://doi.org/10.1145/3267782.3267796
[10]
Sebastian Boring, David Ledo, Xiang 'Anthony' Chen, Nicolai Marquardt, Anthony Tang, and Saul Greenberg. 2012. The Fat Thumb: Using the Thumb's Contact Size for Single-handed Mobile Interaction. In Proceedings of the 14th International Conference on Human-computer Interaction with Mobile Devices and Services (MobileHCI '12). ACM, New York, NY, USA, 39--48. https://doi.org/10.1145/2371574.2371582
[11]
Sean Braley, Calvin Rubens, Timothy Merritt, and Roel Vertegaal. 2018. GridDrones: A Self-Levitating Physical Voxel Lattice for Interactive 3D Surface Deformations. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (UIST '18). Association for Computing Machinery, New York, NY, USA, 87--98. https://doi.org/10.1145/3242587.3242658
[12]
Stephen A. Brewster and Michael Hughes. 2009. Pressure-based Text Entry for Mobile Devices. In Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '09). ACM, New York, NY, USA, Article 9, 4 pages. https://doi.org/10.1145/1613858.1613870
[13]
Jessica R. Cauchard, Jane L. E, Kevin Y. Zhai, and James A. Landay. 2015. Drone and Me: An Exploration into Natural Human-drone Interaction. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '15). ACM, New York, NY, USA, 361--365. https://doi.org/10.1145/2750858.2805823
[14]
Jessica R. Cauchard, Alex Tamkin, Cheng Yao Wang, Luke Vink, Michelle Park, Tommy Fang, and James A. Landay. 2019. Drone.IO: A Gestural and Visual Interface for Human-Drone Interaction. In Proceedings of the 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI '19). IEEE Press, 153--162.
[15]
Jessica Rebecca Cauchard, Kevin Y. Zhai, Marco Spadafora, and James A. Landay. 2016. Emotion Encoding in Human-Drone Interaction. In The Eleventh ACM/IEEE International Conference on Human Robot Interaction (HRI '16). IEEE Press, 263--270.
[16]
Edwin Chan, Teddy Seyed, Wolfgang Stuerzlinger, Xing-Dong Yang, and Frank Maurer. 2016. User Elicitation on Single-hand Microgestures. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 3403--3414. https://doi.org/10.1145/2858036.2858589
[17]
Liwei Chan, Rong-Hao Liang, Ming-Chang Tsai, Kai-Yin Cheng, Chao-Huai Su, Mike Y. Chen, Wen-Huang Cheng, and Bing-Yu Chen. 2013. FingerPad: Private and Subtle Interaction Using Fingertips. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (UIST '13). ACM, New York, NY, USA, 255--260. https://doi.org/10.1145/2501988.2502016
[18]
Chien-Fang Chen, Kang-Ping Liu, and Neng-Hao Yu. 2015. Exploring Interaction Modalities for a Selfie Drone. In SIGGRAPH Asia 2015 Posters (SA '15). ACM, New York, NY, USA, Article 25, 2 pages. https://doi.org/10.1145/2820926.2820965
[19]
Yu-An Chen, Te-Yen Wu, Tim Chang, Jun You Liu, Yuan-Chang Hsieh, Leon Yulun Hsu, Ming-Wei Hsu, Paul Taele, Neng-Hao Yu, and Mike Y. Chen. 2018. ARPilot: Designing and Investigating AR Shooting Interfaces on Mobile Devices for Drone Videography. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '18). Association for Computing Machinery, New York, NY, USA, Article Article 42, 8 pages. https://doi.org/10.1145/3229434.3229475
[20]
Christian Corsten, Marcel Lahaye, Jan Borchers, and Simon Voelker. 2019. ForceRay: Extending Thumb Reach via Force Input Stabilizes Device Grip for Mobile Touch Input. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, New York, NY, USA, Article 212, 12 pages. https://doi.org/10.1145/3290605.3300442
[21]
Rajkumar Darbar, Joan Sol Roo, Thibault Lainé, and Martin Hachet. 2019. DroneSAR: Extending Physical Spaces in Spatial Augmented Reality Using Projection on a Drone. In Proceedings of the 18th International Conference on Mobile and Ubiquitous Multimedia (MUM '19). Association for Computing Machinery, New York, NY, USA, Article Article 4, 7 pages. https://doi.org/10.1145/3365610.3365631
[22]
Maria De Marsico and Alessandro Spagnoli. 2019. Using Hands As an Easy UAV Joystick for Entertainment Applications. In Proceedings of the 13th Biannual Conference of the Italian SIGCHI Chapter: Designing the Next Interaction (CHItaly '19). ACM, New York, NY, USA, Article 9, 9 pages. https://doi.org/10.1145/3351995.3352042
[23]
Tinglin Duan, Parinya Punpongsanon, Daisuke Iwai, and Kosuke Sato. 2018. FlyingHand: Extending the Range of Haptic Feedback on Virtual Hand Using Drone-based Object Recognition. In SIGGRAPH Asia 2018 Technical Briefs (SA '18). ACM, New York, NY, USA, Article 28, 4 pages. https://doi.org/10.1145/3283254.3283258
[24]
Jane L. E, Ilene L. E, James A. Landay, and Jessica R. Cauchard. 2017. Drone Wo: Cultural Influences on Human-Drone Interaction Techniques. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). Association for Computing Machinery, New York, NY, USA, 6794--6799. https://doi.org/10.1145/3025453.3025755
[25]
Alexander Eiselmayer, Chat Wacharamanotham, Michel Beaudouin-Lafon, and Wendy E. Mackay. 2019. Touchstone2: An Interactive Environment for Exploring Trade-Offs in HCI Experiment Design. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). Association for Computing Machinery, New York, NY, USA, Article Paper 217, 11 pages. https://doi.org/10.1145/3290605.3300447
[26]
Markus Funk. 2018. Human-drone Interaction: Let's Get Ready for Flying User Interfaces! Interactions 25, 3 (April 2018), 78--81. https://doi.org/10.1145/3194317
[27]
Sarthak Ghosh, Hyeong Cheol Kim, Yang Cao, Arne Wessels, Simon T. Perrault, and Shengdong Zhao. 2016. Ringteraction: Coordinated Thumb-index Interaction Using a Ring. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '16). ACM, New York, NY, USA, 2640--2647. https://doi.org/10.1145/2851581.2892371
[28]
Alix Goguey, Sylvain Malacria, and Carl Gutwin. 2018. Improving Discoverability and Expert Performance in Force-Sensitive Text Selection for Touch Devices with Mode Gauges. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 477, 12 pages. https://doi.org/10.1145/3173574.3174051
[29]
Boris Gromov, Luca M. Gambardella, and Alessandro Giusti. 2018. Video: Landing a Drone with Pointing Gestures. In Companion of the 2018 ACM/IEEE International Conference on Human-Robot Interaction (HRI '18). ACM, New York, NY, USA, 374--374. https://doi.org/10.1145/3173386.3177530
[30]
Teng Han, Qian Han, Michelle Annett, Fraser Anderson, Da-Yuan Huang, and Xing-Dong Yang. 2017. Frictio: Passive Kinesthetic Force Feedback for Smart Ring Output. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17). ACM, New York, NY, USA, 131--142. https://doi.org/10.1145/3126594.3126622
[31]
John Paulin Hansen, Alexandre Alapetite, I. Scott MacKenzie, and Emilie Møllenbach. 2014. The Use of Gaze to Control Drones. In Proceedings of the Symposium on Eye Tracking Research and Applications (ETRA '14). ACM, New York, NY, USA, 27--34. https://doi.org/10.1145/2578153.2578156
[32]
Matthias Hoppe, Marinus Burger, Albrecht Schmidt, and Thomas Kosch. 2019. DronOS: A Flexible Open-Source Prototyping Framework for Interactive Drone Routines. In Proceedings of the 18th International Conference on Mobile and Ubiquitous Multimedia (MUM '19). Association for Computing Machinery, New York, NY, USA, Article Article 15, 7 pages. https://doi.org/10.1145/3365610.3365642
[33]
Eva Hornecker. 2012. Beyond Affordance: Tangibles' Hybrid Nature. In Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction (TEI '12). Association for Computing Machinery, New York, NY, USA, 175--182. https://doi.org/10.1145/2148131.2148168
[34]
Yi-Ta Hsieh, Antti Jylhä, Valeria Orso, Luciano Gamberini, and Giulio Jacucci. 2016. Designing a Willing-to-Use-in-Public Hand Gestural Interaction Technique for Smart Glasses. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). Association for Computing Machinery, New York, NY, USA, 4203--4215. https://doi.org/10.1145/2858036.2858436
[35]
Min-Chieh Hsiu, Da-Yuan Huang, Chi An Chen, Yu-Chih Lin, Yi-ping Hung, De-Nian Yang, and Mike Chen. 2016. ForceBoard: Using Force As Input Technique on Size-limited Soft Keyboard. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (MobileHCI '16). ACM, New York, NY, USA, 599--604. https://doi.org/10.1145/2957265.2961827
[36]
NASA AMES Research Center Human Performance Research Group. 1999. NASA Task Load Index (TLX). https://humansystems.arc.nasa.gov/groups/TLX/downloads/TLX.pdf
[37]
Robert J.K. Jacob, Audrey Girouard, Leanne M. Hirshfield, Michael S. Horn, Orit Shaer, Erin Treacy Solovey, and Jamie Zigelbaum. 2008. Reality-Based Interaction: A Framework for Post-WIMP Interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08). Association for Computing Machinery, New York, NY, USA, 201--210. https://doi.org/10.1145/1357054.1357089
[38]
Lei Jing, Zixue Cheng, Yinghui Zhou, Junbo Wang, and Tongjun Huang. 2013. Magic Ring: A Self-contained Gesture Input Device on Finger. In Proceedings of the 12th International Conference on Mobile and Ubiquitous Multimedia (MUM '13). ACM, New York, NY, USA, Article 39, 4 pages. https://doi.org/10.1145/2541831.2541875
[39]
Amy K. Karlson, Benjamin B. Bederson, and José Luis Contreras-Vidal. 2006. Studies in One-Handed Mobile Design: Habit, Desire and Agility.
[40]
Md. Nafiz Hasan Khan, Carman Neustaedter, and Alissa. Antle. 2019. Flight Chair: An Interactive Chair for Controlling Emergency Service Drones. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (CHI EA '19). ACM, New York, NY, USA, Article LBW1320, 5 pages. https://doi.org/10.1145/3290607.3313031
[41]
Bomyeong Kim, Hyun Young Kim, and Jinwoo Kim. 2016. Getting Home Safely with Drone. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct (UbiComp '16). Association for Computing Machinery, New York, NY, USA, 117--120. https://doi.org/10.1145/2968219.2971426
[42]
Heesoon Kim and James A. Landay. 2018. Aeroquake: Drone Augmented Dance. In Proceedings of the 2018 Designing Interactive Systems Conference (DIS '18). ACM, New York, NY, USA, 691--701. https://doi.org/10.1145/3196709.3196798
[43]
Hyun Young Kim, Bomyeong Kim, and Jinwoo Kim. 2016. The Naughty Drone: A Qualitative Research on Drone As Companion Device. In Proceedings of the 10th International Conference on Ubiquitous Information Management and Communication (IMCOM '16). ACM, New York, NY, USA, Article 91, 6 pages. https://doi.org/10.1145/2857546.2857639
[44]
Thomas Kosch, Markus Funk, Daniel Vietz, Marc Weise, Tamara Müller, and Albrecht Schmidt. 2018. DroneCTRL: A Tangible Remote Input Control for Quadcopters. In The 31st Annual ACM Symposium on User Interface Software and Technology Adjunct Proceedings (UIST '18 Adjunct). ACM, New York, NY, USA, 120--122. https://doi.org/10.1145/3266037.3266121
[45]
Nataliya Kos'myna, Franck Tarpin-Bernard, and Bertrand Rivet. 2014. Bidirectional Feedback in Motor Imagery BCIs: Learn to Control a Drone Within 5 Minutes. In CHI '14 Extended Abstracts on Human Factors in Computing Systems (CHI EA '14). ACM, New York, NY, USA, 479--482. https://doi.org/10.1145/2559206.2574820
[46]
Joseph La Delfa, Mehmet Aydin Baytas, Olivia Wichtowski, Rohit Ashok Khot, and Florian Floyd Mueller. 2019. Are Drones Meditative?. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (CHI EA '19). Association for Computing Machinery, New York, NY, USA, Article Paper INT046, 4 pages. https://doi.org/10.1145/3290607.3313274
[47]
Kit-Yung Lam, Lik-Hang Lee, Tristan Braud, and Pan Hui. 2019. M2A: A Framework for Visualizing Information from Mobile Web to Mobile Augmented Reality. In 2019 IEEE International Conference on Pervasive Computing and Communications (PerCom. 1--10. https://doi.org/10.1109/PERCOM.2019.8767388
[48]
Megan Landau and Sebastian van Delden. 2017. A System Architecture for Hands-Free UAV Drone Control Using Intuitive Voice Commands. In Proceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction (HRI '17). ACM, New York, NY, USA, 181--182. https://doi.org/10.1145/3029798.3038329
[49]
Huy Viet Le, Sven Mayer, Patrick Bader, and Niels Henze. 2018. Fingers' Range and Comfortable Area for One-Handed Smartphone Interaction Beyond the Touchscreen. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 31, 12 pages. https://doi.org/10.1145/3173574.3173605
[50]
Lik-Hang Lee and Pan Hui. 2018. Interaction Methods for Smart Glasses: A Survey. IEEE Access 6 (2018), 28712--28732. https://doi.org/10.1109/ACCESS.2018.2831081
[51]
Lik-Hang Lee, Kit-Yung Lam, Tong Li, Tristan Braud, Xiang Su, and Pan Hui. 2019. Quadmetric Optimized Thumb-to-Finger Interaction for Force Assisted One-Handed Text Entry on Mobile Headsets. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 2, 4, Article 201 (Dec. 2019), 21 pages. https://doi.org/10.1145/3287079
[52]
Lik-Hang Lee, Kit-Yung Lam, Yui-Pan Yau, Tristan Braud, and Pan Hui. 2019. HIBEY: Hide the Keyboard in Augmented Reality. In 2019 IEEE International Conference on Pervasive Computing and Communications (PerCom. 1--10.
[53]
Lik-Hang Lee, Yiming Zhu, Yui-Pan Yau, Tristan Braud, Xiang Su, and Pan Hui. 2020. One-thumb Text Acquisition on Force-assisted Miniature Interfaces for Mobile Headsets. In 2020 IEEE International Conference on Pervasive Computing and Communications (PerCom. 1--10.
[54]
Hannah Limerick, James W. Moore, and David Coyle. 2015. Empirical Evidence for a Diminished Sense of Agency in Speech Interfaces. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). Association for Computing Machinery, New York, NY, USA, 3967--3970. https://doi.org/10.1145/2702123.2702379
[55]
J. M. M. L., Jolley. 2010. Research design explained: Instructor's edition (7th ed.). Wadsworth/Cengage Learning.
[56]
I. Scott MacKenzie. 2013. Human-Computer Interaction: An Empirical Research Perspective (1st ed.). Morgan Kaufmann Publishers Inc., San Francisco, CA, USA.
[57]
Wenguang Mao, Zaiwei Zhang, Lili Qiu, Jian He, Yuchen Cui, and Sangki Yun. 2017. Indoor Follow Me Drone. In Proceedings of the 15th Annual International Conference on Mobile Systems, Applications, and Services (MobiSys '17). Association for Computing Machinery, New York, NY, USA, 345--358. https://doi.org/10.1145/3081333.3081362
[58]
Silvia Mirri, Catia Prandi, and Paola Salomoni. 2019. Human-Drone Interaction: State of the Art, Open Issues and Challenges. In Proceedings of the ACM SIGCOMM 2019 Workshop on Mobile AirGround Edge Computing, Systems, Networks, and Applications (MAGESys'19). ACM, New York, NY, USA, 43--48. https://doi.org/10.1145/3341568.3342111
[59]
Sachi Mizobuchi, Shinya Terasaki, Turo Keski-Jaskari, Jari Nousiainen, Matti Ryynanen, and Miika Silfverberg. 2005. Making an Impression: Force-controlled Pen Input for Handheld Devices. In CHI '05 Extended Abstracts on Human Factors in Computing Systems (CHI EA '05). ACM, New York, NY, USA, 1661--1664. https://doi.org/10.1145/1056808.1056991
[60]
Koji Morishita, Hiroaki Yanagisawa, and Hisashi Noda. 2016. Intuitive Control for Moving Drones. In SIGGRAPH ASIA 2016 Posters (SA '16). ACM, New York, NY, USA, Article 17, 2 pages. https://doi.org/10.1145/3005274.3005287
[61]
Donald A. Norman. 2010. Natural User Interfaces Are Not Natural. Interactions 17, 3 (May 2010), 6--10. https://doi.org/10.1145/1744161.1744163
[62]
Sarah North, Adnan Rashied, Jason Walters, Ahmad Alissa, Josh Cooper, Eric Rawls, Cheyenne Sancho, Utku "Victor" Sahin, Kate Randell, and Heather Rego. 2018. Performance Analysis of Brain-computer Interfaces in Aerial Drone. In Proceedings of the ACMSE 2018 Conference (ACMSE '18). ACM, New York, NY, USA, Article 16, 5 pages. https://doi.org/10.1145/3190645.3190683
[63]
Mohammad Obaid, Felix Kistler, Gabrielė Kasparavičiūte, Asim Evren Yantaç, and Morten Fjeld. 2016. How Would You Gesture Navigate a Drone?: A User-centered Approach to Control a Drone. In Proceedings of the 20th International Academic Mindtrek Conference (Academic Mindtrek '16). ACM, New York, NY, USA, 113--121. https://doi.org/10.1145/2994310.2994348
[64]
Judith S. Olson and Wendy A. Kellogg. 2014. Ways of Knowing in HCI. Springer Publishing Company, Incorporated.
[65]
Anne Roudaut, Stéphane Huot, and Eric Lecolinet. 2008. TapTap and MagStick: Improving One-handed Target Acquisition on Small Touch-screens. In Proceedings of the Working Conference on Advanced Visual Interfaces (AVI '08). ACM, New York, NY, USA, 146--153. https://doi.org/10.1145/1385569.1385594
[66]
Carlos Ruiz, Shijia Pan, Adeola Bannis, Xinlei Chen, Carlee Joe-Wong, Hae Young Noh, and Pei Zhang. 2018. IDrone: Robust Drone Identification through Motion Actuation Feedback. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 2, 2, Article Article 80 (July 2018), 22 pages. https://doi.org/10.1145/3214283
[67]
Lucian Alexandru Sandru, Marius Florin Crainic, Diana Savu, Cristian Moldovan, Valer Dolga, and Stefan Preitl. 2016. Automatic Control of a Quadcopter, AR. Drone, Using a Smart Glove. In Proceedings of the 4th International Conference on Control, Mechatronics and Automation (ICCMA '16). ACM, New York, NY, USA, 92--98. https://doi.org/10.1145/3029610.3029619
[68]
Matthias Seuter, Eduardo Rodriguez Macrillante, Gernot Bauer, and Christian Kray. 2018. Running with Drones: Desired Services and Control Gestures. In Proceedings of the 30th Australian Conference on Computer-Human Interaction (OzCHI '18). ACM, New York, NY, USA, 384--395. https://doi.org/10.1145/3292147.3292156
[69]
Roy Shilkrot, Jochen Huber, Jürgen Steimle, Suranga Nanayakkara, and Pattie Maes. 2015. Digital Digits: A Comprehensive Survey of Finger Augmentation Devices. ACM Comput. Surv. 48, 2, Article 30 (Nov. 2015), 29 pages. https://doi.org/10.1145/2828993
[70]
Mohamed Soliman, Franziska Mueller, Lena Hegemann, Joan Sol Roo, Christian Theobalt, and Jürgen Steimle. 2018. FingerInput: Capturing Expressive Single-Hand Thumb-to-Finger Microgestures. In Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces (ISS '18). ACM, New York, NY, USA, 177--187. https://doi.org/10.1145/3279778.3279799
[71]
Hong Tan, J. Radcliffe, Book No. Ga, Hong Z. Tan, Brian Eberman, Mandayam A. Srinivasan, and Belinda Cheng. 1994. Human Factors For The Design Of Force-Reflecting Haptic Interfaces.
[72]
Robert J. Teather, Andrew Roth, and I. Scott MacKenzie. 2017. Tilt-Touch synergy: Input control for "dual-analog" style mobile games. Entertainment Computing 21 (2017), 33--43. https://doi.org/10.1016/j.entcom.2017.04.005
[73]
Ryotaro Temma, Kazuki Takashima, Kazuyuki Fujita, Koh Sueda, and Yoshifumi Kitamura. 2019. Third-Person Piloting: Increasing Situational Awareness Using a Spatially Coupled Second Drone. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (UIST '19). Association for Computing Machinery, New York, NY, USA, 507--519. https://doi.org/10.1145/3332165.3347953
[74]
D. Tezza and M. Andujar. 2019. The State-of-the-Art of Human-Drone Interaction: A Survey. IEEE Access 7 (2019), 167438--167454. https://doi.org/10.1109/ACCESS.2019.2953900
[75]
Asher Trockman. 2015. 3D Touch: Sensitivity, Force vs. Weight.
[76]
Hsin-Ruey Tsai, Min-Chieh Hsiu, Jui-Chun Hsiao, Lee-Ting Huang, Mike Chen, and Yi-Ping Hung. 2016. TouchRing: Subtle and Always-available Input Using a Multi-touch Ring. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (MobileHCI '16). ACM, New York, NY, USA, 891--898. https://doi.org/10.1145/2957265.2961860
[77]
Cheng-Yao Wang, Wei-Chen Chu, Po-Tsung Chiu, Min-Chieh Hsiu, Yih-Harn Chiang, and Mike Y. Chen. 2015. PalmType: Using Palms As Keyboards for Smart Glasses. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '15). ACM, New York, NY, USA, 153--160. https://doi.org/10.1145/2785830.2785886
[78]
Eric Whitmire, Mohit Jain, Divye Jain, Greg Nelson, Ravi Karkar, Shwetak Patel, and Mayank Goel. 2017. DigiTouch: Reconfigurable Thumb-to-Finger Input and Text Entry on Head-mounted Displays. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 3, Article 113 (Sept. 2017), 21 pages. https://doi.org/10.1145/3130978
[79]
Anna Wojciechowska, Jeremy Frey, Esther Mandelblum, Yair Amichai-Hamburger, and Jessica R. Cauchard. 2019. Designing Drones: Factors and Characteristics Influencing the Perception of Flying Robots. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 3, 3, Article Article 111 (Sept. 2019), 19 pages. https://doi.org/10.1145/3351269
[80]
Kaito Yamada, Hiroki Usuba, and Homei Miyahita. 2019. Modeling Drone Pointing Movement with Fitts' Law. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (CHI EA '19). ACM, New York, NY, USA, Article LBW2519, 6 pages. https://doi.org/10.1145/3290607.3312835
[81]
Yaxing Yao, Huichuan Xia, Yun Huang, and Yang Wang. 2017. Privacy Mechanisms for Drones: Perceptions of Drone Controllers and Bystanders. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). Association for Computing Machinery, New York, NY, USA, 6777--6788. https://doi.org/10.1145/3025453.3025907
[82]
Jibin Yin, Xiangshi Ren, and Shumin Zhai. 2010. Pen Pressure Control in Trajectory-based Interaction. Behav. Inf. Technol. 29, 2 (March 2010), 137--148. https://doi.org/10.1080/01449290902904733
[83]
Mingyuan Zhong, Chun Yu, Qian Wang, Xuhai Xu, and Yuanchun Shi. 2018. ForceBoard: Subtle Text Entry Leveraging Pressure. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 528, 10 pages. https://doi.org/10.1145/3173574.3174102

Cited By

View all
  • (2025)Exploring user engagement by diagnosing visual guides in onboarding screens with linear regression and XGBoostDisplays10.1016/j.displa.2025.10297587(102975)Online publication date: Apr-2025
  • (2023)EFRingProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35694786:4(1-31)Online publication date: 11-Jan-2023
  • (2023)DRG-KeyboardProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35694636:4(1-30)Online publication date: 11-Jan-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies  Volume 4, Issue 2
June 2020
771 pages
EISSN:2474-9567
DOI:10.1145/3406789
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 June 2020
Published in IMWUT Volume 4, Issue 2

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Human-drone interaction
  2. On-finger interaction
  3. multi-modal inputs

Qualifiers

  • Research-article
  • Research
  • Refereed

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)119
  • Downloads (Last 6 weeks)6
Reflects downloads up to 17 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2025)Exploring user engagement by diagnosing visual guides in onboarding screens with linear regression and XGBoostDisplays10.1016/j.displa.2025.10297587(102975)Online publication date: Apr-2025
  • (2023)EFRingProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35694786:4(1-31)Online publication date: 11-Jan-2023
  • (2023)DRG-KeyboardProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35694636:4(1-30)Online publication date: 11-Jan-2023
  • (2023)BirdViewAR: Surroundings-aware Remote Drone Piloting Using an Augmented Third-person PerspectiveProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580681(1-19)Online publication date: 19-Apr-2023
  • (2022)Human-Avatar Interaction in MetaverseProceedings of the 4th ACM International Conference on Multimedia in Asia10.1145/3551626.3564936(1-7)Online publication date: 13-Dec-2022
  • (2022)One Ring to Rule Them AllProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35503156:3(1-20)Online publication date: 7-Sep-2022
  • (2022)EdgeXAR: A 6-DoF Camera Multi-target Interaction Framework for MAR with User-friendly Latency CompensationProceedings of the ACM on Human-Computer Interaction10.1145/35322026:EICS(1-24)Online publication date: 17-Jun-2022
  • (2022)3DeformRProceedings of the 13th ACM Multimedia Systems Conference10.1145/3524273.3528180(52-61)Online publication date: 14-Jun-2022
  • (2022)Understanding Gesture Input Articulation with Upper-Body Wearables for Users with Upper-Body Motor ImpairmentsProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501964(1-16)Online publication date: 29-Apr-2022
  • (2022)Above and Beyond: A Scoping Review of Domains and Applications for Human-Drone InteractionProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501881(1-22)Online publication date: 29-Apr-2022
  • Show More Cited By

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media