research-article

Acustico: Surface Tap Detection and Localization using Wrist-based Acoustic TDOA Sensing

Authors:

Hrvoje BenkoAuthors Info & Claims

UIST '20: Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology

Pages 406 - 419

https://doi.org/10.1145/3379337.3415901

Published: 20 October 2020 Publication History

Abstract

In this paper, we present Acustico, a passive acoustic sensing approach that enables tap detection and 2D tap localization on uninstrumented surfaces using a wrist-worn device. Our technique uses a novel application of acoustic time differences of arrival (TDOA) analysis. We adopt a sensor fusion approach by taking both 'surface waves' (i.e., vibrations through surface) and 'sound waves' (i.e., vibrations through air) into analysis to improve sensing resolution. We carefully design a sensor configuration to meet the constraints of a wristband form factor. We built a wristband prototype with four acoustic sensors, two accelerometers and two microphones. Through a 20-participant study, we evaluated the performance of our proposed sensing technique for tap detection and localization. Results show that our system reliably detects taps with an F1-score of 0.9987 across different environmental noises and yields high localization accuracies with root-mean-square-errors of 7.6mm (X-axis) and 4.6mm (Y-axis) across different surfaces and tapping techniques.

Supplementary Material

VTT File (ufp9804pv.vtt)

Download
.69 KB

VTT File (ufp9804vf.vtt)

Download
4.23 KB

VTT File (3379337.3415901.vtt)

Download
6.43 KB

SBV File (ufp9804pvc.sbv)

Preview video captions

Download
.64 KB

SBV File (ufp9804vfc.sbv)

Video figure captions

Download
3.98 KB

MP4 File (ufp9804pv.mp4)

Preview video

Download
39.07 MB

MP4 File (ufp9804vf.mp4)

Video figure

Download
163.95 MB

MP4 File (3379337.3415901.mp4)

Presentation Video

Download
58.50 MB

References

[1]

Hideki Koike, Yoichi Sato, Yoshinori Kobayashi. 2001. Integrating paper and digital information on EnhancedDesk: a method for realtime finger tracking on an augmented desk system. ACM Trans. Comput.-Hum. Interact., 8 (4). 307--322. DOI=https://doi.org/10.1145/504704.504706

Digital Library

[2]

Ankur Agarwal, Shahram Izadi, Manmohan Chandraker and Andrew Blake. 2007. High Precision Multi-touch Sensing on Surfaces using Overhead Cameras. In Second Annual IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP'07), 197--200. DOI=https://doi.org/10.1109/TABLETOP.2007.29

[3]

Michael Boyle and Saul Greenberg. 2005. The language of privacy: Learning from video media space analysis and design. ACM Trans. Comput.-Hum. Interact., 12 (2). 328--370. DOI=https://doi.org/10.1145/1067860.1067868

Digital Library

[4]

Alex Butler, Shahram Izadi and Steve Hodges. 2008. SideSight: multi-"touch" interaction around small devices. In Proceedings of the 21st annual ACM symposium on User interface software and technology (UIST '08). 201--204. DOI=https://doi.org/10.1145/1449715.1449746

Digital Library

[5]

William Buxton. 1990. A three-state model of graphical input. In Proceedings of the IFIP TC13 Third Interational Conference on Human-Computer Interaction (INTERACT ?90), 449--456.

Digital Library

[6]

Liwei Chan, Yi-Ling Chen, Chi-Hao Hsieh, Rong-Hao Liang and Bing-Yu Chen. 2015. CyclopsRing: Enabling Whole-Hand and Context-Aware Interactions Through a Fisheye Ring. In Proceedings of the 28th Annual ACM Symposium on User Interface Software and Technology (UIST'15), 549--556. DOI= https://doi.org/10.1145/2807442.2807450

Digital Library

[7]

Jae Sik Chang, Eun Yi Kim, KeeChul Jung and Hang Joon Kim. 2005. Real time hand tracking based on active contour model. In Proceedings of the 2005 international conference on Computational Science and Its Applications. 999. DOI=https://doi.org/10.1007/11424925_104

Digital Library

[8]

Ke-Yu Chen, Shwetak N. Patel and Sean Keller. 2016. Finexus: Tracking Precise Motions of Multiple Fingertips Using Magnetic Sensing. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI'16), 1504--1514. DOI=http://dx.doi.org/10.1145/2858036.2858125

[9]

Artem Dementyev and Joseph A. Paradiso. 2014. WristFlex: low-power gesture input with wrist-worn pressure sensors. In Proceedings of the 27th annual ACM symposium on User interface software and technology (UIST'14), 161--166. DOI=https://doi.org/10.1145/2642918.2647396

[10]

Fabrice Devige and Jean-Pierre Nikolovski. 2003. Accurate Interactive Acoustic Plate. US Patent Application No. US2003/0066692 A1.

[11]

Rui Fukui, Masahiko Watanabe, Tomoaki Gyota, Masamichi Shimosaka and Tomomasa Sato. 2011. Hand shape classification with a wrist contour sensor: development of a prototype device. In Proceedings of the 13th international conference on Ubiquitous computing (Ubicomp'11), 311--314. DOI=https://doi.org/10.1145/2030112.2030154

Digital Library

[12]

Mayank Goel, Brendan Lee, Md. Tanvir Islam Aumi, Shwetak Patel, Gaetano Borriello, Stacie Hibino and Bo Begole. 2014. SurfaceLink: using inertial and acoustic sensing to enable multi-device interaction on a surface. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'14), 1387--1396. DOI=https://doi.org/10.1145/2556288.2557120

[13]

Jun Gong, Xing-Dong Yang and Pourang Irani. 2016. WristWhirl: One-handed Continuous Smartwatch Input using Wrist Gestures. In Proceedings of the 29th Annual ACM Symposium on User Interface Software and Technology (UIST'16). DOI=http://dx.doi.org/10.1145/2984511.2984563

Digital Library

[14]

Jun Gong, Yang Zhang, Xia Zhou and Xing-Dong Yang. 2017. Pyro: Thumb-Tip Gesture Recognition Using Pyroelectric Infrared Sensing. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST'17), 553--563. DOI=https://doi.org/10.1145/3126594.3126615

Digital Library

[15]

Yizheng Gu, Chun Yu, Zhipeng Li, Weiqi Li, Shuchang Xu, Xiaoying Wei and Yuanchun Shi. 2019. Accurate and Low-Latency Sensing of Touch Contact on Any Surface with Finger-Worn IMU Sensor. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (UIST'19), 1059--1070. DOI=https://doi.org/10.1145/3332165.3347947

Digital Library

[16]

Jefferson Y. Han. 2005. Low-cost multi-touch sensing through frustrated total internal reflection. In Proceedings of the 18th annual ACM symposium on User interface software and technology (UIST'05), 115--118. DOI=https://doi.org/10.1145/1095034.1095054

Digital Library

[17]

Teng Han, Khalad Hasan, Keisuke Nakamura, Randy Gomez and Pourang Irani. 2017. SoundCraft: Enabling Spatial Interactions on Smartwatches using Hand Generated Acoustics. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST'17), 579--591. DOI=https://doi.org/10.1145/3126594.3126612

Digital Library

[18]

Chris Harrison. 2010. Appropriated Interaction Surfaces. Computer, 43 (6). 86--89. DOI=https://doi.org/110.1109/MC.2010.158

Digital Library

[19]

Chris Harrison, Hrvoje Benko, and Andrew D. Wilson. 2011. OmniTouch: wearable multitouch interaction everywhere. In Proceedings of the 24th annual ACM symposium on User interface software and technology (UIST '11), 441--450. DOI=https://doi.org/10.1145/2047196.2047255

[20]

Chris Harrison and Scott E. Hudson. 2008. Scratch input: creating large, inexpensive, unpowered and mobile finger input surfaces. In Proceedings of the 21th annual ACM symposium on User interface software and technology (UIST '08), 205--208. DOI=https://doi.org/10.1145/1449715.1449747

[21]

Chris Harrison, Desney S. Tan and Dan Morris. 2010. Skinput: appropriating the body as an input surface. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10), 453--462. DOI=https://doi.org/10.1145/1753326.1753394

[22]

Scott E. Hudson and Ian Smith. 1996. Techniques for addressing fundamental privacy and disruption tradeoffs in awareness support systems. In Proceedings of the 1996 ACM conference on Computer supported cooperative work (CSCW'96), 248--257. DOI=https://doi.org/10.1145/240080.240295

[23]

Yasha Iravantchi, Yang Zhang, Evi Bernitsas, Mayank Goel and Chris Harrison. 2019. Interferi: Gesture Sensing using On-Body Acoustic Interferometry. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI'19), 276. DOI=https://doi.org/10.1145/3290605.3300506

Digital Library

[24]

Hiroshi Ishii, Craig Wisneski, Julian Orbanes, Ben Chun and Joe Paradiso. 1999. PingPongPlus: design of an athletic-tangible interface for computer-supported cooperative play. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems (CHI'99), 394--401. DOI=https://doi.org/10.1145/302979.303115

Digital Library

[25]

Shaun K. Kane, Daniel Avrahami, Jacob O. Wobbrock, Beverly Harrison, Adam D. Rea, Matthai Philipose and Anthony LaMarca. 2009. Bonfire: a nomadic system for hybrid laptop-tabletop interaction. In Proceedings of the 22nd annual ACM symposium on User interface software and technology (UIST'09), 129--138. DOI=https://doi.org/10.1145/1622176.1622202

Digital Library

[26]

Wolf Kienzle and Ken Hinckley. 2014. LightRing: always-available 2D input on any surface. In Proceedings of the 27th annual ACM symposium on User interface software and technology (UIST'14), 157--160. DOI=https://doi.org/10.1145/2642918.2647376

Digital Library

[27]

A. H. F. Lam, W. J. Li, Liu Yunhui and Xi Ning. 2002. MIDS: micro input devices system using MEMS sensors. In IEEE/RSJ International Conference on Intelligent Robots and Systems, 1184--1189 vol.1182. DOI=https://doi.org/10.1109/IRDS.2002.1043893

[28]

Gierad Laput, Robert Xiao and Chris Harrison. 2016. ViBand: High-Fidelity Bio-Acoustic Sensing Using Commodity Smartwatch Accelerometers. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST'16), 321--333. DOI=https://doi.org/10.1145/2984511.2984582

Digital Library

[29]

SK Lee, William Buxton and K. C. Smith. 1985. A multi-touch three dimensional touch-sensitive tablet. SIGCHI Bull., 16 (4). 21--25. DOI=https://doi.org/10.1145/1165385.317461

Digital Library

[30]

Julien Letessier and François Bérard. 2004. Visual tracking of bare fingers for interactive surfaces. In Proceedings of the 17th annual ACM symposium on User interface software and technology (UIST'04), 119--122. DOI=https://doi.org/10.1145/1029632.1029652

Digital Library

[31]

Jaime Lien, Nicholas Gillian, M. Emre Karagozler, Patrick Amihood, Carsten Schwesig, Erik Olson, Hakim Raja and Ivan Poupyrev. 2016. Soli: Ubiquitous Gesture Sensing with Millimeter Wave Radar. In ACM Trans. Graph (SIGGRAPH'16), 10. DOI=https://doi.org/10.1145/2897824.2925953

[32]

Nobuyuki Matsushita and Jun Rekimoto. 1997. HoloWall: designing a finger, hand, body, and object sensitive wall. In Proceedings of the 10th annual ACM symposium on User interface software and technology (UIST'97), 209--210. DOI=https://doi.org/10.1145/263407.263549

Digital Library

[33]

Jess McIntosh, Asier Marzo and Mike Fraser. 2017. SensIR: Detecting Hand Gestures with a Wearable Bracelet using Infrared Transmission and Reflection. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST'17), 593--597. DOI=https://doi.org/10.1145/3126594.3126604

Digital Library

[34]

Dan Morris, T. Scott Saponas and Desney Tan. 2011. Emerging Input Technologies for Always-Available Mobile Interaction. Found. Trends Hum.-Comput. Interact., 4 (4). 245--316. DOI=https://doi.org/10.1561/1100000023

Digital Library

[35]

Rajalakshmi Nandakumar, Vikram Iyer, Desney Tan and Shyamnath Gollakota. 2016. FingerIO: Using Active Sonar for Fine-Grained Finger Tracking. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI'16), 1515--1525. DOI=https://doi.org/10.1145/2858036.2858580

Digital Library

[36]

Shijia Pan, Ceferino G. Ramirez, Mostafa Mirshekari, Jonathon Fagert, Albert J. Chung, Chih C. Hu, John P. Shen, Hae Y. Noh and Pei Zhang. 2017. SurfaceVibe: Vibration-Based Tap and Swipe Tracking on Ubiquitous Surfaces. In 16th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN'17), 197--208.

[37]

J. A. Paradiso, Leo Che King, N. Checka and Hsiao Kaijen. 2002. Passive acoustic sensing for tracking knocks atop large interactive displays. In SENSORS, 2002 IEEE, 521--527 vol.521. DOI=https://doi.org/10.1109/ICSENS.2002.1037150

[38]

Jun Rekimoto. 2001. GestureWrist and GesturePad: Unobtrusive Wearable Interaction Devices. In Proceedings of the 5th IEEE International Symposium on Wearable Computers (ISWC'01), 21. DOI=https://doi.org/10.1109/ISWC.2001.962092

Digital Library

[39]

Elliot N. Saba, Eric C. Larson and Shwetak N. Patel. 2012. Dante vision: In-air and touch gesture sensing for natural surface interaction with combined depth and thermal cameras. In 2012 IEEE International Conference on Emerging Signal Processing Applications, 167--170. DOI=https://doi.org/10.1109/ESPA.2012.6152472

[40]

T. Scott Saponas, Desney S. Tan, Dan Morris, Ravin Balakrishnan, Jim Turner and James A. Landay. 2009. Enabling always-available input with muscle-computer interfaces. In Proceedings of the 22nd annual ACM symposium on User interface software and technology (UIST'09), 167--176. DOI=https://doi.org/10.1145/1622176.1622208

[41]

Katie A. Siek, Yvonne Rogers and Kay H. Connelly. 2005. Fat finger worries: how older and younger users physically interact with PDAs. In Proceedings of the 2005 IFIP TC13 international conference on Human-Computer Interaction, 267--280. DOI=https://doi.org/10.1007/11555261_24

[42]

Hoang Truong, Shuo Zhang, Ufuk Muncuk, Phuc Nguyen, Nam Bui, Anh Nguyen, Qin Lv, Kaushik Chowdhury, Thang Dinh and Tam Vu. 2018. CapBand: Battery-free Successive Capacitance Sensing Wristband for Hand Gesture Recognition. In Proceedings of the 16th ACM Conference on Embedded Networked Sensor Systems (SenSys'18), 54--67. DOI=https://doi.org/10.1145/3274783.3274854

Digital Library

[43]

Dong Wei, Steven Z. Zhou and Du Xie. 2010. MTMR: A conceptual interior design framework integrating Mixed Reality with the Multi-Touch tabletop interface. In 2010 IEEE International Symposium on Mixed and Augmented Reality, 279--280. DOI=https://doi.org/10.1109/ISMAR.2010.5643606

[44]

Hongyi Wen, Julian Ramos Rojas and Anind K. Dey. 2016. Serendipity: Finger Gesture Recognition using an Off-the-Shelf Smartwatch. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI'16), 3847--3851. DOI=https://doi.org/10.1145/2858036.2858466

[45]

Andrew D. Wilson. 2004. TouchLight: an imaging touch screen and display for gesture-based interaction. In Proceedings of the 6th international conference on Multimodal interfaces (ICMI'04), 69--76. DOI=https://doi.org/10.1145/1027933.1027946

Digital Library

[46]

George S. K. Wong. 1986. Speed of sound in standard air. The Journal of the Acoustical Society of America, 79 (5). 1359--1366. DOI=https://doi.org/10.1121/1.393664

[47]

Robert Xiao, Julia Schwarz, Nick Throm, Andrew D. Wilson and Hrvoje Benko. 2018. MRTouch: Adding Touch Input to Head-Mounted Mixed Reality. IEEE Transactions on Visualization and Computer Graphics, 24 (4). 1653--1660. DOI=https://doi.org/10.1109/TVCG.2018.2794222

Digital Library

[48]

Robert Xiao, Greg Lew, James Marsanico, Divya Hariharan, Scott Hudson and Chris Harrison. 2014. Toffee: enabling ad hoc, around-device interaction with acoustic time-of-arrival correlation. In Proceedings of the 16th international conference on Human-computer interaction with mobile devices and services (MobileHCI'14), 67--76. DOI=https://doi.org/10.1145/2628363.2628383

Digital Library

[49]

Ming Yang. 2011. In-Solid Acoustic Source Localization Using Likelihood Mapping Algorithm. Open Journal of Acoustics, 1. 34--40. DOI=https://doi.org/10.4236/oja.2011.12005

[50]

Xing-Dong Yang, Tovi Grossman, Daniel Wigdor and George Fitzmaurice. 2012. Magic Finger: Always-Available Input through Finger Instrumentation. In Proceedings of the 25nd annual ACM symposium on User interface software and technology (UIST'12), 147 - 156. DOI=https://doi.org/10.1145/2380116.2380137

Digital Library

[51]

Sang Ho Yoon, Ke Huo, Yunbo Zhang, Guiming Chen, Luis Paredes, Subramanian Chidambaram and Karthik Ramani. 2017. iSoft: A Customizable Soft Sensor with Real-time Continuous Contact and Stretching Sensing. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST'17), 665--678. DOI=https://doi.org/10.1145/3126594.3126654

Digital Library

[52]

Cheng Zhang, AbdelKareem Bedri, Gabriel Reyes, Bailey Bercik, Omer T. Inan, Thad E. Starner and Gregory D. Abowd. 2016. TapSkin: Recognizing On-Skin Input for Smartwatches. In Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces, 13--22. DOI=https://doi.org/10.1145/2992154.2992187

[53]

Cheng Zhang, Anandghan Waghmare, Pranav Kundra, Yiming Pu, Scott Gilliland, Thomas Ploetz, Thad E. Starner, Omer T. Inan and Gregory D. Abowd. 2017. FingerSound: Recognizing unistroke thumb gestures using a ring. In Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., 1 (3). Article DOI=https://doi.org/120. 10.1145/3130985

[54]

Cheng Zhang, Qiuyue Xue, Anandghan Waghmare, Sumeet Jain, Yiming Pu, Sinan Hersek, Kent Lyons, Kenneth A. Cunefare, Omer T. Inan and Gregory D. Abowd. 2017. SoundTrak: Continuous 3D Tracking of a Finger Using Active Acoustics. In Proc. ACM Interact. Mob. Wearable Ubiquitous DOI=https://doi.org/10.1145/3090095

[55]

Yang Zhang and Chris Harrison. 2018. Pulp Nonfiction: Low-Cost Touch Tracking for Paper. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI'18), 1--11. DOI=https://doi.org/10.1145/3173574.3173691

Digital Library

[56]

Yang Zhang and Chris Harrison. 2015. Tomo: Wearable, Low-Cost Electrical Impedance Tomography for Hand Gesture Recognition. In Proceedings of the 28th Annual ACM Symposium on User Interface Software and Technology (UIST'15), 167--173. DOI=https://doi.org/10.1145/2807442.2807480

Digital Library

[57]

Yang Zhang, Wolf Kienzle, Yanjun Ma, Shiu S. Ng, Hrvoje Benko and Chris Harrison. 2019. ActiTouch: Robust Touch Detection for On-Skin AR/VR Interfaces. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (UIST'19), 1151--1159. DOI=https://doi.org/10.1145/3332165.3347869

Digital Library

[58]

Yang Zhang, Gierad Laput and Chris Harrison. 2017. Electrick: Low-Cost Touch Sensing Using Electric Field Tomography. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI'17), 1--14. DOI=https://doi.org/10.1145/3025453.3025842

Digital Library

[59]

Yang Zhang, Chouchang Yang, Scott E. Hudson, Chris Harrison and Alanson Sample. 2018. Wall++: Room-Scale Interactive and Context-Aware Sensing. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, 273. DOI=https://doi.org/10.1145/3173574.3173847

Digital Library

[60]

Yang Zhang, Junhan Zhou, Gierad Laput and Chris Harrison. 2016. SkinTrack: Using the Body as an Electrical Waveguide for Continuous Finger Tracking on the Skin. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI'16), 1491--1503. DOI=https://doi.org/10.1145/2858036.2858082

Digital Library

Cited By

Liu TXiao YHu MSha HMa SGao BGuo SLiu YSong W(2025)AudioGest: Gesture-Based Interaction for Virtual Reality Using Audio DevicesIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.339786831:2(1569-1581)Online publication date: Feb-2025
https://doi.org/10.1109/TVCG.2024.3397868
Huang KIravantchi YChen DSample A(2024)MagDesk: Interactive Tabletop Workspace Based on Passive Magnetic TrackingProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36997568:4(1-31)Online publication date: 21-Nov-2024
https://dl.acm.org/doi/10.1145/3699756
Kim DWhitmire EBoldu RKienzle WBenko HKostakos VKay JHoang T(2024)SoundScroll: Robust Finger Slide Detection Using Friction Sound and Wrist-Worn MicrophonesProceedings of the 2024 ACM International Symposium on Wearable Computers10.1145/3675095.3676614(63-70)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675095.3676614
Show More Cited By

Index Terms

Acustico: Surface Tap Detection and Localization using Wrist-based Acoustic TDOA Sensing
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices

Recommendations

Distributed Tdoa-Based Indoor Source Localisation
2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
Indoor localisation is an important research topic with several possible applications. For example, knowing a user's location can be used as navigation aid in hospitals and malls, or for better targeted marketing. In this paper we consider the case ...
An Enhanced AUV- Aided TDoA Localization Algorithm for Underwater Acoustic Sensor Networks
Abstract
Since localization now has been an essential step in underwater work. The traditional localization algorithm, like time different of arrival (TDoA) has been proposed for its efficiency in terrestrial while it cannot perform perfect because of the ...
High-Accuracy TDOA-Based Localization without Time Synchronization

Localization is of great importance in mobile and wireless network applications. Time Difference of Arrival (TDOA) is one of the widely used localization schemes, in which the target (source) emits a signal and a number of anchors (receivers) record the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '20: Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology

October 2020

1297 pages

ISBN:9781450375146

DOI:10.1145/3379337

General Chairs:
Shamsi Iqbal
Microsoft Research, USA
,
Karon MacLean
University of British Columbia, Canada
,
Program Chairs:
Fanny Chevalier
University of Toronto, Canada
,
Stefanie Mueller
MIT CSAIL, USA

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 October 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

UIST '20

Sponsor:

UIST '20: The 33rd Annual ACM Symposium on User Interface Software and Technology

October 20 - 23, 2020

Virtual Event, USA

Acceptance Rates

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Upcoming Conference

UIST '25

Sponsor:
sigchi
sigchi

The 38th Annual ACM Symposium on User Interface Software and Technology

September 28 - October 1, 2025

Busan , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

24
Total Citations
View Citations
1,080
Total Downloads

Downloads (Last 12 months)122
Downloads (Last 6 weeks)14

Reflects downloads up to 02 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Liu TXiao YHu MSha HMa SGao BGuo SLiu YSong W(2025)AudioGest: Gesture-Based Interaction for Virtual Reality Using Audio DevicesIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.339786831:2(1569-1581)Online publication date: Feb-2025
https://doi.org/10.1109/TVCG.2024.3397868
Huang KIravantchi YChen DSample A(2024)MagDesk: Interactive Tabletop Workspace Based on Passive Magnetic TrackingProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36997568:4(1-31)Online publication date: 21-Nov-2024
https://dl.acm.org/doi/10.1145/3699756
Kim DWhitmire EBoldu RKienzle WBenko HKostakos VKay JHoang T(2024)SoundScroll: Robust Finger Slide Detection Using Friction Sound and Wrist-Worn MicrophonesProceedings of the 2024 ACM International Symposium on Wearable Computers10.1145/3675095.3676614(63-70)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675095.3676614
Streli PRichardson MBotros FMa SWang RHolz C(2024)TouchInsight: Uncertainty-aware Rapid Touch and Text Input for Mixed Reality from Egocentric VisionProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676330(1-16)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676330
Lee CZhang RAgarwal DYu TGunda VLopez OKim JYin SDong BLi KSakashita MGuimbretiere FZhang C(2024)EchoWrist: Continuous Hand Pose Tracking and Hand-Object Interaction Recognition Using Low-Power Active Acoustic Sensing On a WristbandProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642910(1-21)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642910
Yang YChen THuang YGuo XShangguan L(2024)MAF: Exploring Mobile Acoustic Field for Hand-to-Face Gesture InteractionsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642437(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642437
Dupré CAppert CRey SSaidi HPietriga E(2024)TriPad: Touch Input in AR on Ordinary Surfaces with Hand Tracking OnlyProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642323(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642323
Grady PCollins JTang CTwigg CAneja KHays JKemp C(2024)PressureVision++: Estimating Fingertip Pressure from Diverse RGB Images2024 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)10.1109/WACV57701.2024.00850(8683-8693)Online publication date: 3-Jan-2024
https://doi.org/10.1109/WACV57701.2024.00850
T AR PG PHarshitha VSubramani KL J(2024)Smartwatch-Powered Vehicle Navigation On Unmapped Terrain2024 Third International Conference on Smart Technologies and Systems for Next Generation Computing (ICSTSN)10.1109/ICSTSN61422.2024.10670946(1-5)Online publication date: 18-Jul-2024
https://doi.org/10.1109/ICSTSN61422.2024.10670946
Mackamul ECasiez GMalacria S(2024)Clarifying and differentiating discoverabilityHuman–Computer Interaction10.1080/07370024.2024.2364606(1-26)Online publication date: 13-Jun-2024
https://doi.org/10.1080/07370024.2024.2364606
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten