extended-abstract

PseudoButton: enabling pressure-sensitive interaction by repurposing microphone on mobile device

Authors:

Sungjae Hwang,

Kwang-yun WohnAuthors Info & Claims

CHI EA '12: CHI '12 Extended Abstracts on Human Factors in Computing Systems

Pages 1565 - 1570

https://doi.org/10.1145/2212776.2223673

Published: 05 May 2012 Publication History

Get Access

Abstract

We propose a new interaction technique, called PseudoButton, which emulates a pressure-sensitive touch sensor by repurposing a built-in microphone on mobile devices. This simple and novel technique increases input expressivity of the device and expands its interaction area for users to alleviate the occlusion problem caused by touchscreens without adding extra sensors. To verify our idea, we implemented a prototype and conducted a preliminary evaluation on it. The results show that participants can input at accuracy of 94% for five different pressure levels with minimal error.

Supplementary Material

JPG File (wpfile234-3.jpg)

Download
6.55 KB

suppl.mov (wpfile234-3.mov)

Supplemental video

Download
16.94 MB

References

[1]

A. Butler, S. Izadi, and S. Hodges. Sidesight: multi-"touch" interaction around small devices. In Proceedings of UIST '08, pages 201--204, New York, NY, USA, 2008.

Digital Library

Google Scholar

[2]

A. Misra, G. Essl, and M. Rohs. Microphone as Sensor in Mobile Phone Performance. In Proceedings of the International Conference for New Interfaces for Musical Expression (NIME-08), Genova, Italy, 2008.

Google Scholar

[3]

Baudisch, P and Chu, G. (2009). Back-of-device interaction allows creating very small touch devices. In Proc. CHI'09, pp. 1923--1932.

Digital Library

Google Scholar

[4]

Fmod library, http://www.fmod.org

Google Scholar

[5]

Harrison, C., Hudson, S. E., Scratch input: creating large, inexpensive, unpowered and mobile finger input surfaces, in Proc. of UIST 2008, pp. 205--208.

Digital Library

Google Scholar

[6]

J. S., Lee, W. S. Yeo, Sonicstrument: A Musical Interface with Stereotypical Acoustic Transducers, Proceedings of the International Conference on New Interfaces for Musical Expression (NIME), 2011.

Google Scholar

[7]

N. H. Yu, S. S. Tsai, I. C. Hsiao, D. J. Tsai, M. H. Lee, M. Y. Chen, and Y. P. Hung. 2011. Clip-on gadgets: expanding multi-touch interaction area with unpowered tactile controls. In Proc. UIST '11, 367--372.

Digital Library

Google Scholar

[8]

Siek, K. A., Rogers, Y., and Connelly, K. H. Fat Finger Worries: How Older and Younger Users Physically Interact with PDAs. In Proc. INTERACT' 05, pp. 267--280.

Digital Library

Google Scholar

[9]

Wigdor, D., Forlines, C., Baudisch, P., Barnwell, J., Shen, C. Lucid-Touch: A See-Through Mobile Device. In Proc. UIST 2007, pp. 269--278.

Digital Library

Google Scholar

Cited By

View all

Van Rheden VMaurer BMurer M(2023)Phygital Samples: Enhancing Retail Experiences with Digital Augmentations of Physical MaterialsExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3583904(1-5)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3583904
Wang MQin GSun MZhao JQin J(2023)An exploration of pressure input with bare finger for Mobile interaction in stationary and Mobile situationsMultimedia Tools and Applications10.1007/s11042-023-14503-082:17(25711-25731)Online publication date: 14-Feb-2023
https://doi.org/10.1007/s11042-023-14503-0
Tsuchida TFujita KIkematsu KSarcar STakashima KKitamura Y(2022)TetraForce: A Magnetic-Based Interface Enabling Pressure Force and Shear Force Input Applied to Front and Back of a SmartphoneProceedings of the ACM on Human-Computer Interaction10.1145/35677176:ISS(185-206)Online publication date: 14-Nov-2022
https://dl.acm.org/doi/10.1145/3567717
Show More Cited By

Recommendations

Touch & activate: adding interactivity to existing objects using active acoustic sensing
UIST '13: Proceedings of the 26th annual ACM symposium on User interface software and technology

In this paper, we present a novel acoustic touch sensing technique called Touch & Activate. It recognizes a rich context of touches including grasp on existing objects by attaching only a vibration speaker and a piezo-electric microphone paired as a ...
FingerIO: Using Active Sonar for Fine-Grained Finger Tracking
CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems

We present fingerIO, a novel fine-grained finger tracking solution for around-device interaction. FingerIO does not require instrumenting the finger with sensors and works even in the presence of occlusions between the finger and the device. We achieve ...
ViBand: High-Fidelity Bio-Acoustic Sensing Using Commodity Smartwatch Accelerometers
UIST '16: Proceedings of the 29th Annual Symposium on User Interface Software and Technology

Smartwatches and wearables are unique in that they reside on the body, presenting great potential for always-available input and interaction. Their position on the wrist makes them ideal for capturing bio-acoustic signals. We developed a custom ...

Comments

Information & Contributors

Information

Published In

CHI EA '12: CHI '12 Extended Abstracts on Human Factors in Computing Systems

May 2012

2864 pages

ISBN:9781450310161

DOI:10.1145/2212776

General Chair:
Joseph A. Konstan
University of Minnesota
,
Program Chairs:
Ed H. Chi
Google
,
Kristina Höök
Mobile Life at KTH

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 May 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Extended-abstract

Conference

CHI '12

Sponsor:

SIGCHI

CHI '12: CHI Conference on Human Factors in Computing Systems

May 5 - 10, 2012

Texas, Austin, USA

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

14
Total Citations
View Citations
437
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)1

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Van Rheden VMaurer BMurer M(2023)Phygital Samples: Enhancing Retail Experiences with Digital Augmentations of Physical MaterialsExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3583904(1-5)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3583904
Wang MQin GSun MZhao JQin J(2023)An exploration of pressure input with bare finger for Mobile interaction in stationary and Mobile situationsMultimedia Tools and Applications10.1007/s11042-023-14503-082:17(25711-25731)Online publication date: 14-Feb-2023
https://doi.org/10.1007/s11042-023-14503-0
Tsuchida TFujita KIkematsu KSarcar STakashima KKitamura Y(2022)TetraForce: A Magnetic-Based Interface Enabling Pressure Force and Shear Force Input Applied to Front and Back of a SmartphoneProceedings of the ACM on Human-Computer Interaction10.1145/35677176:ISS(185-206)Online publication date: 14-Nov-2022
https://dl.acm.org/doi/10.1145/3567717
Yeh YRoy QIrudayaraj AVogel D(2020)Expanding Side Touch Input on Mobile PhonesProceedings of the ACM on Human-Computer Interaction10.1145/34273344:ISS(1-20)Online publication date: 4-Nov-2020
https://dl.acm.org/doi/10.1145/3427334
Kubo YKoguchi YShizuki BTakahashi SHilliges O(2019)AudioTouchProceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services10.1145/3338286.3340147(1-13)Online publication date: 1-Oct-2019
https://dl.acm.org/doi/10.1145/3338286.3340147
Tung YShin KBalan RMisra AAgarwal SMascolo C(2016)Expansion of Human-Phone Interface By Sensing Structure-Borne Sound PropagationProceedings of the 14th Annual International Conference on Mobile Systems, Applications, and Services10.1145/2906388.2906394(277-289)Online publication date: 20-Jun-2016
https://dl.acm.org/doi/10.1145/2906388.2906394
Tung YShin K(2016)ForcePhoneIEEE Pervasive Computing10.1109/MPRV.2016.7015:4(20-25)Online publication date: 1-Oct-2016
https://dl.acm.org/doi/10.1109/MPRV.2016.70
Hwang SWohn K(2015)PseudoSensor: Emulation of input modality by repurposing sensors on mobile devicesJournal of Ambient Intelligence and Smart Environments10.3233/AIS-1503467:6(761-776)Online publication date: 20-Nov-2015
https://doi.org/10.3233/AIS-150346
Neumayr TKern DAugstein MKurschl WAltmann J(2015)User Modeling Features Related to Physical PressureProceedings of the 13th International Conference on Advances in Mobile Computing and Multimedia10.1145/2837126.2837169(338-341)Online publication date: 11-Dec-2015
https://dl.acm.org/doi/10.1145/2837126.2837169
Yoon HPark SLee K(2015)Exploiting Ambient Light Sensor for Authentication on Wearable Devices2015 Fourth International Conference on Cyber Security, Cyber Warfare, and Digital Forensic (CyberSec)10.1109/CyberSec.2015.27(95-100)Online publication date: Oct-2015
https://doi.org/10.1109/CyberSec.2015.27
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

Supplementary Material

References

Cited By

Recommendations

Touch & activate: adding interactivity to existing objects using active acoustic sensing

FingerIO: Using Active Sonar for Fine-Grained Finger Tracking

ViBand: High-Fidelity Bio-Acoustic Sensing Using Commodity Smartwatch Accelerometers

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Upcoming Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations