poster

Towards Improving Spatial Orientation using Electrical Muscle Stimulation as Tactile and Force Feedback

Authors:

Vimal Darius Seetohul,

Katrin Schweitzer,

Matthias BöhmerAuthors Info & Claims

MUM '23: Proceedings of the 22nd International Conference on Mobile and Ubiquitous Multimedia

Pages 512 - 514

https://doi.org/10.1145/3626705.3631792

Published: 03 December 2023 Publication History

Abstract

Navigating the environment can be challenging, especially when faced with vision or hearing limitations, such as darkness and visual impairments. To address this issue, we propose using electrical muscle stimulation (EMS) to convey spatial information and assist users in avoiding obstacles. We map direction to EMS channels and distance to current intensity, with force-feedback for closer proximity and tactile EMS feedback for greater proximity. An experimental study (n=12) was conducted to evaluate the concept and gain insights into the qualitative perception of EMS. Participants were able to accurately estimate encoded distance (85.7% accuracy) and direction (99.5% accuracy). Our findings demonstrate the feasibility and effectiveness of using tactile and force feedback EMS to convey spatial information comprehensibly.

References

[1]

Alvaro Cassinelli, Carson Reynolds, and Masatoshi Ishikawa. 2006. Augmenting Spatial Awareness with Haptic Radar. In 2006 10th IEEE International Symposium on Wearable Computers. IEEE, Montreux Switzerland, 61–64. https://doi.org/10.1109/ISWC.2006.286344

[2]

Tim Duente, Justin Schulte, Max Pfeiffer, and Michael Rohs. 2018. MuscleIO: Muscle-Based Input and Output for Casual Notifications. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 2 (July 2018), 64:1–64:21. https://doi.org/10.1145/3214267

Digital Library

[3]

Russell A Epstein, Eva Zita Patai, Joshua B Julian, and Hugo J Spiers. 2017. The cognitive map in humans: spatial navigation and beyond. Nature neuroscience 20, 11 (2017), 1504–1513.

[4]

Sarah Faltaous, Joshua Neuwirth, Uwe Gruenefeld, and Stefan Schneegass. 2020. SaVR: Increasing Safety in Virtual Reality Environments via Electrical Muscle Stimulation. In 19th International Conference on Mobile and Ubiquitous Multimedia. ACM, Essen Germany, 254–258. https://doi.org/10.1145/3428361.3428389

Digital Library

[5]

Sarah Faltaous, Marvin Prochazka, Jonas Auda, Jonas Keppel, Nick Wittig, Uwe Gruenefeld, and Stefan Schneegass. 2022. Give Weight to VR: Manipulating Users’ Perception of Weight in Virtual Reality with Electric Muscle Stimulation. In Proceedings of Mensch Und Computer 2022(MuC ’22). Association for Computing Machinery, New York, NY, USA, 533–538. https://doi.org/10.1145/3543758.3547571

Digital Library

[6]

Bo Geng, Ken Yoshida, Laura Petrini, and Winnie Jensen. 2012. Evaluation of Sensation Evoked by Electrocutaneous Stimulation on Forearm in Nondisabled Subjects. Journal of Rehabilitation Research and Development 49, 2 (2012), 297–308. https://doi.org/10.1682/jrrd.2010.09.0187

[7]

Edward Twitchell Hall. 1966. The Hidden Dimension. Doubleday, New York, NY, USA.

[8]

J. Knibbe, A. Alsmith, and K. Hornbæk. 2018. Experiencing Electrical Muscle Stimulation. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 3 (Sept. 2018), 118:1–118:14. https://doi.org/10.1145/3264928

Digital Library

[9]

Pedro Lopes, Lars Butzmann, and Patrick Baudisch. 2013. Muscle-Propelled Force Feedback: Bringing Force Feedback to Mobile Devices Using Electrical Stimulation. In Proceedings of the 4th Augmented Human International Conference(AH ’13). Association for Computing Machinery, New York, NY, USA, 231–232. https://doi.org/10.1145/2459236.2459276

Digital Library

[10]

Pedro Lopes, Patrik Jonell, and Patrick Baudisch. 2015. Affordance++: Allowing Objects to Communicate Dynamic Use. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems(CHI ’15). Association for Computing Machinery, New York, NY, USA, 2515–2524. https://doi.org/10.1145/2702123.2702128

Digital Library

[11]

Pedro Lopes, Sijing You, Lung-Pan Cheng, Sebastian Marwecki, and Patrick Baudisch. 2017. Providing Haptics to Walls & Heavy Objects in Virtual Reality by Means of Electrical Muscle Stimulation. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, Denver Colorado USA, 1471–1482. https://doi.org/10.1145/3025453.3025600

Digital Library

[12]

Pedro Lopes, Sijing You, Alexandra Ion, and Patrick Baudisch. 2018. Adding Force Feedback to Mixed Reality Experiences and Games Using Electrical Muscle Stimulation. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, Montreal QC Canada, 1–13. https://doi.org/10.1145/3173574.3174020

Digital Library

[13]

Max Pfeiffer, Tim Duente, and Michael Rohs. 2016. Let Your Body Move: A Prototyping Toolkit for Wearable Force Feedback with Electrical Muscle Stimulation. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services. ACM, Florence Italy, 418–427. https://doi.org/10.1145/2935334.2935348

Digital Library

[14]

Max Pfeiffer, Tim Dünte, Stefan Schneegass, Florian Alt, and Michael Rohs. 2015. Cruise Control for Pedestrians: Controlling Walking Direction Using Electrical Muscle Stimulation. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, Seoul Republic of Korea, 2505–2514. https://doi.org/10.1145/2702123.2702190

Digital Library

[15]

Max Pfeiffer and Michael Rohs. 2017. Haptic Feedback for Wearables and Textiles Based on Electrical Muscle Stimulation. In Smart Textiles: Fundamentals, Design, and Interaction, Stefan Schneegass and Oliver Amft (Eds.). Springer International Publishing, Cham, 103–137. https://doi.org/10.1007/978-3-319-50124-6_6

[16]

Max Pfeiffer, Stefan Schneegass, Florian Alt, and Michael Rohs. 2014. Let Me Grab This: A Comparison of EMS and Vibration for Haptic Feedback in Free-Hand Interaction. In Proceedings of the 5th Augmented Human International Conference. ACM, Kobe Japan, 1–8. https://doi.org/10.1145/2582051.2582099

Digital Library

[17]

Henning Pohl, Kasper Hornbæk, and Jarrod Knibbe. 2018. Wanding Through Space: Interactive Calibration for Electric Muscle Stimulation. In Proceedings of the 9th Augmented Human International Conference(AH ’18). Association for Computing Machinery, New York, NY, USA, 1–5. https://doi.org/10.1145/3174910.3174948

Digital Library

[18]

Stefan Schneegass and Rufat Rzayev. 2016. Embodied Notifications: Implicit Notifications through Electrical Muscle Stimulation. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct. ACM, Florence Italy, 954–959. https://doi.org/10.1145/2957265.2962663

Digital Library

[19]

Eldon Schoop, James Smith, and Bjoern Hartmann. 2018. HindSight: Enhancing Spatial Awareness by Sonifying Detected Objects in Real-Time 360-Degree Video. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems(CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3173574.3173717

Digital Library

[20]

Angela Schwering, Jakub Krukar, Rui Li, Vanessa Joy Anacta, and Stefan Fuest. 2017. Wayfinding through orientation. Spatial Cognition & Computation 17, 4 (2017), 273–303.

[21]

Vimal Darius Seetohul and Matthias Böhmer. 2021. Towards Enhancing Spatial Awareness through Electrical Muscle Stimulation. In Companion of the 2021 ACM SIGCHI Symposium on Engineering Interactive Computing Systems. ACM, Virtual Event Netherlands, 17–21. https://doi.org/10.1145/3459926.3464750

Digital Library

[22]

Koji Tsukada and Michiaki Yasumura. 2004. ActiveBelt: Belt-Type Wearable Tactile Display for Directional Navigation. In UbiComp 2004: Ubiquitous Computing, David Hutchison, Takeo Kanade, Josef Kittler, Jon M. Kleinberg, Friedemann Mattern, John C. Mitchell, Moni Naor, Oscar Nierstrasz, C. Pandu Rangan, Bernhard Steffen, Madhu Sudan, Demetri Terzopoulos, Dough Tygar, Moshe Y. Vardi, Gerhard Weikum, Nigel Davies, Elizabeth D. Mynatt, and Itiro Siio (Eds.). Vol. 3205. Springer Berlin Heidelberg, Berlin, Heidelberg, 384–399. https://doi.org/10.1007/978-3-540-30119-6_23

Cited By

Seetohul VSchweitzer KBöhmer M(2024)ShoulderTapper: Providing Directional Cues through Electrotactile Feedback for Target Acquisition in Pick-by-Light SystemsProceedings of the International Conference on Mobile and Ubiquitous Multimedia10.1145/3701571.3701597(228-234)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1145/3701571.3701597

Index Terms

Towards Improving Spatial Orientation using Electrical Muscle Stimulation as Tactile and Force Feedback
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Haptic devices

Recommendations

DextrEMS: Increasing Dexterity in Electrical Muscle Stimulation by Combining it with Brakes
UIST '21: The 34th Annual ACM Symposium on User Interface Software and Technology

Electrical muscle stimulation (EMS) is an emergent technique that miniaturizes force feedback, especially popular for untethered haptic devices, such as mobile gaming, VR, or AR. However, the actuation displayed by interactive systems based on EMS is ...
Controlling Maximal Voluntary Contraction of the Upper Limb Muscles by Facial Electrical Stimulation
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

In this paper, we propose to use facial electrical stimulation to control maximal voluntary contraction (MVC) of the upper limbs. The method is based on a body mechanism in which the contraction of the masseter muscles enhances MVC of the limb muscles. ...
Standing Balance Improved by Electrical Muscle Stimulation to Popliteus Muscles
AHs '23: Proceedings of the Augmented Humans International Conference 2023

Fall prevention is extremely important when it comes to ensuring the well-being of an aging population. There are currently two main fall prevention strategies: wearing exoskeletons to assist with postural stability and using electrical muscle ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

MUM '23: Proceedings of the 22nd International Conference on Mobile and Ubiquitous Multimedia

December 2023

607 pages

ISBN:9798400709210

DOI:10.1145/3626705

Copyright © 2023 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 December 2023

Check for updates

Author Tags

Qualifiers

Poster
Research
Refereed limited

Conference

MUM '23

MUM '23: International Conference on Mobile and Ubiquitous Multimedia

December 3 - 6, 2023

Vienna, Austria

Acceptance Rates

Overall Acceptance Rate 190 of 465 submissions, 41%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
64
Total Downloads

Downloads (Last 12 months)47
Downloads (Last 6 weeks)0

Reflects downloads up to 25 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Seetohul VSchweitzer KBöhmer M(2024)ShoulderTapper: Providing Directional Cues through Electrotactile Feedback for Target Acquisition in Pick-by-Light SystemsProceedings of the International Conference on Mobile and Ubiquitous Multimedia10.1145/3701571.3701597(228-234)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1145/3701571.3701597

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten