skip to main content
10.1145/3411763.3451536acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
demonstration

Let’s Frets! Mastering Guitar Playing with Capacitive Sensing and Visual Guidance

Published: 08 May 2021 Publication History

Abstract

Mastering the guitar requires regular exercise to develop new skills and maintain existing abilities. We present Let’s Frets - a modular guitar support system that provides visual guidance through LEDs that are integrated into a capacitive fretboard to support the practice of chords, scales, melodies, and exercises. Additional feedback is provided through a 3D-printed fretboard that senses the finger positions through capacitive sensing. We envision Let’s Frets as an integrated guitar support system that raises the awareness of guitarists about their playing styles, their training progress, the composition of new pieces, and facilitating remote collaborations between teachers as well as guitar students. This interactivity demonstrates Let’s Frets with an augmented fretboard and supporting software that runs on a mobile device.

Supplemental Material

MP4 File
Supplemental video

References

[1]
Anders Ericsson, Ralf T. Krampe, and Clemens Tesch-Römer. 1993. The Role of Deliberate Practice in the Acquisition of Expert Performance. Psychological Review 100, 3 (1993), 363. https://doi.org/10.1037//0033-295X.100.3.363
[2]
Jakob Karolus, Annika Kilian, Thomas Kosch, Albrecht Schmidt, and Paweł W. Wozniak. 2020. Hit the Thumb Jack! Using Electromyography to Augment the Piano Keyboard. In Proceedings of the ACM Designing Interactive Systems Conference(DIS ’20). ACM, New York, NY, USA, 429–440. https://doi.org/10.1145/3357236.3395500
[3]
Jakob Karolus, Hendrik Schuff, Thomas Kosch, Paweł W. Wozniak, and Albrecht Schmidt. 2018. EMGuitar: Assisting Guitar Playing with Electromyography. In Proceedings of the Designing Interactive Systems Conference(DIS ’18). ACM, New York, NY, USA, 651–655. https://doi.org/10.1145/3196709.3196803
[4]
Joseph R. Keebler, Travis J. Wiltshire, Dustin C. Smith, and Stephen M. Fiore. 2013. Picking Up STEAM: Educational Implications for Teaching With an Augmented Reality Guitar Learning System. In Proceedings of the International Conference on Virtual, Augmented and Mixed Reality(VAMR). Springer, Cham, Switzerland, 170–178. https://doi.org/10.1007/978-3-642-39420-1_19
[5]
Ralf T. Krampe and Karl A. Ericsson. 1995. Deliberate Practice and Elite Musical Performance. Cambridge University Press, Cambridge, United Kingdom, 84–102. https://doi.org/10.1017/CBO9780511552366.005
[6]
Markus Löchtefeld, Sven Gehring, Ralf Jung, and Antonio Krüger. 2011. guitAR: Supporting Guitar Learning Through Mobile Projection. In Extended Abstracts of the CHI Human Factors in Computing Systems(CHI EA ’11). ACM, New York, NY, USA, 1447–1452. https://doi.org/10.1145/1979742.1979789
[7]
Markus Löchtefeld, Sven Gehring, Ralf Jung, and Antonio Krüger. 2011. Using Mobile Projection to Support Guitar Learning. In Proceedings of the International Symposium on Smart Graphics. Springer, Cham, Switzerland, 103–114. https://doi.org/10.1007/978-3-642-22571-0_9
[8]
Karola Marky, Andreas Weiß, and Thomas Kosch. 2019. Supporting Musical Practice Sessions Through HMD-Based Augmented Reality. In Mensch und Computer 2019-Workshopband. Gesellschaft für Informatik e.V., Bonn, Germany, 1–5.
[9]
Karola Marky, Andreas Weiß, Andrii Matviienko, Florian Brandherm, Sebastian Wolf, Martin Schmitz, Florian Krell, Florian Müller, Max Mühlhäuser, and Thomas Kosch. 2021. Let’s Frets! Assisting Guitar Students During Practice via Capacitive Sensing. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). ACM, New York, NY, USA. https://doi.org/10.1145/3411764.3445595
[10]
Yoichi Motokawa and Hideo Saito. 2006. Support system for guitar playing using augmented reality display. In 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality. 243–244. https://doi.org/10.1109/ISMAR.2006.297825
[11]
Boni Rietveld. 2013. Dancers’ and Musicians’ Injuries. Clinical Rheumatology 32, 4 (01 Apr 2013), 425–434. https://doi.org/10.1007/s10067-013-2184-8
[12]
Valkyrie Savage, Ryan Schmidt, Tovi Grossman, George Fitzmaurice, and Björn Hartmann. 2014. A Series of Tubes: Adding Interactivity to 3D Prints Using Internal Pipes. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology(UIST ’14). ACM, New York, New York, USA, 3–12. https://doi.org/10.1145/2642918.2647374
[13]
Martin Schmitz, Mohammadreza Khalilbeigi, Matthias Balwierz, Roman Lissermann, Max Mühlhäuser, and Jürgen Steimle. 2015. Capricate: A Fabrication Pipeline to Design and 3D Print Capacitive Touch Sensors for Interactive Objects. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology(UIST ’15). ACM, New York, New York, USA, 253–258. https://doi.org/10.1145/2807442.2807503
[14]
Beste F. Yuksel, Kurt B. Oleson, Lane Harrison, Evan M. Peck, Daniel Afergan, Remco Chang, and Robert J. K. Jacob. 2016. Learn Piano with BACh: An Adaptive Learning Interface That Adjusts Task Difficulty Based on Brain State. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). ACM, New York, NY, USA, 5372–5384. https://doi.org/10.1145/2858036.2858388

Cited By

View all
  • (2024)Intelligent Music Interfaces: When Interactive Assistance and Adaptive Augmentation Meet Musical InstrumentsProceedings of the Augmented Humans International Conference 202410.1145/3652920.3653039(327-330)Online publication date: 4-Apr-2024
  • (2024)3DA: Assessing 3D-Printed Electrodes for Measuring Electrodermal ActivityExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650938(1-7)Online publication date: 11-May-2024
  • (2023)Intelligent Music Interfaces: When Interactive Assistance and Augmentation Meet Musical InstrumentsProceedings of the Augmented Humans International Conference 202310.1145/3582700.3582731(379-383)Online publication date: 12-Mar-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CHI EA '21: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems
May 2021
2965 pages
ISBN:9781450380959
DOI:10.1145/3411763
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 May 2021

Check for updates

Author Tags

  1. capacitive sensing
  2. musical instruments
  3. support setup

Qualifiers

  • Demonstration
  • Research
  • Refereed limited

Conference

CHI '21
Sponsor:

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025
ACM CHI Conference on Human Factors in Computing Systems
April 26 - May 1, 2025
Yokohama , Japan

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)36
  • Downloads (Last 6 weeks)3
Reflects downloads up to 20 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Intelligent Music Interfaces: When Interactive Assistance and Adaptive Augmentation Meet Musical InstrumentsProceedings of the Augmented Humans International Conference 202410.1145/3652920.3653039(327-330)Online publication date: 4-Apr-2024
  • (2024)3DA: Assessing 3D-Printed Electrodes for Measuring Electrodermal ActivityExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650938(1-7)Online publication date: 11-May-2024
  • (2023)Intelligent Music Interfaces: When Interactive Assistance and Augmentation Meet Musical InstrumentsProceedings of the Augmented Humans International Conference 202310.1145/3582700.3582731(379-383)Online publication date: 12-Mar-2023
  • (2023)MechSense: A Design and Fabrication Pipeline for Integrating Rotary Encoders into 3D Printed MechanismsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581361(1-14)Online publication date: 19-Apr-2023
  • (2022)ElectronicsAR: Design and Evaluation of a Mobile and Tangible High-Fidelity Augmented Electronics ToolkitProceedings of the ACM on Human-Computer Interaction10.1145/35677406:ISS(700-721)Online publication date: 14-Nov-2022
  • (2022)Rethinking Smart Objects: The International Workshop on Interacting with Smart Objects in Interactive SpacesCompanion Proceedings of the 2022 Conference on Interactive Surfaces and Spaces10.1145/3532104.3571470(64-67)Online publication date: 20-Nov-2022
  • (2022)Intelligent Music Interfaces: When Interactive Assistance and Augmentation Meet Musical InstrumentsExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3503743(1-4)Online publication date: 27-Apr-2022
  • (2021)A Real-Time Drum-Wise Volume Visualization System for Learning Volume-Balanced Drum PerformanceEntertainment Computing – ICEC 202110.1007/978-3-030-89394-1_12(154-166)Online publication date: 2-Nov-2021

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media