Abstract
The musical possibilities of force sensors on touchscreen devices are explored, using Apple’s 3D Touch. Three functions are selected to be controlled by force: (a) excitation, (b) modification (aftertouch), and (c) mode change. Excitation starts a note, modification alters a playing note, and mode change controls binary on/off sound parameters. Four instruments are designed using different combinations of force-sound mapping strategies. ForceKlick is a single button instrument that plays consecutive notes within one touch by altering touch force, by detecting force down-peaks. The iPhone 6s/7 Ocarina features force-sensitive fingerholes that heightens octaves upon high force. Force Trombone continuously controls gain by force. Force Synth is a trigger pad array featuring all functions in one button: start note by touch, control vibrato with force, and toggle octaves upon abrupt burst of force. A simple user test suggests that adding force features to well-known instruments are more friendly and usable.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
3D Touch by Apple, on models after iPhone 6s:
- 2.
Although Apple does not disclose 3D Touch’s sample rate, our preliminary experiments indicate it to be approximately between 10 and 15 ms (67–100Hz).
- 3.
Apple’s GarageBand: http://apple.com/ios/garageband/.
- 4.
- 5.
- 6.
- 7.
Not \(2^4 \times 2 = 32\), as “all holes open” does not have any fingers on screen to apply force.
References
Bryan, N.J., Herrera, J., Oh, J., Wang, G.: MoMu: a mobile music toolkit. In: Proceedings of the 2010 International Conference on New Interfaces for Musical Expression, pp. 174–177. Sydney, Australia (2010)
Cook, P., Scavone, G.P.: The synthesis toolkit (STK). In: Proceedings of the 1999 International Computer Music Conference, pp. 164–166. Beijing, China (1999)
Essl, G., Rohs, M., Kratz, S.: Use the force (or something) - pressure and pressure-like input for mobile music performance. In: Proceedings of the 2010 International Conference on New Interfaces for Musical Expression, pp. 182–185. Sydney, Australia (2010)
Kim, B., Yeo, W.S.: Interactive music performance with digital compass. In: Proceedings of the 2012 International Conference on New Interfaces for Musical Expression. Ann Arbor, Michigan (2012)
Michon, R., Smith, J.O., Chafe, C., Wright, M., Wang, G.: NUANCE: adding multi-touch force detection to the iPad. In: Proceedings of the 2016 Sound and Music Computing Conference. Hamburg, Denmark (2016)
Park, T.H., Oriol, N.: Fortissimo: force-feedback for mobile devices. In: Proceedings of the 2013 International Conference on New Interfaces for Musical Expression, pp. 291–294. Daejeon, Korea (2013)
Tanaka, A.: Mobile music making. In: Proceedings of the 2004 International Conference on New Interfaces for Musical Expression, pp. 154–156. Singapore (2004)
Wang, Ge.: Designing smule’s iPhone ocarina: the iPhone’s magic flute. In: Proceedings of the 2009 International Conference on New Interfaces for Musical Expression, pp. 303–307. Pittsburgh, Pennsylvania (2009)
Yong, S., Lee, E.J., Peiris, R., Chan, L., Nam, J.: ForceClicks: enabling efficient button interaction with singer finger touch. In: Proceedings of the TEI 2017: Eleventh International Conference on Tangible, Embedded, and Embodied Interaction. Yokohama, Japan (2017)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this paper
Cite this paper
Lee, E.J., Yong, S., Choi, S., Chan, L., Peiris, R., Nam, J. (2018). Use the Force: Incorporating Touch Force Sensors into Mobile Music Interaction. In: Aramaki, M., Davies , M., Kronland-Martinet, R., Ystad, S. (eds) Music Technology with Swing. CMMR 2017. Lecture Notes in Computer Science(), vol 11265. Springer, Cham. https://doi.org/10.1007/978-3-030-01692-0_38
Download citation
DOI: https://doi.org/10.1007/978-3-030-01692-0_38
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-01691-3
Online ISBN: 978-3-030-01692-0
eBook Packages: Computer ScienceComputer Science (R0)