skip to main content
10.1145/3243274.3243280acmotherconferencesArticle/Chapter ViewAbstractPublication PagesamConference Proceedingsconference-collections
research-article

Smart Mandolin: autobiographical design, implementation, use cases, and lessons learned

Published: 12 September 2018 Publication History

Abstract

This paper presents the Smart Mandolin, an exemplar of the family of the so-called smart instruments. Developed according to the paradigms of autobiographical design, it consists of a conventional acoustic mandolin enhanced with different types of sensors, a microphone, a loudspeaker, wireless connectivity to both local networks and the Internet, and a low-latency audio processing board. Various implemented use cases are presented, which leverage the smart qualities of the instrument. These include the programming of the instrument via applications for smartphones and desktop computer, as well as the wireless control of devices enabling multimodal performances such as screen projecting visuals, smartphones, and tactile devices used by the audience. The paper concludes with an evaluation conducted by the author himself after extensive use, which pinpointed pros and cons of the instrument and provided a comparison with the Hyper-Mandolin, an instance of augmented instruments previously developed by the author.

References

[1]
L. Atzori, A. Iera, and G. Morabito. 2010. The Internet of Things: a survey. Computer networks 54, 15 (2010), 2787--2805.
[2]
P. Brossier. 2006. Automatic annotation of musical audio for interactive systems. Ph.D. Dissertation. Queen Mary University of London.
[3]
Florian Eyben, Martin Wöllmer, and Björn Schuller. 2010. Opensmile: the munich versatile and fast open-source audio feature extractor. In Proceedings of the 18th ACM international conference on Multimedia. ACM, 1459--1462.
[4]
E. Farella. 2010. Ambient Intelligence, Smart Objects and Sensor Networks: Practical Experiences. In IEEE/IFIP International Conference on Embedded and Ubiquitous Computing. 416--421.
[5]
E. Gunther and S. O'Modhrain. 2003. Cutaneous grooves: composing for the sense of touch. Journal of New Music Research 32, 4 (2003), 369--381.
[6]
A.R. Jensenius and M.J. Lyons. 2017. A NIME Reader: Fifteen Years of New Interfaces for Musical Expression. Springer.
[7]
D. Keller and V. Lazzarini. 2017. Ecologically Grounded Creative Practices in Ubiquitous Music. Organised Sound 22, 1 (2017), 61--72.
[8]
A. Mazzoni and N. Bryan-Kinns. 2016. Mood Glove: A haptic wearable prototype system to enhance mood music in film. Entertainment Computing 17 (2016), 9--17.
[9]
A. McPherson and V. Zappi. 2015. An Environment for Submillisecond-Latency Audio and Sensor Processing on BeagleBone Black. In Audio Engineering Society Convention 138. Audio Engineering Society. http://www.aes.org/elib/browse.cfm?elib=17755
[10]
A. P McPherson, Robert H Jack, and Giulio Moro. 2016. Action-Sound Latency: Are Our Tools Fast Enough?. In Proceedings of the Conference on New Interfaces for Musical Expression.
[11]
E.R. Miranda and M.M. Wanderley. 2006. New digital musical instruments: control and interaction beyond the keyboard. Vol. 21. AR Editions, Inc.
[12]
T. Mitchell, S. Madgwick, S. Rankine, G.S. Hilton, A. Freed, and A.R Nix. 2014. Making the Most of Wi-Fi: Optimisations for Robust Wireless Live Music Performance. In Proceedings of the Conference on New Interfaces for Musical Expression. 251--256.
[13]
F. Morreale and A. McPherson. 2017. Design for Longevity: Ongoing Use of Instruments from NIME 2010-14. In Proceedings of the Conference on New Interfaces for Musical Expression. NIME.
[14]
Fabio Morreale, Andrew P McPherson, and Marcelo M Wanderley. 2018. NIME Identity from the Performer's Perspective. In Proceedings of the Conference on New Interfaces for Musical Expression.
[15]
Carman Neustaedter and Phoebe Sengers. 2012. Autobiographical design in HCI research: designing and learning through use-it-yourself. In Proceedings of the Designing Interactive Systems Conference. ACM, 514--523.
[16]
S. O'modhrain. 2011. A framework for the evaluation of digital musical instruments. Computer Music Journal 35, 1 (2011), 28--42.
[17]
M.S. Puckette, T. Apel, and D.D Ziccarelli. 1998. Real-time audio analysis tools for Pd and MSP. In Proceedings of the International Computer Music Conference.
[18]
C.Rottondi, C. Chafe, C. Allocchio, and A. Sarti. 2016. An Overview on Networked Music Performance Technologies. IEEE Access 4 (2016), 8823--8843.
[19]
M. Slaney. 2002. Semantic-audio retrieval. In IEEE International Conference on Acoustics, Speech, and Signal Processing, Vol. 4. 4108--4111.
[20]
P. Sparks. 1995. The classical mandolin. Oxford: Clarendon Press.
[21]
B. Sturm and O. Ben-Tal. 2017. Bringing the models back to music practice: The evaluation of deep learning approaches to music transcription modelling and generation. Journal of Creative Music Systems (2017).
[22]
L. Turchet. 2017. The Hyper-Mandolin. In Proceedings of Audio Mostly Conference. 1:1--1:8.
[23]
L. Turchet and M. Barthet. 2017. Envisioning Smart Musical Haptic Wearables to Enhance Performers' Creative Communication. In Proceedings of International Symposium on Computer Music Multidisciplinary Research. 538--549.
[24]
L. Turchet and M. Barthet. 2018. Demo of interactions between a performer playing a Smart Mandolin and audience members using Musical Haptic Wearables. In Proceedings of the Conference on New Interfaces for Musical Expression. 82--83.
[25]
L. Turchet, M. Benincaso, and C. Fischione. 2017. Examples of use cases with Smart Instruments. In Proceedings of Audio Mostly Conference. 47:1--47:5.
[26]
L. Turchet, C. Fischione, and M. Barthet. 2017. Towards the Internet of Musical Things. In Proceedings of the Sound and Music Computing Conference. 13--20.
[27]
L. Turchet, A. McPherson, and M. Barthet. 2018. Co-design of a Smart Cajón. Journal of the Audio Engineering Society 66, 4 (2018), 220--230.
[28]
L. Turchet, A. McPherson, and M. Barthet. 2018. Real-time hit classification in a Smart Cajón. Frontiers in ICT 5, 16 (2018).
[29]
L. Turchet, A. McPherson, and C. Fischione. 2016. Smart Instruments: Towards an Ecosystem of Interoperable Devices Connecting Performers and Audiences. In Proceedings of the Sound and Music Computing Conference. 498--505.
[30]
J. Tyler and P. Sparks. 2012. The Mandolin: Its Structure and Performance (Sixteenth to Twentieth Centuries). Performance Practice Review 9, 2 (2012), 166--177.

Cited By

View all
  • (2024)From Prototype to Performance Practice: Reflections on Iterative Instrument DesignProceedings of the 19th International Audio Mostly Conference: Explorations in Sonic Cultures10.1145/3678299.3678360(439-444)Online publication date: 18-Sep-2024
  • (2024)MusicoNet: A Social Network for Musicians Based on the Internet of Musical Things and People Paradigm2024 IEEE 5th International Symposium on the Internet of Sounds (IS2)10.1109/IS262782.2024.10704117(1-9)Online publication date: 30-Sep-2024
  • (2023)Boards Hit Back: Reflecting on Martial Arts Practices Through Soma DesignProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580722(1-18)Online publication date: 19-Apr-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
AM '18: Proceedings of the Audio Mostly 2018 on Sound in Immersion and Emotion
September 2018
252 pages
ISBN:9781450366090
DOI:10.1145/3243274
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 September 2018

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Internet of Musical Things
  2. digital musical instruments
  3. smart instruments

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Funding Sources

  • H2020 Marie Sk?odowska-Curie Actions

Conference

AM'18
AM'18: Sound in Immersion and Emotion
September 12 - 14, 2018
Wrexham, United Kingdom

Acceptance Rates

Overall Acceptance Rate 177 of 275 submissions, 64%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)13
  • Downloads (Last 6 weeks)3
Reflects downloads up to 13 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)From Prototype to Performance Practice: Reflections on Iterative Instrument DesignProceedings of the 19th International Audio Mostly Conference: Explorations in Sonic Cultures10.1145/3678299.3678360(439-444)Online publication date: 18-Sep-2024
  • (2024)MusicoNet: A Social Network for Musicians Based on the Internet of Musical Things and People Paradigm2024 IEEE 5th International Symposium on the Internet of Sounds (IS2)10.1109/IS262782.2024.10704117(1-9)Online publication date: 30-Sep-2024
  • (2023)Boards Hit Back: Reflecting on Martial Arts Practices Through Soma DesignProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580722(1-18)Online publication date: 19-Apr-2023
  • (2023)RemixDrum: A Smart Musical Instrument for Music and Visual Art Remix2023 IEEE 9th World Forum on Internet of Things (WF-IoT)10.1109/WF-IoT58464.2023.10539401(1-7)Online publication date: 12-Oct-2023
  • (2023)The Internet of Sounds: Convergent Trends, Insights, and Future DirectionsIEEE Internet of Things Journal10.1109/JIOT.2023.325360210:13(11264-11292)Online publication date: 1-Jul-2023
  • (2023)Towards an Internet of Multisensory, Multimedia and Musical Things (Io3MT) Environment2023 4th International Symposium on the Internet of Sounds10.1109/IEEECONF59510.2023.10335383(1-10)Online publication date: 26-Oct-2023
  • (2023)Semantic Web of Musical ThingsWeb Semantics: Science, Services and Agents on the World Wide Web10.1016/j.websem.2022.10075875:COnline publication date: 1-Jan-2023
  • (2023)Investigating performance ecologies using screen scores: a case studyPersonal and Ubiquitous Computing10.1007/s00779-023-01719-y27:5(1887-1907)Online publication date: 20-May-2023
  • (2022)A Survey on the Internet of Musical Things: Environment Challenges, Standards, Services, and Future Visions2022 IEEE 8th World Forum on Internet of Things (WF-IoT)10.1109/WF-IoT54382.2022.10152210(1-6)Online publication date: 26-Oct-2022
  • (2022)The Smart Musical Instruments OntologyWeb Semantics: Science, Services and Agents on the World Wide Web10.1016/j.websem.2021.10068772:COnline publication date: 1-Apr-2022
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media