skip to main content
10.1145/2647868.2654880acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
demonstration

SynthAssist: an audio synthesizer programmed with vocal imitation

Published: 03 November 2014 Publication History

Abstract

While programming an audio synthesizer can be difficult, if a user has a general idea of the sound they are trying to program, they may be able to imitate it with their voice. In this technical demonstration, we demonstrate SynthAssist, a system that allows the user to program an audio synthesizer using vocal imitation and interactive feedback. This system treats synthesizer programming as an audio information retrieval task. To account for the limitations of the human voice, it compares vocal imitations to synthesizer sounds by using both absolute and relative temporal shapes of relevant audio features, and it refines the query and feature weights using relevance feedback.

Supplementary Material

suppl.mov (tde49.mp4)
Supplemental video

References

[1]
M. Cartwright and B. Pardo. Synthassist: Querying an audio synthesizer by vocal imitation. In Conference on New Interfaces for Musical Expression, London, 2014.
[2]
G. Lemaitre and D. Rocchesso. On the effectiveness of vocal imitations and verbal descriptions of sounds. The Journal of the Acoustical Society of America, 135(2):862--873, 2014.

Cited By

View all
  • (2024)Inteligencia artificial para la producción musical (IAPM)Artificial Intelligence for Music Production (IAPM)Inteligência Artificial para Produção Musical (IAPM)YUYAY: Estrategias, Metodologías & Didácticas Educativas10.59343/yuyay.v3i1.593:1(66-87)Online publication date: 30-Apr-2024
  • (2024)Example-Based Framework for Perceptually Guided Audio Texture GenerationIEEE/ACM Transactions on Audio, Speech, and Language Processing10.1109/TASLP.2024.339374132(2555-2565)Online publication date: 2024
  • (2024)Environmental Sound Synthesis from Vocal Imitations and Sound Event LabelsICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)10.1109/ICASSP48485.2024.10446906(411-415)Online publication date: 14-Apr-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
MM '14: Proceedings of the 22nd ACM international conference on Multimedia
November 2014
1310 pages
ISBN:9781450330633
DOI:10.1145/2647868
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 November 2014

Check for updates

Author Tags

  1. audio
  2. music
  3. synthesis
  4. vocal imitation

Qualifiers

  • Demonstration

Funding Sources

Conference

MM '14
Sponsor:
MM '14: 2014 ACM Multimedia Conference
November 3 - 7, 2014
Florida, Orlando, USA

Acceptance Rates

MM '14 Paper Acceptance Rate 55 of 286 submissions, 19%;
Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)19
  • Downloads (Last 6 weeks)1
Reflects downloads up to 15 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Inteligencia artificial para la producción musical (IAPM)Artificial Intelligence for Music Production (IAPM)Inteligência Artificial para Produção Musical (IAPM)YUYAY: Estrategias, Metodologías & Didácticas Educativas10.59343/yuyay.v3i1.593:1(66-87)Online publication date: 30-Apr-2024
  • (2024)Example-Based Framework for Perceptually Guided Audio Texture GenerationIEEE/ACM Transactions on Audio, Speech, and Language Processing10.1109/TASLP.2024.339374132(2555-2565)Online publication date: 2024
  • (2024)Environmental Sound Synthesis from Vocal Imitations and Sound Event LabelsICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)10.1109/ICASSP48485.2024.10446906(411-415)Online publication date: 14-Apr-2024
  • (2023)Exploring Approaches to Multi-Task Automatic Synthesizer ProgrammingICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)10.1109/ICASSP49357.2023.10095540(1-5)Online publication date: 4-Jun-2023
  • (2023)A Survey of Audio Enhancement Algorithms for Music, Speech, Bioacoustics, Biomedical, Industrial, and Environmental Sounds by Image U-NetIEEE Access10.1109/ACCESS.2023.334481311(144456-144483)Online publication date: 2023
  • (2021)AI Music Mixing SystemsHandbook of Artificial Intelligence for Music10.1007/978-3-030-72116-9_13(345-375)Online publication date: 3-Jul-2021
  • (2019)Flow Synthesizer: Universal Audio Synthesizer Control with Normalizing FlowsApplied Sciences10.3390/app1001030210:1(302)Online publication date: 31-Dec-2019
  • (2019)Improving Content-based Audio Retrieval by Vocal Imitation FeedbackICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)10.1109/ICASSP.2019.8683461(4100-4104)Online publication date: May-2019
  • (2018)Automatic Programming of VST Sound Synthesizers Using Deep Networks and Other TechniquesIEEE Transactions on Emerging Topics in Computational Intelligence10.1109/TETCI.2017.27838852:2(150-159)Online publication date: Apr-2018
  • (2017)Vocal imitation of synthesised sounds varying in pitch, loudness and spectral centroidThe Journal of the Acoustical Society of America10.1121/1.4974825141:2(783-796)Online publication date: 13-Feb-2017
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media