poster

A genetic algorithm for audio retargeting

Authors:

Stephan Wenger,

Marcus MagnorAuthors Info & Claims

MM '12: Proceedings of the 20th ACM international conference on Multimedia

Pages 705 - 708

https://doi.org/10.1145/2393347.2396292

Published: 29 October 2012 Publication History

Get Access

Abstract

We present an audio retargeting technique to create custom soundtracks for movies and games from existing audio material (typically music) by automatically rearranging audio segments. Constraints can be specified to make the length of the audio fit the length of a movie scene, or to align parts of a piece of music with particular events. Existing approaches typically create soundtracks with many unnecessary and often disruptive transitions. We extend a recent analysis and resynthesis method with a novel genetic algorithm for finding an optimal succession of audio segments that minimizes the number of audible transitions and repetitions as well as the deviation from user-specified constraints. Compared to prior work, our experiments with audio examples from different musical genres show a significant improvement with respect to the optimization criteria, and the resulting soundtracks contain few, if any, noticeable transitions.

References

[1]

J. Laroche, "Time and pitch scale modification of audio signals," Applications of Digital Signal Processing to Audio and Acoustics, vol. 437, pp. 279--309, 2002.

Crossref

Google Scholar

[2]

V. Setlur, S. Takagi, R. Raskar, M. Gleicher, and B. Gooch, "Automatic image retargeting," in Proc. International Conference on Mobile and Ubiquitous Multimedia (MUM), 2005, pp. 59--68.

Digital Library

Google Scholar

[3]

D. Schwarz, "A system for data-driven concatenative sound synthesis," in Proc. Digital Audio Effects (DAFx), 2000, pp. 97--102.

Google Scholar

[4]

A. Zils and F. Pachet, "Musical mosaicing," in Proc. Digital Audio Effects (DAFx), 2001.

Google Scholar

[5]

A. Cont, S. Dubnov, and G. Assayag, "Guidage: A fast audio query guided assemblage," in Proc. International Computer Music Conference (ICMC), 2007.

Google Scholar

[6]

G. Strobl, G. Eckel, and D. Rocchesso, "Sound texture modeling: A survey," in Proc. International Conference on Sound and Music Computing (SMC), 2006, pp. 61--65.

Google Scholar

[7]

D. Schwarz, "State of the art in sound texture synthesis," in Proc. Digital Audio Effects (DAFx), 2011, pp. 221--231.

Google Scholar

[8]

S. Dubnov, G. Assayag, and A. Cont, "Audio oracle: A new algorithm for fast learning of audio structures," in Proc. International Computer Music Conference (ICMC), 2007, pp. 224--228.

Google Scholar

[9]

S. Wenger and M. Magnor, "Constrained example-based audio synthesis," in Proc. IEEE International Conference on Multimedia and Expo (ICME), 2011.

Digital Library

Google Scholar

[10]

J. Paulus, M. Müller, and A. Klapuri, "Audio-based music structure analysis," in Proc. International Conference on Music Information Retrieval (ISMIR), 2010, pp. 625--636.

Google Scholar

Cited By

View all

Plachouras CMiron M(2023)Music Rearrangement Using Hierarchical SegmentationICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)10.1109/ICASSP49357.2023.10097212(1-5)Online publication date: 4-Jun-2023
https://doi.org/10.1109/ICASSP49357.2023.10097212
Stoller DAkkermans VDixon S(2018)Detection of Cut-Points for Automatic Music Rearrangement2018 IEEE 28th International Workshop on Machine Learning for Signal Processing (MLSP)10.1109/MLSP.2018.8516706(1-6)Online publication date: Sep-2018
https://doi.org/10.1109/MLSP.2018.8516706
Rubin SAgrawala MBenko HDontcheva MWigdor D(2014)Generating emotionally relevant musical scores for audio storiesProceedings of the 27th annual ACM symposium on User interface software and technology10.1145/2642918.2647406(439-448)Online publication date: 5-Oct-2014
https://dl.acm.org/doi/10.1145/2642918.2647406

Index Terms

A genetic algorithm for audio retargeting
1. Hardware
  1. Communication hardware, interfaces and storage
    1. Signal processing systems
  2. Robustness
    1. Hardware reliability
      1. Signal integrity and noise analysis

Recommendations

Bithoven: Gödel encoding of chamber music and functional 8-bit audio synthesis
FARM 2016: Proceedings of the 4th International Workshop on Functional Art, Music, Modelling, and Design

Bithoven is a prolific composer of approximately 1.079363 * 10^239 different compositions based on four-part harmony and basic chord progressions. It is combined with a purely functional audio synthe- sis engine based on the Ricoh RP2A03, found in the ...
Composing the digital rainstick
MULTIMEDIA '04: Proceedings of the 12th annual ACM international conference on Multimedia

This paper describes work on a composed instrument, the digital rainstick. The instrument is an acoustic rainstick that is augmented by five sensors that send real time performance data to the computer. A generative mechanism creates sound outputs that ...
ASMRcade: Interactive Audio Triggers for an Autonomous Sensory Meridian Response
ICMI '23: Proceedings of the 25th International Conference on Multimodal Interaction

Autonomous Sensory Meridian Response (ASMR) is a sensory phenomenon involving pleasurable tingling sensations in response to stimuli such as whispering, tapping, and hair brushing. It is increasingly used to promote health and well-being, help with ...

Comments

Information & Contributors

Information

Published In

MM '12: Proceedings of the 20th ACM international conference on Multimedia

October 2012

1584 pages

ISBN:9781450310895

DOI:10.1145/2393347

General Chairs:
Noboru Babaguchi
Osaka University, Japan
,
Kiyoharu Aizawa
The University of Tokyo, Japan
,
John Smith
IBM, USA
,
Program Chairs:
Shin'ichi Satoh
National Institute of Informatics, Japan
,
Thomas Plagemann
University of Oslo, Norway
,
Xian-Sheng Hua
Microsoft, USA
,
Rong Yan
Facebook, USA

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 October 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Poster

Conference

MM '12

Sponsor:

SIGMM

MM '12: ACM Multimedia Conference

October 29 - November 2, 2012

Nara, Japan

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
138
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Plachouras CMiron M(2023)Music Rearrangement Using Hierarchical SegmentationICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)10.1109/ICASSP49357.2023.10097212(1-5)Online publication date: 4-Jun-2023
https://doi.org/10.1109/ICASSP49357.2023.10097212
Stoller DAkkermans VDixon S(2018)Detection of Cut-Points for Automatic Music Rearrangement2018 IEEE 28th International Workshop on Machine Learning for Signal Processing (MLSP)10.1109/MLSP.2018.8516706(1-6)Online publication date: Sep-2018
https://doi.org/10.1109/MLSP.2018.8516706
Rubin SAgrawala MBenko HDontcheva MWigdor D(2014)Generating emotionally relevant musical scores for audio storiesProceedings of the 27th annual ACM symposium on User interface software and technology10.1145/2642918.2647406(439-448)Online publication date: 5-Oct-2014
https://dl.acm.org/doi/10.1145/2642918.2647406

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Bithoven: Gödel encoding of chamber music and functional 8-bit audio synthesis

Composing the digital rainstick

ASMRcade: Interactive Audio Triggers for an Autonomous Sensory Meridian Response

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations