skip to main content
10.1145/1255047.1255119acmconferencesArticle/Chapter ViewAbstractPublication PagesesemConference Proceedingsconference-collections
Article

Synchronized background music generation for video

Published: 13 June 2007 Publication History

Abstract

We synchronize background music with a video by changing the timing of music, an approach that minimizes the damage to music data. Starting from a MIDI file and video data, feature points are extracted from both sources, paired, and then synchronized using dynamic programming to time-scale the music. We also introduce the music graph, a directed graph that encapsulates connections between many short music sequences. By traversing a music graph, we cangenerate large amounts of new background music, in which we expect to find a sequence which matches the video features better than the original music.

References

[1]
O. Arikan, D. Forsyth, and J. O'Brien. Motion synthesis from annotations. In Proceedings of ACM SIGGRAPH, pages 402--408, 2003.
[2]
G. R. Bradski. Computer vision face tracking as a component of a perceptual user interface. In Proceedings of Workshop on Applications of Computer Vision., pages 214--219, 1998.
[3]
D. J. Lan, Y. F. Ma, and H. J. Zhang. A novel motion-based. representation for video mining. In Proceedings of IEEE. International Conference on Multimedia and Expo., pages 469--472, 2003.
[4]
H. C. Lee and I. K. Lee. Automatic synchronization of background music and motion in computer animation. In Proceedings of the EUROGRAPHICS 2005, pages 353--362, 2005.
[5]
M. Stone, D. DeCarlo, I. Oh, C. Rodriguez, A. Stere, A. Lees, and C. Bregler. Speaking with hands: Creating animated conversational characters from recordings of human performance. In Proceedings of ACM SIGGRAPH, pages 506--513, 2004.

Cited By

View all
  • (2023)Video-Music Retrieval with Fine-Grained Cross-Modal Alignment2023 IEEE International Conference on Image Processing (ICIP)10.1109/ICIP49359.2023.10222739(2005-2009)Online publication date: 8-Oct-2023
  • (2023)Impact of video content on gastronomic image construction and tourists’ intention to (re-) visit MacaoTourism Recreation Research10.1080/02508281.2023.2296812(1-15)Online publication date: 29-Dec-2023
  • (2018)Rhythm of Motion Extraction and Rhythm-Based Cross-Media Alignment for Dance VideosIEEE Transactions on Multimedia10.1109/TMM.2011.217240114:1(129-141)Online publication date: 26-Dec-2018

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
ACE '07: Proceedings of the international conference on Advances in computer entertainment technology
June 2007
324 pages
ISBN:9781595936400
DOI:10.1145/1255047
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 June 2007

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. music graph
  2. music-video synchronization

Qualifiers

  • Article

Conference

ACE2007
Sponsor:

Acceptance Rates

Overall Acceptance Rate 36 of 90 submissions, 40%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)4
  • Downloads (Last 6 weeks)2
Reflects downloads up to 20 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2023)Video-Music Retrieval with Fine-Grained Cross-Modal Alignment2023 IEEE International Conference on Image Processing (ICIP)10.1109/ICIP49359.2023.10222739(2005-2009)Online publication date: 8-Oct-2023
  • (2023)Impact of video content on gastronomic image construction and tourists’ intention to (re-) visit MacaoTourism Recreation Research10.1080/02508281.2023.2296812(1-15)Online publication date: 29-Dec-2023
  • (2018)Rhythm of Motion Extraction and Rhythm-Based Cross-Media Alignment for Dance VideosIEEE Transactions on Multimedia10.1109/TMM.2011.217240114:1(129-141)Online publication date: 26-Dec-2018

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media