skip to main content
10.1145/2072298.2072416acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
short-paper

An audio-driven virtual dance-teaching assistant

Published: 28 November 2011 Publication History

Abstract

This work addresses the Huawei/3Dlife Grand challenge proposing a set of audio tools for a virtual dance-teaching assistant. These tools are meant to help the dance student develop a sense of rhythm to correctly synchronize his/her movements and steps to the musical timing of the choreographies to be executed. They consist of three main components, namely a music (beat) analysis module, a source separation and remastering module and a dance step segmentation module. These components enable to create augmented tutorial videos highlighting the rhythmic information using, for instance, a synthetic dance teacher voice, but also videos highlighting the steps executed by a student to help in the evaluation of his/her performance.

References

[1]
http://huawei-3dlife-gc-submission.blogspot.com, Aug. 2011.
[2]
M. Alonso, G. Richard, and B. David. Extracting note onsets from audio recordings. Proc. of IEEE-ICME, 2005.
[3]
M. Alonso, G. Richard, and B. David. Accurate tempo estimation based on harmonic+noise decomposition. Eurasip Journal on Advances in Signal Processing, Jan. 2007
[4]
J. Bello, L. Daudet, and M. Sandler. Automatic piano transcription using frequency and time-domain information. IEEE Transactions on Audio, Speech and Language Processing, 14(6):2242--2251, aug 2010.
[5]
E. Moulines, O. Ait Amrane, and Y. Grenier. The generalized multidelay adaptive filter: structure and convergence analysis. Signal Processing, IEEE Transactions on, 43(1):14 --28, jan 1995.
[6]
H. Papadopoulos and G. Peeters. Joint estimation of chords and downbeats from an audio signal. IEEE Transactions on Audio, Speech & Language Processing, 19(1):138--152, 2011.
[7]
G. Peeters. Beat-tracking using a probabilistic framework and linear discriminant analysis. Proc. DAFX, 2009.
[8]
B. Shölkopf and A. J. Smola. Learning with kernels. The MIT Press, Cambridge, MA, 2002.

Cited By

View all
  • (2013)Multimodal classification of dance movements using body joint trajectories and step sounds2013 14th International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS)10.1109/WIAMIS.2013.6616151(1-4)Online publication date: Jul-2013

Index Terms

  1. An audio-driven virtual dance-teaching assistant

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    MM '11: Proceedings of the 19th ACM international conference on Multimedia
    November 2011
    944 pages
    ISBN:9781450306164
    DOI:10.1145/2072298
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 28 November 2011

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. 3DLife
    2. audio
    3. grand challenge
    4. music analysis
    5. remastering
    6. source separation

    Qualifiers

    • Short-paper

    Conference

    MM '11
    Sponsor:
    MM '11: ACM Multimedia Conference
    November 28 - December 1, 2011
    Arizona, Scottsdale, USA

    Acceptance Rates

    Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)8
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 18 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2013)Multimodal classification of dance movements using body joint trajectories and step sounds2013 14th International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS)10.1109/WIAMIS.2013.6616151(1-4)Online publication date: Jul-2013

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media