skip to main content
10.1145/1101149.1101195acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
Article

How speech/text alignment benefits web-based learning

Published: 06 November 2005 Publication History

Abstract

This demonstration presents an integrated web-based synchronized scenario for many-to-one cross-media correlations between speech (an EFL, English as Foreign Language, lecture with free-style lecturing behaviors) and the corresponding textual content. The analysis/presentation of the temporal correlations enable the vivid web-based language learning through the interactive functions: browsing speech via content, word-by-word pointer guidance, synchronized scrolling/highlighting, and listening training mode. We regularly analyze and repackage the multimedia content of VoA (Voice of America) [1], ICRT (International Community Radio Taipei) [2], and Online Lectures in our University [3]. Through the subjective experiments, this repackaged synchronized speech/text content does facilitate the learning for EFL learners.

Supplementary Material

MPG File (1101195.mpg)

References

[1]
VoA: http://www.voanews.com
[2]
ICRT: http://www.icrt.com.tw
[3]
WSML: http://english.csie.ncnu.edu.tw
[4]
Pedro J. Moreno, Chris Joerg, Jean-Manuel Van Thong and Oren Glickman (1998), A Recursive Algorithm for The Forced Alignment of Very Long Audio Segments. International Conference on Spoken Language Processing (ICSLP), Sydney (Australia).
[5]
Wei-Ta Chu & Herng-Yow Chen (2002) Cross-Media Correlations: a case study of navigated hypermedia documents. ACM MM, p.p. 57-66.
[6]
Ralf Steinmetz (1996), Human Perception of Jitter and Media Synchronization, IEEE Journal on Selected Areas in Communication, Vol. 14, No. 1, pp. 61-72.

Cited By

View all
  • (2013)Real-time synchronization of live speech with its transcription2013 10th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology10.1109/ECTICon.2013.6559560(1-5)Online publication date: May-2013

Index Terms

  1. How speech/text alignment benefits web-based learning

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image ACM Conferences
        MULTIMEDIA '05: Proceedings of the 13th annual ACM international conference on Multimedia
        November 2005
        1110 pages
        ISBN:1595930442
        DOI:10.1145/1101149
        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Sponsors

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 06 November 2005

        Permissions

        Request permissions for this article.

        Check for updates

        Author Tags

        1. analysis and presentation
        2. computed synchronization
        3. cross-media correlation
        4. lips sync
        5. speech-to-text alignment

        Qualifiers

        • Article

        Conference

        MM05

        Acceptance Rates

        MULTIMEDIA '05 Paper Acceptance Rate 49 of 312 submissions, 16%;
        Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)1
        • Downloads (Last 6 weeks)0
        Reflects downloads up to 30 Jan 2025

        Other Metrics

        Citations

        Cited By

        View all
        • (2013)Real-time synchronization of live speech with its transcription2013 10th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology10.1109/ECTICon.2013.6559560(1-5)Online publication date: May-2013

        View Options

        Login options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        Figures

        Tables

        Media

        Share

        Share

        Share this Publication link

        Share on social media