skip to main content
10.1145/1101149.1101159acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
Article

Exploring media correlation and synchronization for navigated hypermedia documents

Published: 06 November 2005 Publication History

Abstract

This paper is devoted to explore media correlation and media synchronization in a composite multimedia document, the so-called navigated hypermedia document in our language learning system, to facilitate the multimedia authoring, presentation, and access. Two levels of media correlation in temporal, spatial, and content domains are investigated: syntactic level correlation and semantic level correlation. We devise a capturing mechanism to record all the media streams and relations between them, including voice and event streams, for replaying the lecturing in a form as close as possible to the original classroom experience. The syntactic level correlation is based on specific timestamps of the media stream and used to reconstruct the recorded lecture for synchronized presentation. Furthermore, to integrate media objects with specific segments within the media stream, some computed synchronization processes are required to discover semantic content of the media. The proposed computed synchronization techniques, including speech-event binding process for temporal domain, tele-pointer (i.e. cursor) movement interpolation and adaptable handwriting presentation for spatial domain, and erasing handling for content domain, will be addressed. Experimental results show that in the speech-event binding process 74% of speech access entries for accessible visualized events are found. The acceptable rate of human perception on tele-pointer movement is higher than 85% if time interval is selected carefully. Finally, the accuracy of erasing handling for content removing is about 71%.

References

[1]
Agius, H.W., and Angelides, M.C. Modeling Content for Semantic-Level Querying of Multimedia. Multimedia Tools and Applications, 15, 1 (Sep. 2001), 5--37.
[2]
Allan, J., Carbonell, J., Doddington, G., Yamron, J., and Yang, Y. Topic Detection and Tracking Pilot Study Final report. In Proceedings of the DARPA Broadcast News Transcription and Understanding Workshop (Lansdowne, Virginia, Feb. 8-11), 1998, 194--218.
[3]
Blakowski, G., and Steinmetz, R. A Media Synchronization Survey: Reference Model, Specification, and Case Studies. IEEE Journal on Selected Areas in Communications, 14, 1 (Jan. 1996), 5--35.
[4]
Brotherton, J.A., and Abowd, G.D. Lessons learned from eClass: Assessing automated capture and access in the classroom. ACM Transactions on Computer-Human Interaction, 11, 2 (June 2004), 121--155.
[5]
Chen, H.Y., Chen G.Y., and Hong, J.S. Design of a Web-based Synchronized Multimedia Lecture System for Distance Education. In Proceedings of the IEEE International Conference on Multimedia Computing and Systems (Florence, Italy, June 07-11), 1999, 887--891.
[6]
Chu, W.T., and Chen, H.Y. Toward better retrieval and presentation by exploring cross-media correlations. Multimedia Systems, 10, 3 (March 2005), 183--198.
[7]
Farkas, D.K., and Poltrock, S.E. Online editing, mark-up models and the workplace lives of editors and writers. IEEE Transactions on Professional Communication, 38, 2 (Jun. 1995), 110--117.
[8]
Ginige, A. Lowe, D.B. Robertson, J. Hypermedia Authoring. IEEE Multimedia, 2, 4 (Winter 1995), 24--35.
[9]
Hardman, L. Modeling and Authoring Hypermedia Documents. Ph.D. Thesis, University of Amsterdam, Amsterdam, Netherlands.
[10]
Hardock, G., Kurtenbach, G., and Buxton, W. A marking based interface for collaborative writing. In Proceedings of the 6th annual ACM symposium on User interface software and technology (Atlanta, Georgia, Nov. 3-5), 1993, 259--266.
[11]
Knoy, T. An Editing Workbook for Chinese Technical Writers, 2000.
[12]
Lauer, T., and Ottmann, T. Means and Methods in Automatic Courseware Production: Experience and Technical Challenges. In Proceedings of the E-Learn (Montreal, Canada, Oct. 15-19), 2002, 553--560.
[13]
Lauer, T., Muller, R., and Ottmann, T. Animations for Teaching Purposes: Now and Tomorrow. Journal of Universal Computer Science, 7, 5 (2001), 420--433.
[14]
Liu, K. Y., Wang, J. Y., and Chen, H. Y. Chen, A Marking-based Synchronized Multimedia Tutoring System for Composition Studies. In Proceedings of the IEEE International Conference on Advanced Learning Technologies (Kaohsiung, Taiwan, July 5-8), 2005, 41--45.
[15]
Mekhaldi, D., Lalanne, D., and Ingold, R. Thematic Alignment of Recorded Speech with Documents. In Proceedings of the ACM Symposium on Document Engineering (Grenoble, France, Nov. 20-22), 2003, 52--54.
[16]
Muller, R., and Ottmann, T. The "Authoring on the Flysystem for automated recording and replay of (tele)presentations. Multimedia Systems, 8, 3 (Oct. 2000), 158--176.
[17]
Muller, R., Ottmann, T., and Zhang, H. Presentation Recording as a Means to go Virtual for Campus-based Universities. In Proceedings of 13th International Conference on Information Resources Management Association (Seattle, WA, May 19-22), 2002, 567--570.
[18]
Ogata, H., Yano, Y., and Wakita, R. COCOA: A Communicative Correction Assisting System for Composition Studies, In Proceedings of International Conference on Computers in Education (Sarawak, Malaysia, Dec. 2-6), 1997, 461--468.
[19]
Owen, C.B. Multiple Media Correlation: Theory and Applications. Technical Report PCS-TR98-335, Dartmouth College, USA, 1998.
[20]
Schar, S.G., and Krueger, H. Using New Learning Technologies with Multimedia. IEEE Multimedia, 7, 3 (Jul.-Sep. 2000), 40--51.
[21]
Stifelman, L. J. The Audio Notebook: Paper and Pen Interaction with Structured Speech. Ph.D. thesis, MIT Media Lab, 1997.
[22]
Synchronized Multimedia Integration Language (SMIL) Specification. Available on http://www.w3.org/TR/REC-smil

Cited By

View all
  • (2014)Multimedia applications for playing with digitized theater performancesMultimedia Tools and Applications10.1007/s11042-013-1651-173:3(1777-1793)Online publication date: 1-Dec-2014
  • (2009)Integrating corrections into digital ink playbackProceedings of the 17th ACM international conference on Multimedia10.1145/1631272.1631413(781-784)Online publication date: 23-Oct-2009
  • (2008)Watch-and-comment as a paradigm toward ubiquitous interactive video editingACM Transactions on Multimedia Computing, Communications, and Applications10.1145/1412196.14122014:4(1-24)Online publication date: 6-Nov-2008
  • Show More Cited By

Index Terms

  1. Exploring media correlation and synchronization for navigated hypermedia documents

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image ACM Conferences
        MULTIMEDIA '05: Proceedings of the 13th annual ACM international conference on Multimedia
        November 2005
        1110 pages
        ISBN:1595930442
        DOI:10.1145/1101149
        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Sponsors

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 06 November 2005

        Permissions

        Request permissions for this article.

        Check for updates

        Author Tags

        1. computed synchronization process
        2. media correlation
        3. media synchronization
        4. semantic level correlation
        5. syntactic level correlation

        Qualifiers

        • Article

        Conference

        MM05

        Acceptance Rates

        MULTIMEDIA '05 Paper Acceptance Rate 49 of 312 submissions, 16%;
        Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)0
        • Downloads (Last 6 weeks)0
        Reflects downloads up to 30 Jan 2025

        Other Metrics

        Citations

        Cited By

        View all
        • (2014)Multimedia applications for playing with digitized theater performancesMultimedia Tools and Applications10.1007/s11042-013-1651-173:3(1777-1793)Online publication date: 1-Dec-2014
        • (2009)Integrating corrections into digital ink playbackProceedings of the 17th ACM international conference on Multimedia10.1145/1631272.1631413(781-784)Online publication date: 23-Oct-2009
        • (2008)Watch-and-comment as a paradigm toward ubiquitous interactive video editingACM Transactions on Multimedia Computing, Communications, and Applications10.1145/1412196.14122014:4(1-24)Online publication date: 6-Nov-2008
        • (2008)InkteractorsProceedings of the 2008 ACM symposium on Applied computing10.1145/1363686.1363973(1246-1251)Online publication date: 16-Mar-2008
        • (2008)An Application System to Enable Multimedia on English Composition StudiesProceedings of the 2008 Eighth IEEE International Conference on Advanced Learning Technologies10.1109/ICALT.2008.41(183-185)Online publication date: 1-Jul-2008
        • (2008)Ubiquitous Interactive Video Editing Via Multimodal AnnotationsProceedings of the 6th European conference on Changing Television Environments10.1007/978-3-540-69478-6_8(72-81)Online publication date: 3-Jul-2008
        • (2007)Engineering multimedia applications on the basis of multi-structured descriptions of audiovisual contentsProceedings of the 2007 international workshop on Semantically aware document processing and indexing10.1145/1283880.1283887(31-40)Online publication date: 21-May-2007

        View Options

        Login options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        Figures

        Tables

        Media

        Share

        Share

        Share this Publication link

        Share on social media