skip to main content
10.1145/1631127.1631128acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

Multimedia retrieval through indexing speech: an enterprise perspective

Published: 23 October 2009 Publication History

Abstract

The institutional memory of enterprises is increasingly comprised of digital multimedia content, such as online lecture videos and presentations, archived meetings or conference calls, and voicemail. A key technology for efficiently managing such content is keyword search into the spoken audio content using automatic speech recognition (ASR).
A key learning for deploying ASR-based indexing in enterprises is that multimedia content is often not stored in a centralized hosting application, but in a "long tail' of small teams' intranet sites, often built by technology enthusiasts who like to tinker and make creative use of technology. This calls for an indexing platform rather than a standalone app, audio indexing being one feature, easy to deploy with limited IT skills in a "do-it-yourself"-manner, and integrating with the existing information-management infrastructure.
We will present approaches to three enterprise-characteristic challenges arising from these requirements: (1) Probabilistic indexing of word lattices instead of speech-to-text transcripts, to address the limited recognition accuracy (often in the 50% range due to lack of matching acoustic/domain corpora); (2) phonetic search and vocabulary adaptation for indexing person names, domain terminology, and code names missing in a standard recognizer; and (3) approximations to implement probabilistic lattice indexing on top of existing industry-strength full-text search engines, for maximal reuse and integration with existing tools and deployments to reduce cost, and to enable non-speech experts to manage and operate indexing/search system and build/mesh-up line-of-business applications around it.

References

[1]
M. Saraclar, R. Sproat. Lattice-based search for spoken utterance retrieval. Proc. HLT'2004, Boston, 2004.
[2]
P. Yu, K. J. Chen, C. Y. Ma, F. Seide, Vocabulary-independent indexing of spontaneous speech, IEEE Trans. SAP, Vol.13, No.5.
[3]
P. Yu, K. Thambiratnam, F. Seide, Word-lattice based spoken--document indexing with standard text indexers, SIGIR'08 SSCS Workshop, Singapore, 2008.

Cited By

View all

Index Terms

  1. Multimedia retrieval through indexing speech: an enterprise perspective

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    SSCS '09: Proceedings of the third workshop on Searching spontaneous conversational speech
    October 2009
    48 pages
    ISBN:9781605587622
    DOI:10.1145/1631127
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 23 October 2009

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. multimedia indexing
    2. speech recognition
    3. spoken-document retrieval

    Qualifiers

    • Research-article

    Conference

    MM09
    Sponsor:
    MM09: ACM Multimedia Conference
    October 23, 2009
    Beijing, China

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)0
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 15 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media